Open Conference Systems, CLADAG2023

Font Size: 
Real-time discriminant analysis in the presence of label and measurement noise
Mia Hubert, Iwein Vranckx, Jakob Raymaekers, Bart De Ketelaere, Peter Rousseeuw

Last modified: 2023-07-06

Abstract


Quadratic discriminant analysis (QDA) is a widely used classification technique. Based on a training dataset, each class in the data ischaracterized by an estimate of its center and shape, which can then be used to assign unseen observations to one of the classes. The traditional QDA rule relies on the empirical mean and covariance matrix. Unfortunately, these estimators are sensitive to label and measurement noise which often impairs the model's predictive ability. Robust estimators of location and scatter are resistant to this type of contamination. However, they have a prohibitive computational cost for large scale industrial experiments. We present a novel QDA method based on a real-time robust algorithm. We additionally integrate an anomaly detection step to classify the most atypical observations into a separate class of outliers. Finally, we introduce the classmap, a graphical display to identify label and measurement noise in the training data.