• ISSN: 2148-2225 (online)

Ulaştırma ve Lojistik Kongreleri

alphanumeric journal

The Journal of Operations Research, Statistics, Econometrics and Management Information Systems

Robust Principal Component Analysis Based on Modified Minimum Covariance Determinant in the Presence of Outliers

Bilal Barış Alkan, Ph.D.


Abstract

Principal component analysis (PCA) is not resistant to outliers existing in multivariate data sets. The results which are obtained by using classical PCA are far from real values in the presence of outliers. Therefore, using robust versions of PCA is favorable. The easiest way to obtain robust principal components is to replace classical estimates of the location and scale parameters with their robust versions. Robust estimations of location and scale parameters can be found with minimum covariance determinant (MCD) providing high breakdown point. In this study, algorithm of MCD is modified using Jackknife resampling approach and results of this modification are examined. Proposed robust principal component analysis (RPCA) based on modified MCD (MMCD) method that is modified using Jaccknife resampling are evaluated over two real data with different outlier ratios. In the light of obtained results, it can be said that RPCA based on MMCD is better than RPCA based on MCD in the presence of outliers.

Keywords: Minimum Covariance Determinant, Outliers, Robust Principal Component Analysis

Jel Classification: C38

Aykırı Gözlemlerin Varlığında Uyarlanmış En Küçük Kovaryans Determinant Tahminine Dayalı Dayanıklı Temel Bileşenler Analizi

Öz

Klasik temel bileşenler analizi (KTBA), çok değişkenli veri kümelerinde yer alabilen aykırı gözlemlere karşı dayanıklı değildir. Aykırı gözlemlerin varlığında KTBA kullanılarak elde edilen sonuçlar gerçekte olması gerekenden oldukça farklı çıkabilir. Bu yüzden, aykırı gözlemlerin varlığında PCA’nın dayanıklı versiyonlarının kullanımı tercih edilmelidir. Dayanıklı temel bileşenler elde etmek için en kolay yol konum ve ölçek parametrelerinin klasik tahminleriyle, onların dayanıklı tahminlerinin yer değiştirilmesidir. Çok değişkenli veri kümesi için konum ve ölçek parametrelerinin dayanıklı tahmini, yüksek bozulma noktası sağlayan en küçük kovaryans determinant (EKKD) yöntemi ile yapılabilir. Bu çalışmada, EKKD yöntemi, jacknife yeniden örnekleme yaklaşımı kullanılarak uyarlanıp, bu uyarlamadan kaynaklanan değişimlerin dayanıklı temel bileşenler analizi (DTBA) üzerindeki etkileri incelenmesi amaçlanmaktadır. Jackknife yeniden örnekleme yöntemine dayanan EKKD’nin aykırı gözlem oranındaki değişmelerden nasıl etkilendiği iki gerçek veri kümesi üzerinden değerlendirilmektedir. Elde edilen bulgular ışığında, önerilen uyarlanmış en küçük kovaryans determinant (UEKKD) tahminine dayalı DTBA, klasik EKKD’ye dayanan DTBA’ya göre veri kümesinde aykırı gözlemlerin varlığında daha iyi sonuçlar verdiği görülmektedir.

Anahtar Kelimeler: Aykırı Değerler, Dayanıklı Temel Bileşenler Analizi, En Küçük Kovaryans Determinant

Suggested citation

Alkan, B. B. (). Aykırı Gözlemlerin Varlığında Uyarlanmış En Küçük Kovaryans Determinant Tahminine Dayalı Dayanıklı Temel Bileşenler Analizi. Alphanumeric Journal, 4(2), 85-94. http://dx.doi.org/10.17093/aj.2016.4.2.5000189525

bibtex

References

  • Alkan, B. B., Atakan, C., Alkan, N., (2015). “A comparison of different procedures for principal component analysis in the presence of outliers”, Journal of Applied Statistics, 42(8), 1716-1722.
  • Atkinson, A.C., (1994). “Fast Very Robust Methods for the Detection of Multiple Outliers”, J. Amer. Statist. Assoc. 89, 1329–1339.
  • Campbell, N. A., (1980). “Robust procedures in multivariate analysis I: Robust covariance estimation”, Applied statistics, 231-237.
  • Croux, C., Filzmoser, P., & Fritz, H. (2013). Robust sparse principal component analysis. Technometrics, 55(2), 202-214.
  • Croux, C., Haesbroeck G., (2000). “Principal components analysis based on robust estimators of the covariance or correlation matrix: influence functions and efficiencies”, Biometrika, 87, 603–618.
  • Croux, C., Ruiz-Gazen, A.,(2005). “High breakdown estimators for principal components: the projection-pursuit approach revisited”, Journal of Multivariate Analysis 95, 206–226.
  • Daudin, J.J., Duby, C., Trecourt, P., (1988). “Stability of Principal Component Analysis Studied by the Bootstrap Method;Statistics”, 19, 241–258.
  • Devlin, S. J., Gnanadesikan, R., Kettenring, J. R., (1981). “Robust estimation of dispersion matrices and principal components”, Journal of the American Statistical Association, 76(374), 354-362.
  • Farcomeni, A., Greco, L., (2015). “Robust methods for data reduction”. CRC press.
  • Filzmoser, P., Reimann, C., Garrett, R.G., (2003). “Multivariate outlier detection in exploration geochemistry”, Technical ReportTS 03–5, Department of Statistics, Vienna University of Technology, Austria.
  • Filzmoser, P., Todorov, V., (2011). “Review of robust multivariate statistical methods in high dimension”, Analytica chimica acta, 705(1), 2-14.
  • Hubert, M., Debruyne, M., (2010). “Minimum covariance determinant”, Wiley interdisciplinary reviews: Computational statistics, 2(1), 36-43.
  • Hubert, M., Engelen, S., (2004). “Robust PCA and classification in biosciences”, Bioinformatics, 20(11), 1728-1736.
  • Johnson, R., Wichern, D. (1992). “Applied multivariate statistical methods”, 3rd Edition., Prentice Hall, Englewood Cliffs, NJ.
  • Locantore, N., Marron, J., Simpson, D., Tripoli, N., Zhang, J., Cohen, K., (1999). “Robust principal components for functional data”, Test 8, 1–28.
  • Maronna, R., (2005). “Principal components and orthogonal regression based on robust scales”, Technometrics, 47(3), 264-273.
  • R Development Core Team, (2011). “R: A Language and Environment for Statistical Computing”, R Foundation for Statistical Computing, Vienna.
  • Riu, J., Bro, R., (2003). “Jack-knife technique for outlier detection and estimation of standard errors in PARAFAC models”, Chemometrics and Intelligent Laboratory Systems, 65(1), 35-49.
  • Rocke, D. M., Woodruff, D. L., (1996). “Identification of Outliers in Multivariate Data”, J. Amer. Statist. Assoc. 91 (435), 1047–1061.
  • Rousseeuw, P. J., (1984). “Least median of squares regression”, Journal of the American statistical association, 79(388), 871-880.
  • Rousseeuw, P. J., (1985). “Multivariate estimation with high breakdown point”, Mathematical statistics and applications, 8, 283-297.
  • Rousseeuw, P. J., Driessen, K. V., (1999). “A fast algorithm for the minimum covariance determinant estimator”, Technometrics, 41(3), 212-223.
  • Rousseeuw, P.J., Croux, C., Todorov, V., Ruckstuhl, A., Salibian-Barrera, M., Verbeke T., Maechler, M., (2009). “Robustbase: basic robust statistics”, R package version 0.4–5. Available at http://CRAN. R-project. org/package = robustbase.
  • Todorov ,V. and Filzmoser, P., (2009). “An object-oriented framework for robust multivariate analysis”, J. Statist. Softw. 32(3) (2009), 1–47.
  • Todorov, V., (2009). “rrcov: Scalable Robust Estimators with High Breakdown Point”, R package version 0.5–03, Availableat http://CRAN. R-project. org/package = rrcov.
  • Todorov, V., Neyko, N., Neytchev, P., (1994). “Stability of High Breakdown Point Robust PCA”, in Short Communications, COMPSTAT'94; Physica Verlag, Heidelberg.

Volume 4, Issue 2, 2016

2016.04.02.STAT.02

alphanumeric journal

Volume 4, Issue 2, 2016

Pages 85-94

Received: May 16, 2016

Accepted: Aug. 25, 2016

Published: Sept. 29, 2016

Full Text [548.2 KB]

2016 Alkan, BB.

This is an Open Access article, licensed under Creative Commons Attribution-NonCommercial 4.0 International License.

Creative Commons Attribution licence

scan QR code to access this article from your mobile device

Contact Us

Faculty of Transportation and Logistics, Istanbul University
Beyazit Campus 34452 Fatih/Istanbul/TURKEY

Bahadır Fatih Yıldırım, Ph.D.
editor@alphanumericjournal.com
+ 90 (212) 440 00 00 - 13219

alphanumeric journal

alphanumeric journal has been publishing as "International Peer-Reviewed Journal" every six months since 2013. alphanumeric serves as a vehicle for researchers and practitioners in the field of quantitative methods, and is enabling a process of sharing in all fields related to the operations research, statistics, econometrics and management informations systems in order to enhance the quality on a globe scale.