This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Entropy-Based Feature Extraction and K-Nearest Neighbors for Bearing Fault Detection
Corresponding Author(s) : Sinta Uri El Hakim
Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control,
Vol. 9, No. 1, February 2024
Abstract
Bearing failures in rotating machines can lead to significant operational challenges, causing up to 45-55% of engine failures and severely impacting performance and productivity. Timely detection of bearing anomalies is crucial to prevent machine failures and associated downtime. Therefore, an approach for early bearing failure detection using entropy-based machine learning is proposed and evaluated while combined with a classifier based on K-Nearest Neighbors (KNN) and Support Vector Machine (SVM). Entropy-based feature extraction should be able to effectively capture the intricate patterns and variations present in the vibration signals, providing a comprehensive representation of the underlying dynamics. The results of the classification carried out by KNN-Entropy have an accuracy value of 98%, while the SVM-Entropy model has an accuracy of 96%. Hence, the Entropy-based feature extraction giving the best accuracy when it is coupled with KNN.
Keywords
Download Citation
Endnote/Zotero/Mendeley (RIS)BibTeX
- G. Xin, N. Hamzaoui, and J. Antoni, “Semi-automated diagnosis of bearing faults based on a hidden Markov model of the vibration signals,” Meas. J. Int. Meas. Confed., vol. 127, no. May, pp. 141–166, 2018. https://doi.org/10.1016/j.measurement.2018.05.040
- R. Liu, B. Yang, E. Zio, and X. Chen, “Artificial intelligence for fault diagnosis of rotating machinery: A review,” Mech. Syst. Signal Process., vol. 108, pp. 33–47, 2018. https://doi.org/10.1016/j.ymssp.2018.02.016
- A. Guedidi, A. Guettaf, A. J. M. Cardoso, W. Laala, and A. Arif, “Bearing Faults Classification Based on Variational Mode Decomposition and Artificial Neural Network,” in International Symposium on Diagnostics for Electrical Machines, Power Electronics and Drives (SDEMPED), Toulouse, France: IEEE, 2019, pp. 391–397. https://doi.org/10.1109/DEMPED.2019.8864830
- R. Azeddine, B. Djamel, and B. Hicham, “A signal processing approach to modeled bearing faults detection in electric system,” pp. 202–206, 2022.
- C. Abdelkrim, M. Salah, N. Boutasseta, and L. Boulanouar, “Detection and classification of bearing faults in industrial geared motors using temporal features and adaptive neuro-fuzzy inference system,” Heliyon, vol. 5, no. March, p. e02046, 2019. https://doi.org/10.1016/j.heliyon.2019.e02046
- P. Zhang, Y. Du, T. G. Habetler, and B. Lu, “A survey of condition monitoring and protection methods for medium-voltage induction motors,” IEEE Trans. Ind. Appl., vol. 47, no. 1, pp. 34–46, 2011. https://doi.org/10.1109/TIA.2010.2090839
- J. Pacheco-Cherrez, J. Fortoul-Diaz, F. Cortes-Santacruz, L. M. Aloso-valerdi, and D. I. Ibarra-zarate, “Bearing fault detection with vibration and acoustic signals : Comparison among different machine leaning classification methods,” vol. 139, no. May, 2022. https://doi.org/10.1016/j.engfailanal.2022.106515
- M. Lu and C. Chen, “Applied Sciences Detection and Classification of Bearing Surface Defects Based on Machine Vision,” Adv. Appl. Ind. Inform. Technol., vol. 11(4), 2021. https://doi.org/10.3390/app11041825
- P. Nivesrangsan, “Bearing Fault Monitoring by Comparison with Main Bearing Frequency Components Using Vibration Signal,” in 2018 5th International Conference on Business and Industrial Research (ICBIR), Bangkok, Thailand: IEEE, 2018, pp. 292–296. https://doi.org/10.1109/ICBIR.2018.8391209
- S. E. Pandarakone, Y. Mizuno, and H. Nakamura, “Evaluating the Progression and Orientation of Scratches on Outer-Raceway Bearing Using a Pattern Recognition Method,” IEEE Trans. Ind. Electron., vol. 66, no. 2, pp. 1307–1314, 2019. https://doi.org/10.1109/TIE.2018.2833025
- Y. Liu, Y. Cheng, Z. Zhang, and S. Yang, “Early Fault Diagnosis of Bearing Faults Using Vibration Signals,” Proc. 2021 IEEE 3rd Int. Conf. Civ. Aviat. Saf. Inf. Technol. ICCASIT 2021, pp. 747–751, 2021. https://doi.org/10.1109/ICCASIT53235.2021.9633352
- K. K. Song et al., “An Improved Bearing Defect Detection Algorithm Based on Yolo,” Int. Symp. Control Eng. Robot., pp. 184–187, 2022. https://doi.org/10.1109/ISCER55570.2022.00038
- S. Lee et al., “A Study on Deep Learning Application of Vibration Data and Visualization of Defects for Predictive Maintenance of Gravity Acceleration Equipment,” Multidiscip. Digit. Publ. Inst. Appl. Sci., vol. 11(4), no. Special Issue: Artificial Intelligence for Sustainable Services, Applications and Education, 2021. https://doi.org/10.3390/app11041564
- C. Tastimur, M. Karakose, I. Ayd, and E. Akin, “Defect Diagnosis of Rolling Element Bearing using Deep Learning,” pp. 3–7, 2018.
- CRWU, “Case Western Reserve University (CRWU) Bearing Data Center Website
- D. Neupane and J. Seok, “Bearing fault detection and diagnosis using case western reserve university dataset with deep learning approaches: A review,” IEEE Access, vol. 8, pp. 93155–93178, 2020. https://doi.org/10.1109/ACCESS.2020.2990528
- M. Borowska, “Entropy-based algorithms in the analysis of biomedical signals,” Stud. Logic, Gramm. Rhetor., vol. 43, no. 56, pp. 21–32, 2015. https://doi.org/10.1515/slgr-2015-0039
- S. M. Pincus, “Approximate entropy as a measure of system complexity,” in Proceedings of the National Academy of Sciences of the United States of America, 1991, pp. 2297–2301. https://doi.org/10.1073/pnas.88.6.2297
- J. S. Richman and J. R. Moorman, “Physiological time-series analysis using approximate entropy and sample entropy maturity in premature infants Physiological time-series analysis using approximate entropy and sample entropy,” Am. J. Physiol. Hear. Circ. Physiol., vol. 278, pp. H2039–H2049, 2000.
- M. Rostaghi and H. Azami, “Dispersion Entropy: A Measure for Time-Series Analysis,” IEEE Signal Process. Lett., vol. 23, no. 5, pp. 610–614, 2016. https://doi.org/10.1109/LSP.2016.2542881
- D. Cuesta-Frau, “Slope Entropy: A new time series complexity estimator based on both symbolic patterns and amplitude information,” Entropy, vol. 21, no. 12, 2019. https://doi.org/10.3390/e21121167
- A. Sharma and L. Mathew, “Bearing Fault Diagnosis Using Weighted K-Nearest Neighbor,” in 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI), IEEE, 2018, pp. 1132–1137. https://doi.org/10.1109/ICOEI.2018.8553800
- M. A. Vishwendra et al., “A Novel Method to Classify Rolling Element Bearing Faults Using K -Nearest Neighbor Machine Learning Algorithm,” vol. 8, no. September, pp. 1–11, 2022. https://doi.org/10.1115/1.4053760
- C. J. . Burges, “Tutorial on Support Vector Machine for Pattern Recognition,” Data Min. Knowl. Discov., vol. 2, pp. 121–167, 1998. https://doi.org/10.1023/A:1009715923555
- C. Z. Hu, M. Y. Huang, Q. Yang, and W. J. Yan, “On the use of EEMD and SVM based approach for bearing fault diagnosis of wind turbine gearbox,” Proc. 28th Chinese Control Decis. Conf. CCDC 2016, no. 2, pp. 3472–3477, 2016. https://doi.org/10.1109/CCDC.2016.7531583
References
G. Xin, N. Hamzaoui, and J. Antoni, “Semi-automated diagnosis of bearing faults based on a hidden Markov model of the vibration signals,” Meas. J. Int. Meas. Confed., vol. 127, no. May, pp. 141–166, 2018. https://doi.org/10.1016/j.measurement.2018.05.040
R. Liu, B. Yang, E. Zio, and X. Chen, “Artificial intelligence for fault diagnosis of rotating machinery: A review,” Mech. Syst. Signal Process., vol. 108, pp. 33–47, 2018. https://doi.org/10.1016/j.ymssp.2018.02.016
A. Guedidi, A. Guettaf, A. J. M. Cardoso, W. Laala, and A. Arif, “Bearing Faults Classification Based on Variational Mode Decomposition and Artificial Neural Network,” in International Symposium on Diagnostics for Electrical Machines, Power Electronics and Drives (SDEMPED), Toulouse, France: IEEE, 2019, pp. 391–397. https://doi.org/10.1109/DEMPED.2019.8864830
R. Azeddine, B. Djamel, and B. Hicham, “A signal processing approach to modeled bearing faults detection in electric system,” pp. 202–206, 2022.
C. Abdelkrim, M. Salah, N. Boutasseta, and L. Boulanouar, “Detection and classification of bearing faults in industrial geared motors using temporal features and adaptive neuro-fuzzy inference system,” Heliyon, vol. 5, no. March, p. e02046, 2019. https://doi.org/10.1016/j.heliyon.2019.e02046
P. Zhang, Y. Du, T. G. Habetler, and B. Lu, “A survey of condition monitoring and protection methods for medium-voltage induction motors,” IEEE Trans. Ind. Appl., vol. 47, no. 1, pp. 34–46, 2011. https://doi.org/10.1109/TIA.2010.2090839
J. Pacheco-Cherrez, J. Fortoul-Diaz, F. Cortes-Santacruz, L. M. Aloso-valerdi, and D. I. Ibarra-zarate, “Bearing fault detection with vibration and acoustic signals : Comparison among different machine leaning classification methods,” vol. 139, no. May, 2022. https://doi.org/10.1016/j.engfailanal.2022.106515
M. Lu and C. Chen, “Applied Sciences Detection and Classification of Bearing Surface Defects Based on Machine Vision,” Adv. Appl. Ind. Inform. Technol., vol. 11(4), 2021. https://doi.org/10.3390/app11041825
P. Nivesrangsan, “Bearing Fault Monitoring by Comparison with Main Bearing Frequency Components Using Vibration Signal,” in 2018 5th International Conference on Business and Industrial Research (ICBIR), Bangkok, Thailand: IEEE, 2018, pp. 292–296. https://doi.org/10.1109/ICBIR.2018.8391209
S. E. Pandarakone, Y. Mizuno, and H. Nakamura, “Evaluating the Progression and Orientation of Scratches on Outer-Raceway Bearing Using a Pattern Recognition Method,” IEEE Trans. Ind. Electron., vol. 66, no. 2, pp. 1307–1314, 2019. https://doi.org/10.1109/TIE.2018.2833025
Y. Liu, Y. Cheng, Z. Zhang, and S. Yang, “Early Fault Diagnosis of Bearing Faults Using Vibration Signals,” Proc. 2021 IEEE 3rd Int. Conf. Civ. Aviat. Saf. Inf. Technol. ICCASIT 2021, pp. 747–751, 2021. https://doi.org/10.1109/ICCASIT53235.2021.9633352
K. K. Song et al., “An Improved Bearing Defect Detection Algorithm Based on Yolo,” Int. Symp. Control Eng. Robot., pp. 184–187, 2022. https://doi.org/10.1109/ISCER55570.2022.00038
S. Lee et al., “A Study on Deep Learning Application of Vibration Data and Visualization of Defects for Predictive Maintenance of Gravity Acceleration Equipment,” Multidiscip. Digit. Publ. Inst. Appl. Sci., vol. 11(4), no. Special Issue: Artificial Intelligence for Sustainable Services, Applications and Education, 2021. https://doi.org/10.3390/app11041564
C. Tastimur, M. Karakose, I. Ayd, and E. Akin, “Defect Diagnosis of Rolling Element Bearing using Deep Learning,” pp. 3–7, 2018.
CRWU, “Case Western Reserve University (CRWU) Bearing Data Center Website
D. Neupane and J. Seok, “Bearing fault detection and diagnosis using case western reserve university dataset with deep learning approaches: A review,” IEEE Access, vol. 8, pp. 93155–93178, 2020. https://doi.org/10.1109/ACCESS.2020.2990528
M. Borowska, “Entropy-based algorithms in the analysis of biomedical signals,” Stud. Logic, Gramm. Rhetor., vol. 43, no. 56, pp. 21–32, 2015. https://doi.org/10.1515/slgr-2015-0039
S. M. Pincus, “Approximate entropy as a measure of system complexity,” in Proceedings of the National Academy of Sciences of the United States of America, 1991, pp. 2297–2301. https://doi.org/10.1073/pnas.88.6.2297
J. S. Richman and J. R. Moorman, “Physiological time-series analysis using approximate entropy and sample entropy maturity in premature infants Physiological time-series analysis using approximate entropy and sample entropy,” Am. J. Physiol. Hear. Circ. Physiol., vol. 278, pp. H2039–H2049, 2000.
M. Rostaghi and H. Azami, “Dispersion Entropy: A Measure for Time-Series Analysis,” IEEE Signal Process. Lett., vol. 23, no. 5, pp. 610–614, 2016. https://doi.org/10.1109/LSP.2016.2542881
D. Cuesta-Frau, “Slope Entropy: A new time series complexity estimator based on both symbolic patterns and amplitude information,” Entropy, vol. 21, no. 12, 2019. https://doi.org/10.3390/e21121167
A. Sharma and L. Mathew, “Bearing Fault Diagnosis Using Weighted K-Nearest Neighbor,” in 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI), IEEE, 2018, pp. 1132–1137. https://doi.org/10.1109/ICOEI.2018.8553800
M. A. Vishwendra et al., “A Novel Method to Classify Rolling Element Bearing Faults Using K -Nearest Neighbor Machine Learning Algorithm,” vol. 8, no. September, pp. 1–11, 2022. https://doi.org/10.1115/1.4053760
C. J. . Burges, “Tutorial on Support Vector Machine for Pattern Recognition,” Data Min. Knowl. Discov., vol. 2, pp. 121–167, 1998. https://doi.org/10.1023/A:1009715923555
C. Z. Hu, M. Y. Huang, Q. Yang, and W. J. Yan, “On the use of EEMD and SVM based approach for bearing fault diagnosis of wind turbine gearbox,” Proc. 28th Chinese Control Decis. Conf. CCDC 2016, no. 2, pp. 3472–3477, 2016. https://doi.org/10.1109/CCDC.2016.7531583