Research of Adaptive Neighborhood Incremental Principal Component Analysis and Locality Preserving Projection Manifold Learning Algorithm

doi:10.1007/s12204-018-1936-7

Abstract

Abstract: In view of the incremental learning problem of manifold learning algorithm, an adaptive neighborhood incremental principal component analysis (PCA) and locality preserving projection (LPP) manifold learning algorithm is presented, and the incremental learning principle of algorithm is introduced. For incremental sample data, the adjacency and covariance matrices are incrementally updated by the existing samples; then the dimensionality reduction results of the incremental samples are estimated by the dimensionality reduction results of the existing samples; finally, the dimensionality reduction results of the incremental and existing samples are updated by subspace iteration method. The adaptive neighborhood incremental PCA-LPP manifold learning algorithm is applied to processing of gearbox fault signals. The dimensionality reduction results by incremental learning have very small error, compared with those by batch learning. Spatial aggregation of the incremental samples is basically stable, and fault identification rate is increased.

Key words: incremental learning| adaptive, manifold learning| fault diagnosis

摘要： In view of the incremental learning problem of manifold learning algorithm, an adaptive neighborhood incremental principal component analysis (PCA) and locality preserving projection (LPP) manifold learning algorithm is presented, and the incremental learning principle of algorithm is introduced. For incremental sample data, the adjacency and covariance matrices are incrementally updated by the existing samples; then the dimensionality reduction results of the incremental samples are estimated by the dimensionality reduction results of the existing samples; finally, the dimensionality reduction results of the incremental and existing samples are updated by subspace iteration method. The adaptive neighborhood incremental PCA-LPP manifold learning algorithm is applied to processing of gearbox fault signals. The dimensionality reduction results by incremental learning have very small error, compared with those by batch learning. Spatial aggregation of the incremental samples is basically stable, and fault identification rate is increased.

关键词: incremental learning| adaptive, manifold learning| fault diagnosis

CLC Number:

DENG Shijie (邓士杰), TANG Liwei (唐力伟), ZHANG Xiaotao (张晓涛). Research of Adaptive Neighborhood Incremental Principal Component Analysis and Locality Preserving Projection Manifold Learning Algorithm[J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(2): 269-275.

References 11

[1]	ZHAO Z H, HAO X H. Linear locality preserving anddiscriminating projection for face recognition [J]. Journalof Electronics & Information Technology, 2013,35(2): 463-466 (in Chinese).
[2]	HE X F, NIYOGI P. Locality preserving projections[C]//Neural Information Processing Systems 16. Vancouver:MIT Press, 2004: 153-160.
[3]	ZHANG Z H, ZHU X Z, ZHAO J M, et al. Imageretrieval based on PCA-LPP [C]//2011 10th InternationalSymposium on Distributed Computing and Applicationsto Business, Engineering and Science. Wuxi:IEEE, 2011: 230-233.
[4]	WANG J, FENG J, HAN Z Y. Locally preserving PCAmethod based on manifold learning and its applicationin fault detection [J]. Control and Decision, 2013,28(5): 683-687 (in Chinese).
[5]	JIA P, YIN J S, HUANG X S, et al. IncrementalLaplacian eigenmaps by preserving adjacent informationbetween data points [J]. Pattern Recognition Letters,2009, 30(8): 1457-1463.
[6]	CHIN T J, SUTER D. Out-of-sample extrapolation oflearned manifolds [J]. IEEE Transactions on PatternAnalysis and Machine Intelligence, 2008, 30(9): 1547-1556.
[7]	YANG Q, CHEN G M, TONG X M, et al. Applicationof incremental local tangent space alignment algorithmto rolling bearings fault diagnosis [J]. Journal of MechanicalEigineering, 2012, 48(5): 81-86 (in Chinese).
[8]	TAN C, GUAN J H, ZHOU S G. Multi-sample incrementalmanifold learning algorithm based on isogonalmapping [J]. Pattern Recognition and Artificial Intelligence,2014, 27(2): 127-133 (in Chinese).
[9]	SUN J F. New method for moving object detectionbased on Gaussian kernel density estimation [J]. ComputerTechnology and Development, 2010, 20(8): 45-48(in Chinese).
[10]	YAN S C, XU D, ZHANG B Y, et al. Graph embeddingand extensions: A general framework for dimensionalityreduction [J]. IEEE Transactions on PatternAnalysis and Machine Intelligence, 2007, 29(1): 40-50.
[11]	LI C L, WANG Z S, JIANG H K, et al. AdaptiveHessian LLE in mechanical fault feature extraction [J].Journal of Vibration Engineering, 2013, 26(5): 758-763 (in Chinese).

[1]	PAN Meiqi, HE Xing. A Fault Diagnosis Method for Wind Turbines Based on Zero-Shot Learning [J]. Journal of Shanghai Jiao Tong University, 2025, 59(5): 561-568.
[2]	XUE Guiting, LIU Zhe, HAN Zhaoru, SHI Fang, WANG Ti, WANG Xiao. Switching Modeling and Application in Fault Diagnosis Algorithm Testing of Distribution Network [J]. Journal of Shanghai Jiao Tong University, 2024, 58(9): 1381-1389.
[3]	ZHANG Chunmei, XU Xingque, LIU Silin. Distribution Network Fault Diagnosis Technology Based on Multi-Source Data Fusion [J]. Journal of Shanghai Jiao Tong University, 2024, 58(5): 739-746.
[4]	ZHANG Baolei1, WU Yuke2, TANG Yufeng2. Fault Diagnosis of Electric Slip Ring of EPSO Single Point Mooring Base on CART Decision Tree [J]. Ocean Engineering Equipment and Technology, 2024, 11(2): 95-100.
[5]	TIAN Yuanyuan (田圆圆), JIN Yanrui (金衍瑞), LI Zhiyuan (李志远), LIU Jinlei (刘金磊), LIU Chengliang^∗ (刘成良). Weighted Heterogeneous Graph-Based Incremental Automatic Disease Diagnosis Method [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(1): 120-130.
[6]	GUO Junfeng, WANG Miaosheng, WANG Zhiming. Fault Diagnosis of Rolling Bearing with Roller Spalling Based on Two-Step Transfer Learning on Unbalanced Dataset [J]. Journal of Shanghai Jiao Tong University, 2023, 57(11): 1512-1521.
[7]	LIU Jiahe, HU Pengwei, CHENG Hailong. Research on Condition-Based Maintenance of Complex System Based on Performance Degradation [J]. Air & Space Defense, 2023, 6(1): 56-62.
[8]	XU Yong, CAI Yunze, SONG Lin. Review of Research on Condition Assessment of Nuclear Power Plant Equipment Based on Data-Driven [J]. Journal of Shanghai Jiao Tong University, 2022, 56(3): 267-278.
[9]	NIE Rui, WANG Hongru. Fault Diagnosis of UAV Formation Actuator Based on Neural Network Observer [J]. Air & Space Defense, 2022, 5(2): 32-41.
[10]	LIU Xiuli, XU Xiaoli. A Fault Diagnosis Method Based on Feature Pyramid CRNN Network [J]. Journal of Shanghai Jiao Tong University, 2022, 56(2): 182-190.
[11]	MA Hangyu, ZHOU Di, WEI Yujie, WU Wei, PAN Ershun. Intelligent Bearing Fault Diagnosis Based on Adaptive Deep Belief Network Under Variable Working Conditions [J]. Journal of Shanghai Jiao Tong University, 2022, 56(10): 1368-1377.
[12]	HU Xiaoqiang,ZHONG Xunyu,ZHANG Xiaoli,PENG Xiafu,HE Ying. A Two-Level Fault Diagnosis Method for Gyro-Quadruplet Assisted by Support Vector Machine [J]. Journal of Shanghai Jiaotong University, 2020, 54(11): 1151-1156.
[13]	LU Cheng,XU Tingxue,WANG Hong. Fault Diagnosis of Terminal Guidance Radar Based on Attribute Granulation Clustering and Echo State Network [J]. Journal of Shanghai Jiaotong University, 2018, 52(9): 1112-1119.
[14]	YU Kun (俞昆), TAN Jiwen (谭继文), LIN Tianran (林天然). Fault Diagnosis of Rolling Element Bearing Using Multi-Scale Lempel-Ziv Complexity and Mahalanobis Distance Criterion [J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(5): 696-701.
[15]	JIA Lei,DONG Wei，SUN Xinya，JI Yindong，CHEN Hua. Soft Faults Diagnosis of Track Circuit with Tolerance Based on NodeVoltage Increments [J]. Journal of Shanghai Jiaotong University, 2017, 51(6): 679-685.