Journal of Shanghai Jiao Tong University

Journal of Shanghai Jiaotong University >

2025 , Vol. 59 >Issue 6: 780 - 788

DOI: https://doi.org/10.16183/j.cnki.jsjtu.2023.388

New Type Power System and the Integrated Energy

Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization

  • JI Rong ,
  • HOU Huijuan ,
  • SHENG Gehao ,
  • ZHANG Lijing ,
  • SHU Bo ,
  • JIANG Xiuchen
Expand
  • a. College of Smart Energy; b. Department of Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

Received date: 2023-08-11

  Accepted date: 2024-01-15

  Online published: 2024-02-08

Fold

Abstract

Big data related to power equipment condition is experiencing explosive growth. However, equipment failures and personnel errors result in dirty data, having a negative effect on data quality and subsequent analysis results. Therefore, data cleaning is of great significance. Most existing research focuses on direct identification and elimination of abnormal data, which compromises the integrity of the data. In order to solve this problem, a data cleaning method based on improved stack noise reduction autoencoder is proposed in this paper. First, particle swarm optimization is used to optimize the hyperparameters of the stack noise reduction autoencoder. Then, the characteristics of the autoencoder is used to extract and restore the data features to clean the data. The method improves data quality of power equipment condition by repairing isolated data points and filling in missing data, which is simple and efficient for improving the accuracy and integrity of the data set. Finally, the historical operation data of power equipment is taken as an example. The simulation results show that the proposed method outperforms other classical methods providing good cleaning results for data sets with different abnormal degrees in different running states. The proposed method offers an effective solution for improving the quality of power equipment status data effectively.

Key words： power equipment; status data; stacked denoising autoencoder; data cleaning

Cite this article

JI Rong , HOU Huijuan , SHENG Gehao , ZHANG Lijing , SHU Bo , JIANG Xiuchen . Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization[J]. Journal of Shanghai Jiaotong University, 2025 , 59(6) : 780 -788 . DOI: 10.16183/j.cnki.jsjtu.2023.388

References

[1] 江秀臣, 盛戈皞. 电力设备状态大数据分析的研究和应用[J]. 高电压技术, 2018, 44(4): 1041-1050.
  JIANG Xiuchen, SHENG Gehao. Research and application of big data analysis of power equipment condition[J]. High Voltage Engineering, 2018, 44(4): 1041-1050.
[2] 陈敬德, 盛戈皞, 吴继健, 等. 大数据技术在智能电网中的应用现状及展望[J]. 高压电器, 2018, 54(1): 35-43.
  CHEN Jingde, SHENG Gehao, WU Jijian, et al. Application status and prospect of big data technology in smart grid[J]. High Voltage Apparatus, 2018, 54(1): 35-43.
[3] 方静, 彭小圣, 刘泰蔚, 等. 电力设备状态监测大数据发展综述[J]. 电力系统保护与控制, 2020, 48(23): 176-186.
  FANG Jing, PENG Xiaosheng, LIU Taiwei, et al. Development trend and application prospects of big data-based condition monitoring of power apparatus[J]. Power System Protection & Control, 2020, 48(23): 176-186.
[4] 李刚, 张博, 赵文清, 等. 电力设备状态评估中的数据科学问题: 挑战与展望[J]. 电力系统自动化, 2018, 42(21): 10-20.
  LI Gang, ZHANG Bo, ZHAO Wenqing, et al. Data science issues in state evaluation of power equipment: Challenges and prospects[J]. Automation of Electric Power Systems, 2018, 42(21): 10-20.
[5] 王军, 李建勋, 韩山, 等. 一种效能评估中缺失数据的填充方法[J]. 上海交通大学学报, 2017, 51(2): 180-185.
  WANG Jun, LI Jianxun, HAN Shan, et al. A missing data filling method for effectiveness evaluation system[J]. Journal of Shanghai Jiao Tong University, 2017, 51(2): 180-185.
[6] 周远翔, 林孟龙, 陈健宁, 等. 基于自注意力生成对抗网络的电力设备在线监测缺失数据填补[J]. 高电压技术, 2023, 49(5): 1795-1809.
  ZHOU Yuanxiang, LIN Menglong, CHEN Jianning, et al. Missing data imputation for online monitoring of power equipment based on self-attention generative adversarial networks[J]. High Voltage Engineering, 2023, 49(5): 1795-1809.
[7] 吴金娥, 王若愚, 段倩倩, 等. 基于反向k近邻过滤异常的群数据异常检测[J]. 上海交通大学学报, 2021, 55(5): 598-606.
  WU Jin’e, WANG Ruoyu, DUAN Qianqian, et al. Collective data anomaly detection based on reverse k-nearest neighbor filtering[J]. Journal of Shanghai Jiao Tong University, 2021, 55(5): 598-606.
[8] 李富盛, 陈伟松, 钱斌, 等. 面向低压配电网智能电表误差监测的LightGBM-EM-EC多变量缺失数据高效重建[J]. 中国电机工程学报, 2022, (42 Sup.1): 95-105.
  LI Fusheng, CHEN Weisong, QIAN Bin, et al. Efficient reconstruction of multivariate missing data for smart meter error monitoring in low voltage distribution network based on LightGBM-EM-EC[J]. Proceedings of the CSEE. 2022, (Sup.1): 95-105.
[9] 杨茂, 张书天, 王天硕, 等. 基于IKLIEP-四分位模型的风电场异常数据识别算法[J]. 高电压技术, 2023, 49(7): 2952-2960.
  YANG Mao, ZHANG Shutian, WANG Tianshuo, et al. Identification algorithm of wind farm abnormal data based on IKLIEP-quartile model[J]. High Voltage Engineering, 2023, 49(7): 2952-2960.
[10] 王文森, 杨晓西, 刘阳, 等. 基于层次聚类分析的变压器油中溶解气体在线监测数据异常检测[J]. 高压电器, 2023, 59(1): 142-147.
  WANG Wensen, YANG Xiaoxi, LIU Yang, et al. Anomaly detection of online monitoring data of dissolved gases in transformer oil based on hierarchical cluster analysis[J]. High Voltage Apparatus, 2023, 59(1): 142-147.
[11] 杨挺, 孙兆帅, 季浩, 等. 基于矩阵范数优化理论的用电数据质量提升算法[J]. 中国电机工程学报, 2022, 42(10): 3501-3511.
  YANG Ting, SUN Zhaoshuai, JI Hao, et al. Electricity consumption data quality improvement algorithm based on matrix norm optimization theory[J]. Proceedings of the CSEE, 2022, 42(10): 3501-3511.
[12] 娄建楼, 胥佳, 陆恒, 等. 基于功率曲线的风电机组数据清洗算法[J]. 电力系统自动化, 2016, 40(10): 116-121.
  LOU Jianlou, XU Jia, LU Heng, et al. Wind turbine data-cleaning algorithm based on power curve[J]. Automation of Electric Power Systems, 2016, 40(10): 116-121.
[13] 林峻, 严英杰, 盛戈皞, 等. 考虑时间序列关联的变压器在线监测数据清洗[J]. 电网技术, 2017, 41(11): 3733-3740.
  LIN Jun, YAN Yingjie, SHENG Gehao, et al. Online monitoring data cleaning of transformer considering time series correlation[J]. Power System Technology, 2017, 41(11): 3733-3740.
[14] 朱有产, 梁玮轩, 王英姿. 基于时间序列的配电网数据清理和融合方法研究[J]. 电网技术, 2021, 45(7): 2839-2846.
  ZHU Youchan, LIANG Weixuan, WANG Yingzi. Research on data cleaning and fusion in distribution power grid based on time series technology[J]. Power System Technology, 2021, 45(7): 2839-2846.
[15] REN C, XU Y. A fully data-driven method based on generative adversarial networks for power system dynamic security assessment with missing data[J]. IEEE Transactions on Power Systems, 2019, 34(6): 5044-5052.
[16] 王守相, 陈海文, 潘志新, 等. 采用改进生成式对抗网络的电力系统量测缺失数据重建方法[J]. 中国电机工程学报, 2019, 39(1): 56-64.
  WANG Shouxiang, CHEN Haiwen, PAN Zhixin, et al. A reconstruction method for missing data in power system measurement using an improved generative adversarial network[J]. Proceedings of the CSEE, 2019, 39(1): 56-64.
[17] 代杰杰, 宋辉, 杨祎, 等. 基于栈式降噪自编码器的输变电设备状态数据清洗方法[J]. 电力系统自动化, 2017, 41(12): 224-230.
  DAI Jiejie, SONG Hui, YANG Yi, et al. Cleaning method for status data of power transmission and transformation equipment based on stacked denoising autoencoders[J]. Automation of Electric Power Systems, 2017, 41(12): 224-230.
[18] SHIN H C, ORTON M R, COLLINS D J, et al. Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2013, 35(8): 1930-1943.
[19] HONG C Q, YU J, WAN J, et al. Multimodal deep autoencoder for human pose recovery[J]. IEEE Transactions on Image Processing: A publication of the IEEE Signal Processing Society, 2015, 24(12): 5659-5670.
[20] VINCENT P, LAROCHELLE H, BENGIO Y, et al. Extracting and composing robust features with denoising autoencoders[C]// Proceedings of the 25th international conference on Machine learning. Helsinki, Finland: ACM, 2008: 1096-1103.
[21] VINCENT P, LAROCHELLE H, LAJOIE I, et al. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion[J]. Journal of Machine Learning Research, 2010, 11: 3371-3408.
[22] 李兵, 梁舒奇, 单万宁, 等. 基于改进正余弦算法优化堆叠降噪自动编码器的电机轴承故障诊断[J]. 电工技术学报, 2022, 37(16): 4084-4093.
  LI Bing, LIANG Shuqi, SHAN Wanning, et al. Motor bearing fault diagnosis based on improved sine and cosine algorithm for stacked denoising autoencoders[J]. Transactions of China Electrotechnical Society, 2022, 37(16): 4084-4093.
[23] 招景明, 唐捷, 潘峰, 等. 基于SDAE和双模型联合训练的低压用户窃电检测方法[J]. 电测与仪表, 2021, 58(12): 161-168.
  ZHAO Jingming, TANG Jie, PAN Feng, et al. Detection method of electricity theft for low-voltage users based on SDAE and double-model joint training[J]. Electrical Measurement & Instrumentation, 2021, 58(12): 161-168.
[24] KENNEDY J, EBERHART R. Particle swarm optimization[C]// Proceedings of ICNN’95-International Conference on Neural Networks, Perth, Australia: IEEE, 1995: 1942-1948.
[25] 王立文, 刘建华, 陈斌, 等. 基于改进的PSO优化SVR的机场道面积冰预测[J]. 计算机仿真, 2021, 38(9): 45-50.
  WANG Liwen, LIU Jianhua, CHEN Bin, et al. Prediction of airport road surface icing based on improved PSO optimized SVR[J]. Computer Simulation, 2021, 38(9): 45-50.
[26] DU B G, HUANG S, GUO J, et al. Interval forecasting for urban water demand using PSO optimized KDE distribution and LSTM neural networks[J]. Applied Soft Computing, 2022, 122: 108875.
Options
Outlines

/

〈 〉