This study presents a time series prediction model with output self feedback which is implemented
based on online sequential extreme learning machine. The output variables derived from multilayer perception
can feedback to the network input layer to create a temporal relation between the current node inputs and the
lagged node outputs while overcoming the limitation of memory which is a vital part for any time-series prediction
application. The model can overcome the static prediction problem with most time series prediction models
and can effectively cope with the dynamic properties of time series data. A linear and a nonlinear forecasting
algorithms based on online extreme learning machine are proposed to implement the output feedback forecasting
model. They are both recursive estimator and have two distinct phases: Predict and Update. The proposed
model was tested against different kinds of time series data and the results indicate that the model outperforms
the original static model without feedback.
PAN Feng1* (潘 峰), ZHAO Hai-bo2 (赵海波)
. Online Sequential Extreme Learning Machine Based Multilayer Perception with Output Self Feedback for Time Series Prediction[J]. Journal of Shanghai Jiaotong University(Science), 2013
, 18(3)
: 366
-375
.
DOI: 10.1007/s12204-013-1407-0
[1] Makridakis S, Wheelwright S, Hyndman R. Forecasting: Methods and applications [M]. New York: Wiley, 1998.
[2] Yu L, Lai K K, Wang S. Multistage RBF neural network ensemble learning for exchange rates forecasting [J]. Neurocomputing, 2008, 71(10): 3295-3302.
[3] Dong R, Pedrycz W. A granular time series approach to long-term forecasting and trend forecasting [J]. Physica A, 2008, 387(5): 3253-3270.
[4] Wagner N, Michalewicz Z, Khouja M, et al. Time series forecasting for dynamic environments: The Dy-For genetic program model [J]. IEEE Transactions on Evolutionary Computation, 2007, 11(4): 433-452.
[5] Kulesh M, Holschneider M, Kurennaya K. Adaptive metrics in the nearest neighbours method [J]. Physics D, 2008, 237(5): 283-291.
[6] Cao L J, Tay F E H. Support vector machine with adaptive parameters in financial time series forecasting [J]. IEEE Transactions on Neural Networks, 2003, 14(6): 1506-1518.
[7] Zhang G P, Kline D M. Quarterly time-series forecasting with neural networks [J]. IEEE Transactions on Neural Networks, 2007, 18(6): 1800-1814.
[8] Huang G B, Zhu Q Y, Siew C K. Extreme learning machine: Theory and applications [J]. Neurocomputing, 2006, 70(12): 489-501.
[9] Vairappan C, Tamura H, Gao S, et al. Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction [J]. Neurocomputing, 2009, 72(3): 1870-1877.
[10] Lin Z, Zhang D, Gao L, et al. Using an adaptive self-tuning approach to forecast power loads [J]. Neurocomputing, 2008, 71(1): 559-563.
[11] Liang N Y, Huang G B, Saratchandran P, et al.A fast and accurate online sequential learning algorithm for feedforward networks [J]. IEEE Transactions on Neural Networks, 2006, 17(11): 1411-1423.