Stock Market Forecasting with Financial Micro-Blog Based on Sentiment and Time Series Analysis

doi:10.1007/s12204-017-1818-4

Abstract

Abstract: During the past few decades, time series analysis has become one popular method for solving stock forecasting problem. However, depending only on stock index series makes the performance of the forecast not good enough, because many external factors which may be involved are not taken into consideration. As a way to deal with it, sentiment analysis on online textual data of stock market can generate a lot of valuable information as a complement which can be named as external indicators. In this paper, a new method which combines the time series of external indicators and the time series of stock index is provided. A special text processing algorithm is proposed to obtain a weighted sentiment time series. In the experiment, we obtain financial micro-blogs from some famous portal websites in China. After that, each micro-blog is segmented and preprocessed, and then the sentiment value is calculated for each day. Finally, an NARX time series model combined with the weighted sentiment series is created to forecast the future value of Shanghai Stock Exchange Composite Index (SSECI). The experiment shows that the new model makes an improvement in terms of the accuracy.

Key words: time series| micro-blog| sentiment analysis| parsing| neural network

摘要： During the past few decades, time series analysis has become one popular method for solving stock forecasting problem. However, depending only on stock index series makes the performance of the forecast not good enough, because many external factors which may be involved are not taken into consideration. As a way to deal with it, sentiment analysis on online textual data of stock market can generate a lot of valuable information as a complement which can be named as external indicators. In this paper, a new method which combines the time series of external indicators and the time series of stock index is provided. A special text processing algorithm is proposed to obtain a weighted sentiment time series. In the experiment, we obtain financial micro-blogs from some famous portal websites in China. After that, each micro-blog is segmented and preprocessed, and then the sentiment value is calculated for each day. Finally, an NARX time series model combined with the weighted sentiment series is created to forecast the future value of Shanghai Stock Exchange Composite Index (SSECI). The experiment shows that the new model makes an improvement in terms of the accuracy.

关键词: time series| micro-blog| sentiment analysis| parsing| neural network

CLC Number:

WANG Yinglin (王英林). Stock Market Forecasting with Financial Micro-Blog Based on Sentiment and Time Series Analysis[J]. Journal of shanghai Jiaotong University (Science), 2017, 22(2): 173-179.

References 12

[1]	PEDRYCZ W, CHEN S M. Time series analysis, modelingand applications [M]. Berlin: Springer-Verlag,2013.
[2]	WANG L, ZOU H F, SU J, et al. An ARIMA-ANNhybrid model for time series forecasting [J]. SystemsResearch and Behavioral Science, 2013, 30: 244-259.
[3]	CORTEZ P, RIO M, ROCHA M, et al. Multi-scaleInternet traffic forecasting using neural networks andtime series methods [J]. Expert Systems, 2012, 29(2):143-155.
[4]	KUMAR D A, MURUGAN S. Performance analysisof Indian stock market index using neural networktime series model [C]//Proceedings of the 2013 InternationalConference on Pattern Recognition, Informaticsand Mobile Engineering (PRIME). [s. l.]: IEEE,2013: 72-78.
[5]	O’CONNOR N, MADDEN M G. A neural network approachto predicting stock exchange movements usingexternal factors [J]. Knowledge-Based Systems, 2006,19(5): 371-378.
[6]	SCHUMAKER R P, ZHANG Y L, HUANG C N, etal. Evaluating sentiment in financial news articles [J].Decision Support Systems, 2012, 53(3): 458-464.
[7]	LIANG X, CHEN R C, HE Y, et al. Associatingstock prices with web financial information time seriesbased on support vector regression [J]. Neurocomputing,2013, 115: 142-149.
[8]	HAGENAU M, LIEBMANN M, NEUMANN D. Automatednews reading: Stock price prediction basedon financial news using context-capturing features [J].Decision Support Systems, 2013, 55: 685-697.
[9]	RUIZ E J, HRISTIDIS V, CASTILLO C, et al. Correlatingfinancial time series with micro-blogging activity[C]// Proceedings of the fifth ACM International Conferenceon Web Search and Data Mining. New York,USA: ACM, 2012: 513-522.
[10]	BOLLEN J, MAO H, ZENG X J. Twitter mood predictsthe stock market [J]. Journal of ComputationalScience, 2011, 2(1): 1-8.
[11]	LI Q, WANG J, WANG F, et al. The role of socialsentiment in stock markets: A view from joint effects ofmultiple information sources [J]. Multimedia Tools andApplications, 2016. DOI: 10. 1007/s11042-016-3643-4(published online).
[12]	ROMANOWSKI A, SKUZA M. Towards predictingstock price moves with aid of sentiment analysis ofTwitter social network data and big data processingenvironment [C]// Advances in Business ICT: NewIdeas from Ongoing Research, Studies in ComputationalIntelligence. [s.l.]: Springer International Publishing,2017: 105-123.

[1]	PAN Meiqi, HE Xing. A Fault Diagnosis Method for Wind Turbines Based on Zero-Shot Learning [J]. Journal of Shanghai Jiao Tong University, 2025, 59(5): 561-568.
[2]	HUANG Yixiang, DOU Xun, LI Linxi, YANG Hanyu, YU Jiancheng, HUO Xianxu. Quantitative Method of Response Value of Integrated Energy Equipment Based on Global Sensitivity Analysis [J]. Journal of Shanghai Jiao Tong University, 2025, 59(5): 569-579.
[3]	Ma Yiyuan, Chen Huaiyuan, Chen Weidong. Real-Time Prediction of Elbow Motion Through sEMG-Based Hybrid BP-LSTM Network [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(3): 455-462.
[4]	Pan Xinrong, Liu Xuewen, Zhu Bo, Wang Yingyi. Physics-Guided Neural Network with Gini Impurity-Based Structural Optimizer for Prediction of Membrane-Type Acoustic Material Transmission Loss [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(3): 613-624.
[5]	Feng Lingdong, Miao Yubin. Intelligent Heart Rate Extraction Method Based on Millimeter Wave Radar [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(3): 493-498.
[6]	QIN Hao, SU Liwei, WU Guangbin, JIANG Chongying, XU Zhipeng, KANG Feng, TAN Huochao, ZHANG Yongjun. Short-Term Telephone-Traffic Prediction of Power Grid Customer Service Based on Adaboost-CNN [J]. Journal of Shanghai Jiao Tong University, 2025, 59(2): 266-273.
[7]	Nie Wei, Liang Xinwu. Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(2): 399-416.
[8]	Li Kai, Huang Wenhan, Li Chenchen, Deng Xiaotie. Exploiting a No-Regret Opponent in Repeated Zero-Sum Games [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(2): 385-398.
[9]	A. Sahaya Anselin Nisha^1* , NARMADHA R.¹ , AMIRTHALAKSHMI T. M.²,BALAMURUGAN V.¹, VEDANARAYANAN V.¹. LOBO Optimization-Tuned Deep-Convolutional Neural Network for Brain Tumor Classification Approach [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(1): 107-114.
[10]	SUN Dongyi, PU Yuting, ZHANG Jianbang. Target Assignment Method of Air Defense Missile Based on GA-BP Neural Network [J]. Air & Space Defense, 2025, 8(1): 62-70.
[11]	JIANG Yilin^{1, 2∗}(蒋伊琳), LI Xiang^{1, 2} (李向), ZHANG Haoping³ (张昊平). Emitter Beam State Sensing Based on Convolutional Neural Network and Received Signal Strength [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(6): 1017-1022.
[12]	LI Mingai^{1, 2∗} (李明爱), WEI Lina¹ (魏丽娜). Motor Imagery Classification Based on Plain Convolutional Neural Network and Linear Interpolation [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(6): 958-966.
[13]	LI Lijuan, LIU Hai, LIU Hongliang, ZHANG Qingsong, CHEN Yongdong. Non-Intrusive Load Disaggregation Using Sequence-to-Point Integrating External Attention Mechanism [J]. Journal of Shanghai Jiao Tong University, 2024, 58(6): 846-854.
[14]	XU Liangkun^{1, 2} (徐良坤), XUE Han^2∗ (薛晗), JIN Yongxing¹ (金永兴), ZHOU Shibo² (周世波). Neural Network Optimization of Multivariate KDE Bandwidth for Buoy Spatial Information [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(5): 773-779.
[15]	ZHANG Guodong, LIU Kai, PU Haitao, YAO Fuqiang, ZHANG Shuaishuai. Identification of Inrush Current and Fault Current Based on Long Short-Term Memory Neural Network [J]. Journal of Shanghai Jiao Tong University, 2024, 58(5): 730-738.