Stock Market Forecasting with Financial Micro-Blog Based on Sentiment and Time Series Analysis

doi:10.1007/s12204-017-1818-4

Abstract

Abstract: During the past few decades, time series analysis has become one popular method for solving stock forecasting problem. However, depending only on stock index series makes the performance of the forecast not good enough, because many external factors which may be involved are not taken into consideration. As a way to deal with it, sentiment analysis on online textual data of stock market can generate a lot of valuable information as a complement which can be named as external indicators. In this paper, a new method which combines the time series of external indicators and the time series of stock index is provided. A special text processing algorithm is proposed to obtain a weighted sentiment time series. In the experiment, we obtain financial micro-blogs from some famous portal websites in China. After that, each micro-blog is segmented and preprocessed, and then the sentiment value is calculated for each day. Finally, an NARX time series model combined with the weighted sentiment series is created to forecast the future value of Shanghai Stock Exchange Composite Index (SSECI). The experiment shows that the new model makes an improvement in terms of the accuracy.

Key words: time series| micro-blog| sentiment analysis| parsing| neural network

摘要： During the past few decades, time series analysis has become one popular method for solving stock forecasting problem. However, depending only on stock index series makes the performance of the forecast not good enough, because many external factors which may be involved are not taken into consideration. As a way to deal with it, sentiment analysis on online textual data of stock market can generate a lot of valuable information as a complement which can be named as external indicators. In this paper, a new method which combines the time series of external indicators and the time series of stock index is provided. A special text processing algorithm is proposed to obtain a weighted sentiment time series. In the experiment, we obtain financial micro-blogs from some famous portal websites in China. After that, each micro-blog is segmented and preprocessed, and then the sentiment value is calculated for each day. Finally, an NARX time series model combined with the weighted sentiment series is created to forecast the future value of Shanghai Stock Exchange Composite Index (SSECI). The experiment shows that the new model makes an improvement in terms of the accuracy.

关键词: time series| micro-blog| sentiment analysis| parsing| neural network

CLC Number:

WANG Yinglin (王英林). Stock Market Forecasting with Financial Micro-Blog Based on Sentiment and Time Series Analysis[J]. Journal of shanghai Jiaotong University (Science), 2017, 22(2): 173-179.

References 12

[1]	PEDRYCZ W, CHEN S M. Time series analysis, modelingand applications [M]. Berlin: Springer-Verlag,2013.
[2]	WANG L, ZOU H F, SU J, et al. An ARIMA-ANNhybrid model for time series forecasting [J]. SystemsResearch and Behavioral Science, 2013, 30: 244-259.
[3]	CORTEZ P, RIO M, ROCHA M, et al. Multi-scaleInternet traffic forecasting using neural networks andtime series methods [J]. Expert Systems, 2012, 29(2):143-155.
[4]	KUMAR D A, MURUGAN S. Performance analysisof Indian stock market index using neural networktime series model [C]//Proceedings of the 2013 InternationalConference on Pattern Recognition, Informaticsand Mobile Engineering (PRIME). [s. l.]: IEEE,2013: 72-78.
[5]	O’CONNOR N, MADDEN M G. A neural network approachto predicting stock exchange movements usingexternal factors [J]. Knowledge-Based Systems, 2006,19(5): 371-378.
[6]	SCHUMAKER R P, ZHANG Y L, HUANG C N, etal. Evaluating sentiment in financial news articles [J].Decision Support Systems, 2012, 53(3): 458-464.
[7]	LIANG X, CHEN R C, HE Y, et al. Associatingstock prices with web financial information time seriesbased on support vector regression [J]. Neurocomputing,2013, 115: 142-149.
[8]	HAGENAU M, LIEBMANN M, NEUMANN D. Automatednews reading: Stock price prediction basedon financial news using context-capturing features [J].Decision Support Systems, 2013, 55: 685-697.
[9]	RUIZ E J, HRISTIDIS V, CASTILLO C, et al. Correlatingfinancial time series with micro-blogging activity[C]// Proceedings of the fifth ACM International Conferenceon Web Search and Data Mining. New York,USA: ACM, 2012: 513-522.
[10]	BOLLEN J, MAO H, ZENG X J. Twitter mood predictsthe stock market [J]. Journal of ComputationalScience, 2011, 2(1): 1-8.
[11]	LI Q, WANG J, WANG F, et al. The role of socialsentiment in stock markets: A view from joint effects ofmultiple information sources [J]. Multimedia Tools andApplications, 2016. DOI: 10. 1007/s11042-016-3643-4(published online).
[12]	ROMANOWSKI A, SKUZA M. Towards predictingstock price moves with aid of sentiment analysis ofTwitter social network data and big data processingenvironment [C]// Advances in Business ICT: NewIdeas from Ongoing Research, Studies in ComputationalIntelligence. [s.l.]: Springer International Publishing,2017: 105-123.

[1]	QIN Chao1 (秦超), WANG Yafei1 (王亚飞), ZHANG Yuchao2 (张宇超), YIN Chengliang1∗ (殷承良). Birds-Eye-View Semantic Segmentation and Voxels Semantic Segmentation Based on Frustum Voxels Modeling and Monocular Camera [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 100-113.
[2]	HUANG Yinggang1 (黄迎港), LUO Wenguang1∗ (罗文广), HUANG Dan2 (黄丹), LAN Hongli1 (蓝红莉). Cascade Optimization Control of Unmanned Vehicle Path Tracking under Harsh Driving Conditions [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 114-125.
[3]	ZENG Guozhi, WEI Ziqing, YUE Bao, DING Yunxiao, ZHENG Chunyuan, ZHAI Xiaoqiang. Energy Consumption Prediction of Office Buildings Based on CNN-RNN Combined Model [J]. Journal of Shanghai Jiao Tong University, 2022, 56(9): 1256-1261.
[4]	WU Shuchen, QI Zongfeng, LI Jianxun. Intelligent Global Sensitivity Analysis Based on Deep Learning [J]. Journal of Shanghai Jiao Tong University, 2022, 56(7): 840-849.
[5]	QUAN Daying, CHEN Yun, TANG Zeyu, LI Shitong, WANG Xiaofeng, JIN Xiaoping. Radar Signal Recognition Based on Dual Channel Convolutional Neural Network [J]. Journal of Shanghai Jiao Tong University, 2022, 56(7): 877-885.
[6]	QIN Pengfei (秦鹏飞), WANG Xiaoliang∗ (王晓亮). Construction on Aerodynamic Surrogate Model of Stratospheric Airship [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 768-779.
[7]	SU Hong1 (苏红), WU Bozhao2 (吴博钊), MAO Xuchu1∗ (茅旭初). Non-Line-of-Sight Multipath Detection Method for BDS/GPS Fusion System Based on Deep Learning [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 844-854.
[8]	LÜ Qibing (吕其兵), LIU Tianyuan (刘天元), ZHANG Rong (张荣), JIANG Yanan (江亚南), XIAO Lei (肖雷), BAO Jingsong∗ (鲍劲松). Generation Approach of Human-Robot Cooperative Assembly Strategy Based on Transfer Learning [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(5): 602-613.
[9]	QIN Yichao, HUANG Limin, WANG Xiao, MA Xuewen, DUAN Wenyang, HAO Wei. Feasibility of Wave Measurement by Using a Sailing Buoy and the Artificial Neural Network Technique [J]. Journal of Shanghai Jiao Tong University, 2022, 56(4): 498-505.
[10]	ZHAO Yong, SU Dan. Rogue Wave Prediction Based on Four Combined Long Short-Term Memory Neural Network Models [J]. Journal of Shanghai Jiao Tong University, 2022, 56(4): 516-522.
[11]	LIU Min (刘敏), YI Ming (易鸣), WU Minghu∗ (武明虎), WANG Juan (王娟), HE Yu (何宇). Breast Pathological Image Classification Based on VGG16 Feature Concatenation [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(4): 473-484.
[12]	JIANG Zhiguo (蒋志国), CHANG Qing∗ (常青). USSL Net: Focusing on Structural Similarity with Light U-Structure for Stroke Lesion Segmentation [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(4): 485-497.
[13]	LU Guannan1 (卢冠男), WANG Mengling1∗ (王梦灵), FOX Tamara2, JIANG Peng3 (蒋鹏), JIANG Fusong3 (蒋伏松). Novel Indicators for Adverse Glycemic Events Detection Analysis Based on Continuous Glucose Monitoring Neural Network Predictive Models [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(4): 498-504.
[14]	DING Ming, MENG Shuai, WANG Shuheng, XIA Xi. Neural-Network-Based Adaptive Feedback Linearization Control for 6-DOF Wave Compensation Platform [J]. Journal of Shanghai Jiao Tong University, 2022, 56(2): 165-172.
[15]	LIU Xiuli, XU Xiaoli. A Fault Diagnosis Method Based on Feature Pyramid CRNN Network [J]. Journal of Shanghai Jiao Tong University, 2022, 56(2): 182-190.