簡易檢索 / 詳目顯示

研究生: 林佳慶
Cia-Cing Lin
論文名稱: 以深度學習進行新聞頭條與股市漲跌關聯性之研究
A Study of the Relationship of News Headline and Stock Market by Deep Learning
指導教授: 陳維美
Wei-Mei Chen
口試委員: 林淵翔
林昌鴻
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2018
畢業學年度: 106
語文別: 中文
論文頁數: 47
中文關鍵詞: 股市預測隨機漫步理論深度學習長短期記憶神經網路特徵選取
外文關鍵詞: Stock Market Prediction, Random Walk Theory, Deep Learning, Long Short-Term Memory, Feature Selection
相關次數: 點閱:875下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 無論學界或是業界,預測股市的漲、跌走勢一直以來都是人們所感興趣的主題。然而經濟學有一個隨機漫步理論 (Random Walk Theory) 認為,股票價格變化具有相同分佈及彼此獨立的特性,所以股票價格或市場的過去走勢或趨勢不能用來預測其未來走勢,因此一直以來無法有效運用過去的歷史資訊對未來做出預判。但近年來盛行的深度學習可有效處理大量的雜訊與非線性資料,讓預測未來這件事有了全新的解決方法,因此我們希望透過深度學習尋找出有效的方法來解決此問題。本研究收集Reddit社交新聞網站的頭條新聞以及道瓊工業平均指數 (DJIA) 市場交易資料,做為深度學習所需的訓練及驗證資料集,由於考量股市的時序性及新聞影響的持續性,我們提出一套結合新聞資訊與技術分析指標為基礎的長短期記憶神經網路 (long short-term memory,LSTM)模型並運用特徵選取方式大幅減低訓練模型時間,藉此即時掌握股票市場漲、跌趨勢,讓使用者可借助人工智慧的技術掌握未來股票市場走向趨勢,輔助投資人提高決策投資準確度


    Regardless of academia or industry, predicting the stock market's up and down trend has always been the subject of interest. Nevertheless, there is a Random Walk Theory in economic theory that stock price changes have the same distribution and are independent of each other, so the past movement or trend of a stock price or market information cannot be used to predict its future movement. Therefore, it has not been effectively use past historical information to predict the future. However, the deep learning prevailing in recent years can efficiently deal with a bunch of noise and non-linear data. It is a whole new way to predict the future, so we hope to find an effective way to solve this problem through deep learning. In this study, we will try to find an effective way to solve this problem through deep learning technology. We collect headlines from the Reddit social news website and DJIA market trading data as a training and validation data set for deep learning. In consideration of sequential stock prices and continuous news effects, we propose a LSTM (long short-term memory) model based on news and technical analysis indexes and use the feature selection method to significantly reduce the training model time. This forecast can allow users immediately grasp the trend of the stock market in the future with artificial intelligence technology and help investors improve the accuracy of investment decisions.

    摘要 i Abstract ii 目錄 iii 圖目錄 v 表目錄 vii 第一章 緒論 1 1.1 研究背景與動機 1 1.2 論文架構 3 第二章 文獻探討 4 2.1 文字探勘 4 2.2 文字表示方法 6 2.3 神經網路 8 2.4 深度學習架構 9 2.5 相關研究 11 第三章 系統架構 13 第四章 研究方法 15 4.1 問題描述 (Problem Statement) 15 4.2 資料擷取 (Data Collection) 16 4.3 選擇技術指標 (Tech Index selection) 19 4.4 文字資料預處理 (Text pre-processing) 20 4.5 深度學習模型 (Deep learning model) 22 第五章 實驗模擬與探討 24 5.1 實驗設定 24 5.2 實驗環境 26 5.3 實驗結果 26 第六章 結論 36 參考文獻 37

    R. Bisoi, and P. K. Dash, “A hybrid evolutionary dynamic neural network for stock market trend analysis and prediction using unscented Kalman filter,” Applied Soft Computing, vol. 19, pp. 41-56, 2014.

    [2] J. Bollen, H. Mao, and X. Zeng, “Twitter mood predicts the stock market,” Journal of Computational Science, vol. 2, no. 1, pp. 1-8, 2011.

    [3] J. Y. Campbell, S. J. Grossman, and J. Wang, “Trading volume and serial correlation in stock returns,” The Quarterly Journal of Economics 108.4: 905-93, 1993.

    [4] K. Chen, Yi. Zhou, and F. Dai, “A LSTM-based method for stock returns prediction: A case study of China stock market,” IEEE International Conference on Big Data, pp. 2823-2324, 2015.

    [5] X. Ding, Y. Zhang, T. Liu and J. Duan, “Using Structured Events to Predict Stock Price Movement: An Empirical Investigation,” EMNLP, pp. 1415-1425, 2014.

    [6] X. Glorot, A. Bordes, and Y. Bengio. “Deep sparse rectifier neural networks, ” Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. pp. 315-323, 2011.

    [7] O. Irsoy and C. Cardie, “Opinion Mining with Deep Recurrent Neural Networks,” EMNLP, pp. 720-728, 2014.

    [8] M. Khashei and M. Bijari, “A novel hybridization of artificial neural networks and ARIMA models for time series forecasting,” Applied Soft Computing, vol. 11, no. 2, pp. 2664-2675, 2011.

    [9] Y. Kim, “Convolutional neural networks for sentence classification,” arXiv preprint arXiv:1408.5882, 2014.

    [10] W. Leigh, R. Purvis and J. M. Ragusa, “Forecasting the NYSE Composite Index with Technical Analysis, Pattern Recognizer, Neural Network, and Genetic Algorithm: a Case Studying Decision Support,” Decision Support Systems, no. 32, pp. 361–377, 2002.

    [11] S. Lai, L. Xu, K. Liu and J. Zhao, “Recurrent Convolutional Neural Networks for Text Classification,” AAAI, pp. 2267-2273, 2015.

    [12] T. Mikolov, M. Karafiat, L. Burget, J. Cernock and S. Khudanpur, “Recurrent neural network based language model,” Interspeech. Vol. 2. 2010.

    [13] H. Mizuno, M. Kosaka, H. Yajima and N. Komoda, “Application of neural network to technical analysis of stock market prediction,” Studies in Informatic and control, vol. 7, no. 3, pp. 111-120, 1998.

    [14] G. L. Musgrave, “A Random Walk Down Wall Street,” Business Economics, vol. 32, no. 2, pp. 74-76, 1997.

    [15] A. K. Nassirtoussi, S. Aghabozorgi, T. Y. Wah and D. C. L. Ngo, “Text mining of news-headlines for FOREX market prediction: A Multi-layer Dimension Reduction Algorithm with semantics and sentiment,” Expert Systems with Applications, vol. 42, no. 1, pp. 306-324, 2015.

    [16] G. Rachlin, M. Last, D. Alberg and A. Kandel, “ADMIRAL: A data mining based financial trading system,” IEEE Symposium on Computational Intelligence and Data Mining, pp. 720-725, 2007

    [17] “Reddit Worldnews,” https://www.reddit.com/r/worldnews/.

    [18] R. P. Schumaker and H. Chen, “A quantitative stock prediction system based on financial news,” Information Processing and Management, vol. 45, no. 5, pp. 571-583, 2009.

    [19] R. P. Schumaker, and H. Chen, “Textual analysis of stock market prediction using breaking financial news: The AZFin text system,” ACM Transactions on Information Systems, vol. 27, no. 2, Article 12, 2009.

    [20] S. Thawornwong and D. Enke, “The adaptive selection of financial and economic variables for use with artificial neural networks,” Neurocomputing, vol. 56, pp. 205–232, 2004.

    [21] M. R. Vargas, S. L. P. de Lima. Beatriz, A. G. Evsukoff, “Deep learning for stock market prediction from financial news articles,” IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 60-65, 2017.

    [22] X. Wang, Y. Liu, C. Sun, B. Wang and X. Wang, “Predicting Polarities of Tweets by Composing Word Embeddings with Long Short-Term Memory,” ACL, pp. 1343-1353, 2015.

    [23] J. J. Wang, J. Z. Wang, Z. G. Zhang and S. P. Guo, “Stock index forecasting based on a hybrid model,” Omega, vol. 40, no. 6, pp. 758- 766, 2012.

    [24] H. White, “Economic prediction using neural networks: the case of IBM daily stock returns,” IEEE International Conference on Neural Networks, vol. 2, pp. 451-458, 1998.

    [25] B. Wuthrich, V. Cho, S. Leung, D. Permunetilleke, K. Sankaran and J. Zhang, “Daily stock market forecast from textual web data,” IEEE International Conference on Systems, Man, and Cybernetics, vol. 3, pp. 2920-2725, 1998.

    [26] J. Xu, D. Chen, X. Qiu and X. Huang, “Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification,” arXiv preprint arXiv:1610.04989, 2016.

    [27] “Yahoo! Finance,” https://finance.yahoo.com/quote/^DJI?p=^DJI.

    [28] Y. Zhai, A. Hsu and S. Halgamuge, “Combining news and technical indexs in Daily stock price trends prediction,” Advances in Neural Networks, pp. 1087-1096, 2007.

    [29] X. Zhang and Y. LeCun, “Text understanding from scratch,” arXiv preprint arXiv:1502.01710, 2015

    [30] C. Zhou, C. Sun, Z. Liu and F. Lau, “A C-LSTM neural network for text classification”, arXiv preprint arXiv:1511.08630, 2015.

    無法下載圖示 全文公開日期 2023/01/31 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE