簡易檢索 / 詳目顯示

研究生: 李俊明
Abraham Koroh
論文名稱: Wavelet Transform for Predicting Stock Prices With LSTM-Attention Model
Wavelet Transform for Predicting Stock Prices With LSTM-Attention Model
指導教授: 呂永和
Yung-Ho Leu
口試委員: 楊維寧
Wei-Ning Yang
陳雲岫
Yun-Xiu Chen
學位類別: 碩士
Master
系所名稱: 管理學院 - 資訊管理系
Department of Information Management
論文出版年: 2020
畢業學年度: 108
語文別: 英文
論文頁數: 86
中文關鍵詞: -
外文關鍵詞: ARIMA, Attention-LSTM, Inverse Transform
相關次數: 點閱:153下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報


Wavelet transform is one of the methods to extract the information of data by
splitting the data into two parts, the approximate and detail. Approximate will capture the average of data while detail will capture the abrupt changes from the data. Such method is inspired from ARIMA where ARIMA also use the same approach by splitting the data into Auto-Regression and Moving Average part and then integrated the Auto-Regression and Moving Average. In ARIMA the Auto-Regression captured the regression part where data will predicted based on the previous data value while the moving average captured the error part of the data. This research has tested four models ANN, LSTM, Attention-LSTM and Inverse Transform. The stock data that is used for this research are the oil gas company and gold company stock prices. The company is also one of the biggest companies in the world. Those companies are Chevron, Exxon Mobil and Total S.A. for oil gas companies while Newmont, Barrick Gold and AngloGold Ashanti are the gold companies that used in this research. Based on the conducted experiment the best model is the Attention-LSTM model for predicting stock prices. However, the ARIMA model still performs better compared to Attention-LSTM. Still the difference is not very far and can have a better performance in the future.

TABLE OF CONTENT Pages ABSTRACT............................................................................................................................i ACKNOWLEDGEMENT .....................................................................................................ii TABLE OF CONTENT....................................................................................................... iii LIST OF FIGURES ...............................................................................................................v LIST OF TABLES ...............................................................................................................vii Chapter 1. Introduction...............................................................................................1 1.1 Background of the Problem.....................................................................................1 1.2 Research Problem....................................................................................................4 1.3 Research Limitation ................................................................................................4 1.4 Objective .................................................................................................................4 1.5 Benefits of Research................................................................................................4 Chapter 2. Literature Review .....................................................................................6 Chapter 3. Theoritical Base ......................................................................................12 3.1 Stock......................................................................................................................12 3.2 Wavelet Transform................................................................................................12 3.3 Data Preprocessing ................................................................................................15 3.4 ARIMA Model ......................................................................................................16 3.5 Sliding Windows...................................................................................................16 3.6 Deep Learning .......................................................................................................17 3.7 Error Evaluation ....................................................................................................22 Chapter 4. Research Methodology ...........................................................................24 4.1 Research Setup ......................................................................................................24 4.2 System Description................................................................................................25 Chapter 5. Research Implementation .......................................................................38 5.1 Collecting Dataset .................................................................................................38 iv 5.2 Processing Data .....................................................................................................38 5.3 Experiment Result .................................................................................................42 Chapter 6. Conclusion and Future Works ................................................................46 6.1 Result.....................................................................................................................46 6.2 Future Works.........................................................................................................46 REFERENCES.....................................................................................................................47 APPENDIX.............................................................................................................................i

[1] V. H. Shah, “Machine Learning Techniques for Stock Prediction,” p. 19,
2007.
[2] S. Selvin, R. Vinayakumar, E. A. Gopalakrishnan, V. K. Menon, and K. P.
Soman, “Stock price prediction using LSTM, RNN and CNN-sliding
window model,” in 2017 International Conference on Advances in
Computing, Communications and Informatics (ICACCI), Udupi, Sep. 2017,
pp. 1643–1647, doi: 10.1109/ICACCI.2017.8126078.
[3] I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. The MIT Press,
2016.
[4] Q. Cao, K. B. Leggio, and M. J. Schniederjans, “A comparison between
Fama and French’s model and artificial neural networks in predicting the
Chinese stock market,” Computers & Operations Research, vol. 32, no. 10,
pp. 2499–2512, Oct. 2005, doi: 10.1016/j.cor.2004.03.015.
[5] S. Jeon, B. Hong, J. Kim, and H. Lee, “Stock Price Prediction based on
Stock Big Data and Pattern Graph Analysis:,” in Proceedings of the
International Conference on Internet of Things and Big Data, Rome, Italy,
2016, pp. 223–231, doi: 10.5220/0005876102230231.
[6] R. J. Hyndman and G. Athanasopoulos, “Forecasting: Principles and
Practice,” 2018, Accessed: Jul. 22, 2019. [Online]. Available:
https://research.monash.edu/en/publications/forecasting-principles-andpractice-2.
[7] K. K. Gokmenoglu and N. Fazlollahi, “The Interactions among Gold, Oil,
and Stock Market: Evidence from S&P500,” Procedia Economics and
Finance, vol. 25, pp. 478–488, Jan. 2015, doi: 10.1016/S2212-
5671(15)00760-1.
[8] H. Wong, W.-C. Ip, Z. Xie, and X. Lui, “Modelling and forecasting by
wavelets, and the application to exchange rates,” Journal of Applied
Statistics, vol. 30, no. 5, pp. 537–553, Jun. 2003, doi:
10.1080/0266476032000053664.
[9] S. Chang, R. Gupta, S. M. Miller, and M. E. Wohar, “Growth volatility and
inequality in the U.S.: A wavelet analysis,” Physica A: Statistical Mechanics
and its Applications, vol. 521, pp. 48–73, May 2019, doi:
10.1016/j.physa.2019.01.024.
[10] F. Prananda, “DEEP LONG SHORT-TERM MEMORY NETWORK FOR
PREDICTING EXCHANGE RATE OF RUPIAH TO OTHER
CURRENCY,” Universitas Gadjah Mada, 2019.
[11] D. M. Q. Nelson, A. C. M. Pereira, and R. A. de Oliveira, “Stock market’s
price movement prediction with LSTM neural networks,” in 2017
International Joint Conference on Neural Networks (IJCNN), May 2017, pp.
1419–1426, doi: 10.1109/IJCNN.2017.7966019.
[12] F. Qian and X. Chen, “Stock Prediction Based on LSTM under Different
Stability,” in 2019 IEEE 4th International Conference on Cloud Computing
and Big Data Analysis (ICCCBDA), Chengdu, China, Apr. 2019, pp. 483–
486, doi: 10.1109/ICCCBDA.2019.8725709.
48
[13] Q. Jiang, C. Tang, C. Chen, X. Wang, and Q. Huang, “Stock Price Forecast
Based on LSTM Neural Network,” in Proceedings of the Twelfth
International Conference on Management Science and Engineering
Management, Cham, 2019, pp. 393–408, doi: 10.1007/978-3-319-93351-
1_32.
[14] H. K. Choi, “Stock Price Correlation Coefficient Prediction with ARIMALSTM Hybrid Model,” arXiv:1808.01560 [cs, q-fin], Aug. 2018, Accessed:
Jul. 22, 2019. [Online]. Available: http://arxiv.org/abs/1808.01560.
[15] C. Chalvatzis and D. Hristu-Varsakelis, “High-performance stock index
trading: making effective use of a deep LSTM neural network,”
arXiv:1902.03125 [cs, q-fin, stat], Feb. 2019, Accessed: Jul. 26, 2019.
[Online]. Available: http://arxiv.org/abs/1902.03125.
[16] A. S. Temür, M. Akgün, and G. Temür, “PREDICTING HOUSING SALES
IN TURKEY USING ARIMA, LSTM AND HYBRID MODELS,” Journal
of Business Economics and Management, vol. 20, no. 5, pp. 920–938, Jul.
2019, doi: 10.3846/jbem.2019.10190.
[17] E. F. Brigham and P. R. Daves, Intermediate Financial Management, 9
edition. Mason, OH: South-Western College Pub, 2006.
[18] N. Kehtarnavaz, Digital Signal Processing System Design: LabVIEW-Based
Hybrid Programming, 2 edition. Amsterdam ; Boston: Academic Press,
2008.
[19] S. C. Nayak, B. B. Misra, and H. S. Behera, “Impact of Data Normalization
on Stock Index Forecasting,” p. 13.
[20] J. Han and M. Kamber, “Data Mining : Concepts and Techniques,” p. 772.
[21] H. S. Hota, R. Handa, and A. K. Shrivas, “Time Series Data Prediction
Using Sliding Window Based RBF Neural Network,” p. 12.
[22] T. G. Dietterich, “Machine Learning for Sequential Data: A Review,” in
Structural, Syntactic, and Statistical Pattern Recognition, vol. 2396, T.
Caelli, A. Amin, R. P. W. Duin, D. de Ridder, and M. Kamel, Eds. Berlin,
Heidelberg: Springer Berlin Heidelberg, 2002, pp. 15–30.
[23] F. Chollet, Deep learning with Python. Shelter Island, New York: Manning
Publications Co, 2018.
[24] D. E. Rumelhart and J. L. McClelland, “Learning Internal Representations
by Error Propagation,” in Parallel Distributed Processing: Explorations in
the Microstructure of Cognition: Foundations, MITP, 1987, pp. 318–362.
[25] F. Ciabuschi and B. Venkateswaran, Neural networks with R: smart models
using CNN, RNN, deep learning, and artificial intelligence principles. 2017.
[26] A. Mittal, “Understanding RNN and LSTM,” Medium, Oct. 12, 2019.
https://towardsdatascience.com/understanding-rnn-and-lstm-f7cdf6dfc14e
(accessed Aug. 19, 2020).
[27] M. Nguyen, “Illustrated Guide to LSTM’s and GRU’s: A step by step
explanation,” Medium, Jul. 10, 2019.
https://towardsdatascience.com/illustrated-guide-to-lstms-and-gru-s-a-stepby-step-explanation-44e9eb85bf21 (accessed Aug. 05, 2019).
49
[28] A. Das, “RNN Simplified- A beginner’s guide,” Medium, Jun. 07, 2019.
https://towardsdatascience.com/rnn-simplified-a-beginners-guidecf3ae1a8895b (accessed Aug. 05, 2019).
[29] J. Qiu, B. Wang, and C. Zhou, “Forecasting stock prices with long-short
term memory neural network based on attention mechanism,” PLOS ONE,
vol. 15, no. 1, p. e0227222, Jan. 2020, doi: 10.1371/journal.pone.0227222.

QR CODE