簡易檢索 / 詳目顯示

研究生: 陳峻廷
Jyung-Ting Chen
論文名稱: 應用差分進化演算法為基礎之限制波茲曼機器於推薦系統
An Application of differential evolution algorithm-based restricted Boltzmann machine to recommendation systems
指導教授: 郭人介
Ren-Jieh Kuo
口試委員: 王孔政
Kung-Jeng Wang
楊朝龍
Chao-Lung Yang
學位類別: 碩士
Master
系所名稱: 管理學院 - 工業管理系
Department of Industrial Management
論文出版年: 2016
畢業學年度: 104
語文別: 英文
論文頁數: 64
中文關鍵詞: 推薦系統協同過濾限制波茲曼機器分群演算法K-Means演算法差分進化演算法
外文關鍵詞: Recommendation systems, Collaborative filtering, Restricted Boltzmann machine, Clustering technique, K-Means algorithm, Differential evolution algorithm
相關次數: 點閱:378下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

全球電子商務規模的規模達到每日數百億美金,帶動全球各大運輸業、品牌業以及全球供應鏈的蓬勃成長。因此,在各大線上交易平台如Amazon.com、淘寶網等積極發展推薦系統的技術來發掘消費者潛在的欲購買物。推薦系統擁有多種不同的演算法,本研究主要使用協同過濾藉利用使用者與提他相似的群體的偏好,預測使用者的個人偏好,進而達到個人化的推薦效果。其優點是不需要去分析顧客所觀看的內容,僅需分析顧客的評分。本研究使用限制波茲曼機器進行協同過濾的預測,並以差分進化演算法最佳化限制波茲曼機器中的參數以提高預測結果。


Global e-commerce has grown very fast, and daily revenue can be up to billion US dollars. Many industries follow the trend and earn lots of money, such as: Amazon and Taobao. To raise revenue, Most of e-commerce’s companies endeavor to develop recommendation system to find out potential customers or stick customers. Recommendation systems can be implemented by lots of methods and the most well-known method is collaborative filtering. It mainly uses similar user’s records to recommend what similar users like. Its advantage is no need to analyze the product’s profile. This study, uses restricted Boltzmann machine (RBM) as collaborative filtering, and use differential evolution algorithm to optimize RBM’s parameter to improve prediction performance. Previously, original RBM use mini-batch gradient descent method.

摘要 I Abstract II 致謝 III Contents IV List of Tables VI L ist of Figures VII Chapter 1 Introduction 1 1.1 Background and Motivation 1 1.2 Research Objectives 2 1.3 Research Scope and Constraints 2 1.4 Research Framework 2 Chapter 2 Literature Review 4 2.1 Recommendation systems 4 2.1.1 Content-based approach 5 2.1.2 Collaborative filtering approach 5 2.1.3 Summary of recommendation systems 6 2.2 Restricted Botlzman Machine (RBM) 7 2.2.1 RBM in Collaborative Filtering 11 2.2.2 Metaheuristic based RBM 12 2.3 Metaheuristics 12 2.3.1 Genetic Algorithm 12 2.3.2 Particle Swarm Optimization Algorithm 13 2.3.3 Differential Evolutionary 13 2.4 Cluster Analysis 14 Chapter 3 Methodology 16 3.1 Methodology Framework 16 3.2 Clustering 16 3.3 Metaheuristic cluster Based RBM algorithm 17 3.4 Differential Evolution Cluster Based RBM algorithm 17 Chapter 4 Experimental Results 22 4.1 Datasets 22 4.2 Performance Measurement 25 4.3 Parameter Setting 25 4.4 Computational Results 30 4.5 Statistical Hypothesis 34 Chapter 5 Conclusions and Future Research 37 5.1 Conclusions 37 5.2 Contributions 38 5.3 Future Research 38 References 40 Appendix 44

Ackley, D. H., Hinton, G. E., & Sejnowski, T. J., "A learning algorithm for boltzmann machines*," Cognitive science, vol. 9, no. 1, pp. 147-169, 1985.
Adomavicius, G. & Tuzhilin, A., "Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions," Knowledge and Data Engineering, IEEE Transactions on, vol. 17, no. 6, pp. 734-749, 2005.
Aggarwal, C. C., Wolf, J. L., Wu, K.-L., & Yu, P. S., "Horting hatches an egg: A new graph-theoretic approach to collaborative filtering," in Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, 1999, pp. 201-212.
Balabanović, M. & Shoham, Y., "Fab: content-based, collaborative recommendation," Communications of the ACM, vol. 40, no. 3, pp. 66-72, 1997.
Bose, I. & Chen, X., "Detecting the migration of mobile service customers using fuzzy clustering," Information & Management, vol. 52, no. 2, pp. 227-238, 2015.
Breese, J. S., Heckerman, D., & Kadie, C., "Empirical analysis of predictive algorithms for collaborative filtering," in Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence, 1998, pp. 43-52.
Burke, R., "Hybrid recommender systems: Survey and experiments," User modeling and user-adapted interaction, vol. 12, no. 4, pp. 331-370, 2002.
Cho, Y. H., Kim, J. K., & Kim, S. H., "A personalized recommender system based on web usage mining and decision tree induction," Expert systems with Applications, vol. 23, no. 3, pp. 329-342, 2002.
Dong, C., Wang, G., Chen, Z., & Yu, Z., "A method of self-adaptive inertia weight for PSO," in Computer Science and Software Engineering, 2008 International Conference on, 2008, pp. 1195-1198.
Dong, J. & Qi, M., "A new algorithm for clustering based on particle swarm optimization and K-means," in Artificial Intelligence and Computational Intelligence, 2009. AICI'09. International Conference on, 2009, pp. 264-268.
Duan, Q., Liao, T. W., & Yi, H., "A comparative study of different local search application strategies in hybrid metaheuristics," Applied Soft Computing, vol. 13, no. 3, pp. 1464-1477, 2013.
Duchi, J., Hazan, E., & Singer, Y., "Adaptive subgradient methods for online learning and stochastic optimization," The Journal of Machine Learning Research, vol. 12, pp. 2121-2159, 2011.
Eberhart, R. C. & Kennedy, J., "A new optimizer using particle swarm theory," in Proceedings of the sixth international symposium on micro machine and human science, 1995, pp. 39-43.
Eberhart, R. C. & Shi, Y., "Parameter selection in particle swarm optimization," in Evolutionary programming VII, 1998, pp. 591-600.
Eiben, A. E. & Smith, J. E., Introduction to evolutionary computing: Springer Science & Business Media, 2003.
Engelbrecht, A. P., Computational intelligence: an introduction: John Wiley & Sons, 2007.
Feng, Z. & Zhang, B., "Fuzzy Clustering Image Segmentation Based on Particle Swarm Optimization," TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 13, no. 1, pp. 128-136, 2015.
Fischer, A. & Igel, C., "Training restricted Boltzmann machines: an introduction," Pattern Recognition, vol. 47, no. 1, pp. 25-39, 2014.
Fukuyama, Y., "Fundamentals of particle swarm optimization techniques," Modern heuristic optimization techniques: theory and applications to power systems, pp. 71-87, 2008.
Georgiev, K. & Nakov, P., "A non-iid framework for collaborative filtering with restricted Boltzmann machines," in Proceedings of the 30th International Conference on Machine Learning (ICML-13), 2013, pp. 1148-1156.
Gong, S., Ye, H., & Tan, H., "Combining memory-based and model-based collaborative filtering in recommender system," in Circuits, Communications and Systems, 2009. PACCS'09. Pacific-Asia Conference on, 2009, pp. 690-693.
Good, N., Schafer, J. B., Konstan, J. A., Borchers, A., Sarwar, B., Herlocker, J., et al., "Combining collaborative filtering with personal agents for better recommendations," in AAAI/IAAI, 1999, pp. 439-446.
Gupta, J. & Gadge, J., "Performance analysis of recommendation system based on collaborative filtering and demographics," in 2015 International Conference on Communication, Information & Computing Technology (ICCICT), 2015, pp. 1-6.
Haiqin, Y., Guang, L., Yuxin, S., Lyu, R., & King, I., "Boosting Response Aware Model-Based Collaborative Filtering," Knowledge and Data Engineering, IEEE Transactions on, vol. 27, no. 8, pp. 2064-2077, 2015.
Hinton, G., "A practical guide to training restricted Boltzmann machines," Momentum, vol. 9, no. 1, p. 926, 2010.
Hinton, G. E., "Training products of experts by minimizing contrastive divergence," Neural computation, vol. 14, no. 8, pp. 1771-1800, 2002.
Hinton, G. E. & Salakhutdinov, R. R., "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
Holland, J. H., "Genetic algorithms," Scientific american, vol. 267, no. 1, pp. 66-72, 1975.
Hopfield, J. J., "Neural networks and physical systems with emergent collective computational abilities," Proceedings of the national academy of sciences, vol. 79, no. 8, pp. 2554-2558, 1982.
Jain, A. K. & Dubes, R. C., Algorithms for clustering data vol. 6: Prentice hall Englewood Cliffs, 1988.
Jain, A. K., Murty, M. N., & Flynn, P. J., "Data clustering: a review," ACM computing surveys (CSUR), vol. 31, no. 3, pp. 264-323, 1999.
Kennedy, J. & Eberhart, R., "Particle swarm optimization," in Neural Networks, 1995. Proceedings., IEEE International Conference on, 1995, pp. 1942-1948.
Kim, K. M., Park, J. J., Song, M. H., Kim, I. C., & Suen, C. Y., "Binary decision tree using genetic algorithm for recognizing defect patterns of cold mill strip," in Advances in Artificial Intelligence, ed: Springer, 2004, pp. 461-466.
Krishna, K. & Murty, M. N., "Genetic K-means algorithm," Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, vol. 29, no. 3, pp. 433-439, 1999.
Kuo, R., Syu, Y., Chen, Z.-Y., & Tien, F.-C., "Integration of particle swarm optimization and genetic algorithm for dynamic clustering," Information Sciences, vol. 195, pp. 124-140, 2012.
Kuremoto, T., Kimura, S., Kobayashi, K., & Obayashi, M., "Time series forecasting using restricted Boltzmann machine," in Emerging Intelligent Computing Technology and Applications, ed: Springer, 2012, pp. 17-22.
Lang, K., "Newsweeder: Learning to filter netnews," in Proceedings of the 12th international conference on machine learning, 1995, pp. 331-339.
Leskovec, J., Singh, A., & Kleinberg, J., "Patterns of influence in a recommendation network," in Advances in Knowledge Discovery and Data Mining, ed: Springer, 2006, pp. 380-389.
Levy, D. M., "Information overload," The Handbook of Information and Computer Ethics, p. 497, 2008.
Li, Z., Li, Y., & Xu, L., "Anomaly intrusion detection method based on K-means clustering algorithm with particle swarm optimization," in Information Technology, Computer Engineering and Management Sciences (ICM), 2011 International Conference on, 2011, pp. 157-161.
Lika, B., Kolomvatsos, K., & Hadjiefthymiades, S., "Facing the cold start problem in recommender systems," Expert Systems with Applications, vol. 41, no. 4, pp. 2065-2073, 2014.
Liu, K., Zhang, L. M., & Sun, Y. W., "Deep Boltzmann Machines Aided Design Based on Genetic Algorithms," in Applied Mechanics and Materials, 2014, pp. 848-851.
Lu, J., Wu, D., Mao, M., Wang, W., & Zhang, G., "Recommender system application developments: A survey," Decision Support Systems, vol. 74, pp. 12-32, 2015.
MacQueen, J., "Some methods for classification and analysis of multivariate observations," in Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, 1967, pp. 281-297.
Michielssen, E., Ranjithan, S., & Mittra, R., "Optimal multilayer filter design using real coded genetic algorithms," IEE Proceedings J (Optoelectronics), vol. 139, no. 6, pp. 413-420, 1992.
Mobasher, B., Cooley, R., & Srivastava, J., "Automatic personalization based on web usage mining," Communications of the ACM, vol. 43, no. 8, pp. 142-151, 2000.
Nikfarjam, A., Sarker, A., O’Connor, K., Ginn, R., & Gonzalez, G., "Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features," Journal of the American Medical Informatics Association, p. ocu041, 2015.
Olafsson, S., "Metaheuristics," Handbooks in operations research and management science, vol. 13, pp. 633-654, 2006.
Pascanu, R., Mikolov, T., & Bengio, Y., "On the difficulty of training recurrent neural networks," arXiv preprint arXiv:1211.5063, 2012.
Pazzani, M. & Billsus, D., "Learning and revising user profiles: The identification of interesting web sites," Machine learning, vol. 27, no. 3, pp. 313-331, 1997.
Popescul, A., Pennock, D. M., & Lawrence, S., "Probabilistic models for unified collaborative and content-based recommendation in sparse-data environments," in Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence, 2001, pp. 437-444.
Rajaraman, A. & Ullman, J. D., Minig of Massive Datasets. Cambridge: Cambridge University Press, 2012.
Roh, T. H., Oh, K. J., & Han, I., "The collaborative filtering recommendation based on SOM cluster-indexing CBR," Expert Systems with Applications, vol. 25, no. 3, pp. 413-423, 2003.
Salakhutdinov, R., Mnih, A., & Hinton, G., "Restricted Boltzmann machines for collaborative filtering," in Proceedings of the 24th international conference on Machine learning, 2007, pp. 791-798.
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J., "Item-based collaborative filtering recommendation algorithms," in Proceedings of the 10th international conference on World Wide Web, 2001, pp. 285-295.
Schafer, J. B., Konstan, J., & Riedl, J., "Recommender systems in e-commerce," in Proceedings of the 1st ACM conference on Electronic commerce, 1999, pp. 158-166.
Schein, A. I., Popescul, A., Ungar, L. H., & Pennock, D. M., "Methods and metrics for cold-start recommendations," in Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, 2002, pp. 253-260.
Storn, R. & Price, K., Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces vol. 3: ICSI Berkeley, 1995.
Su, H., Zheng, K., Huang, J., Jeung, H., Chen, L., & Zhou, X., "Crowdplanner: A crowd-based route recommendation system," in Data Engineering (ICDE), 2014 IEEE 30th International Conference on, 2014, pp. 1144-1155.
Su, X. & Khoshgoftaar, T. M., "A survey of collaborative filtering techniques," Advances in artificial intelligence, vol. 2009, p. 4, 2009.
Talbi, E.-G., Metaheuristics: from design to implementation vol. 74: John Wiley & Sons, 2009.
Tan, P.-N., Steinbach, M., & Kumar, V., "Introduction to data mining," in Library of Congress, 2006.
Van der Merwe, D. & Engelbrecht, A. P., "Data clustering using particle swarm optimization," in Evolutionary Computation, 2003. CEC'03. The 2003 Congress on, 2003, pp. 215-220.
Vesterstrm, J. & Thomsen, R., "A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems," in Evolutionary Computation, 2004. CEC2004. Congress on, 2004, pp. 1980-1987.
Wang, J., Wang, W., Wang, R., & Gao, W., "Image classification using RBM to encode local descriptors with group sparse learning," in Image Processing (ICIP), 2015 IEEE International Conference on, 2015, pp. 912-916.
Xie, P., Deng, Y., & Xing, E., "Diversifying restricted boltzmann machine for document modeling," in Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, pp. 1315-1324.
Yang, X.-S., Nature-inspired metaheuristic algorithms: Luniver press, 2010.
Yoshida, T., Irie, G., Arai, H., & Taniguchi, Y., "Towards semantic and affective content-based video recommendation," in Multimedia and Expo Workshops (ICMEW), 2013 IEEE International Conference on, 2013, pp. 1-6.
Yu, K., Schwaighofer, A., Tresp, V., Xu, X., & Kriegel, H.-P., "Probabilistic memory-based collaborative filtering," Knowledge and Data Engineering, IEEE Transactions on, vol. 16, no. 1, pp. 56-69, 2004.
Zhang, Z.-K., Liu, C., Zhang, Y.-C., & Zhou, T., "Solving the cold-start problem in recommender systems with social tags," EPL (Europhysics Letters), vol. 92, no. 2, p. 28002, 2010.
Zhaocai, M., Yi, Y., Fei, W., Caihong, L., & Lian, L., "The SOM Based Improved K-Means Clustering Collaborative Filtering Algorithm in TV Recommendation System," in 2014 Second International Conference on Advanced Cloud and Big Data (CBD), 2014, pp. 288-295.

無法下載圖示 全文公開日期 2021/06/23 (校內網路)
全文公開日期 本全文未授權公開 (校外網路)
全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
QR CODE