簡易檢索 / 詳目顯示

研究生: 李宥良
You-Liang - Li
論文名稱: 應用萬用演算法為基礎之改良漸進式最近鄰距演算法於協同過濾推薦系統研究
Applying Metaheuristic-based Boosted Incremental K-Nearest-Neighborhood Based to Collaborative Filtering Method for Recommendation Systems
指導教授: 郭人介
Ren-Jieh Kuo
口試委員: 王孔政
Kung-Jeng Wang
楊朝龍
Chao-Lung Yang
學位類別: 碩士
Master
系所名稱: 管理學院 - 工業管理系
Department of Industrial Management
論文出版年: 2017
畢業學年度: 105
語文別: 英文
論文頁數: 65
中文關鍵詞: 推薦系統協同過濾萬用演算法最近鄰居值演算法改良漸進式最近鄰居值演算法
外文關鍵詞: Recommendation systems, Collaborative filtering, Metaheuristic, K-nearest-neighbors algorithm, Boosting the K-nearest-neighbors based increment
相關次數: 點閱:307下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 全球電子商務規模的規模達到每日數百億美金,帶動全球各大運輸業、品牌業以及全球供應鏈的蓬勃成長。因此,在各大線上交易平台如Amazon.com、淘寶網等積極發展推薦系統的技術來發掘消費者潛在的欲購買物。推薦系統擁有多種不同的演算法,本研究主要使用協同過濾藉利用使用者與提他相似的群體的偏好,預測使用者的個人偏好,進而達到個人化的推薦效果。其優點是不需要去分析顧客所觀看的內容,僅需分析顧客的評分。本研究使用改良漸進式最近鄰居值演算法進行協同過濾的預測,並以萬用演算法自動最佳化改良漸進式K鄰近值演算法中的參數以提高預測結果。此外,在改良漸進式最近鄰居值演算法中,將過去每新增一筆資料即進行更新的方法改良為批次進行更新,並期望能夠增加演算法的效率以及準確度。
    為了驗證本研究所提出的整合預測模型是否準確,本研究使用K-fold交叉驗證,將資料分成五等分,以驗證在五個等分的資料集都能較好的預測結果。而所使用的資料集包含Movielens 100K、Movielens 1M、 Books-Crossing 及 Restaurants共四個資料集。實驗證明,以萬用演算法為基礎的改良漸進式最近鄰居值演算法,相對於基本最近鄰居值演算法以及原本的改良漸進式最近鄰居值演算法均有明顯差異。


    Global e-commerce has grown very fast, and daily revenue can be up to billion US dollars. Many industries follow the trend and earn lots of money, such as: Amazon and Taobao. To raise revenue, most of e-commerce companies endeavor to develop recommendation system in order to find out potential customers or stick customers. Recommendation systems can be implemented by some methods and the most well-known method is collaborative filtering. It mainly uses similar user’s records to recommend what similar users like. Its advantage is no need to analyze the product’s profile. This study uses the boosting the K-nearest-neighbors based incremental collaborative filtering method (BIKNN) as collaborative filtering, and uses metaheuristics to optimize BIKNN’s parameters to improve prediction performance. Besides, this study uses batch updating method instead of incremental updating method to reduce the computational time.
    To validate the proposed algorithm, this study conducts K-fold cross validation. Four benchmark dataset are used in the experiment: Movielens 100K, Movielens 1M, Books-crossing and Restaurants. The experimental results indicate that the three metaheuristic-based BIKNN algorithms are different and better than basic KNN and original BIKNN.

    摘要 I ABSTRACT II 致謝 III CONTENTS IV LIST OF TABLES VI LIST OF FIGURES VII CHAPTER 1 INTRODUCTION 1 1.1 Research background and Motivation 1 1.2 Research objectives 3 1.3 Research scope and constraints 3 1.4 Research organization 3 CHAPTER 2 LITERATURE REVIEW 5 2.1 Recommendation Systems 5 2.1.1 Content-based filtering 7 2.1.2 Collaborative filtering 7 2.1.3 Summary of recommendation systems 9 2.2 Boosting the K -Nearest-Neighbors Based Incremental Collaborative Filtering (BIKNN) 11 2.2.1 An overview of K -nearest-neighbors algorithm 11 2.2.2 An overview of boosting incremental K -nearest-neighbors algorithm (BIKNN) 12 2.3 Metaheuristics 17 2.3.1 Genetic algorithm (GA) 17 2.3.2 Particle swarm optimization (PSO) algorithm 18 2.3.3 Differential evolutionary algorithm 18 CHAPTER 3 METHODOLOGY 20 3.1 Methodology Framework 20 3.2 Metaheuristic-Based BIKNN algorithms 20 3.3 Genetic Algorithm-Based BIKNN algorithm 21 26 3.4 Particle Swarm Optimization Algorithm Based BIKNN algorithm 27 3.5 Differential Evolution Algorithm Based BIKNN algorithm 32 CHAPTER 4 COMPUTATIONAL RESULTS 37 4.1 Datasets 37 4.2 Performance Measurement 40 4.3 Parameter Setting 40 4.4 Computational Results 46 4.5 Statistical Hypothesis Testing 51 CHAPTER 5 CONCLUSIONS AND FUTURE RESEARCH 54 5.1 Conclusions 54 5.2 Contributions 55 5.3 Future Research 55 REFERENCES 57 APPENDIX 63

    Adomavicius, G. & Tuzhilin, A., "Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions," Knowledge and Data Engineering, IEEE Transactions on, vol. 17, no. 6, pp. 734-749, 2005.
    Aggarwal, C. C., Wolf, J. L., Wu, K.-L., & Yu, P. S., "Horting hatches an egg: A new graph-theoretic approach to collaborative filtering," in Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, 1999, pp. 201-212.
    Alpaydin, E., "Voting over multiple condensed nearest neighbors," Artificial Intelligence Review, vol. 11, no. 1-5, pp. 115-132, 1997.
    Bailey, T. & Jain, A., "A Note on Distance-Weighted $ k $-Nearest Neighbor Rules," IEEE Transactions on Systems, Man, and Cybernetics, no. 4, pp. 311-313, 1978.
    Balabanović, M. & Shoham, Y., "Fab: content-based, collaborative recommendation," Communications of the ACM, vol. 40, no. 3, pp. 66-72, 1997.
    Bell, R. M. & Koren, Y., "Improved neighborhood-based collaborative filtering," in KDD cup and workshop at the 13th ACM SIGKDD international conference on knowledge discovery and data mining, 2007, pp. 7-14.
    Breese, J. S., Heckerman, D., & Kadie, C., "Empirical analysis of predictive algorithms for collaborative filtering," in Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence, 1998, pp. 43-52.
    Bremner, D., Demaine, E., Erickson, J., Iacono, J., Langerman, "Output-sensitive algorithms for computing nearest-neighbour decision boundaries," Discrete & Computational Geometry, vol. 33, no. 4, pp. 593-604, 2005.
    Burke, R., "Hybrid recommender systems: Survey and experiments," User modeling and user-adapted interaction, vol. 12, no. 4, pp. 331-370, 2002.
    Chiu, C. M., Wang, E. T., Fang, Y. H., & Huang, H. Y., "Understanding customers' repeat purchase intentions in B2C e‐commerce: the roles of utilitarian value, hedonic value and perceived risk," Information Systems Journal, vol. 24, no. 1, pp. 85-114, 2014.
    Cho, Y. H., Kim, J. K., & Kim, S. H., "A personalized recommender system based on web usage mining and decision tree induction," Expert systems with Applications, vol. 23, no. 3, pp. 329-342, 2002.
    Cordeau, J.-F., Gendreau, M., Laporte, G., Potvin, J.-Y., & Semet, F., "A guide to vehicle routing heuristics," Journal of the Operational Research society, pp. 512-522, 2002.
    Deb, A., Roy, J. S., & Gupta, B., "Performance comparison of differential evolution, particle swarm optimization and genetic algorithm in the design of circularly polarized microstrip antennas," IEEE Transactions on Antennas and Propagation, vol. 62, no. 8, pp. 3920-3928, 2014.
    Dong, C., Wang, G., Chen, Z., & Yu, Z., "A method of self-adaptive inertia weight for PSO," in Computer Science and Software Engineering, 2008 International Conference on, 2008, pp. 1195-1198.
    Dong, J. & Qi, M., "A new algorithm for clustering based on particle swarm optimization and K-means," in Artificial Intelligence and Computational Intelligence, 2009. AICI'09. International Conference on, 2009, pp. 264-268.
    Duan, Q., Liao, T. W., & Yi, H., "A comparative study of different local search application strategies in hybrid metaheuristics," Applied Soft Computing, vol. 13, no. 3, pp. 1464-1477, 2013.
    Eberhart, R. C. & Kennedy, J., "A new optimizer using particle swarm theory," in Proceedings of the sixth international symposium on micro machine and human science, 1995, pp. 39-43.
    Eberhart, R. C. & Shi, Y., "Parameter selection in particle swarm optimization," in Evolutionary programming VII, 1998, pp. 591-600.
    Eiben, A. E. & Smith, J. E., Introduction to evolutionary computing: Springer Science & Business Media, 2003.
    Engelbrecht, A. P., Computational intelligence: an introduction: John Wiley & Sons, 2007.
    Fukuyama, Y., "Fundamentals of particle swarm optimization techniques," Modern heuristic optimization techniques: theory and applications to power systems, pp. 71-87, 2008.
    Gong, S., Ye, H., & Tan, H., "Combining memory-based and model-based collaborative filtering in recommender system," in Circuits, Communications and Systems, 2009. PACCS'09. Pacific-Asia Conference on, 2009, pp. 690-693.
    Good, N., Schafer, J. B., Konstan, J. A., Borchers, A., Sarwar, B., Herlocker, J., et al., "Combining collaborative filtering with personal agents for better recommendations," in AAAI/IAAI, 1999, pp. 439-446.
    Guo, G., Wang, H., Bell, D., Bi, Y., & Greer, K., "An kNN model-based approach and its application in text categorization," in Computational Linguistics and Intelligent Text Processing, ed: Springer, 2004, pp. 559-570.
    Gupta, J. & Gadge, J., "Performance analysis of recommendation system based on collaborative filtering and demographics," in Communication, Information & Computing Technology (ICCICT), 2015 International Conference on, 2015, pp. 1-6.
    Haiqin, Y., Guang, L., Yuxin, S., Lyu, R., & King, I., "Boosting Response Aware Model-Based Collaborative Filtering," Knowledge and Data Engineering, IEEE Transactions on, vol. 27, no. 8, pp. 2064-2077, 2015.
    Hill, W., Stead, L., Rosenstein, M., & Furnas, G., "Recommending and evaluating choices in a virtual community of use," in Proceedings of the SIGCHI conference on Human factors in computing systems, 1995, pp. 194-201.
    Hjaltason, G. R. & Samet, H., "Distance browsing in spatial databases," ACM Transactions on Database Systems (TODS), vol. 24, no. 2, pp. 265-318, 1999.
    Holland, J. H., "Genetic algorithms," Scientific american, vol. 267, no. 1, pp. 66-72, 1975.
    Kim, H.-W. & Gupta, S., "A comparison of purchase decision calculus between potential and repeat customers of an online store," Decision Support Systems, vol. 47, no. 4, pp. 477-487, 2009.
    Kim, J., Lee, D., & Chung, K.-Y., "Item recommendation based on context-aware model for personalized u-healthcare service," Multimedia Tools and Applications, vol. 71, no. 2, pp. 855-872, 2014.
    Konstan, J. A., Miller, B. N., Maltz, D., Herlocker, J. L., Gordon, L. R., & Riedl, J., "GroupLens: applying collaborative filtering to Usenet news," Communications of the ACM, vol. 40, no. 3, pp. 77-87, 1997.
    Krishna, K. & Murty, M. N., "Genetic K-means algorithm," Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, vol. 29, no. 3, pp. 433-439, 1999.
    Lang, K., "Newsweeder: Learning to filter netnews," in Proceedings of the 12th international conference on machine learning, 1995, pp. 331-339.
    Leskovec, J., Singh, A., & Kleinberg, J., "Patterns of influence in a recommendation network," in Advances in Knowledge Discovery and Data Mining, ed: Springer, 2006, pp. 380-389.
    Levy, D. M., "Information overload," The Handbook of Information and Computer Ethics, p. 497, 2008.
    Li, Z., Li, Y., & Xu, L., "Anomaly intrusion detection method based on K-means clustering algorithm with particle swarm optimization," in Information Technology, Computer Engineering and Management Sciences (ICM), 2011 International Conference on, 2011, pp. 157-161.
    Lika, B., Kolomvatsos, K., & Hadjiefthymiades, S., "Facing the cold start problem in recommender systems," Expert Systems with Applications, vol. 41, no. 4, pp. 2065-2073, 2014.
    Luo, X., Xia, Y., & Zhu, Q., "Incremental collaborative filtering recommender based on regularized matrix factorization," Knowledge-Based Systems, vol. 27, pp. 271-280, 2012.
    Luo, X., Xia, Y., Zhu, Q., & Li, Y., "Boosting the K-Nearest-Neighborhood based incremental collaborative filtering," Knowledge-Based Systems, vol. 53, pp. 90-99, 2013.
    Ma, Z., Yang, Y., Wang, F., Li, C., & Li, L., "The SOM Based Improved K-Means Clustering Collaborative Filtering Algorithm in TV Recommendation System," in Advanced Cloud and Big Data (CBD), 2014 Second International Conference on, 2014, pp. 288-295.
    Madavan, N. K. & Biegel, B. A., "Multiobjective optimization using a Pareto differential evolution approach," 2002.
    Meng, X., Wei, F., Liu, X., Zhou, M., Xu, G., & Wang, H., "Cross-lingual mixture model for sentiment classification," in Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, 2012, pp. 572-581.
    Michielssen, E., Ranjithan, S., & Mittra, R., "Optimal multilayer filter design using real coded genetic algorithms," IEE Proceedings J (Optoelectronics), vol. 139, no. 6, pp. 413-420, 1992.
    Mobasher, B., Cooley, R., & Srivastava, J., "Automatic personalization based on web usage mining," Communications of the ACM, vol. 43, no. 8, pp. 142-151, 2000.
    Pazzani, M. & Billsus, D., "Learning and revising user profiles: The identification of interesting web sites," Machine learning, vol. 27, no. 3, pp. 313-331, 1997.
    Popescul, A., Pennock, D. M., & Lawrence, S., "Probabilistic models for unified collaborative and content-based recommendation in sparse-data environments," in Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence, 2001, pp. 437-444.
    Rajaraman, A. & Ullman, J. D., Minig of Massive Datasets. Cambridge: Cambridge University Press, 2012.
    Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., & Riedl, J., "GroupLens: an open architecture for collaborative filtering of netnews," in Proceedings of the 1994 ACM conference on Computer supported cooperative work, 1994, pp. 175-186.
    Roh, T. H., Oh, K. J., & Han, I., "The collaborative filtering recommendation based on SOM cluster-indexing CBR," Expert Systems with Applications, vol. 25, no. 3, pp. 413-423, 2003.
    Salakhutdinov, R., Mnih, A., & Hinton, G., "Restricted Boltzmann machines for collaborative filtering," in Proceedings of the 24th international conference on Machine learning, 2007, pp. 791-798.
    Sarwar, B., Karypis, G., Konstan, J., & Riedl, J., "Item-based collaborative filtering recommendation algorithms," in Proceedings of the 10th international conference on World Wide Web, 2001, pp. 285-295.
    Schafer, J. B., Frankowski, D., Herlocker, J., & Sen, S., "Collaborative filtering recommender systems," in The adaptive web, 2007, pp. 291-324.
    Schafer, J. B., Konstan, J., & Riedl, J., "Recommender systems in e-commerce," in Proceedings of the 1st ACM conference on Electronic commerce, 1999, pp. 158-166.
    Schein, A. I., Popescul, A., Ungar, L. H., & Pennock, D. M., "Methods and metrics for cold-start recommendations," in Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, 2002, pp. 253-260.
    Shi, Y. & Eberhart, R., "A modified particle swarm optimizer," in Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence., The 1998 IEEE International Conference on, 1998, pp. 69-73.
    Storn, R. & Price, K., Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces vol. 3: ICSI Berkeley, 1995.
    Su, H., Zheng, K., Huang, J., Jeung, H., Chen, L., & Zhou, X., "Crowdplanner: A crowd-based route recommendation system," in Data Engineering (ICDE), 2014 IEEE 30th International Conference on, 2014, pp. 1144-1155.
    Su, X. & Khoshgoftaar, T. M., "A survey of collaborative filtering techniques," Advances in artificial intelligence, vol. 2009, p. 4, 2009.
    Talbi, E.-G., Metaheuristics: from design to implementation vol. 74: John Wiley & Sons, 2009.
    Van der Merwe, D. & Engelbrecht, A. P., "Data clustering using particle swarm optimization," in Evolutionary Computation, 2003. CEC'03. The 2003 Congress on, 2003, pp. 215-220.
    Vesterstrm, J. & Thomsen, R., "A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems," in Evolutionary Computation, 2004. CEC2004. Congress on, 2004, pp. 1980-1987.
    Vesterstrom, J. & Thomsen, R., "A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems," in Evolutionary Computation, 2004. CEC2004. Congress on, 2004, pp. 1980-1987.
    Wang, Y. S., "Assessing e‐commerce systems success: a respecification and validation of the DeLone and McLean model of IS success," Information Systems Journal, vol. 18, no. 5, pp. 529-557, 2008.
    Yoshida, T., Irie, G., Arai, H., & Taniguchi, Y., "Towards semantic and affective content-based video recommendation," in Multimedia and Expo Workshops (ICMEW), 2013 IEEE International Conference on, 2013, pp. 1-6.
    Yu, K., Schwaighofer, A., Tresp, V., Xu, X., & Kriegel, H.-P., "Probabilistic memory-based collaborative filtering," Knowledge and Data Engineering, IEEE Transactions on, vol. 16, no. 1, pp. 56-69, 2004.
    Zeng, Y., Yang, Y., & Zhao, L., "Pseudo nearest neighbor rule for pattern classification," Expert Systems with Applications, vol. 36, no. 2, pp. 3587-3595, 2009.
    Zhang, Z.-K., Liu, C., Zhang, Y.-C., & Zhou, T., "Solving the cold-start problem in recommender systems with social tags," EPL (Europhysics Letters), vol. 92, no. 2, p. 28002, 2010.

    無法下載圖示 全文公開日期 2022/01/17 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE