簡易檢索 / 詳目顯示

研究生: 張凱棠
kai-Tang Chang
論文名稱: 應用萬用演算法為基礎之核心直覺模糊c-means演算法於顧客區隔分析
Application of Metaheuristic Based Kernel Intuitionistic Fuzzy c-means Algorithms to Customer Segmentation
指導教授: 郭人介
Ren-Jieh Kuo
口試委員: 王孔政
Kung-Jeng Wang
楊朝龍
Chao-Lung Yang
學位類別: 碩士
Master
系所名稱: 管理學院 - 工業管理系
Department of Industrial Management
論文出版年: 2016
畢業學年度: 104
語文別: 英文
論文頁數: 118
中文關鍵詞: 分群分析萬用啟發式演算法實數型基因演算法粒子群演算法人工蜂群演算法核心函數直覺模糊集合顧客區隔
外文關鍵詞: Clustering analysis, Metaheuristics, Particle swarm optimization, Genetic algorithm, Artificial bee colony algorithm, Intuitionistic fuzzy set, Kernel function, Fuzzy c-means, Customer segmentation
相關次數: 點閱:241下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 隨著科技進步,許多企業開始會為顧客進行分群,進行精準行銷,因此,分群分析在資料探勘中是一個非常重要的技術,近年來也常被用來處理很多類別型資料。然而,沒有任何一個分群演算法可以對所有的資料集進行正確的分群。因此,本研究提出萬用演算法結合核心直覺模糊c-means演算法 (kernel intuitionistic fuzzy c-means, KIFCM)的新分群演算法。核心直覺模糊c-means演算法結合了直覺模糊集合( intuitionistic fuzzy sets, IFSs) 與核心模糊c-means演算法(kernel-based fuzzy c-means, KFCM)。在本研究中,將會應用三種萬用演算法來改善分群的結果,分別是粒子群演算法、人工蜂群演算法及實數型基因演算法。因此,本研究提出三種分群演算法,包括粒子群演算法為基礎之核心直覺模糊c-means演算法(PSO-KIFCM)、實數型基因演算法為基礎之核心直覺模糊c-means演算法(GA-KIFCM)及人工蜂群演算法為基礎之核心直覺模糊c-means演算法(ABC-KIFCM)。接下來,將它們對Balance scale、Balloons、Lymphography、Car Evaluation、Soybean (small)、Solar flare、Lenses、Monks、Tic-tac-toe endgame 及Hayes-roth資料集的分群結果和其他分群演算法進行比較,分群演算法有K-means分群演算法、模糊c-means演算法、模糊c-means演算法、模糊K-mode演算法及直覺核心模糊c-means演算法。實驗結果顯示PSO-KIFCM演算法在較多的資料集有最好的表現。此外,ABC-KIFCM演算法在進行 App 顧客區隔分析上有較好的表現,進而幫助企業做更精準的行銷。


    Recently, many companies use clustering analysis to segment customers, and more and more studies focus on categorical data. However, there is no clustering method which can cluster all different datasets correctly. Therefore, this study intends to propose a model which is hybrid of metaheuristics and kernel intuitionistic fuzzy c-means (KIFCM) algorithm. The KIFCM algorithm combines Atanassov’s intuitionistic fuzzy set (IFSs) with kernel-based fuzzy c-means (KFCM). In this study, three metaheuristics are applied to improve the clustering results, which are particle swarm optimization (PSO) algorithm, genetic algorithm (GA), and artificial bee colony (ABC) algorithm. Therefore, there are three clustering algorithms proposed including PSO-based KIFCM (PSO-KIFCM), ABC-based KIFCM (ABC-KIFCM) and real-coded GA-based KIFCM (GA-KIFCM. Their results are compared with those of other clustering algorithms, such as K-means, fuzzy c-means (FCM), intuitionistic fuzzy c-means (IFCM), fuzzy K-mode, and KIFCM algorithms using Balance scale, Balloons, Lymphography, Car Evaluation, Soybean (small), Solar flare, Lenses, Monks, Tic-tac-toe endgame and Hayes-roth datasets. From the experimental results, the proposed PSO-KIFCM algorithm has the best performance than the other clustering algorithms in six benchmark datasets. Furthermore, ABC-KIFCM algorithm can stably obtain the optimal solution in App user data. Thus, ABC-KIFCM algorithm is applied to do the App customer segmentation and help the company conduct audience targeting.

    摘要 I ABSTRACT II ACKNOWLEDGEMENTS III CONTENTS IV LISTS OF TABLES VI LISTS OF FIGURES VII CHAPTER 1 INTRODUCTION 1 1.1 Research Background 1 1.2 Research Objectives 3 1.3 Research Scope and Constraints 3 1.4 Research Framework 3 CHAPTER 2 LITERATURE REVIEW 5 2.1 Cluster Analysis 5 2.2 Fuzzy c-means algorithm using cosine correlation 7 2.2.1 Genetic algorithm based fuzzy c-means algorithm 9 2.2.2 Artificial bee colony based algorithm fuzzy c-means algorithm 10 2.2.3 Particle swarm optimization algorithm based fuzzy c-means algorithm 10 2.3 Intuitionistic fuzzy c-means algorithm 11 2.3.1 Fuzzy theory and intuition 11 2.3.2 Intuitionistic fuzzy c-means algorithm 13 2.4 Kernel intuitionistic fuzzy c-means clustering algorithm 14 CHAPTER 3 METHODOLOGY 18 3.1 Methodology Framework 18 3.2 Data Preprocessing 19 3.3 Metaheuristic Algorithm Based KIFCM algorithm 19 CHAPTER 4 EXPERIMENTAL RESULTS 29 4.1 Datasets 29 4.2 Performance Measurement 30 4.3 Parameters Determination 30 4.3.1 Parameters for Balloons Dataset 31 4.4 Computation Results 35 4.5 Statistical Hypothesis 40 CHAPTER 5 CASE STUDY 44 5.1 Dataset 44 5.2 Dataset Preprocessing 46 5.3 Analysis 47 CHAPTER 6 CONCLUSIONS 52 6.1 Conclusions 52 6.2 Contributions 52 6.3 Future Research 53 REFERENCES 54 APPENDIX 59

    Ahmadyfard, A. & Modares, H., "Combining PSO and k-means to enhance data clustering," in Telecommunications, 2008. IST 2008. International Symposium on, 2008, pp. 688-691.
    Akay, B. & Karaboga, D., "Parameter tuning for the artificial bee colony algorithm," in Computational collective intelligence. Semantic web, social networks and multiagent systems, ed: Springer, 2009, pp. 608-619.
    Akay, B. & Karaboga, D., "A modified artificial bee colony algorithm for real-parameter optimization," Information Sciences, vol. 192, pp. 120-142, 2012.
    Atanassov, K. T., "Intuitionistic fuzzy sets," Fuzzy sets and Systems, vol. 20, no. 1, pp. 87-96, 1986.
    Atanassov, K. T., "Intuitionistic fuzzy sets." Intuitionistic Fuzzy Sets. Physica-Verlag HD, 1999. 1-137.
    Babu, G. P. & Murty, M. N., "A near-optimal initial seed value selection in k-means means algorithm using a genetic algorithm," Pattern Recognition Letters, vol. 14, no. 10, pp. 763-769, 1993.
    Bezdek, J. C., Pattern recognition with fuzzy objective function algorithms: Kluwer Academic Publishers, 1981.
    Boran, F. E., "An integrated intuitionistic fuzzy multi criteria decision making method for facility location selection," Mathematical and Computational Applications, vol. 16, no. 2, p. 487, 2011.
    Çoker, D., "An introduction to intuitionistic fuzzy topological spaces," Fuzzy sets and systems, vol. 88, no. 1, pp. 81-89, 1997.
    Dogan, B. & Korurek, M., "ECG beat clustering using fuzzy c-means algorithm and particle swarm optimization," in Signal Processing and Communications Applications Conference (SIU), 2012 20th, 2012, pp. 1-4.
    Dong, C., Wang, G., Chen, Z., & Yu, Z., "A method of self-adaptive inertia weight for PSO," in Computer Science and Software Engineering, 2008 International Conference on, 2008, pp. 1195-1198.
    Dunn, J. C., "A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters," 1973.
    Eberhart, R. C. & Kennedy, J., "A new optimizer using particle swarm theory," in Proceedings of the sixth international symposium on micro machine and human science, 1995, pp. 39-43.
    Eberhart, R. C. & Shi, Y., "Parameter selection in particle swarm optimization," in Evolutionary programming VII, 1998, pp. 591-600.
    Eberhart, R. C. & Shi, Y., "Particle swarm optimization: developments, applications and resources," in Evolutionary Computation, 2001. Proceedings of the 2001 Congress on, 2001, pp. 81-86.
    Egan, M. A., "Locating clusters in noisy data: a genetic fuzzy c-means clustering algorithm," in Fuzzy Information Processing Society - NAFIPS, 1998 Conference of the North American, 1998, pp. 178-182.
    Egan, M. A., Krishnamoorthy, M., & Rajan, K., "Comparative study of a genetic fuzzy c-means algorithm and a validity guided fuzzy c-means algorithm for locating clusters in noisy data," in Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence., The 1998 IEEE International Conference on, 1998, pp. 440-445.
    Fan, J., Han, M., & Wang, J., "Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation," Pattern Recognition, vol. 42, no. 11, pp. 2527-2540, 2009.
    Forgy, E. W., "Cluster analysis of multivariate data: efficiency versus interpretability of classifications," Biometrics, vol. 21, pp. 768-769, 1965.
    Gan, G., Ma, C., & Wu, J., Data clustering: theory, algorithms, and applications vol. 20: Siam, 2007.
    Gorzałczany, M. B., "A method of inference in approximate reasoning based on interval-valued fuzzy sets," Fuzzy sets and systems, vol. 21, no. 1, pp. 1-17, 1987.
    Graves, D. & Pedrycz, W., "Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study," Fuzzy sets and systems, vol. 161, no. 4, pp. 522-543, 2010.
    Jain, A. K. & Dubes, R. C., Algorithms for clustering data vol. 6: Prentice hall Englewood Cliffs, 1988.
    Jain, A. K., Murty, M. N., & Flynn, P. J., "Data clustering: a review," ACM computing surveys (CSUR), vol. 31, no. 3, pp. 264-323, 1999.
    Jiang, B., Wang, N., & Wang, L., "Parameter identification for solid oxide fuel cells using cooperative barebone particle swarm optimization with hybrid learning," International Journal of Hydrogen Energy, vol. 39, no. 1, pp. 532-542, 2014.
    Kackar, R. N., "Off-line quality control, parameter design, and the Taguchi method," Journal of Quality Technology, vol. 17, pp. 176-188, 1985.
    Kanade, P. M. & Hall, L. O., "Fuzzy ants as a clustering concept," in Fuzzy Information Processing Society, 2003. NAFIPS 2003. 22nd International Conference of the North American, 2003, pp. 227-232.
    Karaboga, D., "An idea based on honey bee swarm for numerical optimization," Technical report-tr06, Erciyes university, engineering faculty, computer engineering department2005.
    Karaboga, D. & Basturk, B., "On the performance of artificial bee colony (ABC) algorithm," Applied soft computing, vol. 8, no. 1, pp. 687-697, 2008.
    Kaur, P., Soni, A. K., & Gosain, A., "Robust Intuitionistic Fuzzy C-means clustering for linearly and nonlinearly separable data," in Image Information Processing (ICIIP), 2011 International Conference on, 2011, pp. 1-6.
    Kohonen, Teuvo. "A simple paradigm for the self-organized formation of structured feature maps." Competition and cooperation in neural nets. Springer Berlin Heidelberg, 1982. 248-266.
    Krishna, K. & Murty, M. N., "Genetic K-means algorithm," Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, vol. 29, no. 3, pp. 433-439, 1999.
    Kuo, R., "A sales forecasting system based on fuzzy neural network with initial weights generated by genetic algorithm," European Journal of Operational Research, vol. 129, no. 3, pp. 496-517, 2001.
    Kuo, R., Wang, H., Hu, T.-L., & Chou, S., "Application of ant K-means on clustering analysis," Computers & Mathematics with Applications, vol. 50, no. 10, pp. 1709-1724, 2005.
    Kuo, R., Zulvia, F. E., & Suryadi, K., "Hybrid particle swarm optimization with genetic algorithm for solving capacitated vehicle routing problem with fuzzy demand–A case study on garbage collection system," Applied Mathematics and Computation, vol. 219, no. 5, pp. 2574-2588, 2012.
    Laszlo, M. & Mukherjee, S., "A genetic algorithm that exchanges neighboring centers for k-means clustering," Pattern Recognition Letters, vol. 28, no. 16, pp. 2359-2366, 2007.
    Li, D.-F., "Multiattribute decision making models and methods using intuitionistic fuzzy sets," Journal of computer and System Sciences, vol. 70, no. 1, pp. 73-85, 2005.
    Li, Z., Li, Y., & Xu, L., "Anomaly intrusion detection method based on K-means clustering algorithm with particle swarm optimization," in Information Technology, Computer Engineering and Management Sciences (ICM), 2011 International Conference on, 2011, pp. 157-161.
    Lin, K.-P., "A Novel Evolutionary Kernel Intuitionistic Fuzzy-means Clustering Algorithm," Fuzzy Systems, IEEE Transactions on, vol. 22, no. 5, pp. 1074-1087, 2014.
    Lin, Z.C., "Application of Hybrid of Meta-heuristics and Kernel Intuitionistic Fuzzy c-means Algorithm to Cluster Analysis," National Taiwan University of Science and Technology, 2014.

    Liu, S.-h. & Hou, H.-f., "A combination of mixture Genetic Algorithm and Fuzzy C-means Clustering Algorithm," in IT in Medicine & Education, 2009. ITIME '09. IEEE International Symposium on, 2009, pp. 254-258.
    MacQueen, J., "Some methods for classification and analysis of multivariate observations," in Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, 1967, pp. 281-297.
    Mamdani, E. H., "Application of fuzzy algorithms for control of simple dynamic plant," in Proceedings of the Institution of Electrical Engineers, 1974, pp. 1585-1588.
    Maulik, U. & Bandyopadhyay, S., "Genetic algorithm-based clustering technique," Pattern recognition, vol. 33, no. 9, pp. 1455-1465, 2000.
    Michielssen, E., Ranjithan, S., & Mittra, R., "Optimal multilayer filter design using real coded genetic algorithms," IEE Proceedings J (Optoelectronics), vol. 139, no. 6, pp. 413-420, 1992.
    Monmarché, N., Slimane, M., & Venturini, G., "AntClass: discovery of clusters in numeric data by an hybridization of an ant colony with the Kmeans algorithm," 1999.
    Murthy, C. A. & Chowdhury, N., "In search of optimal clusters using genetic algorithms," Pattern Recognition Letters, vol. 17, no. 8, pp. 825-832, 1996.
    Ng, R. T. & Han, J., "CLARANS: A method for clustering objects for spatial data mining," IEEE transactions on knowledge and data engineering, vol. 14, no. 5, pp. 1003-1016, 2002.
    Omran, M. G., Salman, A., & Engelbrecht, A. P., "Dynamic clustering using particle swarm optimization with application in image segmentation," Pattern Analysis and Applications, vol. 8, no. 4, pp. 332-344, 2006.
    Paterlini, S. & Minerva, T., "Evolutionary approaches for cluster analysis," in Soft Computing Applications, ed: Springer, 2003, pp. 165-176.
    Pedrycz, W. & Rai, P., "Collaborative clustering with the use of Fuzzy C-Means and its quantification," Fuzzy Sets and Systems, vol. 159, no. 18, pp. 2399-2427, 2008.
    Qi, Z., Chunchun, H., Chaolun, L., Lijing, Y., & Wenping, W., "Ultrasound image segmentation based on multi-scale fuzzy c-means and particle swarm optimization," in Information Science and Control Engineering 2012 (ICISCE 2012), IET International Conference on, 2012, pp. 1-5.
    Taguchi, G., Introduction to quality engineering: designing quality into products and processes, 1986.
    Tan, P.-N., Steinbach, M., & Kumar, V., "Introduction to data mining," in Library of Congress, 2006.
    Van der Merwe, D. & Engelbrecht, A. P., "Data clustering using particle swarm optimization," in Evolutionary Computation, 2003. CEC'03. The 2003 Congress on, 2003, pp. 215-220.
    Wei, G., "Some geometric aggregation functions and their application to dynamic multiple attribute decision making in the intuitionistic fuzzy setting," International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 17, no. 02, pp. 179-196, 2009.
    Weile, D. S. & Michielssen, E., "Genetic algorithm optimization applied to electromagnetics: A review," Antennas and Propagation, IEEE Transactions on, vol. 45, no. 3, pp. 343-353, 1997.
    Xiping, S., Li, G., & Luo, L., "Optimizing FCM for segmentation of image using Gbest-guided artificial bee colony algorithm," in Natural Computation (ICNC), 2015 11th International Conference on, 2015, pp. 764-768.
    Xu, R. & Wunsch, D., "Survey of clustering algorithms," Neural Networks, IEEE Transactions on, vol. 16, no. 3, pp. 645-678, 2005.
    Xu, Z., Chen, J., & Wu, J., "Clustering algorithm for intuitionistic fuzzy sets," Information Sciences, vol. 178, no. 19, pp. 3775-3790, 2008.
    Xu, Z. & Wu, J., "Intuitionistic fuzzy C-means clustering algorithms," Systems Engineering and Electronics, Journal of, vol. 21, no. 4, pp. 580-590, 2010.
    Yager, R. R., Kacprzyk, J., & Beliakov, G., Recent developments in the ordered weighted averaging operators: theory and practice vol. 265: Springer Science & Business Media, 2011.
    Yan, X., Zhu, Y., Zou, W., & Wang, L., "A new approach for data clustering using hybrid artificial bee colony algorithm," Neurocomputing, vol. 97, pp. 241-250, 2012.
    Zadeh, L. A., "Fuzzy sets," Information and control, vol. 8, no. 3, pp. 338-353, 1965.
    Zahn, C. T., "Graph-theoretical methods for detecting and describing gestalt clusters," Computers, IEEE Transactions on, vol. 100, no. 1, pp. 68-86, 1971.
    Zhang, C., Ouyang, D., & Ning, J., "An artificial bee colony approach for clustering," Expert Systems with Applications, vol. 37, no. 7, pp. 4761-4767, 2010.
    Zimmermann, H.-J., Fuzzy set theory—and its applications: Springer Science & Business Media, 2001.
    Zou, W., Zhu, Y., Chen, H., & Sui, X., "A clustering approach using cooperative artificial bee colony algorithm," Discrete Dynamics in Nature and Society, vol. 2010, 2010.

    無法下載圖示 全文公開日期 2021/08/10 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE