簡易檢索 / 詳目顯示

研究生: 林子鈞
TZU-CHUN LIN
論文名稱: 應用混合萬用演算法與核心直覺模糊c-means演算法於分群分析
Application of Hybrid of Meta-heuristics and Kernel Intuitionistic Fuzzy c-means Algorithm to Cluster Analysis
指導教授: 郭人介
Ren-Jieh Kuo
口試委員: 歐陽超
Chao Ou-Yang
蔡介元
Chieh-Yuan Tsai
學位類別: 碩士
Master
系所名稱: 管理學院 - 工業管理系
Department of Industrial Management
論文出版年: 2015
畢業學年度: 103
語文別: 英文
論文頁數: 79
中文關鍵詞: 分群分析萬用演算法粒子群演算法實數型基因演算法人工蜂群演算法直覺模糊集合核心函數模糊c-means演算法
外文關鍵詞: Clustering analysis, Meta-heuristic algorithms, Particle swarm optimization, Genetic algorithm, Artificial bee colony, Intuitionistic fuzzy set, Kernel function, Fuzzy c-means
相關次數: 點閱:391下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 分群分析在資料探勘中是一個非常重要的議題,最近幾年許多的分群演算法已被提出。然而,沒有任何一個分群演算法可以對所有不同資料集進行正確的分群。因此,本研究提出萬用演算法結合核心直覺模糊c-means演算法 (kernel intuitionistic fuzzy c-means, KIFCM)的進化分群演算法。核心直覺模糊c-means演算法結合了直覺模糊集合( intuitionistic fuzzy sets, IFSs) 與核心模糊c-means演算法(kernel-based fuzzy c-means, KFCM)。在本研究中,應用三種萬用演算法來改善分群的結果,分別是粒子群演算法、實數型基因演算法及人工蜂群演算法。因此,本研究提出三種分群演算法,包括粒子群演算法為基礎之核心直覺模糊c-means演算法(PSO-KIFCM)、實數型基因演算法為基礎之核心直覺模糊c-means演算法(GA-KIFCM)及人工蜂群演算法為基礎之核心直覺模糊c-means演算法(ABC-KIFCM)。接著,將它們對Iris、Wine、Tae、Flame、Glass及Wbc 資料集的分群結果和其他分群演算法進行比較,分群演算法有K-means分群演算法、模糊c-means演算法、直覺模糊c-means演算法、核心模糊c-means演算法及直覺核心模糊c-means演算法。根據實驗的結果,在分群的準確率上,實數型基因演算法為基礎之核心直覺模糊c-means演算法(GA-KIFCM)比其他分群演算法能獲得更好的結果。


    Clustering analysis is an important issue in data mining. Many clustering algorithms have been proposed in recent years. However, there is no clustering method which can process all different datasets correctly. Thus, this study intends to propose evolutionary-based clustering algorithms which are hybrid of meta-heuristic algorithms and kernel intuitionistic fuzzy c-means (KIFCM) algorithm. The KIFCM algorithm combines Atanassov’s intuitionistic fuzzy set (IFSs) with kernel-based fuzzy c-means (KFCM). In this study, three meta-heuristic algorithms are applied to improve the clustering results, which are particle swarm optimization (PSO) algorithm, genetic algorithm (GA), and artificial bee colony (ABC) algorithm. Therefore, there are three clustering algorithms proposed including PSO-based KIFCM (PSO-KIFCM), real-coded GA-based KIFCM (GA-KIFCM), and ABC-based KIFCM (ABC-KIFCM). Their results are compared with those of other clustering algorithms, such as K-means, fuzzy c-means (FCM), intuitionistic fuzzy c-means (IFCM), KFCM, and KIFCM using iris, wine, tae, flame, glass, and wbc datasets. From the experimental results, the proposed GA-KIFMC is able to obtain better solutions than the other clustering algorithms in six benchmark datasets, in terms of accuracy.

    摘要 I Abstract II 誌謝 III Contents IV List of Tables VI List of Figures VIII Chapter 1 Introduction 10 1.1 Background and Motivation 10 1.2 Research Objectives 11 1.3 Research Scope and Constraints 11 1.4 Research Framework 12 Chapter 2 Literature Review 13 2.1 Cluster Analysis 13 2.2 Fuzzy c-means algorithm 15 2.3 Intuitionistic fuzzy c-means algorithm 17 2.3.1 Intuitionistic fuzzy sets 17 2.3.2 Intuitionistic fuzzy c-means algorithm 19 2.4 Kernel-based fuzzy c-means algorithm 20 2.5 Kernel Intuitionistic fuzzy c-means algorithm 23 Chapter 3 Methodology 25 3.1 Methodology Framework 25 3.2 Data Preprocessing 25 3.3 Meta-heuristic Algorithm Based KIFCM algorithm 26 3.3.1 Particle Swarm Optimization Based KIFCM algorithm 26 3.3.2 Real-Coded Genetic Algorithms Based KIFCM algorithm 29 3.3.3 Artificial Bee Colony Based KIFCM algorithm 33 Chapter 4 Experimental Results 37 4.1 Datasets 37 4.2 Performance Measurement 38 4.3 Parameters Determination 38 4.3.1 Parameters for Iris Dataset 40 4.3.2 Parameters for Wine Dataset 43 4.3.3 Parameters for Tae Dataset 46 4.3.4 Parameters for Flame Dataset 49 4.3.5 Parameters for Glass Dataset 52 4.3.6 Parameters for Wbc Dataset 55 4.4 Computational Results 58 4.5 Statistical Hypothesis 61 Chapter 5 Conclusions and Future Research 67 5.1 Conclusions 67 5.2 Contributions 67 5.3 Future Research 68 References 69 Appendix 73

    Akay, B. & Karaboga, D., "Parameter tuning for the artificial bee colony algorithm," in Computational collective intelligence. Semantic web, social networks and multiagent systems, ed: Springer, 2009, pp. 608-619.
    Akay, B. & Karaboga, D., "A modified artificial bee colony algorithm for real-parameter optimization," Information Sciences, vol. 192, pp. 120-142, 2012.
    Atanassov, K. T., "Intuitionistic fuzzy sets," Fuzzy sets and Systems, vol. 20, no. 1, pp. 87-96, 1986.
    Bezdek, J. C., Pattern recognition with fuzzy objective function algorithms: Kluwer Academic Publishers, 1981.
    Bin, W., Yanwei, Z., Yaliang, M., Hongzhao, D., & Weian, W., "Particle swarm optimization method for vehicle routing problem," in Intelligent Control and Automation, 2004. WCICA 2004. Fifth World Congress on, 2004, pp. 2219-2221.
    Bustince, H. & Burillo, P., "Vague sets are intuitionistic fuzzy sets," Fuzzy sets and systems, vol. 79, no. 3, pp. 403-405, 1996.
    Chaira, T., "A novel intuitionistic fuzzy C means clustering algorithm and its application to medical images," Applied Soft Computing, vol. 11, no. 2, pp. 1711-1717, 2011.
    Clarke, B. S., Fokoué, E., & Zhang, H. H., Principles and theory for data mining and machine learning: Springer, 2009.
    Cristianini, N. & Shawe-Taylor, J., An introduction to support vector machines and other kernel-based learning methods: Cambridge university press, 2000.
    Dong, C., Wang, G., Chen, Z., & Yu, Z., "A method of self-adaptive inertia weight for PSO," in Computer Science and Software Engineering, 2008 International Conference on, 2008, pp. 1195-1198.
    Dong, J. & Qi, M., "A new algorithm for clustering based on particle swarm optimization and K-means," in Artificial Intelligence and Computational Intelligence, 2009. AICI'09. International Conference on, 2009, pp. 264-268.
    Eberhart, R. C. & Shi, Y., "Parameter selection in particle swarm optimization," in Evolutionary programming VII, 1998, pp. 591-600.
    Eberhart, R. C. & Shi, Y., "Particle swarm optimization: developments, applications and resources," in Evolutionary Computation, 2001. Proceedings of the 2001 Congress on, 2001, pp. 81-86.
    Eiben, A. E. & Smith, J. E., Introduction to evolutionary computing: Springer Science & Business Media, 2003.
    Fan, J., Han, M., & Wang, J., "Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation," Pattern Recognition, vol. 42, no. 11, pp. 2527-2540, 2009.
    Fu, L. & Medico, E., "FLAME, a novel fuzzy clustering method for the analysis of DNA microarray data," BMC bioinformatics, vol. 8, no. 1, p. 3, 2007.
    Graves, D. & Pedrycz, W., "Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study," Fuzzy sets and systems, vol. 161, no. 4, pp. 522-543, 2010.
    Han, J., Kamber, M., & Pei, J., Data mining, southeast asia edition: Concepts and techniques: Morgan kaufmann, 2006.
    Holland, J. H., "Genetic algorithms," Scientific american, vol. 267, no. 1, pp. 66-72, 1975.
    Honda, K. & Ichihashi, H., "Linear fuzzy clustering techniques with missing values and their application to local principal component analysis," Fuzzy Systems, IEEE Transactions on, vol. 12, no. 2, pp. 183-193, 2004.
    Huang, L., Wang, K.-p., Zhou, C.-g., PANG, W., DONG, L.-j., & PENG, L., "Particle Swarm Optimization for Traveling Salesman Problems [J]," Acta Scientiarium Naturalium Universitatis Jilinensis, vol. 4, p. 012, 2003.
    Jain, A. K. & Dubes, R. C., Algorithms for clustering data vol. 6: Prentice hall Englewood Cliffs, 1988.
    Jain, A. K., Murty, M. N., & Flynn, P. J., "Data clustering: a review," ACM computing surveys (CSUR), vol. 31, no. 3, pp. 264-323, 1999.
    Jiang, B., Wang, N., & Wang, L., "Parameter identification for solid oxide fuel cells using cooperative barebone particle swarm optimization with hybrid learning," International Journal of Hydrogen Energy, vol. 39, no. 1, pp. 532-542, 2014.
    Kackar, R. N., "Off-line quality control, parameter design, and the Taguchi method," Journal of Quality Technology, vol. 17, pp. 176-188, 1985.
    Karaboga, D., "An idea based on honey bee swarm for numerical optimization," Technical report-tr06, Erciyes university, engineering faculty, computer engineering department2005.
    Karaboga, D. & Basturk, B., "On the performance of artificial bee colony (ABC) algorithm," Applied soft computing, vol. 8, no. 1, pp. 687-697, 2008.
    Karaboga, D. & Ozturk, C., "A novel clustering approach: Artificial Bee Colony (ABC) algorithm," Applied soft computing, vol. 11, no. 1, pp. 652-657, 2011.
    Kennedy, J. & Eberhart, R., "Particle swarm optimization," in Neural Networks, 1995. Proceedings., IEEE International Conference on, 1995, pp. 1942-1948.
    Koay, C. A. & Srinivasan, D., "Particle swarm optimization-based approach for generator maintenance scheduling," in Swarm Intelligence Symposium, 2003. SIS'03. Proceedings of the 2003 IEEE, 2003, pp. 167-173.
    Kohonen, T., Self-organizing maps vol. 30: Springer Science & Business Media, 2001.
    Krishna, K. & Murty, M. N., "Genetic K-means algorithm," Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, vol. 29, no. 3, pp. 433-439, 1999.
    Krishnamoorthi, M. & Natarajan, A., "A comparative analysis of enhanced Artificial Bee Colony algorithms for data clustering," in Computer Communication and Informatics (ICCCI), 2013 International Conference on, 2013, pp. 1-6.
    Kuo, R., Zulvia, F. E., & Suryadi, K., "Hybrid particle swarm optimization with genetic algorithm for solving capacitated vehicle routing problem with fuzzy demand–A case study on garbage collection system," Applied Mathematics and Computation, vol. 219, no. 5, pp. 2574-2588, 2012.
    Li, Z., Li, Y., & Xu, L., "Anomaly intrusion detection method based on K-means clustering algorithm with particle swarm optimization," in Information Technology, Computer Engineering and Management Sciences (ICM), 2011 International Conference on, 2011, pp. 157-161.
    Lin, K.-P., "A Novel Evolutionary Kernel Intuitionistic Fuzzy-means Clustering Algorithm," Fuzzy Systems, IEEE Transactions on, vol. 22, no. 5, pp. 1074-1087, 2014.
    Liu, X. & Wang, L., "Computing the maximum similarity bi-clusters of gene expression data," Bioinformatics, vol. 23, no. 1, pp. 50-56, 2007.
    MacQueen, J., "Some methods for classification and analysis of multivariate observations," in Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, 1967, pp. 281-297.
    Maulik, U. & Bandyopadhyay, S., "Genetic algorithm-based clustering technique," Pattern recognition, vol. 33, no. 9, pp. 1455-1465, 2000.
    Michielssen, E., Ranjithan, S., & Mittra, R., "Optimal multilayer filter design using real coded genetic algorithms," IEE Proceedings J (Optoelectronics), vol. 139, no. 6, pp. 413-420, 1992.
    Patel, R., Raghuwanshi, M., & Jaiswal, A. N., "Modifying genetic algorithm with species and sexual selection by using K-means algorithm," in Advance Computing Conference, 2009. IACC 2009. IEEE International, 2009, pp. 114-119.
    Pedrycz, W. & Rai, P., "Collaborative clustering with the use of Fuzzy C-Means and its quantification," Fuzzy Sets and Systems, vol. 159, no. 18, pp. 2399-2427, 2008.
    Salerno, J., "Using the particle swarm optimization technique to train a recurrent neural model," in 2012 IEEE 24th International Conference on Tools with Artificial Intelligence, 1997, pp. 0045-0045.
    Taguchi, G., Introduction to quality engineering: designing quality into products and processes, 1986.
    Tan, P.-N., Steinbach, M., & Kumar, V., "Introduction to data mining," in Library of Congress, 2006.
    Van der Merwe, D. & Engelbrecht, A. P., "Data clustering using particle swarm optimization," in Evolutionary Computation, 2003. CEC'03. The 2003 Congress on, 2003, pp. 215-220.
    Wang, K.-P., Huang, L., Zhou, C.-G., & Pang, W., "Particle swarm optimization for traveling salesman problem," in Machine Learning and Cybernetics, 2003 International Conference on, 2003, pp. 1583-1585.
    Xu, R. & Wunsch, D., "Survey of clustering algorithms," Neural Networks, IEEE Transactions on, vol. 16, no. 3, pp. 645-678, 2005.
    Yang, M.-S., "A survey of fuzzy clustering," Mathematical and Computer modelling, vol. 18, no. 11, pp. 1-16, 1993.
    Zadeh, L. A., "Fuzzy sets," Information and control, vol. 8, no. 3, pp. 338-353, 1965.
    Zhang, C., Ouyang, D., & Ning, J., "An artificial bee colony approach for clustering," Expert Systems with Applications, vol. 37, no. 7, pp. 4761-4767, 2010.
    Zhang, C., Shao, H., & Li, Y., "Particle swarm optimisation for evolving artificial neural network," in Systems, Man, and Cybernetics, 2000 IEEE International Conference on, 2000, pp. 2487-2490.
    Zhang, D.-Q. & Chen, S.-C., "Clustering incomplete data using kernel-based fuzzy c-means algorithm," Neural Processing Letters, vol. 18, no. 3, pp. 155-162, 2003.

    無法下載圖示 全文公開日期 2020/06/26 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE