簡易檢索 / 詳目顯示

研究生: 黃曼欣
Man-Hsin Huang
論文名稱: 應用兩階段模糊神經網路於前列腺癌預後系統之研究
Application of Two-stage Fuzzy Neural Network to Prostate Cancer Prognosis System
指導教授: 郭人介
Ren-Jieh Kuo
口試委員: 王孔政
Kung-Jeng Wang
駱至中
none
學位類別: 碩士
Master
系所名稱: 管理學院 - 工業管理系
Department of Industrial Management
論文出版年: 2012
畢業學年度: 100
語文別: 英文
論文頁數: 129
中文關鍵詞: 預後前列腺癌最佳化人工免疫網路粒子群最佳化演算法模糊神經網路
外文關鍵詞: Prognosis, Prostate cancer, Optimization version of artificial immune networ, Particle swarm optimization, Fuzzy neural network
相關次數: 點閱:205下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 由於台灣地區男性罹患前列腺癌之死亡人數正在逐年增加,前列腺癌在國內之男性癌症死亡原因及癌症好發率之排名亦呈現年年攀升的現象。然而,目前醫師對於前列腺病人的預後(prognosis)仍是使用五年存活率(five-year survival rate)做為判別的分水嶺,如何利用前列腺癌篩檢中的病理變數去推估較為確切的存活年限成為相當重要的議題。
    有鑑於此,本研究提出一用以預測之兩階段模糊神經網路(two-stage fuzzy neural network, two-stage FNN)。FNN初始之隸屬函數乃是將病理變數分群後計算平均值及變異數所得,然後再結合最佳化人工免疫網路(an optimization version of artificial immune network; Opt-aiNET)與粒子群最佳化演算法(particle swarm optimization; PSO)去學習與訓練FNN之網路架構,藉此找出前列腺病病理變數與存活年限之間的關係。由於結合了人工免疫網路與粒子群最佳化演算法之優點,two-stage FNN具有良好的搜尋能力以避免陷入局部最佳解且收斂速度快。本研究透過三組標竿問題驗證two-stage FNN與其他演算法相較之下確實有較佳之表現。透過模型評估結果亦證明two-stage FNN可更準確預測前列腺癌患者之存活年限。除此之外,本文所提出之方法與人工神經網路不同之處在於,two-stage FNN可藉由模糊中的IF-THEN法則來解釋訓練結果。


    Due to the difficulty of making prognosis for prostate cancer, this study attempts to propose a two-stage fuzzy neural network (FNN) for prediction. The initial membership function parameters of FNN are determined by cluster analysis. Then, an integration of optimization version of artificial immune network (Opt-aiNET) and particle swarm optimization (PSO) is developed to learn the relationship between the prostate cancer clinical features and the prognosis for prostate cancer. The evaluation results for three benchmark data sets first show that the proposed two-stage FNN has better performance than other algorithms. In addition, model evaluation results indicate that the proposed algorithm really can predict the prognosis for prostate cancer more correctly. Besides, unlike artificial neural network, it is much easier to interpret the training results since they are in the form of fuzzy IF-THEN rules.

    ABSTRACT I 摘要 II ACKNOWLEDGEMENTS III CONTENTS IV LIST OF FIGURES VI LIST OF TABLES VIII CHARPTER 1 Introduction 1 1.1 Research Background 1 1.2 Research Objectives 2 1.3 Research Scopes and Constraints 3 1.4 Research Framework 3 CHAPTER 2 Literature Review 5 2.1 Prostate Cancer 5 2.1.1 Cancer Registry Annual Report 5 2.1.2 Process of Diagnosis 5 2.1.3 Critical Pathologic Factors of Prostate Cancer in This Study 6 2.1.4 Classification for Prostate Cancer 9 2.1.5 Predictive Application for Prostate Cancer 10 2.2 Artificial Neural Network 10 2.3 Fuzzy Theory 15 2.3.1 Basic Concept of Fuzzy Sets 15 2.3.2 Fuzzification 18 2.3.3 Defuzzification 18 2.4 Fuzzy Neural Networks 19 2.5 Artificial Immune Network 22 2.6 Particle Swarm Optimization (PSO) 25 2.7 Applications of Soft Computing Techniques to FNN 27 CHAPTER 3 Methodology 30 3.1 Data Collection for Prostate Cancer 31 3.2 Features Selection 32 3.3 Two-Stage Fuzzy Neural Network 32 3.3.1 First Stage- Features Clustering 32 3.3.2 Second Stage- Application of Optimization version of Artificial Immune Network and Particle Swarm Optimization-Based Fuzzy Neural Network 38 CHAPTER 4 Simulation Results 44 4.1 Benchmark Data Set 1- Ackley Function 44 4.1.1 Parameter Determination- Taguchi Method 45 4.1.2 Computational Results 49 4.1.3 Statistical Hypothesis 52 4.2 Benchmark Data Set 2- Hartmann Function 54 4.2.1 Parameter Determination- Taguchi Method 55 4.2.2 Computational Results 58 4.2.3 Statistical Hypothesis 61 4.3 Benchmark Data Set 3- Mackey-Glass Time Series 63 4.3.1 Taguchi Method- Parameter Design 63 4.3.2 Computational Results 66 4.3.3 Statistical Hypothesis 69 CHAPTER 5 Model Evaluation Results and Discussion 72 5.1 Data Collection 72 5.2 Factor Selection- Stepwise Regression 72 5.3 Parameter Determination- Taguchi Method 75 5.4 Prognosis 78 5.4.1 Trial 1 79 5.4.2 Trial 2 84 5.4.3 Trail 3 89 5.4.4 Trail 4 94 5.5 Sensitivity Analysis 98 CHAPTER 6 Conclusion and Future Research 101 6.1 Conclusion 101 6.2 Contributions 101 6.3 Future Research 102 REFERENCES 103 APENDIXES 108 Appendix Ⅰ- The MSE of each algorithm of Ackley function. 108 Appendix Ⅱ- The MSE of each algorithm of Hartmann function. 110 Appendix Ⅲ- The MSE of each algorithm of Mackey-Glass Time Series 112 Appendix Ⅳ- The MSE of each algorithm of Trial 1. 114 Appendix Ⅴ- The MSE of each algorithm of Trial 2. 115 Appendix Ⅵ- The MSE of each algorithm of Trial 3. 116 Appendix Ⅶ- The MSE of each algorithm of Trial 4. 117

    Bao S. & Lin, C., “Ant colony optimization control for fuzzy neural network in freeway entrance ramp”, Computer AndCommunications, Vol.27, No.5 (2009).
    Basheer, I. A. & Hajmeer, M., "Artificial neural networks: fundamentals, computing, design, and application", Journal of Microbiological Methods, Vol.43, pp.3-31(2000).
    Benecchi, L., “Neuro-fuzzy system for prostate cancer diagnosis”, Urology, Vol.68, Issue 2, pp.357-361 (2006).
    Chao, C. T. & Teng, C. C., "Implementation of a fuzzy inference system using a normalized fuzzy neural network", Fuzzy Sets and Fuzzy Systems, Vol.75, pp.17-31 (1994).
    Chen, Y. J. & Teng, C. C., " Rule combination in a fuzzy neural network", Fuzzy Sets and Fuzzy Systems, Vol.82, pp.161-166 (1996).
    Chen, H. S., “Integration of Artificial Immune Network and Particle Swarm Optimization Algorithm for Cluster Analysis”, Master's dissertation.
    Choi, J.J., Arabshahi, P., Marks II, R.J. & Caudell, T.P., "Fuzzy parameter adaptation in neural systems", Proc. of IJCNN, pp.232-238 (1992).
    Chun, J.S., Kim, M.K., Jung, H.K. & Hong, S.K., “Shape optimization of electromagnetic devices using immune algorithm”, IEEE Transactions on Mangetics, pp.1876-1879 (1997).
    Cınar, M., Ergin, M., Ergin, E. Z., Ateşci, Y. Z., “Early prostate cancer diagnosis by using artificial neural networks and support vector machines”, Expert Systems with Applications, Vol.36, pp. 6357-6361 (2009).
    Dasgupta, D., "Advances in artificial immune systems," Computational Intelligence Magazine, IEEE, Vol.1, No. 4,pp.40-49 (2006).
    De Castro, L.N. & Timmis, J., "An artificial immune network for multimodal function optimization", Evolutionary Computation, 2002. CEC '02. Proceedings of the 2002 Congress on , vol.1, pp.699-704 (2002).
    De Castro, L. N. and Von Zuben, F. J., "An evolutionary immune network for data clustering", Proceeding of the IEEE SBRN’00 (Brazilian Symposium on Neural Networks), Rio de Janeiro, pp.84-89 (2000).
    De Castro, L. N. and Von Zuben, F. J., "The clonal selection algorithm with engineering applications", Workshop Proceedings of GECCO, Las Vegas, pp.36-37 (2000).
    De Castro, L. N., "Learning and optimization using the clonal selection principle", IEEE Transactions on Evolutionary Computation, Vol. 6, No. 3, pp.239-251 (2002).
    Freeman, J. A., and Skapura, D. M., “Neural networks: Algorithm, applications and programming techniques”, Redwood City: Addison Wesley Longman Publishing Co., Inc., pp.89-125 (1992).
    Hart, E. & Timmis, J., "Application areas of AIS: The past, the present and the future", Applied Soft Computing, Vol.8, pp.191-201 (2008).
    Hellendoorn, H. & Tomas, C., “Defuzzification in fuzzy controllers” , Intelligent and Fuzzy Systems, Vol. 1, pp.109-123 (1993).
    He Z., Wei C., Yang L., Gao X., Yao S., Eberhart R. C. & Shi Y., “Extracting Rules from Fuzzy Neural Network by Particle Swarm Optimization”, IEEE International Conference on Evolutionary Computation, Anchorage, Alaska, USA (1998).
    Hsiao, S. W. & Tsai, H. C., “Applying a hybrid approach based on fuzzy neural network and genetic algorithm to product form design,” International Journal of Industrial Ergonomics, Vol.35, pp.411–428 (2005).
    Hung, S. Y., “Application of Optimization Artificial Immune Network and Particle Swarm Optimization-Based Fuzzy Neural Network to RFID-Based Positioning System”, Master's dissertation.
    Hunt, J., Timmis, J. and Neal, M., "An artificial immune system for data analysis," BioSystems, Vol. 55, pp.143-150 (2000).
    Hunt﹐J., Timmis, J., Cooke, D., Neal, M. & King, C., “Jisys: Development of an Artificial Immune System for real world applications”, In D Dasgupta, editor, Applications of Artificial Immune Systems, Springer-Verlag, pp. 157-186 (1999).
    Hsiao, S. W. & Tsai, H. C., “Applying a hybrid approach based on fuzzy neural network and genetic algorithm to product form design,” International Journal of Industrial Ergonomics, Vol.35, pp.411–428 (2005).
    Ishigami, H., Fukuda, T., Shibata T. & Arai, F., “Structure optimization of fuzzy neural network by genetic algorithm”, Fuzzy Sets and Systems, Vol. 71, No. 4, pp.257-264 (1995).
    Izadinia, H., Sadeghi, F. & Ebadzadeh, M.M., “A novel multi-epitopic immune network model hybridized with neural theory and fuzzy concept”, Neural Networks, Advances in Neural Networks Research, Vol. 22, pp. 633-641 (2009).
    Jang, J.S.R. & Sun, C.T., "Neuro-fuzzy modeling and control," Proceedings of the IEEE, Vol. 83, No. 3, pp.378-406 (1995).
    Jang, J.S.R., "ANFIS: Adaptive-network-based fuzzy inference system", IEEE Transactions on system, Man, And Cybernetics, Vol.23, No.3, pp.665-685 (1993).
    Jang, J. S. R., Sun, C. T., & Mizutani, E., “Neural-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence”, Prentice-Hall (1997).
    Jerne, N.K., “Towards a network theory of the immune system,” Annual Immunology, pp.373-389 (1974).
    Keles, A., Hasiloglu, A. S., Keles, A., Aksoy, Y., “Neuro-fuzzy classification of prostate cancer using NEFCLASS-J”, Computers in Biology and Medicine, Vol.37, Issue11, pp.1617-1628 (2007).
    Kim, D. H. & Abraham, A., “Optimal learning of fuzzy neural network using artificial immune algorithm”, Neural Network World, Vol.18, No.2, pp.147-170 (2008).
    Kumar, M. & Garg, D. P., “Intelligent learning of fuzzy logic controllers via neural network and genetic algorithm”, Proceedings of 2004 JUSFA, Denver, Colorado, July 19-21 (2004).
    Kuo, R.J., "A sales forecasting system based on fuzzy neural network with initial weights generated by genetic algorithm", European Journal of Operational Research, Vol.129, pp.496-517 (2001).
    Kuo, R.J., Chen, C.H. & Hwang, Y.C., "An intelligent stock trading decision support system through integration of genetic algorithm based fuzzy neural network and artificial neural network", Fuzzy Sets and Systems, Vol.118, pp. 21-45 (1998).
    Kuo, R.J. & Xue, K.C., "Fuzzy neural networks with application to sales forecasting”, Fuzzy Sets and Systems, Vol.108, pp.123-143 (1999).
    Kuo, R.J. & Chen, J.A., "A decision support system for order selection in electronic commerce based on fuzzy neural network supported by real-coded genetic algorithm", Expert Systems with Applications, pp.141-154 (2004).
    Kuo, R.J., Hong, S.M., Lin, Y. & Huang, Y.C., "Continuous genetic algorithm-based fuzzy neural network for learning fuzzy IF–THEN rules", Neurocomputing, Vol.71, pp.2893-2907 (2008).
    LIN, C.T. & Lee, C.S., “NEURAL FUZZY SYSTEM: A Neuro-Fuzzy Synergism to Intelligent Systems” , Prentice Hall (1995).
    Lin, C.T. & George Lee, C. S., "Neural-network-based fuzzy logic control and decision system," IEEE Transactions on Computer, Vol.40, No.12, pp.1320-1336 (1991).
    Lin, C. J., Liu, Y. C. & Lee, C. Y., “An efficient neural fuzzy network based on immune particle swarm optimization for prediction and control applications”, International Journal of Innovative Computing, Information and Control (IJICIC), Vol. 4, No. 7, pp.1711-1722 (2008).
    Liu, F.﹐Wang, Q. & Gao, X., “Survey of artificial immune system”, Systems and Control in Aerospace and Astronautics, ISSCAA 1st International Symposium on pp.9-21 (2006).
    Lee, K.M., Kwak, D.H. & Leekwang, H., "Tuning of fuzzy models by fuzzy neural networks", Fuzzy Sets and Fuzzy Systems, Vol.76, pp. 47-61 (1995).
    Ostermark, R., “A hybrid genetic fuzzy neural network algorithm designed for classification problems involving several groups”, Fuzzy Sets and Systems Vol.114, pp.311-324 (2000).
    Parsti, R., “An immune and a gradient-based method totrain multi-layer perceptron neural networks”, IEEE International Joint Conference on Neural Networks, pp.2075-2082 (2006).
    Ramaswamy, S.A.P., Venayagamoorthy, G.K. & Balakrishnan, S.N., "Optimal control of class of non-linear plants using artificial immune systems: Application of the clonal selection algorithm", IEEE International Symposium on Intelligent Control, Singapore, pp.249-254 (2007).
    Ross, T. J., “Fuzzy Logic With Engineering Application” , McGraw-Hill Inc.(1995).
    Saritas, I. & Ozkan, I.A. & Sert, I.U., “Prognosis of prostate cancer by artificial neural networks”, Expert Systems with Applications, Vol. 37, Issue 9, pp. 6646-6650 ( 2010)
    Shi, Y. & Eberhart, R.C., “Parameter selection in particle swarm optimization”, Lecture Notes in Computer Science, Vol. 1447/1988, pp.591-600 (1998).
    Shibata, T., Fukuda, T., Kosuge, T. & Arai, F., “Skill based control by using fuzzy neural network for hierarchical intelligent control”, Proceedings of IJCNN'92, Vol. 2, pp.81-86 (1992).
    Takagi, T. & Sugeno, M., ‘Fuzzy identification of systems and its applications to modeling and control", IEEE Transactions onSsystems, Man, and Cybernetics, Vol. 15, No. 1, pp.116-132 (1985).
    Timmis, J. & Edmonds, C., “A Comment on opt-AiNET: An Immune Network Algorithm for Optimisation”, Genetic and Evolutionary Computation, Vol. 3102/2004, pp.308-317 (2004).
    Werbos, P. J., “Beyond regression: New tools for prediction and analysis in the behavioral sciences”, Ph.D., Harvard University, Cambridge, MA, (1974).
    Zadeh, L.A., “Fuzzy sets”, Information and Control, Vol.8, Issue 3, pp.338-353 (1965).
    Zadeh, L.A., "Fuzzy logic, neural networks, and soft computing", Communications of the ACM, Vol. 37, No. 3, pp.77-84 (1994).

    QR CODE