簡易檢索 / 詳目顯示

研究生: Muhamad Faisal
Muhamad Faisal
論文名稱: 基於融合特徵與自主深度學習之植物葉片病害識別探索
An Exploration of Plant Leaf Disease Identification via Feature Fusion and Autonomous Deep Learning
指導教授: 呂政修
Jenq-Shiou Leu
口試委員: 呂政修
Jenq-Shiou Leu
周承復
Cheng-Fu Chou
曾建超
Chien-Chao Tseng
許騰尹
Terng-Yin Hsu
陳省隆
Hsing-Lung Chen
鄭瑞光
Ray-Guang Cheng
陳俊良
Jiann-Liang Chen
方文賢
Wen-Hsien Fang
王瑞堂
Jui-Tang Wang
學位類別: 博士
Doctor
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2023
畢業學年度: 111
語文別: 英文
論文頁數: 73
外文關鍵詞: plant leaf disease classification
相關次數: 點閱:345下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

  • The world population has increased by more than 7.5 billion in recent years. This condition has posed a significant challenge to achieving and maintaining food security. As the demand for food is growing, prevention to provide food supply is required. Plant leaf disease has a devastating effect on crop yield, leading to reduced food availability and affecting nutrition and health. Moreover, plant disease can have a severe impact in developing countries where agriculture is the primary source of livelihood. Early detection to prevent the disease from spreading in agricultural areas is vital for maintaining food supply. The advanced detection of plant leaf disease has contributed significantly to the management strategies.
    In this dissertation, the exploration of plant leaf disease detection is presented. At first, we explore the effectiveness of hybrid feature fusion in the classification of coffee leaf diseases. It investigates different model selection techniques to determine the optimal fusion of multiple features for disease classification. The results demonstrate the significance of feature fusion in achieving improved accuracy in coffee leaf disease identification.
    Secondly, we introduce DFNet, a convolutional neural network based on dense fusion specifically designed to identify plant leaf disease. DFNet leverages the power of dense connections and fusion strategies to enhance the learning capabilities of the network. Through experimental evaluation, the DFNet outperforms other benchmarks and existing architectures regarding the accuracy and other metrics, demonstrating its efficacy in accurate plant leaf disease classification.
    In the end, a study on enhancing the accuracy of plant leaf disease detection through autonomous deep learning is presented. It proposes an autonomous deep learning framework that can self-regulate the number of nodes and layers in the classification layers. By integrating the autonomous deep learning approach into the disease detection pipeline, the proposed network reports significant improvements in accuracy compared to traditional methods and existing methods.

    ABSTRACT 1 ACKNOWLEDGEMENTS 3 TABLE OF CONTENTS 4 LIST OF FIGURES 6 LIST OF TABLES 7 LIST OF SYMBOLS 8 CHAPTER 1 9 1.1. Research Background 9 1.2. Research Objective 11 1.3. Dissertation Organization 12 CHAPTER 2 13 2.1. History: Why is it important? 13 2.2. Current progress and challenges 15 2.3. Overview 17 CHAPTER 3 19 3.1. Overview 19 3.2. Feature Fusion 20 3.2.1 Early Feature Fusion 21 3.2.2 Late Feature Fusion 21 3.3. The Development of Hybrid Feature Fusion 22 3.3.1 Swin Transformer and MobileNetV3 22 3.3.2 VAE-CNN and Swin Transformer 23 3.4. Result and Discussion 23 CHAPTER 4 29 4.1. Overview 29 4.2. Materials 30 4.2.1 Dataset 30 4.2.2 Feature Extractor 31 4.3. Deep Learning Schemes via Dense Feature Network 32 4.4. Result and Discussion 36 CHAPTER 5 42 5.1. Overview 42 5.2. Base models 43 5.2.1 Convolutional Neural Network 43 5.3.2 Autonomous Deep Learning 45 5.3. The proposed Autonomous Deep Learning 48 5.4. Results 49 5.5. Discussion 58 CHAPTER 6 60 6.1. Conclusions 60 6.2. Future Works 61 REFERENCES 63

    [1] K. Klein Goldewijk, A. Beusen, and P. Janssen, “Long-term dynamic modeling of global population and built-up area in a spatially explicit way: HYDE 3.1,” The Holocene, vol. 20, no. 4, pp. 565–573, Jun. 2010.
    [2] L. Karthikeyan, I. Chawla, and A. K. Mishra, “A review of remote sensing applications in agriculture for food security: Crop growth and yield, irrigation, and crop losses,” J. Hydrol., vol. 586, p. 124905, Jul. 2020.
    [3] S. Chakraborty and A. C. Newton, “Climate change, plant diseases and food security: an overview,” Plant Pathol., vol. 60, no. 1, pp. 2–14, Feb. 2011.
    [4] D. Tilman, C. Balzer, J. Hill, and B. L. Befort, “Global food demand and the sustainable intensification of agriculture,” Proc. Natl. Acad. Sci., vol. 108, no. 50, pp. 20260–20264, Dec. 2011.
    [5] H. P. Esse, T. L. Reuber, and D. Does, “Genetic modification to improve disease resistance in crops,” New Phytol., vol. 225, no. 1, pp. 70–86, Jan. 2020.
    [6] J. G. A. Barbedo and J. Garcia, “Digital image processing techniques for detecting, quantifying and classifying plant diseases. SpringerPlus 2: 660.” 2013.
    [7] F. Martinelli et al., “Advanced methods of plant disease detection. A review,” Agron. Sustain. Dev., vol. 35, no. 1, pp. 1–25, Jan. 2015.
    [8] T. Rumpf, A.-K. Mahlein, U. Steiner, E.-C. Oerke, H.-W. Dehne, and L. Plümer, “Early detection and classification of plant diseases with Support Vector Machines based on hyperspectral reflectance,” Comput. Electron. Agric., vol. 74, no. 1, pp. 91–99, Oct. 2010.
    [9] E. Omrani, B. Khoshnevisan, S. Shamshirband, H. Saboohi, N. B. Anuar, and M. H. N. M. Nasir, “Potential of radial basis function-based support vector regression for apple disease detection,” Measurement, vol. 55, pp. 512–519, Sep. 2014.
    [10] H. Al Hiary, S. Bani Ahmad, M. Reyalat, M. Braik, and Z. ALRahamneh, “Fast and Accurate Detection and Classification of Plant Diseases,” Int. J. Comput. Appl., vol. 17, no. 1, pp. 31–38, Mar. 2011.
    [11] K. P. Ferentinos, “Deep learning models for plant disease detection and diagnosis,” Comput. Electron. Agric., vol. 145, pp. 311–318, Feb. 2018.
    [12] M. Faisal, J. Leu, C. Avian, S. W. Prakosa, and M. Köppen, “DFNet: Dense fusion convolution neural network for plant leaf disease classification,” Agron. J., Apr. 2023.
    [13] M. Faisal, J.-S. Leu, and J. T. Darmawan, “Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification,” IEEE Access, vol. 11, pp. 62281–62291, 2023.
    [14] C. R. Rahman et al., “Identification and recognition of rice diseases and pests using convolutional neural networks,” Biosyst. Eng., vol. 194, pp. 112–120, Jun. 2020.
    [15] Z. Xu et al., “Using Deep Convolutional Neural Networks for Image-Based Diagnosis of Nutrient Deficiencies in Rice,” Comput. Intell. Neurosci., vol. 2020, pp. 1–12, Aug. 2020.
    [16] D. P. Hughes and M. Salathe, “An open access repository of images on plant health to enable the development of mobile disease diagnostics,” Nov. 2015.
    [17] J. Parraga-Alava, K. Cusme, A. Elica Loor, and E. Santander, “RoCoLe: A robusta coffee leaf images dataset for evaluation of machine learning based methods in plant diseases recognition,” 2019.
    [18] D. Singh, N. Jain, P. Jain, P. Kayal, S. Kumawat, and N. Batra, “PlantDoc: A Dataset for Visual Plant Disease Detection,” Nov. 2019.
    [19] E. Mwebaze, T. Gebru, A. Frome, S. Nsumba, and J. Tusubira, “iCassava 2019 Fine-Grained Visual Categorization Challenge,” Aug. 2019.
    [20] C. H. Bock, G. H. Poole, P. E. Parker, and T. R. Gottwald, “Plant Disease Severity Estimated Visually, by Digital Photography and Image Analysis, and by Hyperspectral Imaging,” CRC. Crit. Rev. Plant Sci., vol. 29, no. 2, pp. 59–107, Mar. 2010.
    [21] S. Sankaran, A. Mishra, R. Ehsani, and C. Davis, “A review of advanced techniques for detecting plant diseases,” Comput. Electron. Agric., vol. 72, no. 1, pp. 1–13, Jun. 2010.
    [22] F. Saeed, M. A. Khan, M. Sharif, M. Mittal, L. M. Goyal, and S. Roy, “Deep neural network features fusion and selection based on PLS regression with an application for crops diseases classification,” Appl. Soft Comput., vol. 103, p. 107164, May 2021.
    [23] Z. Chuanlei, Z. Shanwen, Y. Jucheng, S. Yancui, and C. Jia, “Apple leaf disease identification using genetic algorithm and correlation based feature selection method,” Int. J. Agric. Biol. Eng., vol. 10, no. 2, pp. 74–83, 2017.
    [24] S. Nandhini and K. Ashokkumar, “An automatic plant leaf disease identification using DenseNet-121 architecture with a mutation-based henry gas solubility optimization algorithm,” Neural Comput. Appl., vol. 34, no. 7, pp. 5513–5534, Apr. 2022.
    [25] S. Nandhini and K. Ashokkumar, “Improved crossover based monarch butterfly optimization for tomato leaf disease classification using convolutional neural network,” Multimed. Tools Appl., vol. 80, no. 12, pp. 18583–18610, May 2021.
    [26] L. Li, S. Zhang, and B. Wang, “Plant Disease Detection and Classification by Deep Learning—A Review,” IEEE Access, vol. 9, pp. 56683–56698, 2021.
    [27] A. Ahmad, D. Saraswat, and A. El Gamal, “A survey on using deep learning techniques for plant disease diagnosis and recommendations for development of appropriate tools,” Smart Agric. Technol., vol. 3, p. 100083, Feb. 2023.
    [28] G. Fenu and F. M. Malloci, “Evaluating Impacts between Laboratory and Field-Collected Datasets for Plant Disease Classification,” Agronomy, vol. 12, no. 10, p. 2359, Sep. 2022.
    [29] X. Lu, X. Duan, X. Mao, Y. Li, and X. Zhang, “Feature Extraction and Fusion Using Deep Convolutional Neural Networks for Face Detection,” Math. Probl. Eng., vol. 2017, pp. 1–9, 2017.
    [30] G. Barnum, S. Talukder, and Y. Yue, “On the Benefits of Early Fusion in Multimodal Representation Learning,” Nov. 2020.
    [31] V. Kotu and B. Deshpande, “Data Mining Process,” in Predictive Analytics and Data Mining, Elsevier, 2015, pp. 17–36.
    [32] H. R. Vaezi Joze, A. Shaban, M. L. Iuzzolino, and K. Koishida, “MMTM: Multimodal Transfer Module for CNN Fusion,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 13286–13296.
    [33] A. Howard et al., “Searching for MobileNetV3,” May 2019.
    [34] Z. Liu et al., “Swin Transformer: Hierarchical Vision Transformer using Shifted Windows.”
    [35] M. Yebasse, B. Shimelis, H. Warku, J. Ko, and K. J. Cheoi, “Coffee Disease Visualization and Classification,” Plants, vol. 10, no. 6, p. 1257, Jun. 2021.
    [36] D. C. R, N. Kandasamy, and S. Rajendran, “Integration of dilated convolution with residual dense block network and multi‐level feature detection network for cassava plant leaf disease identification,” Concurr. Comput. Pract. Exp., vol. 34, no. 11, May 2022.
    [37] A. D. Andrushia and A. T. Patricia, “Artificial bee colony optimization (ABC) for grape leaves disease detection,” Evol. Syst., vol. 11, no. 1, pp. 105–117, Mar. 2020.
    [38] M. Amin-Naji, A. Aghagolzadeh, and M. Ezoji, “Ensemble of CNN for multi-focus image fusion,” Inf. Fusion, vol. 51, pp. 201–214, Nov. 2019.
    [39] J. Zhang, M. Qu, Y. Wang, and L. Cao, “A Multi-Head Convolutional Neural Network With Multi-path Attention improves Image Denoising,” Apr. 2022.
    [40] M. Abdar et al., “UncertaintyFuseNet: Robust uncertainty-aware hierarchical feature fusion model with Ensemble Monte Carlo Dropout for COVID-19 detection,” Inf. Fusion, vol. 90, pp. 364–381, Feb. 2023.
    [41] X. Fan, P. Luo, Y. Mu, R. Zhou, T. Tjahjadi, and Y. Ren, “Leaf image based plant disease identification using transfer learning and feature fusion,” Comput. Electron. Agric., vol. 196, p. 106892, May 2022.
    [42] M. Awais, M. T. Bin Iqbal, and S.-H. Bae, “Revisiting Internal Covariate Shift for Batch Normalization,” IEEE Trans. Neural Networks Learn. Syst., vol. 32, no. 11, pp. 5082–5092, Nov. 2021.
    [43] H. Yu et al., “Corn Leaf Diseases Diagnosis Based on K-Means Clustering and Deep Learning,” IEEE Access, vol. 9, pp. 143824–143835, 2021.
    [44] H.-J. Yu and C.-H. Son, “Leaf Spot Attention Network for Apple Leaf Disease Identification,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2020, pp. 229–237.
    [45] X. Liu, W. Min, S. Mei, L. Wang, and S. Jiang, “Plant Disease Recognition: A Large-Scale Benchmark Dataset and a Visual Region and Loss Reweighting Approach,” IEEE Trans. Image Process., vol. 30, pp. 2003–2015, 2021.
    [46] Y. Wang, H. Wang, and Z. Peng, “Rice diseases detection and classification using attention based neural network and bayesian optimization,” Expert Syst. Appl., vol. 178, p. 114770, Sep. 2021.
    [47] W. Zeng, H. Li, G. Hu, and D. Liang, “Lightweight dense-scale network (LDSNet) for corn leaf disease identification,” Comput. Electron. Agric., vol. 197, p. 106943, Jun. 2022.
    [48] S. Wallelign, “An Intelligent System for Coffee Grading and Disease Identification,” 2020.
    [49] Y. Liu, X. Zhang, Y. Gao, T. Qu, and Y. Shi, “Improved CNN Method for Crop Pest Identification Based on Transfer Learning,” Comput. Intell. Neurosci., vol. 2022, pp. 1–8, Mar. 2022.
    [50] J. G. M. Esgario, R. A. Krohling, and J. A. Ventura, “Deep learning for classification and severity estimation of coffee leaf biotic stress,” Comput. Electron. Agric., vol. 169, p. 105162, Feb. 2020.
    [51] G. Habib and S. Qureshi, “Optimization and acceleration of convolutional neural networks: A survey,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 7, pp. 4244–4268, Jul. 2022.
    [52] S. H. S. Basha, S. R. Dubey, V. Pulabaigari, and S. Mukherjee, “Impact of fully connected layers on performance of convolutional neural networks for image classification,” Neurocomputing, vol. 378, pp. 112–119, Feb. 2020.
    [53] M. Pratama, E. Dimla, T. Tjahjowidodo, W. Pedrycz, and E. Lughofer, “Online Tool Condition Monitoring Based on Parsimonious Ensemble+,” IEEE Trans. Cybern., vol. 50, no. 2, pp. 664–677, Feb. 2020.
    [54] A. Ashfahani, “Autonomous Deep Learning: Incremental Learning of Deep Neural Networks for Evolving Data Streams,” in 2019 International Conference on Data Mining Workshops (ICDMW), 2019, pp. 83–90.
    [55] A. Ashfahani and M. Pratama, “Autonomous Deep Learning: Continual Learning Approach for Dynamic Environments,” Oct. 2018.
    [56] “Coffee plant disease.” [Online]. Available: https://www.kaggle.com/datasets/coffeedisease/coffee-plant-disease. [Accessed: 15-Jul-2021].
    [57] R. Ahila Priyadharshini, S. Arivazhagan, M. Arun, and A. Mirnalini, “Maize leaf disease classification using deep convolutional neural networks,” Neural Comput. Appl., vol. 31, no. 12, pp. 8887–8895, Dec. 2019.
    [58] A. Waheed, M. Goyal, D. Gupta, A. Khanna, A. E. Hassanien, and H. M. Pandey, “An optimized dense convolutional neural network model for disease recognition and classification in corn leaf,” Comput. Electron. Agric., vol. 175, p. 105456, Aug. 2020.
    [59] B. Liu, Y. Zhang, D. J. He, and Y. Li, “Identification of apple leaf diseases based on deep convolutional neural networks,” Symmetry (Basel)., vol. 10, no. 1, Jan. 2018.
    [60] Y. Zhong and M. Zhao, “Research on deep learning in apple leaf disease recognition,” Comput. Electron. Agric., vol. 168, p. 105146, Jan. 2020.
    [61] A. Adeel et al., “Entropy‐controlled deep features selection framework for grape leaf diseases recognition,” Expert Syst., May 2020.

    無法下載圖示 全文公開日期 2028/07/31 (校內網路)
    全文公開日期 2028/07/31 (校外網路)
    全文公開日期 2028/07/31 (國家圖書館:臺灣博碩士論文系統)
    QR CODE