簡易檢索 / 詳目顯示

研究生: 蔡心瑜
Hsin-Yu Tsai
論文名稱: 基於RGB相機與熱影像儀的肺部復健輔助系統
Pulmonary Rehabilitation Assistance System based on RGB and Thermal Cameras
指導教授: 林淵翔
Yuan-Hsiang Lin
口試委員: 周迺寬
Nai-Kuan Chou
沈中安
Chung-An Shen
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2022
畢業學年度: 110
語文別: 中文
論文頁數: 51
中文關鍵詞: 肺部復健熱顯像儀影像對應呼吸率動作辨識
外文關鍵詞: pulmonary rehabilitation, thermal camera, image mapping, respiration rate, action recognition
相關次數: 點閱:183下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

  • 摘要 i Abstract ii 致謝 iii 目錄 iv 圖目錄 vii 表目錄 ix 第一章、 緒論 1 1.1 動機與目的 1 1.2 文獻探討 2 1.2.1 非接觸式呼吸訊號量測方法 2 1.2.2 運動辨識方法 9 1.3 論文架構 1 第二章、 研究背景 2 2.1 肺部復健運動 2 2.1.1 呼吸訓練 2 2.1.2 上肢復健運動訓練 3 2.2 人臉特徵點檢測模型 1 2.3 影像對應 3 第三章、 研究方法 5 3.1 系統介紹(System Introduction) 5 3.2 RGB相機與熱影像儀校準(RGB and Thermal Cameras Calibration) 8 3.3 噘嘴式呼吸量測演算法(Pursed-lip Breathing Measurement Algorithm) 11 3.3.1 影像處理(Image Processing) 11 3.3.1.1 人臉特徵點檢測(Facial Landmark Detection) 11 3.3.1.2 感興趣區域選取(ROI Selection) 12 3.3.1.3 ROI對應(ROI Mapping) 13 3.3.2 訊號處理(Signal Processing) 14 3.3.2.1 提取呼吸訊號(Respiration Signal Extraction) 14 3.3.2.2 帶通濾波(Bandpass Filtering) 15 3.3.2.3 波峰檢測(Peak Detection) 16 3.3.2.4 呼吸狀態(Breathing State) 17 3.3.3 標準化與尺寸轉換(Normalization and Resizing) 18 3.4 上肢復健動作辨識模型(Upper Limb Rehabilitation Exercise Action Recognition Model) 19 3.4.1 人體姿態估計(Human Pose Estimation) 19 3.4.2 訊號前處理(Signal Preprocessing) 21 3.4.3 訓練模型參數設置(Training Model Parameters Setting) 23 3.5 使用者介面 24 第四章、 實驗方法與結果討論 27 4.1 RGB相機與熱影像儀校準實驗 28 4.1.1 驗證方法 28 4.1.2 實驗結果 29 4.2 噘嘴式呼吸實驗 30 4.2.1 實驗設置 30 4.2.2 驗證方法 31 4.2.3 實驗結果 32 4.3 上肢復健運動實驗 33 4.3.1 實驗設置 33 4.3.2 驗證方法 34 4.3.3 實驗結果 35 4.4 結果討論 37 4.4.1 噘嘴式呼吸實驗結果討論 37 4.4.1.1 呼吸訊號來源 37 4.4.1.2 感興趣區域選取對結果之影響 39 4.4.1.3 噘嘴式呼吸實驗之較差表現數據分析 42 4.4.1.4 以噘嘴係數作為呼吸訊號來源之結果探討 44 4.4.2 上肢復健運動實驗結果討論 46 第五章、 結論與未來展望 47 參考文獻 48

    [1] World Health Organization, "The Top 10 Causes of Death," [Online] Available: https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death
    [2] World Health Organization, "Chronic Obstructive Pulmonary Disease (COPD)," [Online] Available: https://www.who.int/news-room/fact-sheets/detail/chronic-obstructive-pulmonary-disease-(copd)
    [3] 中華民國衛生福利部國民健康署, "慢性病防治之慢性呼吸道疾病宣導," [Online] Available: https://www.hpa.gov.tw/Pages/List.aspx?nodeid=215
    [4] R. Pawankar et al., "Asia Pacific Association of Allergy Asthma and Clinical Immunology White Paper 2020 on Climate Change, Air Pollution, and Biodiversity in Asia-Pacific and Impact on Allergic Diseases," Asia Pacific allergy, vol. 10, no. 1, 2020.
    [5] R. Gloeckl, T. Schneeberger, I. Jarosch, and K. Kenn, "Pulmonary Rehabilitation and Exercise Training in Chronic Obstructive Pulmonary Disease," Deutsches Ärzteblatt International, vol. 115, no. 8, pp.117-123, 2018.
    [6] X. Yu et al., "Pulmonary Rehabilitation for Exercise Tolerance and Quality of Life in IPF Patients: A Systematic Review and Meta-Analysis," BioMed research international, vol. 2019 8498603, no. 21, 2019.
    [7] W. Li, Y. Pu, A. Meng, X. Zhi, and G. Xu, "Effectiveness of Pulmonary Rehabilitation in Elderly Patients with COPD: A Systematic Review and Meta‐Analysis of Randomized Controlled Trials," International Journal of Nursing Practice, vol.25, no. 5, 2019.
    [8] Y. Nakayama, G. Sun, S. Abe, and T. Matsui, "Non-Contact Measurement of Respiratory and Heart Rates Using A CMOS Camera-Equipped Infrared Camera for Prompt Infection Screening at Airport Quarantine Stations," 2015 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 1-4, 2015.
    [9] J. Fei and I. Pavlidis, "Thermistor at A Distance: Unobtrusive Measurement of Breathing," IEEE transactions on biomedical engineering, vol. 57, no. 4, pp. 988-998, 2010.
    [10] S. E. H. Kiashari, A. Nahvi1, A. Homayounfard, and H. Bakhoda, "Monitoring The Variation in Driver Respiration Rate from Wakefulness to Drowsiness: A Non-Intrusive Method for Drowsiness Detection Using Thermal Imaging," J Sleep Sci, vol. 3, no. 1-2, 2019.
    [11] T. Negishi et al., "Stable Contactless Sensing of Vital Signs Using RGB-Thermal Image Fusion System with Facial Tracking for Infection Screening," 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4371-4374, 2018.
    [12] T. Negishi et al., "Contactless Vital Signs Measurement System Using RGB-Thermal Image Sensors and Its Clinical Screening Test on Patients with Seasonal Influenza," Sensors (Basel, Switzerland), vol. 20, no. 8, 2020.
    [13] H. Nishizaki and K. Makino, "Signal Classification Using Deep Learning," 2019 IEEE International Conference on Sensors and Nanotechnology, pp. 1-4, 2019.
    [14] C. Gong and G. Wu, "Design of Cerebral Palsy Rehabilitation Training System Based on Human-Computer Interaction," 2021 International Wireless Communications and Mobile Computing (IWCMC), pp. 621-625, 2021.
    [15] S. H. Chae, Y. Kim, K. S. Lee, and H. S. Park, "Development and Clinical Evaluation of A Web-Based Upper Limb Home Rehabilitation System Using A Smartwatch and Machine Learning Model for Chronic Stroke Survivors: Prospective Comparative Study, " JMIR mHealth and uHealth, vol.8, no. 7, 2020.
    [16] 衛生福利部桃園醫院, "[復健]腹式呼吸與噘嘴式呼吸," [Online] Available: https://www.tygh.mohw.gov.tw/?aid=509&pid=129&page_name=detail&iid=516
    [17] Y. Sun, X. Wang, and X. Tang, "Deep Convolutional Network Cascade for Facial Point Detection," 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3476-3483, 2013.
    [18] S. Albawi, T. A. Mohammed, and S. Al-Zawi, " Understanding of A Convolutional Neural Network, " 2017 International Conference on Engineering and Technology (ICET), 2017.
    [19] R. Weng, J. Lu, Y. P. Tan, and J. Zhou, "Learning Cascaded Deep Auto-Encoder Networks for Face Alignment," IEEE Transactions on Multimedia, vol. 18, no. 10, pp. 2066-2078, 2016.
    [20] P. Luo, X. Wang, and X. Tang, "Hierarchical Face Parsing via Deep Learning," 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2480-2487, 2012.
    [21] G. Trigeorgis, P. Snape, M. A. Nicolaou, E. Antonakos, and S. Zafeiriou, "Mnemonic Descent Method: A Recurrent Process Applied for End-to-End Face Alignment," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4177-4187, 2016.
    [22] A. G. Howard et al. "Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications," arXiv, 2017.
    [23] M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, "Mobilenetv2: Inverted Residuals and Linear Bottlenecks," The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
    [24] A. Howard et al. "Searching for MobileNetV3," 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1314-1324, 2019.
    [25] M. A. Hossain and B. Assiri, "Emotion Specific Human Face Authentication Based on Infrared Thermal Image," 2020 2nd International Conference on Computer and Information Sciences (ICCIS), pp. 1-6, 2020.
    [26] M. Knapik and B. Cyganek, "Driver’s Fatigue Recognition Based on Yawn Detection in Thermal Images," Neurocomputing, pp. 274-292, 2019.
    [27] A. Ishida and K. Murakami, "Extraction of Nostril Regions Using Periodical Thermal Change for Breath Monitoring," 2018 International Workshop on Advanced Image Technology (IWAIT), pp. 1-5, 2018.
    [28] Y. Sun, W. Zuo, and M. Liu, "RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes," IEEE Robotics and Automation Letters, vol. 4, no. 3, pp. 2576-2583, 2019.
    [29] S. Ivana, L. Jovanov, and W. Philips, "Deep Visible and Thermal Image Fusion for Enhanced Pedestrian Visibility," Sensors 19, no. 17, 2019.
    [30] E. Dubrofsky, "Homography Estimation," University of British Columbia (Vancouver), 2009.

    無法下載圖示 全文公開日期 2027/09/12 (校內網路)
    全文公開日期 2027/09/12 (校外網路)
    全文公開日期 2027/09/12 (國家圖書館:臺灣博碩士論文系統)
    QR CODE