簡易檢索 / 詳目顯示

研究生: 林家瑋
Jia-Wei Lin
論文名稱: 基於熱顯像儀的非接觸式多參數生理信號量測系統
A Contactless Multi-Parameter Physiological Signal Measurement System Based on Thermal Camera
指導教授: 林淵翔
Yuan-Hsiang Lin
口試委員: 周迺寬
Nai-Kuan Chou
林昌鴻
Chang-Hong Lin
吳晉賢
Chin-Hsien Wu
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2020
畢業學年度: 108
語文別: 中文
論文頁數: 83
中文關鍵詞: 非接觸生理訊號量測熱顯像儀影像處理體表溫度心率呼吸率
外文關鍵詞: non-contact physiological signals measurement, thermal camera, image processing, surface temperature, pulse rate, respiration rate
相關次數: 點閱:235下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 人體最重要的幾項生理參數包括呼吸率、心率以及體溫,同時觀察上述幾項生理測量值能夠幫助我們判斷病患的身體與生理狀態。然而,目前用於收集這些生理參數的傳統方法如:心電圖法(ECG)、光體積變化描述法(PPG)與溫度計等接觸式的量測方法長期下來會造成皮膚不適、引發過敏反應與疼痛的問題,而且經常性地量測也會影響受試者的舒適度。
    近年來則陸續有研究提出使用非接觸式的感測方式來量測生理訊號,非接觸式的量測主要可以使用都卜勒雷達以及攝影機來達成,其中攝影方法又可細分為一般的RGB相機或是紅外線熱像儀。與都卜勒雷達和RGB攝影機相比,基於熱顯像儀的非接觸式生理訊號量測技術是一個較新的研究領域。除了高舒適性、高便利性以及高隱私性的優點之外,還能夠不受環境光源、受測者膚色影響。使得它具有更廣的發展空間,也更符合新生兒和長期照護的場景應用。
    本論文建構一套適用於靜態情況下的多生理參數量測系統。利用一低解析度(80×60)的熱顯像儀當作影像來源,並加入影像處理與訊號處理演算法即時推算出受測者當下的體表溫度、心率與呼吸率。經過模擬真實情況下的即時監控顯示,在受測者靜坐狀態下的實驗中,體表溫度之平均絕對誤差為0.41°C、平均心率準確度為89.85%以及平均呼吸率準確度為91.59%;而在受測者靜坐並配戴口罩的實驗中,其體表溫度平均誤差為0.51°C、平均心率準確度為91.55%以及平均呼吸率準確度為96.61%。實驗結果顯示本論文所提出的系統在距離50至80公分的量測前提下,能夠偵測出受測者之即時體表溫度、心率與呼吸率,並有一定的準確度。


    Respiration rate, pulse rate, and body temperature are the most important physiological parameters of the human body. Observing the above-mentioned physiological measurement values at the same time can help us judge the physical and physiological states of the patient. However, current methods, such as ECG, PPG, and thermometers, that are used to collect physiological parameters may cause skin discomfort, allergic reactions and pain in the case of long-term care.
    In recent years, studies have been proposed to use non-contact sensing methods to measure physiological signals. Non-contact measurements are mainly achieved by using Doppler radar and cameras, while the latter can be further divided into two types: general RGB cameras and thermal cameras. Compared with Doppler radar and RGB cameras, researches on the thermal camera-based technology is of a greater novelty. In addition to offering a high level of comfort, convenience, and privacy, it is also immune to environmental light sources and the subject's skin tone. With the above strengths, the method has greater potential for development and is more suitable for applications in neonatal and long-term care.
    In this paper, a system was built for measuring multiple physiological parameters in static conditions. Using a low-resolution (80×60) thermal camera as the image source, image and signal processing algorithms were developed to calculate the surface temperature, pulse rate, and respiratory rate of the subjects in real time. The subjects were requested to sit still in the environment simulating real-world conditions. The mean absolute error of surface temperature was 0.41°C, the average accuracy of pulse rate was 89.85%, and the average accuracy of respiration rate was 91.59%. In the experiment of sitting with wearing a face mask, the mean absolute error of surface temperature was 0.51°C, the average accuracy of pulse rate was 91.55%, and the average accuracy of respiration rate was 96.61%. The experimental results show that the proposed system can measure the subject’s surface temperature, pulse rate and respiration rate with certain accuracy at a distance of 50-80 cm.

    摘要 I Abstract II 致謝 III 目錄 IV 圖目錄 VI 表目錄 VIII 第一章、緒論 1 1.1 動機與目的 1 1.2 文獻探討 4 1.2.1 基於熱顯像儀的人臉偵測方法 4 1.2.2 基於熱顯像儀的非接觸式心率量測方法 6 1.2.3 基於熱顯像儀的非接觸式呼吸率量測方法 7 1.2.4 連續體溫量測方法 8 1.3 相關論文與本論文之比較 9 1.4 論文架構 11 第二章、研究背景 12 2.1 BCG訊號的定義與原理 12 2.2 呼吸的定義與原理 13 2.3 體溫的定義 14 2.4 黑體爐的定義 15 2.5 物件偵測方法 16 第三章、研究方法 18 3.1 系統介紹 18 3.2 訓練工作 19 3.3 熱顯像儀之校正工作 22 3.4 基於深度學習之人臉偵測 27 3.5 感興趣區域(ROI)提取 30 3.6 體溫訊號之擷取與處理 31 3.7 心率訊號之擷取與處理 32 3.8 呼吸率訊號之擷取與處理 37 3.9 使用者介面 44 第四章、實驗方法與結果討論 45 4.1 實驗設置 45 4.2 評估函式 47 4.3 實驗流程與結果 48 4.3.1 實驗一 48 4.3.2 實驗二 52 4.3.3 實驗結果 56 4.4 結果討論 59 4.4.1 距離對於本系統量測準確度的影響 59 4.4.2 與相關論文之結果比較 62 4.4.3 即時SNR計算對於呼吸率量測準確度的影響 64 第五章、結論與未來展望 65 參考文獻 66

    [1]Y. Zheng et al., "Unobtrusive Sensing and Wearable Devices for Health Informatics," IEEE Transactions on Biomedical Engineering, vol. 61, no. 5, pp. 1538-1554, 2014.
    [2]D. E. Bloom et al., "The Global Economic Burden of Noncommunicable Diseases," 2012.
    [3]T. Yilmaz, R. Foster, and Y. J. S. Hao, "Detecting Vital Signs with Wearable Wireless Sensors," vol. 10, no. 12, pp. 10837-10862, 2010.
    [4]J. F. Thayer, S. S. Yamamoto, and J. F. Brosschot, "The Relationship of Autonomic Imbalance, Heart Rate Variability and Cardiovascular Disease Risk Factors," International Journal of Cardiology, vol. 141, no. 2, pp. 122-31, 2010.
    [5]S. Mendis et al., "Global Atlas on Cardiovascular Disease Prevention and Control," ed: World Health Organization (WHO), 2011.
    [6]H. Wang et al., "Global, Regional, and National Life Expectancy, All-Cause Mortality, and Cause-Specific Mortality for 249 Causes of Death, 1980-2015: A Systematic Analysis for the Global Burden of Disease Study 2015," The Lancet, vol. 388, no. 10053, pp. 1459-1544, 2016.
    [7]M. A. Cretikos et al., "Respiratory Rate: The Neglected Vital Sign," The Medical Journal of Australia, vol. 188, no. 11, pp. 657-9, 2008.
    [8]Ambu, "Ambu® Cardiology Electrodes." [Online]. Available: https://www.ambuusa.com/Admin/Public/Download.aspx?file=Files%2FFiles%2FDownloads%2FAmbu+USA%2FCardiology%2F496220100+Cardiology+Catalog+_lores_singlepg.pdf
    [9]APEX, "Finger Monitor SB100. Fingertip Pulse Oximeter." [Online]. Available: https://www.apexmedicalcorp.com/Finger-Monitor-SB100-Fingertip-Pulse-Oximeter.html
    [10]HUAWEI, "HUAWEI WATCH GT," 2016. [Online]. Available: https://consumer.huawei.com/tw/wearables/watch-gt/
    [11]A. Al-Naji, K. Gibson, S. Lee, and J. Chahl, "Monitoring of Cardiorespiratory Signal: Principles of Remote Measurements and Review of Methods," IEEE Access, vol. 5, pp. 15776-15790, 2017.
    [12]J. Kranjec, S. Beguš, J. Drnovšek, and G. Geršak, "Novel Methods for Noncontact Heart Rate Measurement: A Feasibility Study," IEEE Transactions on Instrumentation and Measurement, vol. 63, no. 4, pp. 838-847, 2014.
    [13]A. Gomez, F. Conti, and L. Benini, "Thermal Image-based CNN's for Ultra-Low Power People Recognition," in 15th ACM International Conference on Computing Frontiers (CF), Ischia, Italy, 2018, pp. 326-331.
    [14]Y. K. Cheong, V. V. Yap, and H. Nisar, "A Novel Face Detection Algorithm using Thermal Imaging," in 2014 IEEE Symposium on Computer Applications and Industrial Electronics (ISCAIE), 2014, pp. 208-213.
    [15]J. Mekyska, V. Espinosa-Duró, and M. Faundez-Zanuy, "Face Segmentation: A Comparison between Visible and Thermal Images," in 44th IEEE International Carnahan Conference on Security Technology (ICCST), 2010, pp. 185-189.
    [16]P. Viola and M. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features," in 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2001.
    [17]A. Kwaśniewska and J. Rumiński, "Real-Time Facial Feature Tracking in Poor Quality Thermal Imagery," in 9th International Conference on Human System Interactions (HSI), 2016, pp. 504-510.
    [18]A. Kwaśniewska and J. Rumiński, "Face Detection in Image Sequences using a Portable Thermal Camera," in 13th Quantitative Infrared Thermography Conference (QIRT), 2016.
    [19]A. Kwaśniewska, J. Rumiński, and P. Rad, "Deep Features Class Activation Map for Thermal Face Detection and Tracking," in 10th International Conference on Human System Interactions (HSI), 2017, pp. 41-47.
    [20]S. Nanfei, M. Garbey, A. Merla, and I. Pavlidis, "Imaging the Cardiovascular Pulse," in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2005, vol. 2, pp. 416-421.
    [21]N. Sun and I. Pavlidis, "Counting Heartbeats at a Distance," in 2006 International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), 2006, pp. 228-231.
    [22]M. Garbey, N. Sun, A. Merla, and I. Pavlidis, "Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery," IEEE Transactions on Biomedical Engineering, vol. 54, no. 8, pp. 1418-1426, 2007.
    [23]C. B. Pereira et al., "Monitoring of Cardiorespiratory Signals Using Thermal Imaging: A Pilot Study on Healthy Human Subjects," Sensors, vol. 18, p. 1541, 2018.
    [24]G. Balakrishnan, F. Durand, and J. Guttag, "Detecting Pulse from Head Motions in Video," in 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, pp. 3430-3437.
    [25]J. Fei and I. Pavlidis, "Thermistor at a Distance: Unobtrusive Measurement of Breathing," IEEE Transactions on Biomedical Engineering, vol. 57, no. 4, pp. 988-98, 2010.
    [26]A. K. Abbas et al., "Neonatal Non-Contact Respiratory Monitoring based on Real-Time Infrared Thermography," BioMedical Engineering OnLine, vol. 10, no. 1, p. 93, 2011.
    [27]G. F. Lewis, R. G. Gatto, and S. W. Porges, "A Novel Method for Extracting Respiration Rate and Relative Tidal Volume from Infrared Thermography," Psychophysiology, vol. 48, no. 7, pp. 877-887, 2011.
    [28]C. B. Pereira et al., "Remote Monitoring of Breathing Dynamics Using Infrared Thermography," Biomed Opt Express, vol. 6, no. 11, pp. 4378-94, 2015.
    [29]C. B. Pereira et al., "Noncontact Monitoring of Respiratory Rate in Newborn Infants Using Thermal Imaging," IEEE Transactions on Biomedical Engineering, vol. 66, no. 4, pp. 1105-1114, 2019.
    [30]H. Metzmacher et al., "Real-Time Human Skin Temperature Analysis Using Thermal Image Recognition for Thermal Comfort Assessment," Energy and Buildings, vol. 158, pp. 1063-1078, 2018.
    [31]D. Li, C. C. Menassa, and V. R. Kamat, "Non-Intrusive Interpretation of Human Thermal Comfort Through Analysis of Facial Infrared Thermography," Energy and Buildings, vol. 176, pp. 246-261, 2018.
    [32]I. Starr, A. J. Rawson, H. A. Schroeder, and N. R. Joseph, "Studies on The Estimation of Cardiac Ouptut in Man, and of Abnormalities in Cardiac Function, from The Heart's Recoil and The Blood's Impacts; The Ballistocardiogram," The American Journal of Physiology, vol. 127, no. 1, pp. 1-28, 1939.
    [33]P. J. Lynch, "Human Head Anatomy with External and Internal Carotid Arteries," 2007. [Online]. Available: https://www.flickr.com/photos/patrlynch/450142019
    [34]A. Abdelhamid, "Mercy of Allah: Adaptation to Weather Extremes," 2020. [Online]. Available: https://aboutislam.net/muslim-issues/science-muslim-issues/mercy-allah-adaptation-weather-extremes/?utm_content=buffer17a1c&utm_medium=social&utm_source=pinterest.com&utm_campaign=buffer
    [35]D. G. Lowe, "Object Recognition from Local Scale-Invariant Features," in 7th IEEE International Conference on Computer Vision (ICCV), 1999, vol. 2, pp. 1150-1157.
    [36]N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2005, vol. 1, pp. 886-893.
    [37]R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation," in 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, pp. 580-587.
    [38]W. Liu et al., "SSD: Single Shot MultiBox Detector," arXiv:1512.02325, 2015.
    [39]J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779-788.
    [40]PASCAL VOC Challenge performance evaluation and download server, "Detection Results: VOC2012." [Online]. Available: http://host.robots.ox.ac.uk:8080/leaderboard/displaylb_main.php?cls=date&challengeid=11&compid=3&submid=28170 (Visited on 03/23/2020)
    [41]FLIR, "Lepton Engineering Datasheet," 2019. [Online]. Available: https://www.flir.com/globalassets/imported-assets/document/flir-lepton-engineering-datasheet.pdf
    [42]A. G. Howard et al., "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," arXiv: 1704.04861, 2017.
    [43]"MobileNet-SSD," GitHub repository, 2017. [Online]. Available: https://github.com/chuanqi305/MobileNet-SSD
    [44]J. Shi and Tomasi, "Good Features to Track," in 1994 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1994, pp. 593-600.
    [45]K. Lin, D. Chen, and W. Tsai, "Image-Based Motion-Tolerant Remote Respiratory Rate Evaluation," IEEE Sensors Journal, vol. 16, no. 9, pp. 3263-3271, 2016.
    [46]KEYSIGHT TECHNOLOGIES, "U5855A TrueIR Thermal Imager." [Online]. Available: https://www.keysight.com/en/pd-2417816-pn-U5855A
    [47]Vernier, "Go Direct® EKG Sensor." [Online]. Available: https://www.vernier.com/product/go-direct-ekg-sensor/
    [48]Vernier, "Go Direct® Respiration Belt." [Online]. Available: https://www.vernier.com/product/go-direct-respiration-belt/
    [49]X. Xu, A. J. Karis, M. J. Buller, and W. R. Santee, "Relationship Between Core Temperature, Skin Temperature, and Heat Flux During Exercise in Heat," Eur J Appl Physiol, vol. 113, no. 9, pp. 2381-9, Sep 2013.
    [50]A. P. Welles et al., "Estimation of Core Body Temperature from Skin Temperature, Heat Flux, and Heart Rate Using a Kalman Filter," Comput Biol Med, vol. 99, pp. 1-6, Aug 1 2018.

    無法下載圖示 全文公開日期 2025/07/10 (校內網路)
    全文公開日期 2025/07/10 (校外網路)
    全文公開日期 2025/07/10 (國家圖書館:臺灣博碩士論文系統)
    QR CODE