由於2019年新型冠狀病毒（COVID-19）的流行，世界衛生組織（WHO）建議人與人之間應保持至少1公尺的社交距離。然而，在醫院或診所內很難在保持社交距離情況下同時收集病患的生理參數。目前生理參數收集的傳統方法如：心電圖（ECG）、光體積變化描述法（PPG）與溫度計等接觸式的量測方法。近年來陸續有研究提出使用非接觸式的方式來量測生理訊號，目前主要使用都卜勒雷達、RGB攝影機或紅外線熱顯像儀。而基於熱顯像儀的非接觸式生理訊號量測技術為較新的研究領域，其不受環境光源、受測者膚色影響，且更有隱私性。使得它具有更廣的發展空間，也更符合門診、臨床、新生兒和長期照護的場景應用。
本論文建構一套適用於門診靜態情況下的多生理參數量測系統。以低解析度（80×60）熱顯像儀作為影像來源，並加入影像處理與訊號處理演算法即時推算出受測者當下的體表溫度、心率與呼吸率。實驗分為黑體爐溫度量測和生理信號量測。生理信號量測分成實驗室環境與醫院門診環境。在黑體爐表面溫度量測準確度實驗結果整體平均MAE/RMSE為0.1401 °C/0.1753 °C，實驗室環境的生理信號量測分為實驗一和實驗二，實驗一之未配戴口罩實驗中體表溫度、心率與呼吸率之平均MAE/RMSE分別為0.27 °C/0.32 °C、2.70 BPM/3.15 BPM與0.79 BPM/1.07 BPM；配戴口罩實驗中體表溫度、心率與呼吸率之平均MAE/RMSE分別為0.33 °C/0.37 °C、3.11 BPM/3.68 BPM與0.24 BPM/0.35 BPM。實驗二之未配戴口罩實驗中體表溫度、心率與呼吸率之平均MAE/RMSE分別為0.20 °C/0.26 °C、3.16 BPM/3.95 BPM與0.45 BPM/0.68 BPM；配戴口罩實驗中體表溫度、心率與呼吸率之平均MAE/RMSE分別為0.38 °C/0.42 °C、3.30 BPM/4.04 BPM與0.19 BPM/0.28 BPM。醫院門診環境量測平均體表溫度、心率與呼吸率之MAE/RMSE分別為0.36 °C/0.40 °C、2.71 BPM/3.27 BPM與0.41 BPM/0.58 BPM。

Due to the 2019 COVID-19 epidemic, the World Health Organization (WHO) recommends that people should maintain a social distance of at least one meter. However, it is difficult to collect the physiological parameters of patients while keeping social distancing in a hospital or clinic. The current methods of physiological parameter collection such as ECG, PPG, and thermometers might cause allergies, discomfort, and activity limitation in the long term. Researchers have proposed the use of non-contact methods to measure physiological signals in recent years, such as Doppler radar, RGB cameras, or thermal cameras. The non-contact measurement based on the thermal camera is not affected by the environmental light source and the skin color of the subject. It is more suitable for outpatient, clinical, neonatal, and long-term care with these advantages.
In this thesis, we built a multi-physiological parameter measurement system, which is suitable for static conditions in outpatient and clinics. A low-resolution (80×60) thermal camera is used as the image source, then the proposed image processing and signal processing algorithm are used to calculate the subject’s surface temperature, heart rate, and respiration rate. The experiment includes blackbody temperature measurement and physiological signal measurement. Physiological signal measurement is divided into laboratory environment and outpatient environment. The average MAE/RMSE of the blackbody temperature measurement was 0.1401 °C/0.1753 °C. The physiological signal measurement of the laboratory environment is divided into experiment 1 and experiment 2.
In experiment 1, the average MAE/RMSE of body surface temperature, heart rate, and respiration rate without a mask were 0.27 °C/0.32 °C, 2.70 BPM/3.15 BPM, and 0.79 BPM/1.07 BPM, respectively; and the average MAE/RMSE of the result with a mask were 0.33 °C/0.37 °C, 3.11 BPM/3.68 BPM and 0.24 BPM/0.35 BPM, respectively. In experiment 2, the average MAE/RMSE of the body surface temperature, heart rate and respiration rate without a mask were 0.20 °C/0.26 °C, 3.16 BPM/3.95 BPM and 0.45 BPM/0.68 BPM, respectively; and the average MAE/RMSE of the result with a mask were 0.38 °C/0.42 °C, 3.30 BPM/4.04 BPM and 0.19 BPM/0.28 BPM, respectively. The average MAE/RMSE of the body surface temperature, heart rate, and respiration rate measured in the outpatient environment were 0.36 °C/0.40 °C, 2.71 BPM/3.27 BPM, and 0.41 BPM/0.58 BPM, respectively.

[1] J. Phua et al., "Intensive care management of coronavirus disease 2019 (COVID-19): challenges and recommendations," The Lancet Respiratory Medicine, vol. 8, no. 5, pp. 506-517, 2020.
[2] World Health Organization, "WHO Coronavirus Disease (COVID-19) Dashboard," [Online] Available: https://covid19.who.int/
[3] World Health Organization, "COVID-19: physical distancing," [Online] Available: https://www.who.int/westernpacific/emergencies/covid-19/information/physical-distancing
[4] D. K. Chu et al., "Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis," The Lancet, vol. 395, no. 10242, pp. 1973-1987, 2020.
[5] M. W. Fong et al., "Nonpharmaceutical measures for pandemic influenza in nonhealthcare settings—social distancing measures," Emerging infectious diseases, vol. 26, no. 5, pp. 976-984, 2020.
[6] D. Dias and J. P. S. Cunha, "Wearable health devices—vital sign monitoring, systems and technologies," Sensors, vol. 18, no. 8, p. 2414, 2018.
[7] American Heart Association, "All About Heart Rate (Pulse)," [Online] Available: https://www.heart.org/en/health-topics/high-blood-pressure/the-facts-about-high-blood-pressure/all-about-heart-rate-pulse
[8] W. Q. Lindh et al., Delmar's comprehensive medical assisting: administrative and clinical competencies. Cengage Learning, 2013.
[9] American Heart Association, "Tachycardia: Fast Heart Rate," [Online] Available: https://www.heart.org/en/health-topics/arrhythmia/about-arrhythmia/tachycardia--fast-heart-rate
[10] N. T. Srinivasan and R. J. Schilling, "Sudden cardiac death and arrhythmias," Arrhythmia & electrophysiology review, vol. 7, no. 2, pp. 111-117, 2018.
[11] H. Aly and M. Youssef, "Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones," in IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on Computer Communications, 2016: IEEE, pp. 1-9.
[12] M. A. Cretikos et al., "Respiratory rate: the neglected vital sign," Medical Journal of Australia, vol. 188, no. 11, pp. 657-659, 2008.
[13] I. I. Geneva, B. Cuzzo, T. Fazili, and W. Javaid, "Normal body temperature: a systematic review," 2019, vol. 6: Oxford University Press US, 4 ed., p. ofz032.
[14] D. J. A. Brown, H. Brugger, J. Boyd, and P. Paal, "Accidental hypothermia," New England Journal of Medicine, vol. 367, no. 20, pp. 1930-1938, 2012.
[15] E. A. McGugan, "Hyperpyrexia in the emergency department," Emergency Medicine, vol. 13, no. 1, pp. 116-120, 2001.
[16] L. q. Li et al., "COVID‐19 patients' clinical characteristics, discharge rate, and fatality rate of meta‐analysis," Journal of medical virology, vol. 92, no. 6, pp. 577-583, 2020.
[17] R. Eccles, "Understanding the symptoms of the common cold and influenza," The Lancet infectious diseases, vol. 5, no. 11, pp. 718-725, 2005.
[18] P. Kiekkas et al., "Fever and standard monitoring parameters of ICU patients: a descriptive study," Intensive and Critical Care Nursing, vol. 23, no. 5, pp. 281-288, 2007.
[19] K. Yeboah-Antwi et al., "Community case management of fever due to malaria and pneumonia in children under five in Zambia: a cluster randomized controlled trial," PLoS Med, vol. 7, no. 9, p. e1000340, 2010.
[20] A. N. Kochi et al., "Cardiac and arrhythmic complications in patients with COVID‐19," Journal of cardiovascular electrophysiology, vol. 31, no. 5, pp. 1003-1008, 2020.
[21] C. Zheng et al., "Risk-adapted treatment strategy for COVID-19 patients," International journal of infectious diseases, vol. 94, pp. 74-77, 2020.
[22] A. Sharifi-Razavi, N. Karimi, and N. Rouhani, "COVID-19 and intracerebral haemorrhage: causative or coincidental?," New microbes and new infections, vol. 35, p. 100669, 2020.
[23] C. Qin et al., "Dysregulation of immune response in patients with coronavirus 2019 (COVID-19) in Wuhan, China," Clinical infectious diseases, vol. 71, no. 15, pp. 762-768, 2020.
[24] T. Matsui et al., "A novel screening method for influenza patients using a newly developed non-contact screening system," Journal of Infection, vol. 60, no. 4, pp. 271-277, 2010.
[25] Ambu, "Ambu® Cardiology" [Online] Available: https://www.ambu.com/cardiology
[26] AEROcheck, "AEROcheck® - PO11 Fingertip Pulse Oximete" [Online] Available: https://www.hum-online.de/index.php/en/patient-monitoring@rCH=2.html
[27] fitbit, "fitbit Sense" [Online] Available: https://www.fitbit.com/global/us/products/smartwatches/sense?sku=512BKBK
[28] A. Al-Naji, K. Gibson, S. H. Lee, and J. Chahl, "Monitoring of cardiorespiratory signal: Principles of remote measurements and review of methods," IEEE Access, vol. 5, pp. 15776-15790, 2017.
[29] J. Kranjec, S. Beguš, J. Drnovšek, and G. Geršak, "Novel methods for noncontact heart rate measurement: A feasibility study," IEEE transactions on instrumentation and measurement, vol. 63, no. 4, pp. 838-847, 2013.
[30] M. Mercuri et al., "A direct phase-tracking doppler radar using wavelet independent component analysis for non-contact respiratory and heart rate monitoring," IEEE transactions on biomedical circuits and systems, vol. 12, no. 3, pp. 632-643, 2018.
[31] B. F. Wu, Y. W. Chu, P. W. Huang, and M. L. Chung, "Neural network based luminance variation resistant remote-photoplethysmography for driver’s heart rate monitoring," IEEE Access, vol. 7, pp. 57210-57225, 2019.
[32] A. Gomez, F. Conti, and L. Benini, "Thermal image-based CNN's for ultra-low power people recognition," in Proceedings of the 15th ACM International Conference on Computing Frontiers, 2018, pp. 326-331.
[33] H. Metzmacher et al., "Real-time human skin temperature analysis using thermal image recognition for thermal comfort assessment," Energy and Buildings, vol. 158, pp. 1063-1078, 2018.
[34] D. Li, C. C. Menassa, and V. R. Kamat, "Non-intrusive interpretation of human thermal comfort through analysis of facial infrared thermography," Energy and Buildings, vol. 176, pp. 246-261, 2018.
[35] N. Sun, M. Garbey, A. Merla, and I. Pavlidis, "Imaging the cardiovascular pulse," in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), 2005, vol. 2: IEEE, pp. 416-421.
[36] N. Sun and I. Pavlidis, "Counting heartbeats at a distance," in 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, 2006: IEEE, pp. 228-231.
[37] M. Garbey, N. Sun, A. Merla, and I. Pavlidis, "Contact-free measurement of cardiac pulse based on the analysis of thermal imagery," IEEE transactions on Biomedical Engineering, vol. 54, no. 8, pp. 1418-1426, 2007.
[38] C. B. Pereira et al., "Monitoring of cardiorespiratory signals using thermal imaging: a pilot study on healthy human subjects," Sensors, vol. 18, no. 5, p. 1541, 2018.
[39] G. Balakrishnan, F. Durand, and J. Guttag, "Detecting pulse from head motions in video," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, pp. 3430-3437.
[40] 林家瑋, "基於熱顯像儀的非接觸式多參數生理信號量測系統," 國立臺灣科技大學, 2020.
[41] J. Fei and I. Pavlidis, "Thermistor at a distance: unobtrusive measurement of breathing," IEEE transactions on biomedical engineering, vol. 57, no. 4, pp. 988-998, 2009.
[42] A. Ishida and K. Murakami, "Extraction of nostril regions using periodical thermal change for breath monitoring," in 2018 International Workshop on Advanced Image Technology (IWAIT), 2018: IEEE, pp. 1-5.
[43] T. Negishi et al., "Contactless vital signs measurement system using RGB-thermal image sensors and its clinical screening test on patients with seasonal influenza," Sensors, vol. 20, no. 8, p. 2171, 2020.
[44] M. Knapik and B. Cyganek, "Driver’s fatigue recognition based on yawn detection in thermal images," Neurocomputing, vol. 338, pp. 274-292, 2019.
[45] C. B. Pereira et al., "Noncontact monitoring of respiratory rate in newborn infants using thermal imaging," IEEE transactions on Biomedical Engineering, vol. 66, no. 4, pp. 1105-1114, 2018.
[46] T. Tamura, M. Huang, and T. Togawa, "Current developments in wearable thermometers," Advanced Biomedical Engineering, vol. 7, pp. 88-99, 2018.
[47] J. Gordon, "Certain molar movements of the human body produced by the circulation of the blood," Journal of anatomy and physiology, vol. 11, pp. 533-536, 1877.
[48] I. Starr, A. Rawson, and H. Schroeder, "Apparatus for recording the heart’s recoil and the blood’s impacts in man (ballistocardiograph), experiments on the principles involved, records in normal and abnormal conditions," in Proceedings of the Am. Physiol. SOC. 50th Annual Meeting. Am. J. Physiol, 1938, vol. 123, p. 195.
[49] I. Starr, A. Rawson, H. Schroeder, and N. Joseph, "Studies on the estimation of cardiac ouptut in man, and of abnormalities in cardiac function, from the heart's recoil and the blood's impacts; the ballistocardiogram," American Journal of Physiology-Legacy Content, vol. 127, no. 1, pp. 1-28, 1939.
[50] B. Medical, "Medical gallery of blausen medical 2014," WikiJournal of Medicine, vol. 1, no. 2, pp. 1-79, 2014.
[51] P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, 2001, vol. 1: IEEE, pp. I-I.
[52] D. G. Lowe, "Object recognition from local scale-invariant features," in Proceedings of the seventh IEEE international conference on computer vision, 1999, vol. 2: Ieee, pp. 1150-1157.
[53] N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), 2005, vol. 1: Ieee, pp. 886-893.
[54] R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 580-587.
[55] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You only look once: Unified, real-time object detection," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 779-788.
[56] T. Y. Lin et al., "Focal loss for dense object detection," in Proceedings of the IEEE international conference on computer vision, 2017, pp. 2980-2988.
[57] PASCAL VOC Challenge performance evaluation and download server, "Detection Results: VOC2012." [Online] Available: http://host.robots.ox.ac.uk:8080/leaderboard/displaylb_main.php?cls=date&challengeid=6&compid=3&submid=28819
[58] FLIR, "Lepton Engineering Datasheet," [Online] Available: https://www.flir.com/globalassets/imported-assets/document/flir-lepton-engineering-datasheet.pdf
[59] W. Liu et al., "Ssd: Single shot multibox detector," in European conference on computer vision, 2016: Springer, pp. 21-37.
[60] A. G. Howard et al., "Mobilenets: Efficient convolutional neural networks for mobile vision applications," arXiv preprint arXiv:1704.04861, 2017.
[61] "MobileNet-SSD," GitHub repository, [Online] Available: https://github.com/chuanqi305/MobileNet-SSD
[62] K. S. Kaya et al., "Assessment of facial analysis measurements by golden proportion☆,☆☆," Brazilian journal of otorhinolaryngology, vol. 85, pp. 494-501, 2019.
[63] J. Shi, "Good features to track," in 1994 Proceedings of IEEE conference on computer vision and pattern recognition, 1994: IEEE, pp. 593-600.
[64] Fluke. "Fluke Precision Infrared Calibrators 4180." [Online] Available: https://assets.testequity.com/te1/Documents/pdf/fluke/4180-4181-ds.pdf
[65] KEYSIGHT TECHNOLOGIES, "U5855A TrueIR Thermal Imager." [Online] Available: https://www.keysight.com/us/en/support/U5855A/trueir-thermal-imager-350-c.html
[66] Vernier, "Go Direct® EKG Sensor." [Online] Available: https://www.vernier.com/product/go-direct-ekg-sensor/
[67] Vernier, "Go Direct® Respiration Belt." [Online] Available: https://www.vernier.com/product/go-direct-respiration-belt/