In current millennium, camera is become daily consumer goods in different application. Followed by rapid development and research in computer vision, the capabilities of camera application are not limited to capture beautiful moment of scene. New trend study are focusing to calculate human physiological information using camera technology, this can be done by measuring the human body vital signs parameter.
In this paper we proposed a real time contactless vital sign measurement. There are three parameter of vital signs were calculated by the system including pulse rate (PR), respiration rate (RR), and blood oxygen saturation (SpO2). We use the algorithm based on remote imaging photopletysmography (rIPPG) algorithm used to extract PPG signal. A consumer-grade RGB camera was used as the main sensor in proposed system. The region-of-interest (ROI) selected for this work is forehead-to-cheek area of the face. G-channel data from camera used to extract the information about PR and RR. While the combination R-B channel used to estimate the SpO2 value. All parameters calculation is done by using time-domain processing. Moreover, we provide real-time measurement operation for the parameters.
The experimental results shows, the highest accuracy among the calculated parameters from the proposed system is PR measurement. 97.9% average accuracy measurement was obtained with no hard motion included in experiment. For RR measurement the average accuracy obtained from the experiment was 80.95%. The inaccuracy of the RR mainly was caused by the position of the subjects. In the other hand, the unsatisfied results were obtained from SpO2 measurement. The average accuracy agreements only reach 87.04%.

In current millennium, camera is become daily consumer goods in different application. Followed by rapid development and research in computer vision, the capabilities of camera application are not limited to capture beautiful moment of scene. New trend study are focusing to calculate human physiological information using camera technology, this can be done by measuring the human body vital signs parameter.
In this paper we proposed a real time contactless vital sign measurement. There are three parameter of vital signs were calculated by the system including pulse rate (PR), respiration rate (RR), and blood oxygen saturation (SpO2). We use the algorithm based on remote imaging photopletysmography (rIPPG) algorithm used to extract PPG signal. A consumer-grade RGB camera was used as the main sensor in proposed system. The region-of-interest (ROI) selected for this work is forehead-to-cheek area of the face. G-channel data from camera used to extract the information about PR and RR. While the combination R-B channel used to estimate the SpO2 value. All parameters calculation is done by using time-domain processing. Moreover, we provide real-time measurement operation for the parameters.
The experimental results shows, the highest accuracy among the calculated parameters from the proposed system is PR measurement. 97.9% average accuracy measurement was obtained with no hard motion included in experiment. For RR measurement the average accuracy obtained from the experiment was 80.95%. The inaccuracy of the RR mainly was caused by the position of the subjects. In the other hand, the unsatisfied results were obtained from SpO2 measurement. The average accuracy agreements only reach 87.04%.

[1] J. Gilby, “Roadmapping computer vision-directions and opportunities for CCTV,” The IEE International Symposium on Imaging for Crime Detection and Prevention, 2005. ICDP 2005., 2005.
[2] A. Forsyth, D., &Ponce, J. (2003). Computer Vision: A Modern Approach.
[3] M. Dubská, A. Herout, R. Juránek and J. Sochor, “Fully Automatic Roadside Camera Calibration for Traffic Surveillance,” in IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 3, pp. 1162-1171, June 2015.
[4] J. Choi et al., “Environment-Detection-and-Mapping Algorithm for Autonomous Driving in Rural or Off-Road Environment,” in IEEE Transactions on Intelligent Transportation Systems, vol. 13, no. 2, pp. 974-982, June 2012.
[5] C. Jiang, F. Zhang and Z. Wang, “Image Processing of Aluminum Alloy Weld Pool for Robotic VPPAW Based on Visual Sensing,” in IEEE Access, vol. 5, pp. 21567-21573, 2017.
[6] L. Chen, P. Bentley, K. Mori, K. Misawa, M. Fujiwara and D. Rueckert, “DRINet for Medical Image Segmentation,” in IEEE Transactions on Medical Imaging.
[7] J. Huang, Z. Chen, D. Ceylan and H. Jin, “6-DOF VR videos with a single 360-camera,” 2017 IEEE Virtual Reality (VR), Los Angeles, CA, 2017.
[8] C. Zywietz, “Standardized representation of vital signs for continuous care in cardiology,” Computers in Cardiology 1998. Vol. 25 (Cat. No.98CH36292), Cleveland, OH, 1998, pp. 205-208.
[9] W. Wang, A. C. den Brinker, S. Stuijk and G. de Haan, “Algorithmic Principles of Remote PPG,” in IEEE Transactions on Biomedical Engineering, vol. 64, no. 7, pp. 1479-1491, July 2017.
[10] G. Balakrishnan, F. Durand and J. Guttag, “Detecting Pulse from Head Motions in Video,” 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, 2013, pp. 3430-3437.
[11] Wieringa, F. P., Mastik, F., &Steen, A. F. W.van der. (2005). Contactless Multiple Wavelength Photoplethysmographic Imaging: A First Step Toward “SpO2 Camera” Technology. Annals of Biomedical Engineering, 33(8), pp. 1034–1041.
[12] G. de Haan and V. Jeanne, “Robust Pulse Rate From Chrominance-Based rPPG,” in IEEE Transactions on Biomedical Engineering, vol. 60, no. 10, pp. 2878-2886, Oct. 2013.
[13] De Haan, G., &vanLeest, A. (2014). Improved motion robustness of remote-PPG by using the blood volume pulse signature. Physiological Measurement, 35(9), 1913.
[14] W. Wang, S. Stuijk and G. de Haan, “A Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation,” in IEEE Transactions on Biomedical Engineering, vol. 63, no. 9, pp. 1974-1984, Sept. 2016.
[15] Poh, M.-Z., McDuff, D. J., &Picard, R. W. (2010). Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Optics Express, 18(10), 10762.
[16] Y. C. Lin and Y. H. Lin, “Step Count and Pulse Rate Detection Based on the Contactless Image Measurement Method,” in IEEE Transactions on Multimedia.
[17] M. C. Li and Y. H. Lin, “A real-time non-contact pulse rate detector based on smartphone,” 2015 International Symposium on Next-Generation Electronics (ISNE), Taipei, 2015, pp. 1-3.
[18] Y. C. Lin, G. Y. Lin and Y. H. Lin, “Development of a FPGA-based contactless pulse rate detection system,” 2016 2nd International Conference on Intelligent Green Building and Smart Grid (IGBSG), Prague, 2016, pp. 1-5.
[19] Van Gastel, M., Stuijk, S., & de Haan, G. (2016). Robust respiration detection from remote photoplethysmography. Biomedical Optics Express, 7(12), 4941–4957.
[20] Zhao, F., Li, M., Qian, Y., & Tsien, J. Z. (2013). Remote Measurements of Heart and Respiration Rates for Telemedicine. PLoS ONE, 8(10), e71384.
[21] Tarassenko, L., Villarroel, M., Guazzi, A., Jorge, J., Clifton, D. A., &Pugh, C. (2014). Non-contact video-based vital sign monitoring using ambient light and auto-regressive models. Physiological Measurement, 35(5), 807.
[22] D. Shao, Y. Yang, C. Liu, F. Tsow, H. Yu and N. Tao, “Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time,” in IEEE Transactions on Biomedical Engineering, vol. 61, no. 11, pp. 2760-2767, Nov. 2014.
[23] Humphreys, K., Ward, T., &Markham, C. (2007). Noncontact simultaneous dual wavelength photoplethysmography: A further step toward noncontact pulse oximetry. Review of Scientific Instruments, 78(4), 44304.
[24] Kong, L., Zhao, Y., Dong, L., Jian, Y., Jin, X., Li, B., Wu, H. (2013). Non-contact detection of oxygen saturation based on visible light imaging device using ambient light. Optics Express, 21(15), 17464.
[25] Bal, U. (2015). Non-contact estimation of heart rate and oxygen saturation using ambient light. Biomedical Optics Express, 6(1), 86–97.
[26] J. Jiang, D. Liu, J. Gu and S. Süsstrunk, "What is the space of spectral sensitivity functions for digital color cameras?," 2013 IEEE Workshop on Applications of Computer Vision (WACV), Tampa, FL, 2013, pp. 168-179.
[27] H. Y. Tsai, K. C. Huang, H. C. Chang and C. H. Chang, "A study on oxygen saturation images constructed from the skin tissue of human hand," 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Minneapolis, MN, 2013, pp. 58-62.
[28] H. Y. Tsai, K. C. Huang, H. C. Chang, J. L. A. Yeh and C. H. Chang, "A Noncontact Skin Oxygen-Saturation Imaging System for Measuring Human Tissue Oxygen Saturation," in IEEE Transactions on Instrumentation and Measurement, vol. 63, no. 11, pp. 2620-2631, Nov. 2014.
[29] D. Shao et al., “Noncontact Monitoring of Blood Oxygen Saturation Using Camera and Dual-Wavelength Imaging System,” in IEEE Transactions on Biomedical Engineering, vol. 63, no. 6, pp. 1091-1098, June 2016.
[30] G. Bai, J. Huang and H. Liu, “Real-Time Robust Noncontact Heart Rate Monitoring With a Camera,” in IEEE Access, vol. 6, pp. 33682-33691, 2018.
[31] Vogels, T., VanGastel, M., Wang, W., DeHaan, G., “Fully-automatic camera-based pulse-oximetry during sleep”, Computer Vision and Pattern Recognition (CVPR) Conference 2018. 1462–1470.
[32] S. Sanyal and K. K. Nundy, “Algorithms for Monitoring Heart Rate and Respiratory Rate From the Video of a User’s Face,” in IEEE Journal of Translational Engineering in Health and Medicine, vol. 6, pp. 1-11, 2018.
[33] A. B. Hertzman and C. R. Spealman, “Observations on the finger volume pulse recorded photoelectrically,” Amer. J. Physiol. Meas., vol. 119, pp. 334-335, 1937.
[34] Matt. Fujitsu’s camera software can read your pulse just by looking at your face - The Verge. Retrieved May 23, 2018, from https://www.theverge.com/2013/3/18/4118268/smartphone-camera-pulse-monitor
[35] Yelda Atamaz Pinar, Figen Govsa, and S. C. (n.d.). Arteries of the Face and Neck | Plastic Surgery Key. Retrieved May 23, 2018, from https://plasticsurgerykey.com/arteries-of-the-face-and-neck/
[36] M. van Gastel, S. Stuijk and G. de Haan, “Motion Robust Remote-PPG in Infrared,” in IEEE Transactions on Biomedical Engineering, vol. 62, no. 5, pp. 1425-1433, May 2015.
[37] M. Hulsbusch, “An image-based functional method for opto-electronic detection of skin-perfusion (in German),” Ph.D. dissertation, RWTH Aachen, 2008.
[38] Corral Martinez, L. F., Paez, G., &Strojnik, M. (2011). Optimal wavelength selection for noncontact reflection photoplethysmography, 801191(November 2011), 801191.
[39] Kanzawa, Y., Kimura, Y., &Naito, T. (2011). Human Skin Detection by Visible and Near-Infrared Imaging. IAPR Conference on Machine Vision, pp. 503–507. Retrieved from http://www.mva-org.jp/Proceedings/2011CD/papers/14-22.pdf
[40] John Hopkins. Vital Signs (Body Temperature, Pulse Rate, Respiration Rate, Blood Pressure) | Johns Hopkins Medicine Health. Retrieved May23, 2018, from https://www.hopkinsmedicine.org/healthlibrary/conditions/cardiovascular_diseases/vital_signs_body_temperature_pulse_rate_respiration_rate_blood_pressure
[41] M. Folke, L. Cernerud, M. Ekstr öm, B. Hok, "Critical review of non-invasive respiratory monitoring in medical care", Med. Bio1. Eng. Comp., vol. 41, no. 4, pp. 377-383, July 2003.
[42] Scalp and Face | Basicmedical Key. (n.d.). Retrieved May23, 2018, from https://basicmedicalkey.com/scalp-and-face/
[43] Togias, A. (2003). Rhinitis and asthma: Evidence for respiratory system integration. Journal of Allergy and Clinical Immunology, 111(6), 1171–1183.
[44] Liu, H., Ivanov, K., Wang, Y., &Wang, L. (2015). A novel method based on two cameras for accurate estimation of arterial oxygen saturation. BioMedical Engineering Online, 14(1), 1–17.
[45] Verkruysse, W., Bartula, M., Bresch, E., Rocque, M., Meftah, M., & Kirenko, I. (2017). Calibration of Contactless Pulse Oximetry. Anesthesia and Analgesia, 124(1), 136–145.
[46] VanGastel, M., Stuijk, S., &DeHaan, G. (2016). New principle for measuring arterial blood oxygenation, enabling motion-robust remote monitoring. Scientific Reports, 6(April), 1–16.
[47] Guazzi, A. R., Villarroel, M., Jorge, J., Daly, J., Frise, M. C., Robbins, P. A., &Tarassenko, L. (2015). Non-contact measurement of oxygen saturation with an RGB camera. Biomedical Optics Express, 6(9), 3320.
[48] P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai, HI, USA, 2001, pp. I-I.
[49] Lin, S.-T., Chen, W.-H., &Lin, Y.-H. (2017). A Pulse Rate Detection Method for Mouse Application Based on Multi-PPG Sensors. Sensors, 17(7).
[50] Davis, S., Watkinson, P., Guazzi, A., McCormick, K., Tarassenko, L., Jorge, J., Green, G. (2014). Continuous non-contact vital sign monitoring in neonatal intensive care unit. Healthcare Technology Letters, 1(3), 87–91.
[51] ECG EKG Cardiac Monitoring LITFL ECG LLIbrary. (n.d.). Retrieved August22, 2018, from https://lifeinthefastlane.com/ecg-library/basics/lead-positioning/
[52] IVAM - “oBPM” – a disruptive technology for non-invasive, continuous blood pressure measurement. (n.d.). Retrieved August22, 2018, from https://www.ivam.de/news/MikroMedia_2_2017_1?lang=en
[53] Y. Lin and Y. Lin, “Step Count and Pulse Rate Detection Based on the Contactless Image Measurement Method,” in IEEE Transactions on Multimedia, vol. 20, no. 8, pp. 2223-2231, Aug. 2018.