簡易檢索 / 詳目顯示

研究生: 韓宗翰
Zong-Han Han
論文名稱: 利用毫米波雷達訊號與特徵轉移深度神經網路之非接觸式心電訊號重建技術
Non-contact ECG signal reconstruction using millimeter wave radar signals and feature transfer deep neural networks
指導教授: 彭盛裕
Sheng-Yu Peng
曹昱
Tsao Yu
口試委員: 陳怡然
Yi-Jan Chen
許育瑞
Yu-Juei Hsu
謝易錚
Yi-Zeng Hsieh
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2023
畢業學年度: 111
語文別: 英文
論文頁數: 65
中文關鍵詞: 毫米波雷達心電圖神經網路深度學習非接觸式生理訊號監測遷移學習
外文關鍵詞: Non-contact physiological signal monitoring, Conformer
相關次數: 點閱:241下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 心電圖是一種用來檢測心臟功能的醫療診斷工具,透過將電極貼在身體不同部位,測量身體的心電信號,以繪製出心臟的電活動圖形,以檢測心臟的異常。心電圖也可以用於監測心臟疾病患者的治療效果和預防心臟疾病的發展。但目前臨床上的量測方法都是以接觸式為主,也就是說在量測前醫護人員必須協助病患黏貼電極貼片,這樣不僅會增加醫護人員作業量,也因為量測時會接觸病患皮膚,因此也不利於燒燙傷病患的量測。同時在流行性傳染病的疫情之下如流感,長時間接觸病患也會讓醫護人員增加被感染的風險,因此本論文提出非接觸式60GHz毫米波雷達為基礎的心電圖量測系統,在量測過程中無須協助病患黏貼電極貼片,可以減少醫護作業量,也因為無須接觸病患,醫護人員也不會暴露在受感染的風險之下,其量測方式為,透過60GHz 毫米波雷達裝置,量測病患胸口的微震動,並經訊號處理和深度學習,還原出心電圖,其中在訓練過程,將模型分成兩部分Encoder 和Decoder,先訓練Decoder 具有還原心電圖的能力,再訓練Encoder 能從雷達訊號中,找出PQRST 波的位置,最後由預先訓練好的Decoder還原成心電圖。


    An electrocardiogram (ECG) is a medical diagnostic tool to test heart function. An abnormality in the heart can be detected by placing electrodes on different body parts and measuring the body's electrocardiogram signal. ECG can also be used to monitor the effectiveness of treatment for heart disease patients and to prevent the development of heart disease. Currently, clinical ECG measurement methods are based on contact methods meaning that medical personnel must assist patients in applying electrode patches before measurement. This increases the workload of medical personnel and is not conducive to measuring burn or scalding patients. Additionally, during outbreaks of infectious diseases such as the flu, prolonged contact with patients can increase the risk of infection for medical personnel.

    Therefore, this paper proposes a non-contact 60GHz millimeter wave radar-based ECG measurement system. The measurement process does not require assistance from medical personnel to apply electrode patches, which can reduce the workload of medical personnel. Additionally, because it does not require contact with patients, medical personnel are not exposed to the risk of infection. During the measurement process, the system uses a 60GHz millimeter wave radar device to measure micro-vibrations in the patient's chest. The signal is processed and reconstructed ECG signal using deep learning. During training, the model is divided into two parts: an Encoder and a Decoder. The Decoder is trained to have the ability to reconstruct the ECG signal, and the Encoder is trained to find the position of the PQRST wave in the radar signal. Finally, the pre-trained Decoder is used to reconstruct the ECG.

    中文摘要 III Abstract in English IV Acknowledgement V Contents VI List of Figures X List of Tables XIV Chapter 1 Introduction 1 1.1 Background and Motivation for the Study 1 1.2 Study Purpose 2 1.3 Thesis Structure 3 2 Literature Review 4 2.1 Clinical ECG Measurement 4 2.2 Capacitive ECG 5 2.3 Physiological Monitoring Device and mmWave Radar 6 2.4 Radar Fundamentals 7 2.4.1 Chirp 7 2.4.2 Intermediate Frequency Signal (IF Signal) 8 2.4.3 Object Distance 9 2.4.4 Distance-related Parameters in Radar Systems 10 2.4.5 Micro Vibration Detection 11 2.5 Conformer 13 2.5.1 Feed Forward Module 14 2.5.2 Multihead Self-Attention Module 15 2.5.3 Convolution Module 15 2.6 Baseline ECG Reconstruction 18 2.6.1 Baseline Model 18 2.6.2 Convolutional Neural Network 18 2.6.3 Recurrent Neural Network 20 Chapter 3 Materials and Methods 21 3.1 Experiment Protocol 21 3.2 Participants 22 3.3 Data Preprocessing 23 3.3.1 Range-FFT 23 3.3.2 Range-Bin 24 3.3.3 Phase and Phase Difference 26 3.3.4 Bandpass Filter 26 3.3.5 Data Segmentation 27 3.3.6 Data Cleaning and Data Alignment 28 3.4 The Proposed ECG Reconstruction 30 3.4.1 Model Architecture 30 3.4.2 Conformer 31 3.4.3 ECG Encoder and Shared Decoder 32 3.4.4 Peak Detection 33 3.4.5 mmWave Encoder 34 3.5 Performance Evaluation 35 Chapter 4 Experimental Results 38 4.1 Signal Reconstruction Performance 38 4.2 Cardiac Events Integrity 41 4.3 Ablation Experiment 42 4.4 Comparison 43 Chapter 5 Discussion 45

    [1] B. Şahin and G. İlgün, “Risk factors of deaths related to cardiovascular diseases in world health organization (who) member countries,” Health & Social Care in the Community, vol. 30, no. 1, pp. 73–80, 2022.

    [2] D. U. Uguz, R. Dettori, A. Napp, M. Walter, N. Marx, S. Leonhardt, and C. Hoog Antink, “Car Seats with Capacitive ECG Electrodes Can Detect Cardiac Pacemaker Spikes,” Sensors (Basel), vol. 20, Nov 2020.

    [3] X. Yu, X. Chen, Y. Huang, L. Zhang, J. Guan, and Y. He, “Radar moving target detection in clutter background via adaptive dual-threshold sparse fourier transform,” IEEE Access, vol. 7, pp. 58200–58211, 2019.

    [4] X. Chen, B. Chen, J. Guan, Y. Huang, and Y. He, “Space-range-doppler focus-based low-observable moving target detection using frequency diverse array mimo radar,” IEEE Access, vol. 6, pp. 43892–43904, 2018.

    [5] I. Bekkerman and J. Tabrikian, “Target detection and localization using mimo radars and sonars,” IEEE Transactions on Signal Processing, vol. 54, no. 10, pp. 3873–3883, 2006.

    [6] Y. Wang, Z. Jiang, Y. Li, J.-N. Hwang, G. Xing, and H. Liu, “Rodnet: A real-time radar object detection network cross-supervised by camera-radar fused object 3d localization,” IEEE Journal of Selected Topics in Signal Processing, vol. PP, pp. 1–1, 02 2021.

    [7] W. Hu, Z. Zhao, Y. Wang, H. Zhang, and F. Lin, “Noncontact accurate measurement of cardiopulmonary activity using a compact quadrature doppler radar sensor,” IEEE Transactions on Biomedical Engineering, vol. 61, no. 3, pp. 725–735, 2014.

    [8] W. Massagram, V. M. Lubecke, A. HØst-Madsen, and O. Boric-Lubecke, “Assessment of heart rate variability and respiratory sinus arrhythmia via doppler radar,” IEEE Transactions on Microwave Theory and Techniques, vol. 57, no. 10, pp. 2542–2549, 2009.

    [9] J. Wang, X. Wang, Z. Zhu, J. Huangfu, C. Li, and L. Ran, “1-d microwave imaging of human cardiac motion: An ab-initio investigation,” IEEE Transactions on Microwave Theory and Techniques, vol. 61, no. 5, pp. 2101–2107, 2013.

    [10] C. Li, V. M. Lubecke, O. Boric-Lubecke, and J. Lin, “A review on recent advances in doppler radar sensors for noncontact healthcare monitoring,” IEEE Transactions on Microwave Theory and Techniques, vol. 61, no. 5, pp. 2046–2060, 2013.

    [11] J. Chen, D. Zhang, Z. Wu, F. Zhou, Q. Sun, and Y. Chen, “Contactless electrocardiogram monitoring with millimeter wave radar,” IEEE Transactions on Mobile Computing, pp. 1–17, 2022.

    [12] C. Xu, H. Li, Z. Li, H. Zhang, A. S. Rathore, X. Chen, K. Wang, M.-c. Huang, and W. Xu, “Cardiacwave: A mmwave-based scheme of non-contact and high-definition heart activity computing,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 5, sep 2021.

    [13] J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” CoRR, vol. abs/1411.4038, 2014.

    [14] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” CoRR, vol. abs/1706.03762, 2017.

    [15] A. Gulati, J. Qin, C.-C. Chiu, N. Parmar, Y. Zhang, J. Yu, W. Han, S. Wang, Z. Zhang, Y. Wu, and R. Pang, “Conformer: Convolution-augmented transformer for speech recognition,” eess.AS, 2020.

    [16] H. Lee and H. Kwon, “Going deeper with contextual cnn for hyperspectral image classification,” IEEE Transactions on Image Processing, vol. 26, no. 10, pp. 4843–4855, 2017.

    [17] D. Han, Q. Liu, and W. Fan, “A new image classification method using cnn transfer learning and web data augmentation,” Expert Systems with Applications, vol. 95, pp. 43–56, 2018.

    [18] Y. Chen, H. Jiang, C. Li, X. Jia, and P. Ghamisi, “Deep feature extraction and classification of hyperspectral images based on convolutional neural networks,” IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 10, pp. 6232–6251, 2016.

    [19] D. Yu, A. Li, J. Li, Y. Xu, and Y. Long, “Mean inflection point distance: Artificial intelligence mapping accuracy evaluation index—an experimental case study of building extraction,” Remote Sensing, vol. 15, no. 7, 2023.

    [20] W. Qiu, Z. Pan, and J. Yang, “Few-shot polsar ship detection based on polarimetric features selection and improved contrastive self-supervised learning,” Remote Sensing, vol. 15, no. 7, 2023.

    [21] S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137–1149, 2017.

    [22] K. He, X. Zhang, S. Ren, and J. Sun, “Spatial pyramid pooling in deep convolutional networks for visual recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 9, pp. 1904–1916, 2015.

    [23] G. Cheng, P. Zhou, and J. Han, “Learning rotation-invariant convolutional neural networks for object detection in vhr optical remote sensing images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 12, pp. 7405–7415, 2016.

    [24] L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, “Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 40, no. 4, pp. 834–848, 2018.

    [25] F. Milletari, N. Navab, and S.-A. Ahmadi, “V-net: Fully convolutional neural networks for volumetric medical image segmentation,” in 2016 Fourth International Conference on 3D Vision (3DV), pp. 565–571, 2016.

    [26] V. Badrinarayanan, A. Kendall, and R. Cipolla, “Segnet: A deep convolutional encoder-decoder architecture for image segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 12, pp. 2481–2495, 2017.

    [27] E. Shelhamer, J. Long, and T. Darrell, “Fully convolutional networks for semantic segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 4, pp. 640–651, 2017.

    [28] S. Kiranyaz, T. Ince, and M. Gabbouj, “Real-time patient-specific ecg classification by 1-d convolutional neural networks,” IEEE Transactions on Biomedical Engineering, vol. 63, no. 3, pp. 664–675, 2016.

    [29] H.-T. Chiang, Y.-Y. Hsieh, S.-W. Fu, K.-H. Hung, Y. Tsao, and S.-Y. Chien, “Noise reduction in ecg signals using fully convolutional denoising autoencoders,” IEEE Access, vol. 7, pp. 60806–60813, 2019.

    [30] A. Reiss, I. Indlekofer, P. Schmidt, and K. Van Laerhoven, “Deep ppg: Large-scale heart rate estimation with convolutional neural networks,” Sensors, vol. 19, no. 14, 2019.

    [31] J. Huang, B. Chen, B. Yao, and W. He, “Ecg arrhythmia classification using stft-based spectrogram and convolutional neural network,” IEEE Access, vol. 7, pp. 92871–92880, 2019.

    [32] X. Fan, Q. Yao, Y. Cai, F. Miao, F. Sun, and Y. Li, “Multiscaled fusion of deep convolutional neural networks for screening atrial fibrillation from single lead short ecg recordings,” IEEE Journal of Biomedical and Health Informatics, vol. 22, no. 6, pp. 1744–1753, 2018.

    [33] B. Pourbabaee, M. J. Roshtkhari, and K. Khorasani, “Deep convolutional neural networks and learning ecg features for screening paroxysmal atrial fibrillation patients,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 48, no. 12, pp. 2095–2104, 2018.

    [34] M. Sundermeyer, H. Ney, and R. Schlüter, “From feedforward to recurrent lstm neural networks for language modeling,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 23, no. 3, pp. 517–529, 2015.

    [35] Y. Qian, M. Bi, T. Tan, and K. Yu, “Very deep convolutional neural networks for noise robust speech recognition,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 24, no. 12, pp. 2263–2276, 2016.

    [36] A. Pearce, J. A. Zhang, R. Xu, and K. Wu, “Multi-object tracking with mmwave radar: A review,” Electronics, vol. 12, no. 2, 2023.

    [37] M. Alizadeh, G. Shaker, J. C. M. D. Almeida, P. P. Morita, and S. Safavi-Naeini, Remote monitoring of human vital signs using mm-wave fmcw radar,” IEEE Access, vol. 7, pp. 54958–54968, 2019.

    [38] M. Tsipouras, D. Fotiadis, and D. Sideris, “An arrhythmia classification system based on the rr-interval signal,” Artificial Intelligence in Medicine, vol. 33, no. 3, pp. 237–250, 2005.

    無法下載圖示 全文公開日期 2028/05/15 (校內網路)
    全文公開日期 2028/05/15 (校外網路)
    全文公開日期 2028/05/15 (國家圖書館:臺灣博碩士論文系統)
    QR CODE