簡易檢索 / 詳目顯示

研究生: 洪信甫
Hsin-Fu Hung
論文名稱: 即時瞳孔偵測系統
A Real-Time Pupils Detection System
指導教授: 王乃堅
Nai-Jian Wang
口試委員: 呂學坤
Shyue-Kung Lu
方劭云
Shao-Yun Fang
鍾順平
Shun-Ping Chung
蔡超人
Chau-Ren Tsai
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 中文
論文頁數: 96
中文關鍵詞: 非接觸式互動人臉偵測平面旋轉人臉瞳孔偵測
外文關鍵詞: Contactless Interaction, Face Detection, Point-Rotation Face, Pupils Detection System
相關次數: 點閱:191下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

現今,絕大多數的人機介面皆透過鍵盤、滑鼠或觸控裝置等接觸式裝置來控制與互動。如何讓裝置主動地分析人類的行為表現,並提供人類所需求的服務以達到非接觸式的互動,將會是人機互動的未來趨勢。非接觸式的人機介面可藉由瞳孔偵測系統來達成。瞳孔偵測系統是希望透過影像處理的方法,從攝影機所擷取的影像進行瞳孔偵測,並且根據偵測的結果進一步分析出使用者雙眼的開闔狀態。
人臉偵測的功能是藉由影像處理來進行的典型人機互動方式。本研究以人臉偵測為基礎,更進一步地發展出瞳孔偵測系統。在使用傳統的人臉偵測系統時,使用者必須臉部正對攝影機才能使系統正常運作。這個限制造成使用者在操作上有些不自然。本篇論文中提出可以對平面旋轉的人臉進行偵測的架構。架構中,首先利用膚色偵測定位出人臉候選區並針對候選區進行邊緣偵測,接著套用放射性模板進行邊緣特徵的搜尋。根據放射性模板的特徵搜尋結果可以將平面旋轉的人臉校正為正常(up-right)角度,後續使用一個正常(up-right)角度的人臉偵測模組對該候選區進行人臉驗證。經由上述的步驟後,將人臉影像進行力矩權重定位法擷取出眼部區域,並且由YUV色彩空間過濾出瞳孔的最終位置。藉由這個系統架構,使用者可以更加自然、直覺地操作系統。


Nowadays, most of man-machine interfaces are controlled by contact devices such as keyboard, mouse, or touch panel. It will be a future trend of man-machine interface to analyze human behaviors and provide suitable services through contactless interfaces instead of contact interfaces. Man-machine contactless interface can be achieved by pupils detection system. Pupils detection system can detect user’s pupils from the input image by camera and further analyze user’s eyes status (close or open). Then, the pupils detection system can play a key role in contactless man-machine interface.
Face detection conducted by image processing is a crucial part of man-machine interaction. This research is on the basis of face detection to develop a pupils detection system. In the typical face detection system, users need to face the camera without head tilting to make the system operate normally and accurately. Due to this limitation, it is inconvenient in the real practical applications. This research proposes a point-rotation face detection framework. In this framework, we first locate the face candidates by skin tone detection and apply the edge detection on the candidates to complete the localization. Then we search the edge features by radial template. By the symmetricity of faces, our method can correct the face image to the up-right angle. Finally, a frontal face detector is used to determine the existence and the location of faces. After the previous process the face image will be converted to an up-right face image. Then we apply the torque-weight method to extract the eyes region on the face image. At last, the pupils in the eyes region are detected by using YUV color space. By the proposed framework, the users can operate the system more instinctively and easily.

摘要 I Abstract II 誌謝 IV 目錄 V 圖目錄 VII 表目錄 X 第一章 緒論 1 1.1 研究背景與動機 1 1.2 文獻回顧 2 1.3 論文目標 2 1.4 論文組織 3 第二章 系統架構與發展環境 4 2.1 系統架構 4 2.1.1 系統流程圖 4 2.1.2 系統模組架構 4 2.2 開發環境 7 第三章 前端處理演算法 8 3.1人臉候選區定位 8 3.1.1膚色偵測 8 3.1.2 快速物件聯通標記法 14 3.1.3候選區size filter 26 3.2臉部邊緣特徵 28 3.2.1邊緣偵測 28 3.2.2邊緣雜訊濾除 31 3.3人臉旋轉校正 33 3.3.1 相關演算法探討 33 3.3.2 角度判定器 36 3.3.3放射性模板 37 3.3.4放射性模板直方圖 38 3.3.5旋轉角度估算 41 3.3.6 精準度問題解決 45 第四章 人臉候選區驗證與瞳孔定位 48 4.1 人臉偵測 48 4.1.1 Haar-like特徵 49 4.1.2 積分影像 52 4.1.3 積分影像運用方式 54 4.1.4弱學習演算法 56 4.1.5AdaBoost演算法 58 4.2 眼部區域截取 64 4.2.1 眼部候選區定位 64 4.2.2力矩權重定位法 66 4.3 瞳孔偵測 67 第五章 實驗結果與分析 71 5.1 Sample001影像序列實驗與分析 72 5.2 Sample002影像序列實驗與分析 73 5.3 Sample003影像序列實驗與分析 75 5.4 Sample004影像序列實驗與分析 77 5.5 Sample005影像序列實驗與分析 79 5.6 綜合偵測率與效能分析 81 第六章 結論與未來研究方向 82 6.1 結論 82 6.2 未來研究方向 82 參考文獻 84

[1]. Christophe Garcia and Georgios Tziritas, “Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis,” IEEE Transactions on Multimedia, Vol. 1, No. 3, pp. 264-277, 1999.
[2]. Constantine P. Papageorgiou, Michael Oren, Tomaso Poggio, “A General Framework for Object Detection,” IEEE Sixth International Conference on Computer Vision, pp. 555-562, 1998.
[3]. Paul Viola and Micheal Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 511-518,2001.
[4]. Cha Zhang and Zhengyou Zhang, “A Survey of Recent Advances in Face Detection,” Microsoft Research, 2010.
[5]. Bo Wu, Haizhou Ai, Chang Huang, Shihong Lao, “Fast Rotation Invariant Multi-View Face Detection Based on Real Adaboost,” IEEE International Conference on Automatic Face and Gesture Recognition, pp. 79-84, 2004.
[6]. Duan-Sheng Chen and Zheng-Kai Liu, “Generalized Haar-Like Features for Fast Face Detection,” IEEE International Conference on Machine Learning and Cybernetics, Vol. 4, pp. 2131-2135, 2007.
[7]. Qi Han, Qiong Li, Xiongdong Huang, Tong Zhou and XiaMu Niu, “Eyes Tracking in a Video Sequence Based-On Haar-like Features and Skin Color,” IEEE Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Vol. 1, pp. 608-611, 2007.
[8]. Cheng-Chin Chiang, Wen-Kai Tai, Mau-Tsuen Yang, Yi-Ting Huang and Chi-Jaung Huang,“ A Novel Method for Detecting Lips, Eyes and Faces in Real Time,” Real-Time Imaging, Vol. 9, pp. 277-287, 2003.
[9]. Xiao-Guang Lv, Jie Zhou and Chang-Shui Zhang, “A Novel Algorithm for Rotated Human Face Detection,” IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 760-765, 2000.
[10]. Heng Liu, Shengye Yan, Xilin Chen and Wen Gao, “Rotated Face Detection in Color Images Using Radial Template (RT),” IEEE International Conference on Multimedia and Expo, Vol. 3, pp. 137-140, 2003.
[11]. Lienhart Rainer, Maydt Jochen, “An Extended Set of Haar-like Features for Rapid Object Detection,” IEEE International Conference on Image Processing, Vol. 1, pp. 900-903, 2002.
[12]. Lifeng He, Yuyan Chao, Kenji Suzuki and Kesheng Wu, “Fast Connected-Component Labeling,” Pattern Recognition, Vol. 42, pp. 1977-1987, 2009.
[13]. Lifeng He, Yuyan Chao and Kenji Suzuki, “A Run-Based Two-Scan Labeling Algorithm,” IEEE Transactions on Image Processing, Vol. 17, pp. 749-756, 2008.
[14]. Rowley Henry A., Baluja Shumeet, Kanade Takeo, “Rotation Invariant Neural Network-Based Face Detection,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition , pp. 963-970, 1998.
[15]. Changming Sun, “Symmetry Detection Using Gradient Information,” Pattern Recognition Letters, Vol. 16, pp. 987-996, 1995.
[16]. Changming Sun and D. Si, “Fast Reflectional Symmetry Detection Using Orientation Histograms,” Real-Time Imaging, Vol. 5, pp. 63-74,1999.
[17]. Rainer Lienhart, Alexander Kuranov, Vadim Pisarevsky, “Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection,” Pattern Recognition, Vol. 2781, pp. 297-304, 2003.
[18]. Shuo Chen and Chengjun Liu, “Fast Eye Detection Using Different Color Space,” IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 521-526, 2011.

QR CODE