簡易檢索 / 詳目顯示

研究生: 李承翰
Chen-han Lee
論文名稱: 主動式多解析度人臉辨識系統
An Active Human-Machine Interface based on Multi-Resolution Face Recognition
指導教授: 陳建中
Jiann-Jone Chen
口試委員: 蔡超人
Chau-Ren Tsai
黃雅軒
Yea-Shuan Huang
張意政
I-Cheng Chang
劉俊麟
Chun-Lin Liu
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2011
畢業學年度: 99
語文別: 中文
論文頁數: 101
中文關鍵詞: 人臉辨識局部二元樣板局部方向樣板
外文關鍵詞: Face recognition, Local binary pattern, Local directional pattern
相關次數: 點閱:252下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

本論文提出一個適用於即時性(real-time)互動環境中,以數位影像處理技術開發主動式多解析度人臉辨識系統,以自動化及非接觸方式開發人機介面。人臉特徵抽取運用灰度不變特性之局部二元樣板(local binary pattern, LBP)紋理描述,搭配局部方向樣板(local directional pattern, LDP)紋理描述降低誤判率。為了提高表情造成的局部特徵變異容忍程度,故本論文提出非線性人臉影像區域切割統計紋理特徵直方圖演算法,依據平均樣板變異數矩陣及加速強健性特徵(speeded up robust features, SURF)角點匹配驗證人臉局部具鑑別性及抗變異性區域劃分為九格非線性子區塊,個別統計紋理直方圖以串接方式將影像局部與整體關係互相聯結並搭配權重式卡方匹配檢定,經實驗證實本論文提出非線性人臉影像區域切割統計紋理特徵演算法能有效抵抗表情變化並提昇人臉辨識準確率、降低誤判率,也可適用於大眾環境之性別辦識。針對即時主動的人機介面應用環境,除了表情變化問題,人機距離使影像具有不同解析度之情況,將嚴重影響到辨識穩定度。本論文提出三維紋理鑑別特徵方法,結合時間、空間資訊及多解析度人臉影像紋理分析並線性累加成整合直方圖,運用正規化突顯個人面部影像於不同時間、空間及距離所共存之主要紋理分佈。因此使用者可於不同時間、空間及距離皆可人機互動,系統依然能準確地辨識使用者身份,並且搭配自動化鑑別特徵學習機制及其權重更新,於運作時間不斷推移所致各種變異皆保持穩定地辨識效果。


We proposed to perform face recognition in an active and multi-resolution approach. The design target is to provide a real-time natural (non-contact) human interface for an IPTV system. For face image features, both local binary pattern and local directional pattern are adopted for robustness. In addition, these features and histogram statistics are extracted from one face image which is decomposed into nine blocks with different size. These decomposed face block regions are determined from an average face from which fast robust features for recognition can be obtained. The histogram statistics are extracted from each region individually and then are concatenated to yield the final feature vector. Weighted chi-square measurement is utilized for face recognition. Experiments verified that the proposed active face recognition method is insensitive to changing facial expressions. In addition, higher recognition accuracy and lower false positive rate can be achieved, which can also be applied to gender recognition. To develop an active human-machine interface under the condition that the face recognition has to be carried out in a multi-resolution approach, we proposed to use three-dimensional (3D) histogram which comprised histogram statistics across both time and space dimensions. The most distinguished feature of the proposed method is that it can perform face recognition very well when peoples are with different distances to the camera. In addition, the weighting factors are subjected to be updated in the recognition process and the discriminated features are selected through an learning algorithm, such that the system can maintain a stable recognition accuracy.

摘要 I ABSTRACT II 誌謝 III 目錄 IV 圖目錄 VII 表目錄 XII 第一章 緒論 1 1.1 前言 1 1.2 研究背景與動機 2 1.3 研究項目及方法 4 1.4 論文架構 6 第二章 人臉辨識背景知識 7 2.1 人臉偵測 7 2.2 人臉辨識 10 2.3 特徵描述 13 2.3.1 局部紋理描述 13 2.3.2 尺度旋轉不變特徵點描述 18 2.4 性別辨識 30 第三章 主動式多解析度人臉辨識系統 32 3.1 應用環境描述及系統架構 32 3.2 人臉偵測及影像前處理 34 3.2.1 OpenCV人臉訓練分類器 34 3.2.2 人臉誤判膚色遮罩過濾 38 3.3 非線性人臉區域切割紋理直方圖統計特徵擷取 42 3.3.1 局部紋理特徵描述 43 3.3.2 非線性人臉影像區域切割 45 3.4 人臉特徵辨識與自動統計學習 49 3.4.1 三維個人紋理鑑別特徵建立 50 3.4.2 即時性主動式人臉辨識及自動統計學習 51 3.5 延伸應用人數統計及性別辨識 55 3.5.1 人數統計及注視度分析 56 3.5.2 觀看者性別辨識 61 第四章 實驗結果 63 4.1 實驗平台及實驗人臉資料庫 63 4.2 人臉辨識 64 4.2.1 FERET靜態人臉影像辨識 64 4.2.2 主動式人臉辨識系統 72 4.3 性別辨識 79 第五章 結論與未來研究方向 81 5.1 結論 81 5.2 未來研究方向 82 參考文獻 83

[1] http://www.youtube.com/?gl=TW&hl=zh-TW
[2] http://en.wikipedia.org/wiki/OpenCV
[3] P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” IEEE Computer Society Conference on CVPR, Vol.1, pp.511-518, 2001.
[4] M.A. Turk and A.P. Pentland, "Face recognition using eigenfaces," presented at Computer Vision and Pattern Recognition, 1991.
[5] A. Mohan, C. Papageorgiou and T. Poggio, “Example-based Object Detection in Images by Components,” IEEE Pattern Analysis and Machine Intelligence, Vol.20, pp.39-51, 1998.
[6] J. Yang and A. Waibel, “A Real-Time Face Tracker,” Proc. Third Workshop Applications of Computer Vision, pp. 142-147, 1996.
[7] D. Benjamin, Zarit, J. Boaz, Super, and K.H. Francis, “Comparison of Five Color Models in Skin Pixel Classification” , International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-time Systems, pp. 58 - 63, Sept.1999.
[8] http://en.wikipedia.org/wiki/Color_space
[9] Zou, L.-H., Liu, Y.-C. “A new algorithm of counting human based on segmentation of human faces in color image” CIS 2009 - 2009 International Conference on Computational Intelligence and Security 2, art. no. 5376172, pp. 505-509
[10] Chen, A., Pan, L., Tong, Y., Ning, N. “Face detection technology based on skin color segmentation and template matching” 2nd International Workshop on Education Technology and Computer Science, ETCS 2010 2, art. no. 5458635, pp. 708-711
[11] D. Chai and A. Bouzerdoum, “A Bayesian Approach to Skin Color Classification in YCbCr Color Space,” TENCON 2000. Proceedings, IEEE, Kuala Lumpur Malaysia, Vol. 2, pp. 421-424, Sept. 2000.
[12] 廖維中,「以色彩分析為基礎之臉部遮蔽偵測應用於A T M 監視系統」,淡江大學資訊工程學系碩士論,民94。
[13] P.N Belhumeur, J.P. Hespanha, and D.J. Kriegman,, "Eigenfaces vs. Fisherfaces: recognition using class specific linear projection," IEEE Transactions, Pattern Analysis and Machine Intelligence, 1997
[14] Laura, L., Juan, L.B., Juan, M., Waldo, H. “Face recognition using SIFT and binary PSO descriptors” Proceedings of the International Conference on Information Technology Interfaces, ITI , art. no. 5546480, pp. 557-562
[15] J. Zhu, M.I. Vai and P.U. Mak, “Face Recognition Using 2D DCT with PCA", in The 4nd Chinese Conference on Biometric Recognition (Sinobiometrics’03) at Beijing, P. R. China, Dec. 7-8, 2003.
[16] G. Guo, S.Z. Li and K. Chan, “Face Recognition by Support Vector Machines”, Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000 pp. 196
[17] http://en.wikipedia.org/wiki/Support_vector_machine
[18] Ojala, T., Pietik‥ainen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29 (1996) 51–59
[19] Timo Ahonen, Abdenour Hadid, and Matti Pietik‥ainen ” Face Recognition with Local Binary Patterns” ECCV 2004, LNCS 3021, pp. 469–481, 2004.
[20] X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions", In Proc. IEEE International Workshop on Analysis and Modeling of Faces and Gestures 2007 (AMFG 2007), 2007.
[21] Taskeed Jabid, Md. Hasanul Kabir, and Oksam Chae” Local Directional Pattern (LDP) for Face Recognition” ICCE 2010 - 2010 Digest of Technical Papers International Conference on Consumer Electronics , art. no. 5418801, pp. 329-330.
[22] D. G. Lowe, "Object recognition from local scale-invariant features," International Conference of Computer Vision, vol. 60, pp. 1150-1157, 1999.
[23] D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, Nov. 2004.
[24] Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.” Speeded-Up Robust Features (SURF)” Computer Vision and Image Understanding 110 (3), pp. 346-359
[25] H. Lu and H. Lin, "Gender recognition using AdaBoosted feature," Third International Conference on Natural Computation, Vol. 2, pp. 646-650, Aug. 2007.
[26] M. J. Lyons, J. Budynek, A. Plante and S. Akamatsu, "Classifying facial attributes using a 2-D Gabor wavelet representation and discriminant analysis," Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 202-207, Mar. 2000.
[27] S. U. Jung, D. H. Kim, K. H. An and M. J. Chung, "Efficient rectangle feature extraction for real-time facial expression recognition based on AdaBoost," IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1941-1946, Aug. 2005.
[28] 林陳琦,「基於平均臉差異遮罩與二維離散餘弦轉換特徵之即時人臉性別辨識系統」,國立台灣科技大學電機工程系碩士論文,民99
[29] Du, S., Zheng, N., You, Q., Wu, Y., Yuan, M., Wu, J. , “Rotated haar-like features for face detection with in-plane rotation” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 4270 LNCS, pp. 128-137.
[30] Y. Freund and R. Schapire, “A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting,” Journal of Computer and System Sciences, pp.119-139, Aug. 1997.
[31] Timo Ojala, Matti PietikaÈ inen, “Multiresolution gray-scale and rotation invariant texture classification with local binary patterns” IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (7), pp. 971-987.
[32] http://face.nist.gov/colorferet/
[33] R.J. Baron, “Mechanisms of human facial recognition”, Int. J. Man-Machine Studies, 1981.
[34] http://www.scholarpedia.org/article/Local_Binary_Patterns
[35] 楊煒達,「簡易方法之少量人臉辨識系統」,國立中央大學資訊工程系碩士論文,民96

無法下載圖示 全文公開日期 2016/07/28 (校內網路)
全文公開日期 本全文未授權公開 (校外網路)
全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
QR CODE