簡易檢索 / 詳目顯示

研究生: 劉翁昌
Wang-Chang Liu
論文名稱: 複雜環境下之即時人臉偵測與辨識系統
Real-time Face Detection and Recognition System under Complex Environment
指導教授: 阮聖彰
Shanq-Jang Ruan
口試委員: 許孟超
Mon-Chau Shie
林昌鴻
Chang-Hong Lin
吳晉賢
Chin-Hsien Wu
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2009
畢業學年度: 97
語文別: 中文
論文頁數: 70
中文關鍵詞: 人臉偵測人臉辨識主成份分析人臉校正即時
外文關鍵詞: face detection, face recognition, PCA, face adjustment, real-time
相關次數: 點閱:386下載:11
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 有鑒於實際的人臉偵測與辨識系統需要運作在真實複雜場景裡,環境中複雜的背景、人臉不同拍攝角度和人臉區域框選位置與大小皆會影響到人臉辨識率。因此本論文目的為克服這些因素並減少環境的干擾,建立能夠運作於真實環境的人臉辨識系統。在人臉偵測的部份結合了灰階人臉特徵偵測與彩色膚色密度計算,改善灰階特徵偵測的誤判情形。在人臉區域框選部份,利用人臉五官特徵定位,取出人臉區域並進行不同角度的旋轉校正,有效排除大部分複雜背景與降低人臉旋轉角度的影響。在資料庫訓練與人臉辨識的部份採用了主成份分析法(Principal Component Analysis, PCA)來降低人臉特徵資料量並利用人臉特徵空間投影係數的距離比對來決定辨識結果。

    本論文結合了人臉偵測、人臉區域框選正規化與人臉辨識三個部份,實現複雜環境下之人臉辨識系統。系統在實際場景進行測試時,運用本論文所提出之人臉正規框選校正方法,人臉辨識率從原本的73.8%提昇至91.6%。在系統運作速度上,本論文亦進行程式效能瓶頸的改善,辨識速度從1.1fps提昇為9fps的運作速度,滿足了實際環境中即時處理的需求。


    There is an urgent need for Face Detection and Recognition System (FDRS) to be used in complex situations. However, face recognition rates are often affected by complicated background, different head angles, variant face size and position. For building a Face Recognition System under real environment, this thesis aims to solve these problems and reduce the interferences occurred in the environment. The author combines gray-scale facial feature and skin color density to improve face detection yield. Also, at face identifiable region segmentation, the author uses facial feature to orientate facial region, and then modifies each with different angles. This method can efficiently exclude the dominant effects from the complex background information and the distortions via rotating angles. At database training and face recognition stage, the Principal Component Analysis method (PCA) is adopted to decompose and reduce the mass facial feature information. Moreover, the author uses the Euclidean distance of projection coefficients of facial eigen-space to determine the recognition results.

    Overall, in this thesis, it combines face detection, face region normalization and face recognition to elaborate a face recognition system under complex scenarios. In real simulation, the proposed method improves face recognition rate from 73.8% up to 91.6%. Not only does the proposed method speed up the function efficiency from 1.1 fps up to 9fps but also fulfils the instant need in real settings.

    論文摘要 i Abstract ii 誌謝 iii 目錄 iv 圖索引 vii 表索引 x 第一章 緒論 1 1.1 研究動機 1 1.2 研究目標 2 1.3 研究方法 2 1.4 論文架構 3 第二章 相關知識 5 2.1 人臉偵測方法 5 2.1.1 色彩分割應用於人臉偵測 5 2.1.2 Adaboost訓練演算法應用於人臉偵測 6 2.2 主成份分析應用於人臉辨識 12 2.3 影像處理基礎 13 2.3.1 色彩空間 13 2.3.2 二值化 14 2.3.3 形態學 16 2.3.4 連通法 18 2.3.5 影像旋轉 20 第三章 人臉辨識系統設計 22 3.1 系統整體運作流程 22 3.2 人臉偵測框選 23 3.3 人臉內部特徵定位 25 3.3.1 眼睛特徵候選區塊取得 25 3.3.2 嘴部特徵候選區塊取得 33 3.3.3 眼睛嘴巴配對演算法 35 3.4 人臉正規化處理 38 3.4.1 第一次框選校正 39 3.4.2 人臉旋轉角度校正 40 3.4.3 第二次框選校正 42 3.5 人臉資料庫訓練與辨識 43 3.5.1 人臉資料庫訓練方法與步驟 44 3.5.2 人臉辨識方法 48 第四章 系統測試與實驗結果 50 4.1 實驗環境與設備 50 4.2 人臉資料庫 53 4.2.1 ORL 人臉資料庫 53 4.2.2 自製ESL人物資料庫 53 4.3 系統測試方法與測試目的介紹 54 4.4 實驗結果 56 4.4.1 辨識率測試結果與比較 56 4.4.2 系統運作速度測試結果與效能提昇 59 第五章 結論與未來展望 63 5.1 結論 63 5.2 未來展望 63 附錄A: ORL人臉資料庫 64 附錄B: ESL人物資料庫 65 附錄C: ESL人臉資料庫(正規化) 66 附錄D: ESL人臉資料庫(未正規化) 67 參考文獻 68

    [1]M. H. Yang and N. Ahuja, “Detecting Human Faces in Color Images,” IEEE Int’l Conf. Image Processing, pp. 127-139, Oct. 1998.
    [2]R.L. Hsu, M. Abdel-Mottaleb, and AK. Jain, "Face Detection in Color Images," IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 24, no. 5, pp. 696-706, 2002.
    [3]鄭凱方,「人臉可辨識度計算用於監控系統中人臉正面最佳影像判定」,碩士論文,資訊工程所,國立中央大學,桃園(2005)。
    [4]K. Sobottka and I. Pitas, “Extraction of facial regions and features using color and shape information”, in Proc. 13th International Conference on Pattern Recognition, pp.421-425, Vienna, Austria, Aug. 1996.
    [5]P. Viola and M. J. Jones, "Robust Real-Time Face Detection," International Journal of Computer Vision, Vol. 57, pp. 137-154, May 2004.
    [6]P. Viola and M. J. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 511-518, 2001.
    [7]P. Viola and M. J. Jones, "Fast and Robust Classification using Asymmetric AdaBoost and a Detector Cascade," NIPS, pp. 1311-1318, 2001.
    [8]R. Lienhart, A. Kuranov and V. Pisarevsky, "Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection", Technical report, MRL, Intel Labs, 2002.
    [9]Y. Freund and R.E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol.55, pp. 119-139, 1997.
    [10]R. E. Schapire, "The Strength of Weak learnability," Machine Learning, Vol. 5, pp. 197-227, 1990.
    [11]V. Perlibakas, "Distance measures for PCA-based face recognition", Pattern Recognition Letters 25, 711 - 724, 2004.
    [12]M. Kirby and L. Sirovich, "Application of the Karhunen-Loeve procedure for the characterization of human faces", IEEE Trans. Pat. Anal. Mach. Intell. 12, 1990.
    [13]M.A. Turk and A.P. Pentland, "Face recognition using eigenfaces," Computer Vision and Pattern Recognition, 1991.
    [14]R. C. Gonzalez and R. E. Woods, “Digital Image Processing,” Second edition, Prentice Hall, 2002.
    [15]N. Otsu, "A threshold selection method from gray-level histogram," IEEE Transactions on System, Man, Cybernetics, 19(1):62-66, January 1978.
    [16]W. Niblack, “An Introduction to Digital Image Processing,” Prentice-Hall, Englewood Cliffs, New Jersey, pp. 115-116, 1986.
    [17]J. Sauvola, M. Pietikainen, “Adaptive Document Image Binarization,” Pattern Recognition 33, p.225-236, 2000.
    [18]井上誠喜、八木伸行、林正樹、中須英府輔、三谷公二、奧井誠人,C語言數位影像處理,全華圖書,中華民國95年。
    [19]M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision, PWS Publishing , 1999.
    [20]S. Jiazhen, S. E. Reichenbach, “Interpolation by asymmetric, two-dimensional cubic convolution,” IEEE International Conference on Image Processing, vol. 2, Sept. 2005.
    [21]C. Garcia, and G. Tziritas. “Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis,” in IEEE Transactions on Multimedia, vol. 1. no. 3. September, pp. 264-277, 1999.
    [22]陳志銘,「利用環場及 PTZ攝影機建構室內環境監控系統作臉部辨識」,碩士論文,資訊工程所,國立中央大學,桃園(2008)。
    [23]張家豪,「以AAM與PCA為基礎之眼鏡特徵弱化方法於人臉辨識之改進」,碩士論文,資訊工程所,國立中央大學,桃園(2008)。
    [24]楊煒達,「簡易方法之少量人臉辨識系統」,碩士論文,資訊工程所,國立中央大學,桃園(2007)。
    [25]王志良、孟秀艷,人臉工程學,機械工業出版社(2008)。
    [26]鐘國亮,影像處理與電腦視覺,東華書局(2002)
    [27]謝育書,「基於投影方法的人臉辨識之研究」,碩士論文,資訊工程所,國立清華大學,新竹(2008)。
    [28]呂元昊,「以SOPC為基礎之人臉辨識系統」,碩士論文,電子工程所,國立台灣科技大學,台北(2005)。
    [29]李易俊,「基於Gabor特徵及二維PCA之人臉辨識」,碩士論文,電腦與通訊工程所,國立成功大學,台南(2005)。

    QR CODE