簡易檢索 / 詳目顯示

研究生: 謝育錡
Yu-chi Hsieh
論文名稱: 嵌入式即時人臉偵測與辨識系統
Embedded Real-time Human Face Detection and Recognition System
指導教授: 許孟超
Mon-chau Shie
口試委員: 阮聖彰
Shanq-jang Ruan
吳晉賢
Chin-hsien Wu
林昌鴻
Chang-hong Lin
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2009
畢業學年度: 97
語文別: 中文
論文頁數: 59
中文關鍵詞: 進階相關性過濾器人臉偵測人臉辨識Qt即時嵌入式
外文關鍵詞: Advanced Correlation Filter, Human Face Detection, Human Face Recognition, Qt, Real-time, Embedded
相關次數: 點閱:257下載:7
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 人臉偵測與辨識一直廣泛的應用在不同領域,本論文針對Smart Phone,以跨平台Qt GUI開發環境整合人臉偵測與辨識模組,並以加裝攝影機的嵌入式Linux平台模擬Smart Phone,可即時完成偵測與辨識使用者,確保機密不外洩。

    本系統主要包含二個子模組,分別為人臉偵測模組和人臉訓練與辨識模組,人臉訓練與辨識的部份,採用進階相關性過濾器(Advanced Correlation Filters)來實做,並因應嵌入式平台速度與記憶體的限制,選擇適合的過濾器,將人臉資料透過快速傅立葉轉換轉至頻率域,並透過進階相關性過濾器以一人一檔案的方式製作成XML格式的人臉資料檔,以支援多人共用的Smart Phone裝置。

    系統經過實際測試,可正確的完成偵測與辨識使用者,使用ESL人臉資料庫,辨識率達92.57%,於嵌入式系統運作的效率在XScale-PXA270 520 MHz嵌入式系統環境下,單一人臉偵測速度可達200ms,單一人臉辨識速度可達400ms。


    The face detection and recognition are always applied to many different fields. This thesis focuses on the Smart Phones. We combine the human face detection and recognition modules by using Qt GUI Integration Development Environment (IDE) and utilize embedded system platform which has camera emulating Smart Phone. It can work in real-time and prevent the secret data be stolen via impostors.
    The system is composed of two modules: human face detection and human face database training and recognition. About the modules of human face database training and recognition, we implement those by using the Advanced Correlation Filters and choose the suitable one for the embedded system constraints in speed and memory. We convert the human face data from spatial domain to frequency domain by Fast Fourier Transform (FFT) in order to build human face database via Advanced Correlation Filter. For multi-user Smart Phone, we store human database in XML format file for each user.
    The experiment result shows that our system can detect human face and recognize it in real-time. The recognition rate is 92.57% by using ESL human face database. The performance on embedded system (XScale-PXA270 520 MHz) is 200ms for detection and 400ms for recognition per face.

    論文摘要 i Abstract ii 誌謝 iii 目錄 iv 圖索引 vi 表索引 viii 第一章 緒論 1 1.1 研究動機 1 1.2 研究目標 1 1.3 研究背景 2 1.3.1 外掛攝影模組 2 1.3.2 嵌入式系統平台 3 1.3.3 系統環境 4 1.3.4 開發環境 5 1.4 系統流程 6 1.5 論文內容概要 7 第二章 系統相關 8 2.1 人臉偵測介紹 8 2.1.1 Color-based methods 8 2.1.2 Knowledge-based methods 8 2.1.3 Feature-based methods 9 2.1.4 Template matching methods 9 2.1.5 Appearance-based methods 10 2.2 Advanced Correlation Filters 相關知識 10 2.2.1 離散傅立葉轉換 (Discrete Fourier Transform) 11 2.2.2 交叉相互關聯(Cross-correlation) 12 2.3 ARM嵌入式處理器 15 2.4 嵌入式Linux系統 15 2.4.1 Linux與嵌入式Linux 16 2.4.2 Linux系統之組成 17 2.4.3 ARM EABI 18 2.5 Qt 20 第三章 即時人臉偵測與辨識系統 21 3.1 人臉偵測模組 22 3.1.1 Adaboost訓練流程 22 3.1.2 Adaboost物體偵測 26 3.1.3 嵌入式人臉偵測效能最佳化 30 3.2 人臉資料前置處理 31 3.2.1 雙線性內插法(Bilinear Interpolation) 34 3.2.2 前置處理執行成效 35 3.3 人臉訓練與辨識 36 3.3.1 流程架構 36 3.3.2 Minimum Average Correlation Energy Filter 38 3.3.3 Unconstrained Minimum Average Correlation Energy Filter 39 3.3.4 Peak to Sidelobe Ratio(PSR) 40 3.4 GUI系統整合 42 3.4.1 人臉訓練GUI系統使用說明 42 3.4.2 人臉辨識GUI系統使用說明 43 第四章 實驗結果 45 4.1 系統實驗相關介紹 45 4.2 人臉偵測速度 46 4.3 人臉訓練速度 47 4.4 人臉辨識速度 48 4.5 人臉辨識率實驗 49 4.5.1 人臉辨識門檻值 49 4.5.2 人臉辨識率 52 第五章 結論與未來方向 54 附錄 A: CMU AMP LAB人臉資料庫 55 附錄 B: NTUST ESL人臉資料庫 56 參考文獻 57

    [1]B.V.K. Vijaya Kumar, M. Savvides, K. Venkataramani, Xie Chunyan. “Spatial frequency domain image processing for biometric recognition Image Processing,” IEEE ICIP, vol 1, pp.22-25, Sept. 2002.
    [2]M.H. Yang, D. Kriegman, and N. Ahuja. “Detecting faces in images: A survey,” IEEE Trans. on Pattern Anal. Mach. Intell., 24(1), 34-58, 2002.
    [3]Paul Viola, Michael J. Jones. “Robust Real-time Object Detection,” Cambridge Research Laboratories, 2001/01.
    [4]Y. Freund and R.E. Schapire. “A decision-theoretic generalization of no-line learning and an application to boosting,” Journal of Computer and System Sciences, vol.55, pp. 119-139, 1997.
    [5]M.A. Turk and A.P. Pentland, Face recognition using eigenfaces, Computer Vision and Pattern Recognition, 1991.
    [6]Peter N. Belhumenr, Joao P. Hespanha and David J. Kriegman. “Eigenfaces vs. Fisherfaces:Recognition Using Class Specific Linear Projection,”IEEE Transactions on Pattern Analysis and Machine Intellgence, vol. 19., No. 7, July 1997.
    [7]Wikipedia, “Discrete Fourier transform,” http://en.wikipedia.org/wiki/Discrete_Fourier_transform
    [8]Marios Savvides. Introduction to Biometric Recognition Technologies and Applications, Carnegie Mellon CyLab & ECE.
    [9]探矽工作室, ARM原理與實作-以Soc為例,宏友圖書,中華民國92年。
    [10]Andres Calderon and Nelson Castillo. “Why ARM's EABI Matters,”
    http://www.linuxdevices.com/articles/AT5920399313.html, 14, Mar 2007.
    [11]Wikipedia, “Qt(toolkit),”http://en.wikipedia.org/wiki/Qt_(toolkit)
    [12]K. Jensen and D. Anastassiou, “Subpixel edge localization and the interpolation of still images,” IEEE Trans. On Image Processing. vol. 4, pp. 285-295, Mar 1995.
    [13]M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis and Machine Vision, PWS Publishing, pp. 67-68, 1999.
    [14]劉鴻明,「Splines應用於影像內插法之研究」,中原大學資訊工程學系碩士論文,2005。
    [15]A. Mahalanobis, B.V.K. Vijaya Kumar, and D. Casasent. “Minimum average correlation energy filters,” Applied Optics, vol. 26, pp. 3630-3633, 1987.
    [16]B.V.K. Vijaya Kumar, A. Mahalanobis, S.R.F. Sims, J. F. Epperson. “Unconstrained correlation filters,” Applied Optics, vol. 33, pp. 3751-3759, 1994.
    [17]M. Savvides, B.V.K. Vijaya Kumar and P. Khosla. “Face verification using correlation filters,” Proceeding of Third IEEE Automatic Identification Advanced Technologies, pp. 56-61, 2002.
    [18]M. Savvides, K. Venkataramani and B.V.K. Vijaya Kumar. “Incremental Updating of Advanced Correlation Filters for Biometric Authentication System,” Proceeding of ICME, vol. 3, pp. 229-232, 2003.
    [19]P. Hennings, B.V.K. Vijaya Kumar. “Palmprint Recognition Using Correlation Filter Classifiers,” Conference Record of The 38th Asilomar Conference on Signal, Systems and Computers, vol. 1, pp. 567-571, 2004.
    [20]Wikipedia, “Standard deviation,” http://en.wikipedia.org/wiki/Standard_deviation
    [21]張家豪,「以AAM與PCA為基礎之眼鏡特徵弱化方法於人臉辨識之改進」,中央大學資訊工程學系碩士論文,2008。
    [22]楊煒達,「簡易方法之少量人臉辨識系統」,中央大學資訊工程學系碩士論文,2007。
    [23]井上誠喜、八木伸行、林 正樹、中須英府輔、三谷公二、奧井誠人,C語言數位影像處理,全華圖書,中華民國95年。
    [24]R. C. Gonzalez、R. E. Woods、S. L. Eddins,數位影像處理-運用MATLAB,東華書局,中華民國97年。
    [25]Open Source Computer Vision Library,
    http://www.intel.com/technology/computing/opencv/
    [26]Christopher Hallinan,Embedded Linux 開發實務徹底研究,旗標出版社,中華民國96年。
    [27]S.Rodriguez、Fischer、Smolski,The Linux Kernel Primer,上奇出版社,中華民國95年。
    [28]劉翁昌,「複雜環境下之即時人臉偵測與辨識系統」,台灣科技大學電子工程學系碩士論文,2009。

    QR CODE