簡易檢索 / 詳目顯示

研究生: 張勝傑
Sheng-Chieh Chang
論文名稱: 以FPGA實現即時多人臉偵測系統
A Real-Time Multi-Face Detection System Implemented on FPGA
指導教授: 王乃堅
Nai-Jian Wang
口試委員: 呂學坤
Shyue-Kung Lu
鍾順平
Shun-Ping Chung
郭景明
Jing-Ming Guo
蔡超人
Chau-Ren Tsai
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2012
畢業學年度: 100
語文別: 中文
論文頁數: 63
中文關鍵詞: FPGA人臉偵測區域二元特徵物件連通標記
外文關鍵詞: FPGA, Local binary pattern, Real-time, Face detection
相關次數: 點閱:253下載:28
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

人臉偵測是人臉辨識和臉部資料庫建立的首要步驟,對於系統的要求必須快速且準確,目前人臉偵測已經有許多種方法被提出,大多數都是基於軟體演算法方面加以改善偵測率並減少誤檢率,但隨著演算法日趨複雜,在嵌入式系統上的呈現較難達到即時(real-time)的效果。
本論文提出一個以純硬體的數位電路設計出一即時多人臉偵測系統,在這系統中主要的六個步驟為:(1)影像縮放,(2)色彩空間轉換,(3)膚色偵測,(4)膨脹與侵蝕,(5)物件連通標記法以及(6)人臉特徵擷取,將這些步驟分別設計成硬體電路模組,此系統使用Verilog硬體描述語言(Hardware Description Language)以純硬體的方式設計並在Altera DE2-70多媒體開發平台實現。
實驗結果顯示此系統使用了15,223個邏輯元件(logic elements),人臉偵測率高達94.9%,且處理速度為每秒達30張影像(NTSC Input),最高可同時偵測人臉數為5人,達到了高偵測率且低成本的即時人臉偵測系統。


In the field of face recognition and establishment of face database, face detection is a crucial step. Most of the face detection proposed as now are focused on software algorithms to improve the detection rate and decrease the false alarm. However, the more complex algorithm, the more computation time is required. It hinders our real-time applications.
In this thesis, we proposed a real-time multi-face detection system based on hardware design to enhance the processing time. The six steps in our processing system are as follows:(1) Image scale, (2) Color space transform, (3) Skin color detection, (4) Morphology, (5) Connected-component labeling and (6) Face feature extraction. Each step is designed by hardware circuit module written in Verilog HDL. Finally, the proposed hardware architecture is implemented on Altera DE2-70 development board to test the feasibility of our hardware design.
The implementation of our system requires 15,223 logic elements. It can operate in real-time at a frame rate of 30fps, and detect up to five faces simultaneously. The experimental result shows that our proposed face detection architecture attains a real-time reliable system with low cost and high detection rate.

誌謝 I 摘要 II ABSTRACT III 目錄 IV 圖目錄 VII 表目錄 IX 第一章 緒論 1 1.1 研究動機 1 1.2 相關研究 2 1.3 研究方法與步驟 4 1.4 論文組織 6 第二章 開發環境與視訊原理 7 2.1 DE2-70多媒體開發平台簡介 7 2.2 視訊解碼晶片簡介 8 2.3 VGA標準介紹 9 2.4 開發環境介紹 10 2.5 視訊原理介紹 11 2.5.1 NTSC簡介 12 2.5.2 ITU-R BT.656規格介紹 12 2.5.3 色彩取樣 16 第三章 影像處理技術 19 3.1 人臉偵測系統 19 3.2 色彩空間 19 3.3 膚色偵測 21 3.4 形態學 23 3.4.1 膨脹(Dilation) 23 3.4.2 侵蝕(Erosion) 24 3.5 快速連通標記演算法 25 3.6 嘴唇特徵擷取 28 3.7 水平邊緣偵測 29 3.7.1 區域二元特徵(Local Binary Pattern) 30 3.7.2 改良式區域二元特徵(Modified LBP) 32 第四章 系統硬體實現 34 4.1 影像縮放硬體設計 35 4.2 YCbCr轉RGB硬體設計 36 4.3 膚色偵測硬體設計 37 4.4 形態學硬體設計 38 4.4.1 膨脹 39 4.4.2 侵蝕 40 4.5 物件連通標記演算法硬體設計 40 4.6 嘴唇特徵擷取硬體設計 44 4.7 改良式區域二元特徵硬體設計 45 4.8 門檻值之硬體設計 46 第五章 實驗結果與效能分析 48 5.1 軟體演算法驗證 48 5.2 DE2-70開發平台驗證 55 5.2.1 Frame rate分析 57 5.2.2 FPGA硬體資源使用情況 58 第六章 結論與未來研究方向 60 6.1 結論 60 6.2 未來研究方向 60 參考文獻 61 作者簡介 63

[1] M.A. Berbar, H.M. Kelash, and A.A. Kandeel, “Faces and facial features detection in color images,” Geometric Modeling and Imaging-New Trends, pp. 209-214, 1993.
[2] L. He, Y. Chao and K. Suzuki, “A run-based two-scan labeling algorithm,” IEEE Transactions on Image Processing, vol. 17, no. 5, pp. 749-756, 2008.
[3] L. He, Y. Chao, K. Suzuki, and K. Wu, “Fast connected-component labeling,” Pattern Recognition, vol. 42, pp. 1977-1987, 2009.
[4] T. Wark, “An approach to statistical lip modelling for speaker identification via chromatic feature extraction,” Fourteenth International Conference on Pattern Recognition,, vol. 3, pp. 123-125, 1998.
[5] A. Hadid, “The local binary pattern and its applications to face analysis,” First Workshops on Image Processing Theory, Toolsand Applications, pp. 28 -36, 2008.
[6] S.-W. Yang, M.-H. Sheu, H.-H. Wu, H.-E. Chien, P.-K. Weng, and Y.-Y. Wu, “VLSI architecture design for a fast parallel label assignment in binary image,” IEEE International Symposium on Circuits and Systems, vol. 3, pp. 2393-2396, 2005.
[7] D. Nguyen, P. Aarabi, D. Halupka, and A. Sheikholeslami, “Real-time face detection and lip feature extraction using field-programmable gate arrays,” IEEE Transactions on System, Man, and Cybernetics-Part B: Cybernetics, vol. 36, 2006.
[8] N. Farrugia , F. Mamalet , S. Roux , F. Yang, and M. Paindvoine, “Fast and robust face detection on a parallel optimized architecture implemented on FPGA,” IEEE Transactions on Circuits Systems. Video Technology, vol. 19, no. 4, pp. 597-602, 2009.
[9] K.-T. Hu, Y.-T. Pai, S.-J. Ruan, and Edwin Naroska, “A hardware-efficient color segmentation algorithm for face detection,” IEEE Asia Pacific Conference on Circuits and Systems, pp. 688-691, 2010.
[10] C. A. Waring and X. Liu, “Face detection using spectral histograms and SVMs”, IEEE Transactions on System, Man, and Cybernetics—Part B: Cybernetics, vol. 35, No. 3, pp. 467-476, 2005.
[11] P. Viola and M. J. Jones, “Robust real-time face detection,” International Journal of Computer Vision, vol. 57, no. 2, pp. 137-154, 2004.
[12] C. Garcia and M. Delakis, “Convolutional face finder: a neural architecture for fast and robust face detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp. 1408-1423, 2004.
[13] 黃塏碩,在非固定式鏡頭下之物件追蹤-基於顏色與紋理資訊的適應性粒子濾波器追蹤演算法,國立台灣科技大學電機工程系碩士論文,民國九十九年。

[14] 廖柏宇,即時智慧型手勢提取與辨識系統,國立台灣科技大學電機工程系碩士論文,民國一百年。

[15] 陳裕仁,多目標追蹤用即時動態彩色影像處理晶片之研製,義守大學電子工程學系碩士論文,民國九十二年。
[16] Sony EVI-D70技術手冊,
URL: http://pro.sony.com/bbsc/ssr/product-EVID70P/
[17] Terasic, Altera DE2-70 datasheet.
URL: http://www.terasic.com.tw/
[18] U.C. Berkeley, “Rec. ITU-R BT.656-4,”
URL: http://inst.eecs.berkeley.edu/~cs150/Documents/ITU656.PDF

QR CODE