簡易檢索 / 詳目顯示

研究生: 何彥智
Yen-Chih Ho
論文名稱: 智慧型公共安全監控系統之事件關係人臉部辨識
A Public Security Surveillance System for Face Detection and Recognition of Event Related Pedestrian
指導教授: 蔡超人
Chau-Ren Tsai
口試委員: 李祖添
none
蘇順豐
Shun-Feng Su
郭景明
Jing-Ming Guo
王乃堅
none
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2012
畢業學年度: 100
語文別: 中文
論文頁數: 156
中文關鍵詞: 遺留物與遺失物偵測數位信號處理器臉部辨識
外文關鍵詞: DSP, abandoned events and stolen events detection, face recognition
相關次數: 點閱:355下載:6
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近幾年來隨著影像處理技術與數位信號處理器的進步,影像處理的技術已不僅僅只能局限於單張影像的處理。由於恐怖攻擊事件的頻傳與犯罪率的上升,影像監控技術已被廣泛運用在公共場所當中。本論文結合德州儀器TMS320DM642之數位信號處理器(DSP:Digital Signal Processor)開發模組以及雙攝影機架構,以實現具有臉部擷取以及人臉辨識功能的智慧型公共安全監控系統。在雙攝影機架構中,場景攝影機主要用來偵測場景中的遺留物事件與遺失物事件,而PTZ攝影機則用來追尋並擷取此事件關係人的臉部影像,而所擷取到的影像將與系統預先建立的人臉資料庫進行人臉辨識的比對。最後本系統將結合網路傳輸的架構以DSP為Server端,而遠端電腦為Client端,藉由網路傳輸,使用者即可以遠端來控制系統,以實現具有遠端監控能力的智慧型公共安全監控系統之事件關係人正面臉部影像擷取與辨識。


    With the advances of image processing and digital signal processor, image processing technology has not only limited to dealing with single image. Because of the threat of terrorism and increasing crime recently, the visual surveillance systems are widely applied in public spaces. In the paper, we combine TMS320DM642 evaluation module and dual-camera module to achieve the public security surveillance system of face detection and face recognition. In dual-camera, the field camera is responsible for detecting the abandoned event and the stolen event. And the PTZ camera can be guided to track the owner of the event and capture faces. The faces would be recognized from face database which was established by the system. Finally, the system will associate with internet for the DSP platform as a Server-side, the remote PC as a Client-side. The user can remotely control the system, to achieve the public security surveillance system of face detection and face recognition.

    摘 要 I Abstract II 致 謝 III 目 錄 IV 圖 索 引 VIII 表 索 引 XVI 第一章 緒論 1 1.1 研究動機與目的 1 1.2 研究方法 2 1.3 論文架構 3 第二章 系統架構 5 2.1 行人與物件分類程序 7 2.2 遺留物與遺失物分類程序 9 2.3 事件關係人追蹤程序 10 2.4 事件關係人正面臉部擷取與辨識程序 11 2.5 使用者介面傳輸程序 13 2.6 硬體規格與配置 15 第三章 行人物件偵測與分類 20 3.1 混合式前景區塊萃取 20 3.1.1 背景相減法 20 3.1.2 陰影濾除 23 3.1.3 雜訊濾除 25 3.1.4 使用碼本模型之前景萃取 28 3.1.5 基於差值原理之背景相減法 34 3.2 行人與物件 41 3.2.1 物件標記處理 41 3.2.2 行人與物件分類 43 3.2.3 關聯性區域比對 47 3.2.4 行人交錯之追蹤 48 第四章 遺留事件與遺失事件 54 4.1 遺留物與遺失物分類 54 4.1.1 靜態目標物偵測 54 4.1.2 靜態目標物實際輪廓 56 4.1.3 邊緣輪廓色彩比對 58 4.2 遺留物持有者與遺失物擷取者追蹤 61 4.2.1 歷史影像與歷史影像吻合率 61 4.2.2 遺留事件與遺失事件關鍵性影像 66 4.2.3 遺留物持有者與遺失物擷取者追蹤 68 第五章 臉部資訊擷取 70 5.1 頭部追蹤參考點 70 5.2 PTZ攝影機之追蹤控制 72 5.2.1 雙攝影機座標轉換 72 5.2.2 PTZ攝影機倍率控制 78 5.3 正面臉部資訊擷取 79 5.3.1 眼睛對搜尋 80 5.3.2 正面臉部擷取 85 5.3.3 正面臉部影像大小正規化 86 第六章 人臉資料庫訓練與辨識 88 6.1 人臉資料庫訓練 88 6.2 人臉辨識 94 6.3 辨識結果 96 第七章 系統實現與效能測試 100 7.1 使用者介面 100 7.1.1 網路傳輸架構 101 7.1.2 使用者介面畫面配置 102 7.1.3 影像傳輸 103 7.1.4 辨識結果處理 107 7.1.5 追蹤遺留物件 110 7.2 系統軟體架構 112 7.3 系統實現 115 7.4 系統效能測試 122 第八章 結論 124 8.1 研究成果 124 8.2 未來發展方向 128 參 考 文 獻 129

    [1] C. R. Wren, A. Azarbayejani, T. Darrell and A. Pentland. “Pfinder: Real-Time Tracking of the Human Body,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 7, pp. 780-785, 1997.
    [2] I. Haritaoglu, D. Harwood and L. S. Davis, “W4: Real-Time Surveillance of People and Their Activities,”IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 809-830, 2000.
    [3] A. J. Lipton, H. Fujiyoshi and R. S. Patil, “Moving Target Classification and Tracking from Real-Time Video,” Proceedings of the 4th IEEE Workshop on Applications of Computer Vision, Vol. 98, No. 2, pp. 8-14, 1998.
    [4] L. D. Stefano, S. Mattoccia and M. Mola, “A Change-Detection Algorithm Based on Structure and Colour,” Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, pp. 252-259, 2003.
    [5] R. C. Gonzalez and R. E. Woods, Digital Image Processing, Prentice-Hall, New Jersey, pp. 116-123, 2002.
    [6] A. Prati, I. Mikic, M. M. Trivedi and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 7, pp. 918-923, 2003.
    [7] R. Cucchiara, C. Grana, M. Piccardi and A. Prati, “Detection Moving Objects, Ghosts, and Shadows in Video Streams,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 10, pp. 1337-1342, 2003.
    [8] J. P. Serra, Image Analysis and Mathematical Morphology, Academic Press, pp. 115-130, 1982.
    [9] B. Liu and H. Zhou, “Using Object Classification To Improve Urban Traffic Monitoring System,” IEEE International Conference on Neural Networks and Signal Processing, Vol. 2, pp. 1155-1159, 2003.
    [10] P. Spagnolo, A. Caroppo, M. Leo, T. Martiriggiano and T. D’Orazio, “An Abandoned/Removed Objects Detection Algorithm and Its Evaluation on PETS Datasets,” IEEE International Conference on Video and Signal Based Surveillance, pp. 17-17, 2006.
    [11] R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, “Face Detection in Color Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 5, pp. 696-706, 2002.
    [12] V. Perlibakas, “Distance Measures for PCA-Based Face Recognition,” Pattern Recognition Letters, Vol. 25, No. 6, pp. 711-724, 2004.
    [13] Y. H. Liang, S. Guo, Z. Y. Wang, X. W. Xu and X. Y. Cao, “A Robust and Fast Motion Segmentation Method for Video Sequences,” Proceedings of the IEEE International Conference on Automation and Logistics, pp. 2952-2957, 2007.
    [14] G. Szwoch, P. Dalka, “Identification of Regions of Interest in Video for a Traffic Monitoring System,” Proceedings of the 2008 1st International Conference on Information Technology, pp. 19-21, 2008.
    [15] J. Stauder, R. Mech and J. Ostermann, “Detection of Moving Cast Shadows for Object Segmentation,” IEEE Transactions on Multimedia, Vol. 1, No. 1, pp. 65-76, 1999.
    [16] C. Kim and J. N. Hwang, “Fast and Automatic Video Object Segmentation and Tracking for Content-Based Applications,”IEEE Transactions on Circuits and Systems for Video Technology, Vol. 12, No. 2, pp. 122-129, 2002.
    [17] J. W. Hsieh, W. F. Hu, C. J. Chang and Y. S. Chen, “Shadow Elimination for Effective Moving Object Detection by Gaussian Shadow Modeling,” Image Vision and Computing Journal, Vol. 21, No. 6, pp. 505-516, 2003.
    [18] S. J. McKenna, S. Jabri, Z. Duric, A. Rosenfeld and H. Wechsler, “Tracking Groups of People,” Computer Vision and Image Understanding, Vol. 80, No. 1, pp. 42-56, 2000.
    [19] W. Lu and Y. Tan, “A Color Histogram Based People Tracking System,” Proceedings of the IEEE International Symposium on Circuit and Systems, Vol. 2, pp. 137-140, 2001.
    [20] 李建輝, “智慧型公共安全之遺留物體和遺失物體監控系統,” 國立台灣科技大學電機工程系碩士論文, pp. 14-68, 2009.
    [21] 陳昱宏, “智慧型公共安全之遺留物持有者和遺失物擷取者偵測,” 國立台灣科技大學電機工程系碩士論文, pp. 48-75, 2010.
    [22] F. Porikli, “Detection of Temporarily Static Regions by Processing Video at Different Frame Rates,” IEEE Conference on Video and Signal Based Surveillance, pp. 236-241, 2007.
    [23] E. Stringa and C. S. Regazzoni, “Real-Time Video Shot Detection for Scene Surveillance Applications,” IEEE Transactions on Image Processing, Vol. 9, No. 1, pp. 69-79, 2000.
    [24] A. Rosenfield and M. Thurston, “Edge and Curve Detection for Visual Scene Analysis,” IEEE Transactions on Computation, Vol. 20, No. 5, pp. 562-569, 1971.
    [25] M. Soriano, B. Martinkauppi, S. Huovinen and M. Laaksonen, “Adaptive Skin Color Modeling Using the Skin Locus for Selecting Training Pixels,” Pattern Recognition, Vol. 36, No. 3, pp. 681–690, 2003.
    [26] Z. Jin, Z. Lou, J. Yang and Q. Sun, “Face Detection Using Template Matching and Skin-Color Information,” Neurocomputing, Vol 70, No. 4, pp. 794-800, 2007.
    [27] K. Jensen and D. Anastassiou, “Subpixel Edge Localization and the Interpolation of Still Images,” IEEE Transactions on Image Processing, Vol. 4, No. 3, pp. 285-295, 1995.
    [28] K. Kim, T. H. Chalidabhongse, D. Harwood and L. Davis, “Real-Time Foreground-Background Segmentation Using Codebook Model,” Real-Time Imaging, Vol. 11, No. 3, pp. 172-185, 2005.
    [29] J. M. Guo, Y. F. Liu, C. H. Hsia, M. H. Shih and C. S. Hsu, “Hierarchical Method for Foreground Detection Using Codebook Model,” IEEE Transactions on Circuits And Systems for Video Technology, Vol. 21, No. 6, pp. 804-815, 2011.

    QR CODE