簡易檢索 / 詳目顯示

研究生: 廖柏宇
Po-yu Liao
論文名稱: 即時智慧型手勢提取與辨識系統
A Real-Time Intelligent Hand Gesture Extraction and Recognition System
指導教授: 王乃堅
Nai-Jian Wang
口試委員: 鍾順平
Shun-Ping Chung
郭景明
Jing-Ming Guo
蔡超人
Chau-Ren Tsai
郭重顯
Chung-Hsien Kuo
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2011
畢業學年度: 99
語文別: 中文
論文頁數: 105
中文關鍵詞: 手勢辨識手部提取即時手勢辨識系統非接觸互動式平台
外文關鍵詞: Hand gesture recognition, Hand extraction, Real-time intelligent hand gesture recognition s, Non-contact human computer interface
相關次數: 點閱:299下載:4
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 現今,絕大多數的人機介面都是透過鍵盤、滑鼠或遙控器等接觸式裝置來進行控制。然而對於人類而言,手勢的使用是最自然的表達方式。手勢辨識系統的發展就是希望透過影像處理的方法,讓系統能夠自動對攝影機所擷取的影像進行手部之偵測,並進一步分析手勢動作所代表的意義。
    目前在手勢辨識的相關研究上,大部分都是必須把鏡頭架設於手部前面,距離需要非常近,因此很難應用於智慧型系統之中,且在實際生活中很少有這樣的情況發生也不方便。通常使用者會離攝影機有一段距離,所以本論文將探討攝影機影像中包含使用者上半身與手部。首先我們要移除不感興趣的區塊,例如身體、臉部和其它雜訊,然後利用影像處理的相關演算法抓取出手部。接著,再對抓取出的手部使用極座標轉換辨識、Hausdorff 距離辨識和樣板比對辨識,當作手部姿勢辨識的方法,最後利用分別給予權重的方式,可以提高手姿的辨識率。經由實驗結果顯示,本論文所提出的系統能成功在即時處理中達成,且有好的辨識率。


    Nowadays, we use most of human-computer interfaces like keyboards, mice or remote controls as command input devices. However, gesture is considered as one of the most natural ways for human to communicate with other people or to issue commands. Generally, the gesture recognition system is designed based on image processing to detect human hands and also recognize the gesture automatically.
    Now, most researches about hand gesture recognition revealed that the camera needs to be set in front of hands, with a short distance limitation. However, it is difficult to apply in an intelligent system and inconvenient in practice. Usually, users keep a distance from the camera. Thus, our study focuses on the image including both users' upper body part and hands. First, we need to remove unnecessary area, such as body part, face, or noise. We make use of related image processing algorithms to extract image of hands. Second, we develop polar transformation recognition, Hausdorff distance recognition, and template matching recognition as gesture recognition methods. By weighting these three methods, the gesture recognition rate can be improved. The experimental results show that our proposed method can be accomplished successfully in real-time with a good recognition rate.

    摘要 I Abstract II 誌謝 III 目錄 IV 圖目錄 VI 表目錄 IX 第一章 緒論 1 1.1 研究動機 1 1.2 研究背景 3 1.3 文獻回顧 4 1.4 論文目標 4 1.5 論文組織 6 第二章 系統架構與實驗環境 7 2.1 系統架構 7 2.1.1 提取手部系統架構 7 2.1.2 手勢辨識系統架構 9 2.2 開發環境與介面 11 2.3 系統流程 14 第三章 提取手部系統 15 3.1 離散小波轉換 15 3.1.1 提昇式結構小波轉換 19 3.1.2 直接低低頻遮罩法小波轉換 22 3.2 背景相減 24 3.3 移除影像中頭部和身體 25 3.4 膚色偵測 27 3.5 快速連通標記演算法 30 3.6 刪除手臂 36 第四章 手勢辨識演算法 39 4.1 手部角度矯正 40 4.2 極座標辨識 41 4.2.1 極座標五指判斷演算法 43 4.2.2 極座標握拳判斷演算法 51 4.3 Hausdorff距離辨識 53 4.4 樣板比對辨識 58 4.5 資料庫中的手部模型分析 62 4.6 手勢辨識演算法總結 64 第五章 實驗結果與效能分析 66 5.1 實際訊號控制 66 5.2 手勢辨識實驗結果展示與分析 69 5.3 實際訊號控制實驗結果展示與分析 93 第六章 結論與未來研究方向 100 6.1 結論 100 6.2 未來研究方向 100 參考文獻 102 作者簡介 105

    [1] S. Wagner, B. Alefs, C. Picus, "Framework for a portable gesture interface," Conference on Automatic Face and Gesture Recognition, FGR 2006. 7th International, pp.275-280, 2-6 April 2006.
    [2] L. Gupta, M. Suwei, "Gesture-based interaction and communication: automated classification of hand gesture contours," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol.31, no.1, pp.114-120, Feb 2001.
    [3] P. Premaratne, Q. Nguyen, "Consumer electronics control system based on hand gesture moment invariants," IET Computer Vision, vol.1, no.1, pp.35-41, March 2007.
    [4] I. Haritaoglu, D. Harwood, L. Davis, "W4: real-time surveillance of people and their activities," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.8, pp.809-830, Aug 2000.
    [5] Y. Y. Pang, N. A. Ismail, P. L. S. Gilbert, "A real time vision-based hand gesture interaction," 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation (AMS), pp.237-242, 26-28 May 2010.
    [6] C. H. Hsia, J. M. Guo, J. S. Chiang, "Improved low-complexity algorithm for 2-D integer lifting-based discrete wavelet transform using symmetric mask-based scheme," IEEE Transactions on Circuits and Systems for Video Technology, vol.19, no.8, pp.1202-1208, Aug. 2009.
    [7] J. S. Chiang, C. H. Hsia, H. J. Chen, T. J. Lo, "VLSI architecture of low memory and high speed 2D lifting-based discrete wavelet transform for JPEG2000 applications," IEEE International Symposium on Circuits and Systems, vol.5, pp.4554- 4557, 23-26 May 2005.
    [8] K. C. B. Tan, T. Arslan, "Shift-accumulator ALU centric JPEG2000 5/3 lifting based discrete wavelet transform architecture," ISCAS '03. Proceedings of the 2003 International Symposium on Circuits and Systems, vol.5, pp.V-161- V-164, 25-28 May 2003.
    [9] C. J. Lian, K. F. Chen, H. H. Chen, L. G. Chen, "Lifting based discrete wavelet transform architecture for JPEG2000 ," The 2001 IEEE International Symposium on Circuits and Systems, vol.2, pp.445-448, 6-9 May 2001.
    [10] Y. H. Yang, M. D. Levine, "The background primal sketch: an approach for tracking moving objects mach", Machine and Vision Applications, pp.17-34, 1992.
    [11] M. A. Berbar, H. M. Kelash, A. A. Kandeel, "Faces and facial features detection in color images," Geometric Modeling and Imaging-New Trends, pp.209-214, 16-18 Aug. 1993.
    [12] L. He, Y. Chao, K. Suzuki, "A run-based two-scan labeling algorithm," IEEE Transactions on Image Processing, vol.17, no.5, pp.749-756, May 2008.
    [13] L. He, Y. Chao, K. Suzuki, K. Wu, "Fast connected-component labeling," Pattern Recognition, vol.42, issue 9, pp.1977-1987, Sept. 2009.
    [14] E.J. Holden, R. Owens, "Recognising moving hand shapes," Proceedings 12th International Conference on Image Analysis and Processing, pp.14-19, 17-19 Sept. 2003.
    [15] X. Yin, X. Zhu, "Hand posture recognition in gesture-based human-robot interaction," 2006 1ST IEEE Conference on Industrial Electronics and Applications, pp.1-6, 24-26 May 2006.
    [16] E. Yoruk, E. Konukoglu, B. Sankur, J. Darbon, "Shape-based hand recognition," IEEE Transactions on Image Processing, vol.15, no.7, pp.1803-1815, July 2006.
    [17] Y. Gao, "Efficiently comparing face images using a modified Hausdorff distance," IEE Proceedings Vision, Image and Signal Processing, vol.150, no.6, pp.346- 350, 15 Dec. 2003.
    [18] J. W. Hsieh, Y. T. Hsu, H. Y. Liao, C. C. Chen, "Video-based human movement analysis and its application to surveillance systems," IEEE Transactions on Multimedia, vol.10, no.3, pp.372-384, April 2008.
    [19] G. Borgefors, "Distance transformations in digital images," In Computer Vision, Graphics and Image Processing, 34(3):344–371, 1986.
    [20] J. Zaletelj, J. Perhavc, J. F. Tasic, "Vision-based human-computer interface using hand gestures," WIAMIS '07. Eighth International Workshop on Image Analysis for Multimedia Interactive Services, pp.41, 6-8 June 2007.
    [21] A. A. Argyros, M. I. A. Lourakis, "Vision-based interpretation on hand gestures for remote control of a computer mouse," In Computer Vision in Human-Computer Interaction, pp.40-51, 2006.
    [22] J. S. Lee, Y. J. Lee, E. H. Lee, S. H. Hong, "Hand region extraction and gesture recognition from video stream with complex background through entropy analysis," IEMBS '04. 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol.1, pp.1513-1516, 1-5 Sept. 2004.
    [23] L. Anton-Canalis, E. Sanchez-Nielsen, M. Castrillon-Santana, "Hand pose detection for vision-based gesture interfaces," Conference on Machine Vision Applications, Tsukuba Science City, Japan, May 16-18, 2005.
    [24] C. G. Rafael, E. W. Richard, Digital Image Processing (2nd ed.), Prentice Hall, 2002.

    QR CODE