簡易檢索 / 詳目顯示

研究生: 林廸宏
Di-Hong Lin
論文名稱: 指尖行為分析系統
Fingertip-Movement Analysis System
指導教授: 王乃堅
Nai-Jian Wang
口試委員: 鍾順平
Shun-Ping Chung
呂學坤
Shyue-Kung Lu
曾德峰
Der-Feng Tseng
蘇順豐
Shun-Feng Su
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2015
畢業學年度: 103
語文別: 中文
論文頁數: 64
中文關鍵詞: 指尖偵測手部區域提取指尖行為分析
外文關鍵詞: Hand extraction, Fingertip positioning, Fingertip-movement analysis
相關次數: 點閱:135下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

本論文提出一個指尖行為分析系統,此系統能分辨放大、縮小、左右移與拍照的手勢,並以此做為人機互動的方式。
  系統一開始使用背景相減搭配膚色偵測進行手部區域提取,此方法在複雜的背景下能初步濾除不必要的雜訊。取出手部區域後,進行手指指尖定位,我們以粒子隨機擴散讓粒子分佈於手部邊緣,接著保留位於指尖上的粒子,剩下的粒子再進行分群以區分不同指尖上的粒子,每一群粒子的平均位置即是手指指尖定位的結果。最後,利用指尖定位結果分析指尖的行為,系統共區分為單指指尖行為分析、雙指指尖行為分析、四指指尖行為分析,藉由此系統,使用者可以在不需配戴任何指套或標記的情況下自然的操作達到人機互動的目的。由實驗結果顯示本系統指尖偵測率為84.58%,且處理速度為每秒29張影像,能準確與即時的分析手勢。


A fingertip-movement analysis system is proposed in this paper. This system can distinguish the gesture like flick-right, flick-left, pinching to zoom in and out and taking picture to be a way for human-computer interaction.
We combine background subtraction and skin detection to extract hand region. This method can remove most noise in the complex background. After hand extraction we use particle random diffusion algorithm to position fingertip. The algorithm uses particles to diffuse to the contour of hand randomly. Then keep the particles which are located in fingertip. After that, a particle grouping algorithm is applied to distinguish each fingertip. Fingertip position is the average position of each group’s particles. The system will analyze fingertip in three different ways which are single fingertip-movement analysis, double fingertip-movement analysis and four fingertip-movement analysis. By this system, user can easily interact with computer without any fingertip marker. The experimental results show that our system can operate in real-time at a frame rate of 29fps and with 84.58% fingertips detection rate.

摘要 I Abstract II 誌謝 III 目錄 IV 圖目錄 VI 表目錄 VIII 第一章 緒論 1 1.1研究動機 1 1.2文獻回顧 2 1.3論文目的 3 1.4論文組織 3 第二章 系統架構與實驗環境 5 2.1 系統架構 5 2.2 開發環境 6 第三章 手部區域提取 8 3.1 背景相減 9 3.1.1 建立背景 10 3.1.2背景相減 11 3.1.3 膚色偵測 12 3.1.4 背景更新 16 3.2 侵蝕膨脹運算 17 3.3快速連通標記法 19 3.4物件填補 22 第四章 指尖行為分析 25 4.1指尖偵測 25 4.1.1粒子擴散 26 4.1.2粒子選擇 31 4.1.3粒子分群 35 4.2指尖行為分析 37 4.2.1指尖狀態機 38 4.2.2 單指指尖行為分析 40 4.2.3 雙指指尖行為分析 42 4.2.4四指指尖行為分析 45 第五章 實驗結果與分析 48 5.1 Sample 01影像序列實驗分析 49 5.2 Sample 02影像序列實驗分析 51 5.3 Sample 03影像序列實驗分析 52 5.4 Sample 04 影像序列實驗分析 54 5.5 錯誤偵測情況分析 57 5.6 綜合偵測率與效能分析 59 第六章 結論與未來研究方向 61 6.1 結論 61 6.2未來研究方向 61 參考文獻 63

[1] H. Lilha and D. Shivmurthy, “Analysis of pixel level features in recognition of real life dual-handed sign language data set,” International Conference on Recent Trends in Information Systems, pp. 246-251, Dec. 2011.

[2] M. Elmezain, A. Al-Hamadi, J. Appenrodt and B. Michaelis, “A hidden Markov model-based continuous gesture recognition system for hand motion trajectory,” International Conference on Pattern Recognition, pp. 1-4, Dec. 2008.

[3] S. Zhao, L. Shen and W. Tan, “A method of dynamic hand gesture detection based on local background updates and skin color model,” International Conference on Computer Application and System Modeling, vol. 5, pp. 657-660, Oct. 2010.

[4] D. Yang, L.W. Jin, J. Yin, J.X. Yin, L.X. Zhen and J.C. Huang, “An effective robust fingertip detection method for finger writing character recognition system,” Proceedings of the Fourth International Conference On Machine Learning And Cybernetics, Guangzhou, China, pp. 4191–4196, 2005.

[5] K. Oka, Y. Sato and H. Koike, “Real time tracking of multiple fingertips and gesture recognition for augmented desk interface systems,” Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, Washington, D.C., USA, pp. 411–416, May 2002.

[6] K. Oka, Y. Sato and H. Koike, “Real time fingertip tracking and gesture recognition,” IEEE Computer Graphics and Applications, pp. 64–71, Dec. 2002.

[7] T. Brown and R. C. Thomas, “Finger tracking for the digital desk,” Proceedings of First Australasian User Interface Conference, Canberra, Australia, pp.11-16, 2000.

[8] E. J. Holden and R. Owens, “Reconditioning moving hand shapes,” Proceedings of International Conference on Image Analysis and Processing, pp. 14-19, Sep. 2003.

[9] H. Patel and M. P. Wankhade, “Human tracking in video surveillance,” International Journal of Emerging Technology and Advanced Engineering, vol. 1, no. 2, pp. 1-5, Dec. 2011.

[10] J. Heikkila and O. Silven, “A real-time system for monitoring of cyclists and pedestrians,” Second IEEE Workshop on Visual Surveillance, pp. 74-81, Jul. 1999.

[11] L. He, Y. Chao, K. Suzuki and K. Wu, “Fast connected-component labeling,” Pattern Recognition, vol. 42, no. 9, pp. 1977-1987, Sep. 2009.

[12] L. He, Y. Chao and K. Suzuki, “A run-based two-scan labeling algorithm,” IEEE Transactions on Image Processing, vol. 17, no. 5, pp. 749-756, May 2008.

[13] K. J. Hsiao, T. W. Chen and S. Y. Chien, “Fast fingertip positioning by combining particle filtering with particle random diffusion,” IEEE International Conference on Multimedia and Expo, pp. 977-980, Apr.-Jun. 2008.

[14] M. J. Alam and M. Chowdhury, “Detection of fingertips based on the combination of color information and circle detection,” IEEE International Conference on Industrial and Information Systems, pp. 572-576, Aug. 2013.

[15] T. C. Pham, X. D. Pham, D. D. Nguyen, S. H. Jin and J. W. Jeon, “Dual hand extraction using skin color and stereo information,” IEEE International Conference on Robotics and Biomimetics, Bangkok, Thailand, Feb. 2009.

[16] 井上誠喜, 八木伸行, 林正樹, 中須英輔, 三谷公二, 奧井誠人 著, 吳上立, 林明德 譯, C語言數位影像處理, 全華科技圖書股份有限公司, 2010年。

[17] J. S. Lee, Y. J. Lee, E. H. Lee and S. H. Hong, “Hand region extraction and gesture recognition from video stream with complex background through entropy analysis,” 26th Annual Internation Conference of the IEEE EMBS, vol. 1, pp. 1513-1516, Sep. 2004.

QR CODE