Basic Search / Detailed Display

Author: 林粲登
TSAN-DENG - LIN
Thesis Title: 利用CCDT技術研究具3D手勢之ATM人機介面系統
Applying 3D Gestures to ATM Machine Interface Based on CCDT
Advisor: 洪西進
Shi-Jinn Horng
Committee: 林韋宏
Wei-Hung Lin
古鴻炎
Hung-Yan Gu
Degree: 碩士
Master
Department: 電資學院 - 資訊工程系
Department of Computer Science and Information Engineering
Thesis Publication Year: 2017
Graduation Academic Year: 105
Language: 中文
Pages: 70
Keywords (in Chinese): 人機互動手部定位手部追蹤手勢辨識
Keywords (in other languages): human–computer interaction, hand detection, hand tracking, gesture recognition
Reference times: Clicks: 289Downloads: 0
Share:
School Collection Retrieve National Library Collection Retrieve Error Report

本論文提出一個使用者在不穿戴任何體感設備和不需使用接觸式裝置的情況下,可以直接操控游標並點擊按鈕或揮動來啟用快速鍵的系統。經由實驗證實,利用我們提出的方法進行手部追蹤與辨識,不但可以在干擾的環境下有效的完成指令,亦可達到即時手勢辨識並可以直覺的方式來完成操控、點擊、揮動等指令,達到以3D手勢操控提款機的功能。


In this thesis, we propose a system which one can move the cursor and click a button or wave hand to activate a hotkey function without carrying on or contacting any device.At last, according to the results of the experiment, the proposed method is successfully implemented in real time under disturbed environment and it not only can achieve gesture recognition commands but can move cursor and click the button or wave hand to activate a hotkey function to control the ATM machine.

目錄 第一章序論1 1.1研究動機與目的1 1.2論文章節安排2 第二章相關研究與系統硬體規格3 2.1相關研究3 2.2系統架構5 2.2.1輸入影像5 2.2.2辨識影像部分5 2.2.3輸出影像/執行功能6 2.3系統執行環境7 2.4系統執行結果與應用8 第三章手勢辨識11 3.1影像前處理12 3.1.1過濾深度影像12 3.1.2基於深度資訊之時間差相減法13 3.1.3侵蝕運算14 3.1.4擴張運算16 3.2手部定位17 3.3CCDT手部追蹤法19 3.3.1反向投影計算20 3.3.2CamShift算法結合深度資訊23 3.4偵測ROI面積28 3.5切除手臂29 3.6手勢辨識31 3.7點擊Click36 3.8手寫簽名38 3.9揮動辨識39 第四章系統效能與實作40 4.1手部定位40 4.2 手部追蹤42 4.3 手勢辨識44 4.4ATM提款操作系統應用47 第五章結論53 5.1研究成果53 5.2未來展望54 參考文獻55

[1]Xianyi Yang and Guo Chen, “Human-Computer Interaction Design in Product Design,” First International Workshop on Education Technology and Computer Science, pp. 437-439, 2009.
[2]Bian Junxia, Yin Jianqin, Wei Jun and Zhang Ling, “Hand Detection Based on Depth Information and Color Information of the Kinect,” The 27th Chinese Control and Decision Conference, pp. 4205-4210, 2015
[3]Xun Wang, Ruomei Wang and Zhou F., “Fingertips Detection and Hand Tracking Based on Curve Fitting,” International Congress on Image and Signal Processing, pp. 99-103, 2014
[4]Lingming Sun, Wei Wei and Fu Liu, “A Hand Shape Recognition Method Research Based on Gaussian Mixture Model,” International Conference on Optoelectronics and Image Processing, pp. 15-19, 2010.
[5]Bilal, S., Akmeliawati, R., Salami, M.J.E., Shafie, A.A. and Bouhabba, E.M., “A Hybrid Method Using Haar-like and Skin-color Algorithm for Hand Posture Detection, Recognition and Tracking,” International Conference on Mechatronics and Automation, pp. 934-939, 2010.
[6]Sung Kwan Kang, Mi Young Nam and Phill Kyu Rhee, “Color Based Hand and Finger Detection Technology for User Interaction,” International Conference on Convergence and Hybrid Information Technology, pp. 229– 236, 2008.
[7]Wei Wang and Jing Pan “Hand Segmentation Using Skin Color and Background Information,” International Conference on Convergence and Hybrid Information Technology, pp. 1487-1492, 2012.
[8]Caifeng Shan, Yucheng Wei, Tieniu Tan and Ojardias, F., “Real Time Hand Tracking by Combining Particle Filtering and Mean Shift,” International Conference on Automatic Face and Gesture Recognition, pp.669-674, 2004.
[9]Asaari, M.S.M. and Suandi, S.A., “Hand Gesture Tracking System Using Adaptive Kalman Filter,” International Conference on Intelligent Systems Design and Applications, pp.166-171, 2010.
[10]Yi-Bo Li, Xiao-ling Shen and Shan-shan Bei, G., “Real-Time Tracking Method for Moving Target Based on an Improved Camshift Algorithm,” IEEE International Symposium on Intelligent Signal Processing, pp. 1-6, 2011.
[11]Georgiana Simion, Vasile Gui and Marius Otesteanu, “Finger Detection Based on Hand Contour and Colour Information,” International Conference on Multimedia Technology, pp.6548 - 6551 , 2007
[12]Xun Wang, Ruomei Wang and Zhou, F., “Fingertips Detection and Hand Tracking Based on Curve Fitting,” International Congress on Image and Signal Processing, pp. 99-103, 2014.
[13]連俊宇, “Feature Extraction of 3D Handwritten Chinese Characters Based on Leap Motion,” Master Thesis, National Central University 2013.
[14]Gruev, V. and Etienne Cummings, R., “A Pipelined Temporal Difference Imager,” IEEE Journal of Solid-State Circuits, pp. 538-543, 2004.
[15]Youbing Zhang and Kui Zhou, “Study on Automotive Style Recognition with the Image Erosion Technology,” International Conference on Consumer Electronics, Communications and Networks, pp.4438-4441, 2011.
[16]Ortiz, E. and Bowyer, K.W., “Dilation Aware Multi-image Enrollment for Iris Biometrics,” International Joint Conference on Biometrics, pp.1-7, 2011.
[17]Chengzhu Lin, Shaozi Li and Songzhi Su, “Image Classification Using Adapted Codebook,” IEEE International Symposium on IT in Medicine & Education, pp. 1307-1312, 2009.
[18]Kairong Wang, Bingjia Xiao, Jinyao Xia and Dan Li, “A Dynamic Hand Gesture Recognition Algorithm Using Codebook Model and Spatial Moments,” International Conference on Intelligent Human-Machine Systems and Cybernetics, pp. 130-133, 2015.
[19]Kanjana Pattanaworapan, Kosin Chamnongthai and Jing-Ming Guo, “Hand Gesture Recognition Using Codebook Model and Pixel-Based Hierarchical-Feature Adaboosting,” IEEE International Symposium on IT in Medicine & Education, pp. 544-548, 2013.
[20]Lingming Sun, Wei Wei and Fu Liu, “A Hand Shape Recognition Method Research Based on Gaussian Mixture Model,” International Conference on Optoelectronics and Image Processing, pp. 15-19, 2010.
[21]Shipeng Xie and Jing Pan, “Hand Detection Using Robust Color Correction and Gaussian Mixture Model,” International Conference on Image and Graphics Sixth, pp. 553-557, 2011.
[22]Jianmin Jiang and Dong Wang, “Recognition of Hand Gesture Based on Gaussian Mixture Model,” International Workshop on Content-Based Multimedia Indexing, pp. 353-356, 2008.
[23]Jing-Ming Guo, Chih-Hsien Hsia, MinHsiung Shih, Yun-Fu Liu and Jing-Yu Wu, “High Speed Multi-layer Background Subtraction,” International Symposium on Intelligent Signal Processing and Communications Systems, pp. 74-79, 2012
[24]Rania A. Elsayed, Mohammed S. Sayed and Mahmoud I. Abdalla, “Skin-based Adaptive Background Subtraction for Hand Gesture Segmentation,” International Conference on Electronics, Circuits, and Systems, pp. 33-36, 2015
[25]Fu Bin, Xiong Xinyan and Sun Guozhen, “An Efficient Mean filter Algorithm,” International Conference on Complex Medical Engineering, pp. 1-6, 2014.
[26]Priyanka Shrivastava and Uday Pratap Singh, “Noise Removal Using First Order Neighborhood Mean Filter,” International Conference on IT in Business, Industry and Government, pp. 466-470, 2011.
[27]HowLung Eng and KaiKuang Ma, “Noise Adaptive Soft-Switching Median Filter,” IEEE Transactions on Image Processing, vol. 10, pp.242-251, 2001.
[28]ChinChen Chang, JuYuan Hsiao and ChihPing Hsieh, “An Adaptive Median Filter for Image Denoising,” International Symposium on Intelligent Information Technology Application, pp.346-350, 2008.
[29]Yenewondim Biadgie and Kyung-Ah Sohn, “Feature Detector Using Adaptive Accelerated Segment Test,” International Conference on Neural Networks and Brain, pp. 1-4, 2014.
[30]Lisha Guo, Junshan Li, YingHong Zhu and ZongQi Tang, “A Novel Features from Accelerated Segment Test Algorithm Based on LBP on Image Matching,” IEEE 3rd International Conference on Communication Software and Networks, pp. 355-358, 2011.
[31]D. Schugk, A. Kummert and C. Nunn, “Adaptation of the Mean Shift Tracking Algorithm to Monochrome Vision Systems for Pedestrian Tracking Based on HoG-Features,” SAE World Congress & Exhibition, 2014.
[32]T. Y. Zhang and C. Y. Suen, “A Fast Parallel Algorithm for Thinning Digital Patterns,” Communications of the ACM, pp.236–239, 1984
[33]Mandeep Kaur Ahuja and Amardeep Singh, “Static Vision Based Hand Gesture Recognition Using Principal Component Analysis,” International Conference on MOOCs, Innovation and Technology in Education, pp.402–406, 2015.
[34]Yanmei Chen, Bing Luo, Yen-Lun Chen, Guoyuan Liang and Xinyu Wu, “A Real-time Dynamic Hand Gesture Recognition System Using Kinect Sensor,” IEEE International Conference on Robotics and Biomimetics, pp.2026–2030,2015.
[35]Yingying She, Qian Wang, Yunzhe Jia, Ting Gu, Qun He and Baorong Yang, “A Real-Time Hand Gesture Recognition Approach Based on Motion Features of Feature Points,” IEEE 17th International Conference on Computational Science and Engineering, pp.1096–1102, 2014.
[36]P. Kumar, S. Rautaray and S. Agrawal, “Hand Data Glove: A New Generation Real-time Mouse for Human-Computer Interaction,”IEEE International Conference on Technology Enhanced Education, pp. 1-6, 2012.
[37]Ye Zhichao, Xin Zhang, Lianwen Jin, Ziyong Feng and Shaojie Xu, “Finger-Writing-In-The-Air System Using Kinect sensor,” IEEE International Conference on Multimedia and Expo Workshops, pp. 1-4, 2013.
[38]Xtion PRO LIVE|3D體感|ASUS台灣,“ Xtion PRO開發的體感應用程序和遊戲解決方案,” https://www.asus.com/tw/3D-Sensor/Xtion_PRO_LIVE/.

無法下載圖示 Full text public date 2022/01/11 (Intranet public)
Full text public date This full text is not authorized to be published. (Internet public)
Full text public date This full text is not authorized to be published. (National library)
QR CODE