簡易檢索 / 詳目顯示

研究生: 林芮珊
Ruei-Shan Lin
論文名稱: 基於手部軌跡辨識之Android行動裝置應用
The Trajectory of Gesture Recognition Applications on Android Operating System
指導教授: 洪西進
Shi-Jinn Horng
口試委員: 范欽雄
none
吳怡樂
none
林韋宏
none
學位類別: 碩士
Master
系所名稱: 電資學院 - 資訊工程系
Department of Computer Science and Information Engineering
論文出版年: 2016
畢業學年度: 104
語文別: 中文
論文頁數: 81
中文關鍵詞: 手勢辨識人機互動
外文關鍵詞: hand gesture recognition, iteraction
相關次數: 點閱:241下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • Android系統是一個以Linux為基礎的半開放原始碼作業系統,主要用於行動設備,此種屬於開發性系統,自由度高,機體相容性廣泛,提供完善的開發環境,支援各種先進的繪圖、網路、相機等處理能力,近年來市場佔有率逐漸提高,Android的應用需求也越來越大。而本論文將手勢辨識系統應用於Android系統上,將此發展在Android的好處在於現今越來越多裝置採用此作業系統,因此可被使用的範圍隨之變廣,由於Android APP相容性高,Android系統的裝置皆可使用本論文所提出的系統。
    一般手勢辨識主要分為三個部份,分別為手部定位、手部追蹤與手勢辨識,在本論文中提出了相似比例法與Quick Hull偵測法來完成手部定位,並以Motion Detection、改良混和Histogram of Oriented Gradients (HOG)與Simplified Local Directional Number Pattern (SLDN)方法來進行手部追蹤的效果,最後再以temporal edge point difference與移動方向偵測達成手勢及軌跡辨識。經由實驗的結果得知,本論文所提出之方法可成功的在行動裝置上即時執行,並可在受干擾的環境下完成手勢辨識指令。


    Android System is a Linux-based and semi-open operating system which is manly used for mobile devices. There are four features in this system, high degree of freedom, wide compatibility, comprehensive development environment, and supporting graphic operating, Internet, and camera operating. With the increase of market share in recent years, the demand of Android application is getting bigger and bigger.
    In this thesis, the hand gesture recognition system is implemented on Android system. We take advantages of the increase of market share and wide compatibility to develop on Android system. Wide compatibility of Android APP is the key for the system in this thesis can be used for all Android devices.
    General hand gesture recognition system divides into 3 parts, hand areas detecting, gesture tracking and gesture recognition. This thesis proposes, using the Similar proportion method and Quick hull method to reach hand areas detecting, exploiting the Motion Detection and improved combination of Histogram of Oriented Gradients (HOG) and Improved Simplified Local Directional Number Pattern (SLDN) to process gesture tracking, and utilizing the temporal edge point difference and the detection of movement direction method to accomplish the hand gesture recognition and trajectory recognition.
    From the experiment result, the method of hand gesture recognition system in this thesis has abilities of instance execution on mobile devices and consummation under environment perturbations.

    第一章序論 1.1研究動機與目的 1.2相關研究 1.3論文章節安排 第二章系統架構與相關硬體規格 2.1系統架構 2.1.1輸入影像 2.1.2手勢辨識 2.2相關硬體規格 2.3使用環境與操作說明 第三章手勢辨識 3.1影像前處理 3.1.1連續重疊時間差相減法 3.1.2侵蝕運算 3.1.3擴張運算 3.1.4連通結構標示 3.2手部定位 3.2.1Quick Hull 3.2.2相似比例法 3.3手部追蹤 3.3.1Motion detection 3.3.2Histogram of Oriented Gradients (HOG) 3.3.3Simplified Local Directional Number Pattern (SLDN) 3.4手勢辨識 3.4.1手部追蹤與軌跡平滑化 3.4.2Click手勢 3.4.3方向偵測功能 第四章系統效能與實作 4.1手部定位 4.2手部追蹤 4.3手勢辨識 4.4系統效能 第五章結論 5.1研究成果 5.2未來展望 參考文獻

    [1]Xiaoyun Zhao,Chunlai Zhou and Wenhui Huang, “Smart home power management system design based on human-computer interaction model”, 2013 3rd International Conference on Science and Network Technology (ICCSNT), pp. 1247 - 1250, 2013.
    [2]Yuh-Rau Wang,Wei-Hung Lin,Ling Yang, “An improved hand detection by employing corner detector”, 2014 International Conference on Machine Learning and Cybernetics (ICMLC), pp. 414 - 419, 2014.
    [3]Chenyang Chen, Mingmin Zhang , Kaijia Qiu ,Zhigeng Pan, “Real-Time Robust Hand Tracking Based on Camshift and Motion Velocity”, 2014 5th International Conference on Digital Home (ICDH), pp. 20 - 24, 2014.
    [4]Cheng Tang, Yongsheng Ou ,Guolai Jiang ,Qunqun Xie,Yangsheng Xu, “Hand tracking and pose recognition via depth and color information”, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1104 - 1109, 2012.
    [5]Tofighi, G. , Monadjemi, S.A. and Ghasem-Aghaee, N., “Rapid hand posture recognition using Adaptive Histogram Template of Skin and hand edge contour”, Machine Vision and Image Processing, pp. 1-5, 2010.
    [6]Bilal, S. , Akmeliawati, R. , Salami, M.J.E. , Shafie, A.A. and Bouhabba, E.M., “A hybrid method using haar-like and skin-color algorithm for hand posture detection, recognition and tracking”, International Conference on Mechatronics and Automation, pp. 934-939, 2010.
    [7]Shu Mo, Shihai Cheng,Xiaofen Xing, “Hand gesture segmentation based on improved kalman filter and TSL skin color model”, 2011 International Conference on Multimedia Technology (ICMT), pp. 3543– 3546, 2011.
    [8]Gutzeit, E., Vahl, M. ,Zhiliang Zhou,von Lukas, U., “Skin cluster tracking and verification for hand gesture recognition”, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 241– 246, 2011.
    [9]Haiting Zhai , Xiaojuan Wu and Hui Han, “Research of a Real-time Hand Tracking Algorithm”, International Conference on Neural Networks and Brain, pp. 1233-1235, 2005.
    [10]Dengfeng Li,Hu Li, Xiuling Wei, “Kalman filtering-based modified Cam-Shift vehicle tracking algorithm for highway traffic conditions”, IEEE International Conference on Computer Application and System Modeling , pp. 271-275, 2010.
    [11]Asaari, M.S.M. and Suandi, S.A., “Hand gesture tracking system using Adaptive Kalman Filter”, International Conference on Intelligent Systems Design and Applications, pp.166-171, 2010.
    [12]Parra, I. , Fernandez, D. , Sotelo, M.A. , Marron, M. , Gavilan, M. and Lacey, G., “Tracking using Particle and Kalman Filters in Hand Washing Quality Assessment System”, IEEE International Symposium on Intelligent Signal Processing, pp. 1-6, 2007.
    [13]Ching-Tang Hsieh , Cheng-Hsiang Yeh , Kuo-Ming Hung , Li-Ming Chen and Chin-Yen Ke, “A real time hand gesture recognition system based on DFT and SVM”, International Conference on Information Science and Digital Content Technology, pp. 490-494, 2012.
    [14]Jiang Guo , Jun Cheng , Jianxin Pang and Yu Guo, “Real-time hand detection based on multi-stage HOG-SVM classifier”, IEEE International Conference on Image Processing, pp. 4108-4111, 2013.
    [15]Deng-Yuan Huang , Wu-Chih Hu and Sung-Hsiang Chang, “Vision-Based Hand Gesture Recognition Using PCA+Gabor Filters and SVM”, International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 1-4, 2009.
    [16]Iqbal, M.R.A., Rahman, S., Nabil, S.I. and Chowdhury, I.U.A., “Knowledge based decision tree construction with feature importance domain knowledge”, International Conference on Electrical & Computer Engineering, pp. 659-662, 2012.
    [17]Chang Tan and Xiao Nanfeng, “Improved RCE neural network and its application in human-robot interaction based on hand gesture recognition”, International Conference on Information Science and Engineering, pp. 1260-1263, 2010.
    [18]Md. Rezwanul Ahsan, Muhammad Ibn Ibrahimy, Othman O. Khalifa, “Two-handed hand gesture recognition for Bangla sign language using LDA and ANN”, 2014 8th International Conference on Software, Knowledge, Information Management and Applications, pp. 1-5, 2014.
    [19]Jaroensawad, R., Dejdumrong, N., Prakancharoen, S., “T Handwritten curve approximation by a Bézier curve with featured points”, 2013 International Conference on Computer Science and Engineering Conference, pp. 250-254, 2013.
    [20]Wen-Hung Ting, Chia-Chang Li ,Duan-Li Liao , Hian-Kun Tenn, S., “Digital content manipulating system using hand gesture”, 2011 International Conference on Electrical and Control Engineering, pp. 4772-4775, 2011.
    [21]J Chen-Chiung Hsieh, “A real time hand gesture recognition system using motion history image”, 2010 2nd International Conference on Signal Processing Systems , pp.394-398, 2010.
    [22]Panwar, M., “Hand gesture recognition based on shape parameters”, 2012 International Conference on Computing, Communication and Applications, pp1-6, 2012.
    [23]Menacer, M., Arbaoui, A., Amri, I., “Gesture recognition system for NOOR eMashaf application: Concepts and architecture”, 2014 World Congress on Computer Applications and Information Systems , pp1-5, 2014.
    [24]Ghosh, R., Roy, P.P., “A novel feature extraction approach for online Bengali and Devanagari character recognition”, 2015 2nd International Conference on Signal Processing and Integrated Networks , pp.483-488, 2015.
    [25]Xun Wang, Ruomei Wang,Zhou, F., “Fingertips detection and hand tracking based on curve fitting”, 2014 7th International Congress on Image and Signal Processing, pp.99-103, 2014.
    [26]Asano, T., Honda, S., “Visual interface system by character handwriting gestures in the air”, RO-MAN, 2010 IEEE,pp.56-61, 13-15 Sept.2010.
    [27]Lingming Sun, Wei Wei, Fu Liu ,“A Hand Shape Recognition Method Research Based on Gaussian Mixture Model”, 2010 International Conference on Optoelectronics and Image Processing, pp15-19, 2010.
    [28]Tan Wenjun, Wu Chengdong, Zhao Shuying, Jiang Li ,“Dynamic hand gesture recognition using motion trajectories and key frames”, 2010 2nd International Conference on Advanced Computer Control, pp163-167, 2010.
    [29]Frolova, D., Stern, H., Berman, S.,“Most Probable Longest Common Subsequence for Recognition of Gesture Character Input”, IEEE Transactions on Cybernetics , pp871-880, 2013.
    [30]You-bing Zhang and Kui Zhou, “Study on automotive style recognition with the image erosion technology”, International Conference on Consumer Electronics, Communications and Networks, pp.4438-4441, 2011.
    [31]Ortiz, E. and Bowyer, K.W., “Dilation aware multi-image enrollment for iris biometrics”, International Joint Conference on Biometrics, pp.1-7, 2011.
    [32]F. Chang, C. J. Chen, and C. J. Lu, “A linear-time component-labeling algorithm using contour tracing technique”, Comput. Vis. Image Understand, vol. 93, pp. 206-220, 2004.
    [33]Grana, C., Borghesani, D., and Cucchiara, R., “Fast block based connected components labeling”, IEEE International Conference on Image Processing, pp. 4061 – 4064, 2009.
    [34]Ji Shan-Fan,Sheng-Wu Xiong,Jing Zhuo-Wang, “The Multi-objective Differential Evolution Algorithm Based on Quick Convex Hull Algorithms”, IEEE International Conference on Natural Computation, pp. 469 – 473, 2009.
    [35]Ji Shan-Fan,Sheng-Wu Xiong,Jing Zhuo-Wang, “Hand motion detection from EMG signals by using ANN based classifier for human computer interaction”, IEEE International Conference on Modeling, Simulation and Applied Optimization, pp. 1 – 6, 2011.
    [36]Ghafouri, S. and Seyedarabi, H., “Hybrid method for hand gesture recognition based on combination of Haar-like and HOG features”, Iranian Conference on Electrical Engineering, pp. 1-4, 2013.
    [37]Xingbao Meng,Jing Lin and Yingchun Ding, “An extended HOG model: SCHOG for human hand detection”, IEEE International Conference on Systems and Informatics , pp. 2593-2596, 2012.
    [38]Ramirez Rivera, A., Rojas Castillo and Oksam Chae: “Local Directional Number Pattern for Face Analysis: Face and Expression Recognition”, IEEE Transactions on Image Processing, 2013, vol.22, issue.5, pp.1740-1752
    [39]Arivazhagan, S., Priyadharshini, R.A. and Sowmiya, S.: “Face recognition based on local directional number pattern and ANFIS classifier”, 2014 International Conference on Advanced Communication Control and Computing Technologies (ICACCCT), 2014, pp.1627-1631
    [40]Pal, A., Schaefer, G., Celebi , M.E., “Robust codebook-based video background subtraction”, IEEE International Conference on Acoustics Speech and Signal Processing, pp. 1146-1149, 2010.
    [41]Zhigeng Pan, Yang Li, Mingmin Zhang, Chao Sun, Kangde Guo, Xing Tang and Zhou, S.Z.,“A real-time multi-cue hand tracking algorithm based on computer vision”, IEEE Virtual Reality Conference, pp. 219-222, 2010.
    [42]Igarashi, M., Mizuno, A. and Ikebe, M., “Accuracy improvement of histogram-based image filtering”, IEEE International Conference on Image Processing, pp. 1217-1221, 2013.
    [43]Simion, G., Gui, V., Otesteanu, M. and Ikebe, M., “Finger detection based on hand contour and colour information”, IEEE International Symposium on Applied Computational Intelligence and Informatics, pp. 97-100, 2011.
    [44]Geng Hao, Luo Min, Hu Feng, “Improved Self-Adaptive Edge Detection Method Based on Canny”, 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics, pp. 527-530, 2013.
    [45]Imran Hussain , Anjan Kumar Talukdar , Kandarpa Kumar Sarma, “Hand gesture recognition system with real-time palm tracking”, India Conference on 2014 Annual IEEE, pp. 1-6, 2014.
    [46]Sheng-Hsiang Chang,Wen-Cheng Chou and Wen-Yen Lin, “A Real-time Gesture Recognition Implementation on SoC Development Platform”, Consumer Electronics-Berlin of IEEE, pp. 1-5, 2012.
    [47]許組碩。2014。Android系統下之手勢辨識應用。碩士論文。台北:國立台灣科技大學資訊工程學研究所。
    [48]李彥廷。2014。手勢辨識在嵌入式系統ARM之應用。碩士論文。台北:國立台灣科技大學資訊工程學研究所。

    無法下載圖示 全文公開日期 2021/08/18 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 2021/08/18 (國家圖書館:臺灣博碩士論文系統)
    QR CODE