簡易檢索 / 詳目顯示

研究生: 蔡孟鋼
Meng-Kang Tsai
論文名稱: 結合細線化之即時美國文字手語辨識系統
A Study of a Real-Time American Sign Language Recognition System Using Thinning Algorithm
指導教授: 蔡超人
Chau-ren Tsai
口試委員: 陳建中
Jiann-jone Chen
郭景明
Jing-ming Guo
王文智
Wen-jieh Wang
黃安橋
An-chyau Huang
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2008
畢業學年度: 96
語文別: 中文
論文頁數: 130
中文關鍵詞: 細線化手腕切割DSP分類
外文關鍵詞: classification, thinning, wrist cropped, DSP
相關次數: 點閱:170下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在電腦視覺領域中的人機介面系統,手勢與手語辨識一直是非常熱門的研究主題之一,眾多研究的成果可以被廣泛地應用在某些特定領域上,然而大多數研究還是以個人電腦為基礎架構,在經過影像的輸入和輸出以及作業系統的運算,都會造成電腦內的中央處理器龐大負擔,導致整體系統效率降低,不如我們預期想要達到的效能。因此近年來,由於數位訊號處理器擁有體積小且對大量且複雜的運算處理有著高效能的表現,所以本論文結合德州儀器生產的數位訊號處理器TMS320DM642 EVM與CCS(Code Composer Studio)軟體系統當作是我們的開發平台。首先使用移動物體偵測判斷手勢目前的狀態,判斷手勢靜止後才抓取目前影像,接著利用手腕切割(Wrist Cropped)去除手腕以下的部分,以得到手勢,手勢得到後,先使用角度分類將手勢分為兩大群組,第二群組使用特徵辨識,第一群組經由細線化(Thinning)簡化手勢,再來使用細線化後的手勢影像以及前處理過後的手勢特徵影像將手勢分類與辨識,最後辨識結果經由OSD(On Screen Display)顯示在螢幕上,如此一來就能達到即時美國文字手語辨識的任務。


    Both Hand gesture and sign language are very popular research in the filed of computer vision for human interface system. The accomplishments of the research can be widely applied to some specific fields. However, most of the digital image process systems are based on personal computer. After input and output of images and the operations of Operating System, these procedures will cause heavy loading of the CPU and lower efficiency of the system. Hence, the result doesn’t meet what we expected. In recent years, due to the development of DSP bring many benefits such as small size and high performance of the complicated operation algorithms, we integrate the TI TMS320DM642 EVM with CCS software system as our research developing platform. First of all, we determine that whether the gesture is moving or not by utilizing moving edge detection until the gesture is motionless. Secondly, we capture the image and cut the part below the wrist by utilizing wrist cropped algorithm. Thirdly,we utilize orientation to classify gestures into two classifications, one is recognized by characteristics ,another is recognize by utilizing the thinning algorithm to simplify the gestures, and then classify and recognize based on gestures image alter thinning and gesture characteristic image after preprocess. Finally, the results of recognition are displayed on the monitor by OSD. We complete the real time American Sign Language recognition system at the end.

    摘要 I Abstract II 目錄 III 圖索引 VI 表索引 XII 第一章 緒論 1 1.1 研究動機與目的 1 1.2 研究方法 2 1.3 論文架構 3 第二章 即時美國文字手語辨識系統架構 4 2.1 移動物體偵測程序 5 2.2 手腕位置切割程序 7 2.3 手勢分類與辨識程序 9 2.4 相關硬體配置及規格 10 第三章 移動物體偵測程序 14 3.1 影像前處理 14 3.1.1 色彩模式及灰階模式之轉換 15 3.1.2 影像邊緣偵測 16 3.2 移動邊點偵測法 23 3.3 移動物體偵測程序流程 25 第四章 手腕位置切割程序 26 4.1 膚色過濾 26 4.2 影像品質改善 27 4.2.1 影像雜訊抑制 28 4.2.2 型態學 30 4.3 手部質心及角度向量 33 4.4 手腕間距的計算 35 4.4.1 角度向量與邊界之交叉點 35 4.4.2 手部內部之間隔點 38 4.4.3 手腕間距 39 4.5 獲得手腕位置 42 4.6 手腕切割處理程序流程 43 第五章 手勢分類與辨識程序 45 5.1 手勢定義 45 5.2 手勢角度分類 48 5.3 細線化 49 5.4 上頂點數分類 54 5.5 一個上頂點數分類 58 5.5.1 交叉點數分類 58 5.5.2 相對長度分類 61 5.5.3 相對位置分類 63 5.5.4 特徵位置分類 66 5.5.5 特徵距離辨識 71 5.5.6 門檻值設定辨識 72 5.5.7 特徵長度辨識 73 5.5.8 特徵凹點數辨識 74 5.6 二個上頂點數分類 75 5.6.1 交叉點數分類 75 5.6.2 相對位置分類 76 5.6.3 相對長度分類 78 5.6.4 相對角度分類 81 5.5.5 特徵位置分類 83 5.6.6 特徵長度辨識 87 5.6.7 特徵角度辨識 88 5.7 三個上頂點數分類 89 5.7.1 相對長度分類 89 5.7.2 特徵位置辨識 90 5.8 第二群組辨識 91 5.9 手勢分類與辨識程序流程 92 第六章 辨識系統之實現 94 6.1 OSD基本架構 94 6.1.1 OSD之基本設定 96 6.1.2 OSD之顯示實作流程 99 6.2 系統整合與實現 100 6.3 系統效能測試 104 6.4 辨識結果分析與討論 110 第七章 結論112 7.1 研究成果 112 7.2 未來研究方向 114 參考文獻 115

    [1]J. P. Serra, Image Analysis and Mathematical Morphology, Academic Press, pp. 115-130, 1982.
    [2]H. I. Park and J. W. Lee, “Hand Gesture Recognition for Table-Top Interaction System,” International Symposium on Ubiquitous Virtual Reality, Vol. 260, pp. 34-35, 2007.
    [3]T. Y. Zhang and C. Y. Suen, “A Fast Parallel Algorithm for Thinning Digital Patterns,” Image Processing and Computer Vision, Vol. 27, pp. 236-239, 1984.
    [4]M. C. Holt, A. Stewart, M. Clint and R. H. Perrott, “Improved Parallel Thinning Algorithm,” Image Processing and Computer Vision, Vol. 30, pp. 156-160, 1987.
    [5]R. Y. Wu and W. H. Tsai, “A New One-Pass Parallel Tthinning Algorithm for Binary Images,” Pattern Recognition Letters, Vol. 13, pp. 715-723, 1992.
    [6]D. Hearn and M. P. Baker, Computer Graphics, 2nd Edition, Prentice Hall, New York, pp. 49-81, 1994.
    [7]M. Sonka, V. Hlavac and R. Bole, Image Processing, Analysis, and Machine Vision, PWS Pub., New York, pp. 35-48, 1999.
    [8]D. H. Ballard and C. M. Brown, Computer Vision, Prentice-Hall, New York, pp. 65-78, 1982.
    [9]N. Kanopoulos, N. Vasanthavada and R. L. Baker, “Design of An Image Edge Detection Filter Using the Sobel Operator,” IEEE Journal of Solid-State Circuits, Vol. 23, No. 2, pp. 358-367, 1988.
    [10]N. Kazakova, M. Margala and N. G. Durdle, “Sobel Edge Detection Processor for A Real-Time Volume Rendering System,” Proceedings of the 2004 International Symposium on Circuits and System, Vol. 2, pp. 913-916, 2004.
    [11]S. A. Bakerand and R. J. Green, “Detection of Edges Based on Hexagonal Pixel Formats,” IEEE Int’l Conf. on Signal Processing, Vol. 2, pp. 1114-1117, 1996.
    [12]J. F. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. on Pattern Analysis Machine Intelligence, Vol. 6, pp. 679-698, 1986.
    [13]D. Chai and K. N. Ngan, “Face Segmentation Using Skin-Color Map in Videophone Applications, ” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 9, pp. 551-564, 1999.
    [14]J. R. New, “A Method for Hand Gesture Recognition,” ACM Mid-Southeast Chapter Fall Conference, pp. 79-80, 2002.
    [15]C. W. Ng and S. Ranganath, “Real-Time Gesture Recognition System and Application,” Image and Vision Computing, Vol. 20, pp. 993-1007, 2002.
    [16]A. Licsar and T. Sziranyi, “Hand Gesture Recognition in Camera-Projector,” International Workshop on Human-Computer Interaction, Lecture Notes in Computer Science, Vol. 3058, pp. 83-93, 2004.
    [17]N. D. Binh, E. Shuchi and T. Ejima, “Real-Time Hand Tracking and Gesture Recognition System,” Proceedings of International Conference on Graphics, Vision and Image Processing, pp. 362-368, 2005.
    [18]N. D. Binh and T. Ejima, “A New Approach Dedicated to Hand Gesture Recognition,” IEEE International Conference, Vol. 1, pp. 62-67, 2006.
    [19]R. Lockton and A. W. Fitzgibbon, “Real-Time Gesture Recognition Using Deterministic Boosting,” British Machine Vision Conference, pp. 817-826, 2002.
    [20]J. MacLean, R. Herpers, C. Pantofaru, L. Wood, K. Derpanis and J. Tsotsos, “Fast Hand Gesture Recognition for Real-Time Teleconferencing Applications,” IEEE Proc. of the Second Int. Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-Time Systems, pp. 133-144, 2001.
    [21]T. B. Dinh, V. B. Dang, D. A. Duong, T. T. Nguyen and D. D. Le, “Hand Gesture Classification Using Boosted Cascade of Classifiers,” Research, Innovation and Vision for the Future, International Conference, pp. 139-144, 2006.
    [22]A. M. Martinez, R. B. Wilbur, R. Shay and A. C. Kak, “Purdue RVL-SLLL ASL Database for Automatic Recognition of American Sign Language,” Proceedings Fourth IEEE International Conference, pp. 167-172, 2002.
    [23]A. M. Ashraful and Y. Hong, “Sign Language Finger Alphabet Recognition from Gabor-PCA Representation of Hand Gestures,” Machine Learning and Cybernetics International Conference, Vol. 4, pp. 2218- 2223, 2007.
    [24]Q. Munib, M. Habeeb, B. Takruri and H. A. Malik, “American Sign Language Recognition Based on Hough Transform and Neural Networks,” Expert Systems with Applications, Vol. 32, pp. 24-37, 2007.
    [25]J. P. Wachs, H. Stern and Y. Edan, “Cluster Labeling and Parameter Estimation for The Automated Setup of A Hand Gesture Recognition System,” Systems, Man and Cybernetics, Part A, IEEE Transactions, Vol. 35, pp. 932-944, 2005.
    [26]H. S. Yoon, J. S. Younglae, J. Bae and H. S. Yang, “Hand Gesture Recognition Using Combined Features,” Pattern Recognition, Vol. 34, pp. 1491-1501, 2001.
    [27]Y. Hamada, N. Shimada and Y. Shirai, “Hand Shape Estimation Under Complex Backgrounds for Sign Language Recognition,” Automatic Face and Gesture Recognition Proceedings, Sixth IEEE International Conference, pp. 589-594, 2004.
    [28]Texas Instruments Inc., TMS320DM642 EVM OSD FPGA User’s Guide, 2003.

    QR CODE