研究生: |
蔡孟鋼 Meng-Kang Tsai |
---|---|
論文名稱: |
結合細線化之即時美國文字手語辨識系統 A Study of a Real-Time American Sign Language Recognition System Using Thinning Algorithm |
指導教授: |
蔡超人
Chau-ren Tsai |
口試委員: |
陳建中
Jiann-jone Chen 郭景明 Jing-ming Guo 王文智 Wen-jieh Wang 黃安橋 An-chyau Huang |
學位類別: |
碩士 Master |
系所名稱: |
電資學院 - 電機工程系 Department of Electrical Engineering |
論文出版年: | 2008 |
畢業學年度: | 96 |
語文別: | 中文 |
論文頁數: | 130 |
中文關鍵詞: | 細線化 、手腕切割 、DSP 、分類 |
外文關鍵詞: | classification, thinning, wrist cropped, DSP |
相關次數: | 點閱:170 下載:1 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在電腦視覺領域中的人機介面系統,手勢與手語辨識一直是非常熱門的研究主題之一,眾多研究的成果可以被廣泛地應用在某些特定領域上,然而大多數研究還是以個人電腦為基礎架構,在經過影像的輸入和輸出以及作業系統的運算,都會造成電腦內的中央處理器龐大負擔,導致整體系統效率降低,不如我們預期想要達到的效能。因此近年來,由於數位訊號處理器擁有體積小且對大量且複雜的運算處理有著高效能的表現,所以本論文結合德州儀器生產的數位訊號處理器TMS320DM642 EVM與CCS(Code Composer Studio)軟體系統當作是我們的開發平台。首先使用移動物體偵測判斷手勢目前的狀態,判斷手勢靜止後才抓取目前影像,接著利用手腕切割(Wrist Cropped)去除手腕以下的部分,以得到手勢,手勢得到後,先使用角度分類將手勢分為兩大群組,第二群組使用特徵辨識,第一群組經由細線化(Thinning)簡化手勢,再來使用細線化後的手勢影像以及前處理過後的手勢特徵影像將手勢分類與辨識,最後辨識結果經由OSD(On Screen Display)顯示在螢幕上,如此一來就能達到即時美國文字手語辨識的任務。
Both Hand gesture and sign language are very popular research in the filed of computer vision for human interface system. The accomplishments of the research can be widely applied to some specific fields. However, most of the digital image process systems are based on personal computer. After input and output of images and the operations of Operating System, these procedures will cause heavy loading of the CPU and lower efficiency of the system. Hence, the result doesn’t meet what we expected. In recent years, due to the development of DSP bring many benefits such as small size and high performance of the complicated operation algorithms, we integrate the TI TMS320DM642 EVM with CCS software system as our research developing platform. First of all, we determine that whether the gesture is moving or not by utilizing moving edge detection until the gesture is motionless. Secondly, we capture the image and cut the part below the wrist by utilizing wrist cropped algorithm. Thirdly,we utilize orientation to classify gestures into two classifications, one is recognized by characteristics ,another is recognize by utilizing the thinning algorithm to simplify the gestures, and then classify and recognize based on gestures image alter thinning and gesture characteristic image after preprocess. Finally, the results of recognition are displayed on the monitor by OSD. We complete the real time American Sign Language recognition system at the end.
[1]J. P. Serra, Image Analysis and Mathematical Morphology, Academic Press, pp. 115-130, 1982.
[2]H. I. Park and J. W. Lee, “Hand Gesture Recognition for Table-Top Interaction System,” International Symposium on Ubiquitous Virtual Reality, Vol. 260, pp. 34-35, 2007.
[3]T. Y. Zhang and C. Y. Suen, “A Fast Parallel Algorithm for Thinning Digital Patterns,” Image Processing and Computer Vision, Vol. 27, pp. 236-239, 1984.
[4]M. C. Holt, A. Stewart, M. Clint and R. H. Perrott, “Improved Parallel Thinning Algorithm,” Image Processing and Computer Vision, Vol. 30, pp. 156-160, 1987.
[5]R. Y. Wu and W. H. Tsai, “A New One-Pass Parallel Tthinning Algorithm for Binary Images,” Pattern Recognition Letters, Vol. 13, pp. 715-723, 1992.
[6]D. Hearn and M. P. Baker, Computer Graphics, 2nd Edition, Prentice Hall, New York, pp. 49-81, 1994.
[7]M. Sonka, V. Hlavac and R. Bole, Image Processing, Analysis, and Machine Vision, PWS Pub., New York, pp. 35-48, 1999.
[8]D. H. Ballard and C. M. Brown, Computer Vision, Prentice-Hall, New York, pp. 65-78, 1982.
[9]N. Kanopoulos, N. Vasanthavada and R. L. Baker, “Design of An Image Edge Detection Filter Using the Sobel Operator,” IEEE Journal of Solid-State Circuits, Vol. 23, No. 2, pp. 358-367, 1988.
[10]N. Kazakova, M. Margala and N. G. Durdle, “Sobel Edge Detection Processor for A Real-Time Volume Rendering System,” Proceedings of the 2004 International Symposium on Circuits and System, Vol. 2, pp. 913-916, 2004.
[11]S. A. Bakerand and R. J. Green, “Detection of Edges Based on Hexagonal Pixel Formats,” IEEE Int’l Conf. on Signal Processing, Vol. 2, pp. 1114-1117, 1996.
[12]J. F. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. on Pattern Analysis Machine Intelligence, Vol. 6, pp. 679-698, 1986.
[13]D. Chai and K. N. Ngan, “Face Segmentation Using Skin-Color Map in Videophone Applications, ” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 9, pp. 551-564, 1999.
[14]J. R. New, “A Method for Hand Gesture Recognition,” ACM Mid-Southeast Chapter Fall Conference, pp. 79-80, 2002.
[15]C. W. Ng and S. Ranganath, “Real-Time Gesture Recognition System and Application,” Image and Vision Computing, Vol. 20, pp. 993-1007, 2002.
[16]A. Licsar and T. Sziranyi, “Hand Gesture Recognition in Camera-Projector,” International Workshop on Human-Computer Interaction, Lecture Notes in Computer Science, Vol. 3058, pp. 83-93, 2004.
[17]N. D. Binh, E. Shuchi and T. Ejima, “Real-Time Hand Tracking and Gesture Recognition System,” Proceedings of International Conference on Graphics, Vision and Image Processing, pp. 362-368, 2005.
[18]N. D. Binh and T. Ejima, “A New Approach Dedicated to Hand Gesture Recognition,” IEEE International Conference, Vol. 1, pp. 62-67, 2006.
[19]R. Lockton and A. W. Fitzgibbon, “Real-Time Gesture Recognition Using Deterministic Boosting,” British Machine Vision Conference, pp. 817-826, 2002.
[20]J. MacLean, R. Herpers, C. Pantofaru, L. Wood, K. Derpanis and J. Tsotsos, “Fast Hand Gesture Recognition for Real-Time Teleconferencing Applications,” IEEE Proc. of the Second Int. Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-Time Systems, pp. 133-144, 2001.
[21]T. B. Dinh, V. B. Dang, D. A. Duong, T. T. Nguyen and D. D. Le, “Hand Gesture Classification Using Boosted Cascade of Classifiers,” Research, Innovation and Vision for the Future, International Conference, pp. 139-144, 2006.
[22]A. M. Martinez, R. B. Wilbur, R. Shay and A. C. Kak, “Purdue RVL-SLLL ASL Database for Automatic Recognition of American Sign Language,” Proceedings Fourth IEEE International Conference, pp. 167-172, 2002.
[23]A. M. Ashraful and Y. Hong, “Sign Language Finger Alphabet Recognition from Gabor-PCA Representation of Hand Gestures,” Machine Learning and Cybernetics International Conference, Vol. 4, pp. 2218- 2223, 2007.
[24]Q. Munib, M. Habeeb, B. Takruri and H. A. Malik, “American Sign Language Recognition Based on Hough Transform and Neural Networks,” Expert Systems with Applications, Vol. 32, pp. 24-37, 2007.
[25]J. P. Wachs, H. Stern and Y. Edan, “Cluster Labeling and Parameter Estimation for The Automated Setup of A Hand Gesture Recognition System,” Systems, Man and Cybernetics, Part A, IEEE Transactions, Vol. 35, pp. 932-944, 2005.
[26]H. S. Yoon, J. S. Younglae, J. Bae and H. S. Yang, “Hand Gesture Recognition Using Combined Features,” Pattern Recognition, Vol. 34, pp. 1491-1501, 2001.
[27]Y. Hamada, N. Shimada and Y. Shirai, “Hand Shape Estimation Under Complex Backgrounds for Sign Language Recognition,” Automatic Face and Gesture Recognition Proceedings, Sixth IEEE International Conference, pp. 589-594, 2004.
[28]Texas Instruments Inc., TMS320DM642 EVM OSD FPGA User’s Guide, 2003.