簡易檢索 / 詳目顯示

研究生: 顧昱得
YU-TE KU
論文名稱: 基於數字地標影像辨識及手寫字元操作之移動機器人導航控制系統
Mobile Robot Guidance Control System Based on Digit Landmarks Image Recognition and Fingertip Writing Maneuver
指導教授: 施慶隆
Ching-Long Shih
口試委員: 黃志良
Chih-Lyang Hwang
李文猶
none
何昭慶
none
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2016
畢業學年度: 104
語文別: 中文
論文頁數: 98
中文關鍵詞: 影像處理數字地標辨識手寫字元辨識移動機器人導航FPGA
外文關鍵詞: Image processing, Digit landmarks image recognition, Fingertip writing recognition, Mobile robot guidance, FPGA.
相關次數: 點閱:231下載:20
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本論文之目的是經由符號辨識的技術來解決有關移動機器人的定位、導航與人機互動的問題,所完成之系統係使用Verilog HDL在FPGA晶片上實現。此系統由三個子系統所組成,包括全方位移動機器人子系統、地標影像辨識子系統與即時影像手寫辨識子系統。影像或符號是機器人所要接收的外在資訊,藉由使用影像辨識之技術,機器人可以偵測使用者的命令、目前所在的位置以及機器人的姿態。即時影像手寫辨識子系統可以辨識一筆畫的字元軌跡,包括阿拉伯數字 0 到 9 與英文字母 a 到 z 總共36個符號。地標影像辨識子系統可辨識天花板上張貼的數字地標圖案,包括阿拉伯數字 1 到 9。全方位移動機器人子系統則根據使用者書寫的字元與貼在天花板上之地標圖案的資訊決定其動作。


    The object of the paper is intended to deal with the issues regarding positioning and navigation of a mobile robot, and human–computer interaction by using the technique of symbol identification. The system is implemented on FPGA chip by programming with Verilog. The system consists of three sub-systems including an omnidirectional mobile robot sub-system, a landmark Image recognition sub-system and a real time vision-based fingertip-writing character recognition sub-system. Image or symbol is the only external information received by the mobile robot. The robot can detect the user's command, the current location and the posture of the robot by using the technique of image recognition. The real time vision-based fingertip-writing character recognition sub-system can recognize the track of character strokes including Arabic numerals 0-9 and English alphabet a to z total of which are 36 symbols. The landmark Image recognition sub-system can identify the pattern of digit landmarks including Arabic numerals 0-9, which were pasted on ceiling.The omnidirectional mobile robot sub-system will move according to the information regarding the characters input by user and the landmark Image pasted on ceiling.

    第一章 緒論1 1.1研究動機與目標1 1.2 文獻回顧2 1.3論文架構4 第二章 系統架構介紹5 2.1系統架構說明5 2.2全方位移動機器人與即時影像手寫辨識系統8 2.3系統功能10 2.4 FPGA開發板11 2.5 影像感測器與顯示器12 2.6伺服馬達及驅動控制器12 2.7 HC-SR04超聲波測距模組15 2.8 HC-05藍芽模組15 2.9電源模組16 第三章 三輪全方位式移動機器人系統17 3.1 全方位式三輪移動機器人的移動方程式17 3.2移動機器人控制19 3.2.1影像對位控制19 3.2.2地圖建置19 3.2.3障礙物偵測模組20 3.2.4移動機器人狀態23 第四章 影像處理26 4.1影像處理架構26 4.2色彩模型與影像前景與背景分離27 4.3 RAW to RGB 影像格式轉換29 4.4 RGB to YCbCr色彩模型轉換29 4.5 RGB to HSI色彩模型轉換31 4.6直方圖等化法用於影像強度轉化函數32 4.7特徵顏色擷取36 4.8濾除影像雜訊37 第五章 地標影像辨識系統39 5.1地標辨識系統架構39 5.2特徵點擷取40 5.3特徵描述41 5.4 FPGA實作特徵點座標轉換運算44 5.5最近鄰居法(KNN)48 5.6姿態校正50 5.6.1 地標姿態50 5.6.2機器人姿態51 第六章 即時影像手寫辨識系統52 6.1系統介紹53 6.2影像處理與手指尖端位置偵測54 6.3手指尖端軌跡追蹤及記錄56 6.4判斷手寫字元之特徵角57 6.5符號比對59 6.6 FPGA實現圖型化人機界面63 6.6.1圖型化界面顯示基本單元64 6.6.2 字元與圖形顯示64 6.7手寫文字辨識實驗結果69 第七章 系統整合與實驗結果74 7.1智慧型代理人介紹74 7.2任務環境75 7.3知覺序列與代理人函數75 7.4 系統整合78 7.5實驗結果78 第八章 結論、建議與論文比較91 8.1結論91 8.2建議92 8.3論文比較93 參考文獻96

    [1] Z. Zafrulla, H. Brashear, T. Starner, H. Hamilton and P. Presti, “American sign
    language recognition with the Kinect”, Proceedings of the 13th International Conference on Multimodal Interfaces , pp. 279-286, 2011.
    [2] S. Mitra and T. Acharya, “Gesture recognition: a survey”, IEEE Transactions on Systems, Man, and Cybernetics, Part C -Applications and Reviews, Vol. 37, No. 3,
    pp. 311-324, 2007.
    [3] S. L. Phung, A. Bouzerdoum, and D. Chai, “Skin segmentation using color pixel classification: Analysis and comparison”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, Number. 1, pp. 148-154, 2005.
    [4] D. Lee and S. Lee, “Vision-based finger action recognition by angle detection and contour analysis”, ETRI Journal, Vol. 33, No. 3, pp. 415-422, 2011.
    [5] Xin Zhang , Lianwen Jin and Ziyong Feng , “Finger-writing-in-the-air system using kinect sensor”, IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1-4, 2013.
    [6] L. Jin, D. Yang, L. Zhen and J. Huang, “A novel vision based finger-writing character recognition system”, IEEE International Conference on Pattern Recognition (ICPR'06), Vol. 1, pp. 1104-1107, 2006.
    [7] D. Lee and S. Lee, “Vision-based finger action recognition by angle detection and
    contour analysis”, Journal of ETRI, Vol. 33, No. 3, pp. 415-422, 2011.
    [8] Mohammed Elmogy , “Landmark manipulation system for mobile robot navigation”, IEEE International Conference on Computer Engineering and Systems (ICCES),
    pp. 120-125, 2010.

    [9] Wenzheng Chi , Wei Zhang , Jason Gu and Hongliang Ren, “A vision-based mobile robot localization method”, IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 2703-2708, 2013.
    [10] Rui Lin, Zhenhua Wang, Rongchuan Sun and Lining Sun, “Image features-based mobile robot localization”, IEEE International Conference on Information and Automation Shenyang , pp. 304-310, 2012.
    [11] Juntao Li , Zhilei Wu, Jun Zhang , Weiyi Chen, “Research of AGV positioning based on the two-dimensional code recognition method”, IEEE International Conference on Logistics, Informatics and Service Sciences (LISS) , pp. 1-6, 2015.
    [12] 林啟賢,基於地圖之室內自走車導航研究,國立成功大學電機工程學系碩士論文,2009。
    [13] 陳柏安,室內自走機器人之定位系統設計和實作,國立台灣科技大學機械工程學系碩士學位論文,2012。
    [14] 楊勝明,以圖樣辨識為基礎之自走車導航控制,國立中央大學電機工程學系碩士論文,2010。
    [15] Li Guanghui, Jiang Zhijian. “An artificial landmark design based on mobile robot localization and navigation”, IEEE International Conference on Intelligent Computation Technology and Automation (ICICTA) , Vol. 1, pp. 588 - 591, 2011.
    [16] 謝易軒,自走車的立體障礙物偵測, 國立中央大學資訊工程學系碩士論文, 2013。
    [17] M. Van den Bergh, D. Carton, R. De Nijs, N. Mitsou, C. Landsiedel, K. Kuehnlenz, D. Wollherr, L. Van Gool and M. Buss, “Real-time 3D hand gesture interaction with a robot for understanding directions from humans”, IEEE International Symposium on Robot and Human Interactive Communication, pp. 357-362, 2011.
    [18] Minoru Mori, “Video based handwritten characters recognition”, Character Recognition Chapter 7, Publisher Sciyo, August, 2010
    [19] Fu-An Huang, Chung-Yen Su and Tsai-Te Chu, “Kinect-based mid-air handwritten digit recognition using multiple segments and scaled coding”, IEEE International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS), pp. 694-697, 2013.
    [20] Hiroyuki Ishida, Tomokazu Takahashi , Ichiro Ide ,Hiroshi Murase, “A hilbert warping method for camera-based finger-writing recognition”, IEEE International Conference Pattern Recognition (ICPR), pp. 1-5, 2008.
    [21] Kayhan Moharreri, Chirag Tayal , “Gesture based character recognition”, CSE 5524: Computer Vision for Human-Computer Interaction, The Ohio State University, 2007
    [22] Mohammad Reza ,Aminian Heidari, Azrulhizam Shapi ,Riza Sulaiman , “Writing in the air using kinect and growing neural gas network”, Penerbit UTM Press, Universiti Teknologi Malaysia, 2012.
    [23] 原著Gonzalez Woods ,譯者繆紹綱,數位影像處理,培生教育出版公司,2009。
    [24] 鍾國亮,影像處理與電腦視覺,第五版,東華書局,2014。
    [25] 許鈞霖,以硬軟體共同設計的自走車之地標搜索、視覺辨識、建圖及視覺導引 , 國立台灣科技大學電機工程學系碩士學位論文, 2015。
    [26] 原著Stuart Russell, Peter Norvig,編譯 高超群,審定 張俊盛,人工智慧現代方法,第二版,全華圖書股份有限公司,2006。
    [27] 施慶隆、李文猶,機電整合控制--多軸運動設計與應用,第二版,全華圖書股份有限公司,2009。

    QR CODE