簡易檢索 / 詳目顯示

研究生: 詹振揚
Jhen-yang Chan
論文名稱: 視覺伺服擊球之DSP機械視覺與機械手臂分散式控制系統
Vision Servo Batting by Distributed Control System of DSP Machine Vision and Robot Manipulator
指導教授: 邱士軒
Shih-Hsuan Chiu
口試委員: 溫哲彥
none
陳建光
Jem-Kun Chen
黃昌群
Chang-Chiun Huang
學位類別: 碩士
Master
系所名稱: 工程學院 - 材料科學與工程系
Department of Materials Science and Engineering
論文出版年: 2009
畢業學年度: 97
語文別: 中文
論文頁數: 83
中文關鍵詞: 嵌入式系統視覺系統數位信號處理器CMOS影像感測器二軸機械手臂分散式控制
外文關鍵詞: embedded system, vision system, digital signal processor, CMOS image sensor, two-link robot arm, distributed control
相關次數: 點閱:220下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

機器人的發展中,為了使其更貼近人類的行為,因此需要在機器人上裝設各式感測器,讓其接收現實世界的各項資訊,並做出更相像於人類的動作與反應。其中,隨著影像辨識技術的發展越來越蓬勃,此技術開始廣泛的被應用於機器人上,使其具有如人類一般的眼睛,此稱為機械視覺。
本論文旨在於發展一個基於數位信號處理器(Digital Signal Processor)的嵌入式影像擷取系統,並使用分散式控制的作法,與機械手臂平台做配合應用。在硬體方面,本系統設計以CMOS影像感測器、圖框緩衝器、SPI to I2C橋接器與UART傳輸模組組成之DSP影像擷取擴充子板,其中以TMS320C6416 DSP為核心之DSK(DSP Starter Kit)開發板作為影像處理核心平台。在軟體方面,有擷取影像的時序控制、影像處理技術與DSP和電腦溝通程式,以此儲存完整影像資料,並做影像辨識,再將辨識結果的訊息傳送給電腦做下一步處理。最後,將此系統與二軸機械手臂平台結合,使用分散式控制的觀念,DSP做影像辨識追蹤球滾動的位置,電腦控制二軸機械手臂將球來回打向壁面。


A robot in real world needs to obtain environment information for its actions and response. Therefore, a robot generally equips specific sensors to acquire environment information. In particular, the vision system is able to capture environment images, act as the robot's eye, and is able applied for different application.
The objective of this thesis is to develop a DSP-based embedded imaging system for a two-link robot arm. The implementation of the system consists of hardware implementation and software implementation. For the hardware implementation, the embedded imaging system is composed of a TMS320C6416 DSK board as the image process platform and a custom plug-in image acquisition daughter card which contains a CMOS image sensor OV7620, a frame buffer and SPI to I2C bridge. The software procedure contains the timing control, interfacing between system components, and image preprocessing to improve the image quality. The imaging system is integrated with a two-link robot arm. The DSP-based imaging system of the distributed control system uses to tracking the position of a rolling ball, then PC-based two-link robot arm hits the ball back to the wall.

摘要I AbstractII 誌謝III 目錄IV 圖索引VII 表索引XI 第一章緒論1 1.1前言1 1.2文獻回顧2 1.3研究動機與目的8 1.4論文架構9 第二章DSP-based影像擷取系統架構10 2.1數位信號處理器11 2.2CMOS影像感測器16 2.3影像擷取緩衝暫存18 2.3.1圖框緩衝器18 2.3.2外部記憶體介面與一般通用輸出入21 2.4影像感測器初始化設定控制23 2.4.1SPI to I2C橋接器23 2.4.2SPI與I2C串列傳輸26 2.5DSP與PC連接介面:UART串列傳輸30 第三章影像系統與機械手臂理論描述32 3.1影像擷取色彩轉換32 3.1.1Bayer Pattern彩色濾鏡陣列32 3.1.2YUV 4:2:2格式35 3.2影像處理演算法38 3.2.1二值化38 3.2.2雜訊去除40 3.2.3質心位置41 3.3二軸機械手臂反向運動學43 第四章影像擷取系統實驗結果與討論46 4.1DSP與機械手臂機台溝通實驗46 4.1.1DSP與PC連接模組46 4.1.2實驗流程與結果51 4.2擷取動態影像實驗55 4.2.1影像感測器初始化設定模組55 4.2.2影像擷取緩衝模組59 4.2.3實驗流程與結果61 4.3分散式控制之影像伺服擊球實驗68 4.3.1DSP擷取影像追蹤球73 4.3.2二軸機械手臂平台擊球77 4.3.3實驗結果79 第五章結論與未來展望82 5.1結論82 5.2未來展望83 參考文獻84

[1]Yamazaki, K., Tomono, M., Tsubouchi, T., and Yuta, S., “Object Shape Reconstruction and Pose Estimation by a Camera Mounted on a Mobile Robot, ” Proc. of 2004 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Sendai, Japan, vol. 4, pp. 4019-4025 (2004).
[2]Song, K. T., and Chen, W. J., “Face Recognition and Tracking for Human-Robot Interaction, ” IEEE Int. Conf. on Systems, Man and Cybernetics, The Hague , Netherlands, vol. 3, pp. 2877-2882 (2004).
[3]Palacin, J., Sanuy, A., Clua, X., Chapinal, G., Bota, S., Moreno, M., and Herms, A., “Autonomous mobile mini-robot with embedded CMOS vision system,” IEEE 2002 28th Annual Conf. on Industrial Electronics Society, Sevilla, Spain, vol. 3, pp. 2439-2444 (2002).
[4]Corley, D., and Jovanov, E., “A low power intelligent video-processing sensor,” Proc. Of 2002 the Thirty-Fourth Southeastern Symposium on System Theory, pp. 176-178 (2002).
[5]Andrian, H., and Song, K. T., “Embedded CMOS imaging system for real-time robotic vision,” Intelligent Robots and Systems, 2005. (IROS 2005). 2005 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Alberta, Canada, pp. 1096-1101 (2005).
[6]Li, D., Jiang, Y., and Chen, G., “A Low Cost Embedded Color Vision System Based on SX52,” IEEE Int. Conf. on Information Acquisition, Shandong, China, pp. 883-887 (2006).
[7]Bonato, V., Fernandes, M. M., Marques, E., “A smart camera with gesture regcognition and SLAM capabilities for mobile robots,” International Journal of Electronics, Vol. 93, Issue 6, pp. 385-401 (2006).
[8]Zhang, Y., “Design of robot monocular vision based on DSP and CMOS image sensor,” ICALIP Int. Conf. on Audio, Language and Image Processing, Shanghai, China, pp. 614-618 (2008).
[9]Huang, S. J., Wu, S. S., “Vision-Based Robotic Motion Control for Non-autonomous Environment,” Journal of Intelligent and Robotic Systems:Theory and Application, Vol. 54, No. 5, pp. 733-754 (2009).
[10]TMS320C6000, Reference Guide, “TMS320C6416T Fixed-point Digital Signal Processors,” Literature Number:SPRS226J, 2003, Texas Instrument, Inc.
[11]TMS320C6416T DSK, Technical Reference, 2004, Spectrum Digital, Inc.
[12]TMS320C6000, User’s Guide, “TMS320C6000 Assembly Language Tools v 6.1,” Literature Number:SPRU186Q, 2008, Texas Instrument, Inc.
[13]OV7620, Datasheet, “Single-Chip CMOS VGA Color Digital Camera,” 2001, OmniVision Technologies, Inc.
[14]AL422B Data Sheets, Datasheet, 2004, Aver Logic, Inc.
[15]TMS320C6000, Reference Guide, “TMS320C6000 DSP External Memory Interface (EMIF),” Literature Number:SPRU266E, 2007, Texas Instrument, Inc.
[16]TMS320C6000, Reference Guide, “TMS320C6000 DSP Multichannel Buffered Serial Port (McBSP),” Literature Number:SPRU580G, 2006, Texas Instrument, Inc.
[17]I2C-bus specification and user manual, 2007, NXP Semiconductors.
[18]SC18IS600/601, Datasheet, “SPI to I2C-bus interface,” 2006, NXP Semiconductors.
[19]Martinez, C., “Serial Memory Interface: The benefits of SPI over I2C and uWire,” Application Note, Xicor.
[20]陳浥菁,「自走車DSP嵌入式影像系統之實現」,成功大學,工程科學系,民國九十五年。
[21]Gonzalez, R. C., Woods, R. E., Digital Image Processing, Prentice Hall, New Jersey, pp. 105-117 (2008).

[22]鐘國亮,影像處理與電腦視覺,台灣東華書局股份有限公司,台北,第386-387頁(2006)。
[23]Spong, M. W., Hutchinson, S., Vidyasagar, M., Robot Modeling And Control, John Wiley and Sons, NY, pp. 22-23 (2006).
[24]TMS320C6000, Application Report, “TMS320C620x/C642x McBSP: UART,” Literature Number:SPRA633C, 2008, Texas Instrument, Inc.
[25]Max232, Datasheet, “Dual EIA-232 Drivers/Receivers,” 2004, Texas Instrument, Inc.
[26]TMS320C6000, Application Report, “TMS320C6000 EMIF to External FIFO Interface,” Literature Number:SPRA543C, 1999, Texas Instrument, Inc.

QR CODE