簡易檢索 / 詳目顯示

研究生: 李少鈞
Shao-Chun Lee
論文名稱: 以六軸機械手臂執行之相機自動校正與物件影像定位系統
Automatic camera calibration and image-based object positioning systems based on 6-axis robot arm
指導教授: 林其禹
Chyi-Yen Lin
口試委員: 范欽雄
Chin-Shyurng Fahn
邱士軒
Shih-Hsuan Chiu
學位類別: 碩士
Master
系所名稱: 工程學院 - 機械工程系
Department of Mechanical Engineering
論文出版年: 2018
畢業學年度: 106
語文別: 中文
論文頁數: 88
中文關鍵詞: 相機內部參數校正鏡頭形變校正手眼校正影像PNP問題物件定位工作點修正
外文關鍵詞: camera calibration, intrinsic parameter calibration, lens distortion calibration, hand-eye calibration, object positioning, working point adjustment
相關次數: 點閱:380下載:6
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究針對視覺系統在自動化加工中的應用情境提出兩個系統以解決現有的問題。首先針對傳統使用人工進行操作的相機校正流程,提出一個使用機械手臂自動進行校正的解決方案,透過將待校正相機裝設在手臂上以手臂帶動改變相機位置的方式,系統會自動依照校正板所在位置進行路徑規劃,有效率、有系統的引導相機到不同的拍攝點透過不同角度拍攝校正用影像,並且在拍攝校正用影像的同時記錄手臂姿態以進行手眼校正。透過實驗證實本系統能有效的省去人工針對校正用影像取像位置進行篩選的流程,且系統以大量且有效的校正用影像進行相機內部參數與鏡頭形變參數校正並獲得優於人工校正的結果,其內部參數校正誤差為0.112像素。更同時在單一執行過程中自動的完成手眼校正,達到短時間、全自動與三合一的校正成果。其二針對自動化加工中所牽涉到有關物件定位的問題,本研究基於影像系統提出一個新的解決方案。透過在目標物件上貼附人工標記的方式,系統將針對該人工標記拍攝影像,根據物件移動前後的標記位置影像進行數據分析,在不移動物件的前提下即可對目標進行重新定位與修正工作點,使加工過程可以繼續進行。在實驗結果中顯示,系統對於物件的位移量有相當高程度的修正,最高可修正95.3%的位移量,並有相當優秀的定位速度可在500ms內完成定位與工作點修正。本研究提出的兩個系統皆各自以嶄新的概念針對自動化加工流程中常見的問題提出解決方案,並由實驗結果證實能有效的解決及改善問題,且在未來仍有相當大的應用空間與發展潛力,並具有能夠導入實際產業的高度可能性。


    This research provides two solutions to solve two exist problems in the automated production process. Firstly, we provide a solution to improve the efficiency and accuracy of a manual camera calibration process by using a robot-arm operated automatic calibration procedure. With the robot arm holding the camera in a predefined positions and orientation to take the pictures on the calibration board and calibrate the camera intrinsic parameters, the lens distortion parameters and hand-eye transform matrix at the same time in a fully autonomous manner. Secondly, in order to tackle the difficulty resulted from poor object positioning situations in the automated production process, we develop a new solution by attaching some artificial landmarks on the target object and using the camera system to perform the calibration based on the image containing the landmarks. In the case that the object has some position errors, the system can compute the compensation displacement needed by the robot arm by comparison of the two images of the artificial landmarks. The results in the experiments show both systems have successfully shown high performance, high accuracy and high implementation potential.

    摘要 I Abstract II 誌謝 III 目錄 IV 圖目錄 VI 表目錄 VIII 第一章 緒論 1 1-1 前言 1 1-2 研究動機與研究目的 2 1-2-1 研究動機 2 1-2-2 研究目的 4 1-3 文獻回顧 5 1-3-1 AX=ZB閉合轉換矩陣 6 1-3-2 AX=XB閉合轉換矩陣 6 1-4 本文架構 7 第二章 研究理論基礎 8 2-1 相機校正 8 2-1-1 相機成像原理 - Pinhole camera model 8 2-1-2 內部參數 - Intrinsic parameter 10 2-1-3 形變參數 - Distortion coefficients 12 2-1-4 外部參數 - Extrinsic parameter 15 2-1-5 相機校正 - Camera calibration 17 2-2 影像PNP(Perspective-N-Point)問題解 23 2-3 影像處理 - 角點偵測 25 2-4 AX=ZB閉合形式手眼校正 26 2-5 手臂為基礎之全自動校正系統 29 2-5-1 機械手臂運動學 30 2-5-2 末端效應器(工具端)移動控制 32 2-5-3 手臂掃描路徑規劃策略 35 2-5-4 系統流程圖與系統架構 40 2-6 影像物件定位系統 41 第三章 實驗器材與設置 46 3-1 棋盤格校正板 46 3-2 影像物件定位之人工標記 47 3-3 工業相機 48 3-4 六軸機械手臂 49 3-5 手臂末端效應器與相機連結器 51 第四章 實驗結果 53 4-1 全自動校正系統自動掃描路徑規劃結果 53 4-2 相機校正實驗結果 58 4-3 影像PNP解誤差分析 64 4-4 物件定位實驗結果 67 第五章 結論與未來展望 74 5-1 結論 74 5-2 未來展望 75

    1. Forsyth, D.A. and J. Ponce, A modern approach. Computer vision: a modern approach, 2003: p. 88-101.
    2. Heikkila, J. and O. Silven. A four-step camera calibration procedure with implicit image correction. in Computer Vision and Pattern Recognition, 1997. Proceedings., 1997 IEEE Computer Society Conference on. 1997. IEEE.
    3. Zhang, Z., A flexible new technique for camera calibration. IEEE Transactions on pattern analysis and machine intelligence, 2000. 22.
    4. Tsai, R.Y. and R.K. Lenz. Real time versatile robotics hand/eye calibration using 3D machine vision. in Robotics and Automation, 1988. Proceedings., 1988 IEEE International Conference on. 1988. IEEE.
    5. Dornaika, F. and R. Horaud, Simultaneous robot-world and hand-eye calibration. IEEE transactions on Robotics and Automation, 1998. 14(4): p. 617-622.
    6. Bayro-Corrochano, E., K. Daniilidis, and G. Sommer, Motor algebra for 3D kinematics: The case of the hand-eye calibration. Journal of Mathematical Imaging and Vision, 2000. 13(2): p. 79-100.
    7. Strobl, K.H. and G. Hirzinger. Optimal hand-eye calibration. in Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on. 2006. IEEE.
    8. Daniilidis, K., Hand-eye calibration using dual quaternions. The International Journal of Robotics Research, 1999. 18(3): p. 286-298.
    9. 江宗錡, 六軸關節型機械手臂之手眼校正研究. 成功大學電機工程學系學位論文, 2014: p. 1-66.
    10. Hartley, R. and A. Zisserman, Multiple view geometry in computer vision. 2003: Cambridge university press.
    11. Duane, C.B., Close-range camera calibration. Photogramm. Eng, 1971. 37(8): p. 855-866.
    12. The MathWorks, I. What Is Camera Calibration? 2018; Available from: http://www.mathworks.com/help/vision/ug/camera-calibration.html?w.mathworks.com.
    13. Fryer, J.G. and D.C. Brown, Lens distortion for close-range photogrammetry. Photogrammetric engineering and remote sensing, 1986. 52(1): p. 51-58.
    14. Spong, M.W., S. Hutchinson, and M. Vidyasagar, Robot modeling and control. Vol. 3. 2006: Wiley New York.
    15. Quan, L. and Z. Lan, Linear n-point camera pose determination. IEEE Transactions on pattern analysis and machine intelligence, 1999. 21(8): p. 774-780.
    16. Horaud, R., et al. An analytic solution for the perspective 4-point problem. in Computer Vision and Pattern Recognition, 1989. Proceedings CVPR'89., IEEE Computer Society Conference on. 1989. IEEE.
    17. Harris, C. and M. Stephens. A combined corner and edge detector. in Alvey vision conference. 1988. Citeseer.
    18. De la Escalera, A. and J.M. Armingol, Automatic chessboard detection for intrinsic and extrinsic camera parameter calibration. Sensors, 2010. 10(3): p. 2027-2044.

    QR CODE