簡易檢索 / 詳目顯示

研究生: 何祈新
Chi-Hsin Ho
論文名稱: 基於整合多組高精度線雷射掃描和電腦視覺技術之複雜形狀物件特徵擷取
Feature Extraction of Complex-Shaped Objects Based on Integrated Operation of Multi High-Resolution Line Laser Scanning and Image Processing
指導教授: 林其禹
Chyi-Yeu Lin
口試委員: 劉益宏
Yi-Hung Liu
李維楨
Wei-Chen Lee
學位類別: 碩士
Master
系所名稱: 工程學院 - 機械工程系
Department of Mechanical Engineering
論文出版年: 2021
畢業學年度: 109
語文別: 中文
論文頁數: 81
中文關鍵詞: 雷射掃描點雲檔拼接相機校正五角金字塔OpenCV
外文關鍵詞: Laser Scanning, Point Cloud, Calibration Pyramid, OpenCV, Image Recognition
相關次數: 點閱:213下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 雷射掃描技術已非常普遍,不論利用點雷射來測量距離,或於工業中使用線雷射掃描作為加工成品之精密量測、甚至使用面雷射掃描針對各種物件之逆向工程掃描用以獲得3D空間中的點陣雲檔都已相當成熟。
    但若要從掃描之點雲檔進而自動化獲取加工路徑,目前現有的方法都是從3D的點雲資訊,透過演算法,找出特定的特徵點再進行軌跡規劃。而從3D點雲資訊做運算找特徵的缺點是需要花費大量時間進行3D的資訊點運算,且由於物件若是過於複雜將難以找到正確的軌跡。因此本文中將提到如何透過自建多組線雷射掃描系統,並利用新方法拼接多組掃描,且能夠在掃描物件時,從2D影像中,利用影像辨識演算法,找出待加工之特徵點,並轉換成3D的點雲檔。
    各組雷射掃描系統由一部相機及一支雷射光源組成,透過事先計算出光平面方程式,再從雷射光投影至物體上所形成的曲線Pixel點(c, r),將這些Pixel點放進所算出的光平面方程式,算出3D的點雲檔資訊。
    拼接多組掃描系統將會運用到「雙面棋盤格」進行相機校正並獲得外部參數,以及「五角金字塔」作為掃描之物件,並透過SVD算出各組掃描系統間的轉換矩陣完成拼接,最後影像演算法之建立運用多項OpenCV功能,作為輔助,可針對不同物件外形之需求,寫出適合的一套2D影像演算法,將特徵軌跡在掃描結束同時即同步完成特徵軌跡生成。


    Laser scanning technologies have become very common in the last decade. Modern laser scanning operations which include using point laser scanners to measure distances and using line laser scanners for scanning in the industry as precision measurement of products are quite mature.
    To automatically obtain the processing path from the point cloud file, most current existing methods are based on using algorithm to calculate the specific feature points for the trajectory planning based on 3D point cloud information. The corresponding disadvantage of finding features by such operations is the large amount of time required to perform calculations on 3D information points. It will be also relatively difficult to find the correct trajectory if the shape of the object is complex. Therefore, this research will aim to build a multi-set line laser scanning system. While scanning objects, the image recognition algorithms based on 2D images is used to find desired feature points and subsequently convert them into 3D point cloud files of exclusive feature points.
    Each set of the laser scanning system is composed of a camera and a laser light source. By calculating the light plane equation in advance, the curve pixel points (c, r) is formed by laser light projected onto the object. These pixel points are put in the calculated light plane equation to calculate the 3D point cloud file information.
    This new proposed method for merging multiple point clouds uses the "double-sided chessboard" to calibrate the camera and obtain external parameters, use "pentagonal pyramid" as the scanned object, and then use SVD to calculate the transfer matrix between each point clouds to complete the merging. The establishment of the algorithm will use many OpenCV functions to write required 2D image algorithms for detecting different object shapes, and complete the feature trajectory generation while the object is being scanned.

    摘要 I Abstract I 致謝 II 目錄 I 圖目錄 IV 表目錄 I 第1章 緒論 1 1-1 前言 1 1-2 研究動機與研究目的 2 1-3 文獻回顧 3 第2章 研究理論 8 2-1 相機系統 8 2-1-1 相機成像原理(Pinhole Camera Model) 8 2-1-2 內部參數(Intrinsic Parameter) 9 2-1-3 形變參數(Distortion Coefficients) 10 2-1-4 外部參數(Extrinsic Parameter) 13 2-1-5 相機校正(Camera Calibration) 15 2-1-6 相機系統選用 17 2-1-7 使用Zhang's Camera Calibration Algorithm計算相機校正 19 2-2 線雷射掃描系統之建立 20 2-2-1 線雷射掃描理論 20 2-2-2 線雷射掃描-光平面之計算 23 2-3 電腦視覺技術 29 2-3-1 棋盤格角點偵測(findChessboardCorners) 29 2-3-2 亞畫素級的角點迭代偵測(cornerSubPixel) 30 2-3-3 HSV顏色空間(Color Space) 31 2-4 雷射影像擷取 33 2-4-1 雷射光源選用 33 2-4-2 色彩空間雷射光源擷取 35 2-4-3 雷射光線細化(Thinning Operation) 36 2-4-4 平滑模糊化(Image Blurring) 39 第3章 多組掃描系統與電腦視覺影像特徵擷取 42 3-1 雷射系統架設(System Implementation) 42 3-1-1 高解析度工業相機及極細線寬雷射光掃描 42 3-1-2 低成本網路相機及粗線寬雷射光掃描 43 3-2 點陣雲檔拼接(Point cloud Combination) 44 3-2-1 外部參數矩陣拼接理論 44 3-2-2 外部參數矩陣拼接-雙面棋盤格法 46 3-2-3 利用五角金字塔點雲進行SVD計算點雲檔拼接誤差 48 3-2-4 利用SVD求出兩點雲間之轉換矩陣修正點雲檔拼接誤差 51 3-3 電腦視覺影像特徵擷取 54 3-3-1 二維影像特徵點定義 54 3-3-2 二維影像前處理 56 3-3-3 二維影像演算法建立 56 第4章 實驗結果 60 4-1 雷射掃描結果 60 4-1-1 單組雷射系統掃描結果 60 4-2 多組點雲拼接結果 61 4-2-1 四組高解析度工業相機及極細線寬雷射光系統拼接結果 61 4-2-2 兩組網路相機及粗線寬雷射光系統拼接結果 62 4-3 二維影像演算法擷取結果 64 4-3-1 馬丁鞋加工軌跡 64 第5章 結論與未來展望 65 5-1 結論 65 5-2 未來展望 66 參考文獻 67

    1. Zhang, H., Ren, Y., Liu, C., & Zhu, J. (2014). Flying spot laser triangulation scanner using lateral synchronization for surface profile precision measurement. Applied optics, 53(20), 4405–4412.
    2. https://www.makepartsfast.com/scanner-helps-reverse-engineer-impellor-at-hydroelectric-plant/
    3. https://3dwalla.com/3d-scanning.php
    4. Ebrahim, M. (2015). Laser Scanners ’ Techniques Overview
    5. Tornslev, K. (2005). 3D scanning using multibeam laser.
    6. Lee, Ju Hwan & Park, Soon-Yong. (2019). Calibration of Two 3D Sensors with Perpendicular Scanning Directions by using a Piece of Paper. 162-168. 10.5220/0007383301620168.
    7. Oomori, S., Nishida, T. & Kurogi, S. Point cloud matching using singular value decomposition. Artif Life Robotics 21, 149–154 (2016)
    8. T. Wang, J. Zhang, J. Dong, S. Pan and L. Zheng, "A Method for Generating Spray Trajectory of a Shoe Sole Based on Laser Vision," 2019 IEEE 4th International Conference on Image, Vision and Computing (ICIVC), 2019, pp. 36-39, doi: 10.1109/ICIVC47709.2019.8981040.
    9. The MathWorks, I. What Is Camera Calibration? 2018; Available from: http://www.mathworks.com/help/vision/ug/camera-calibration.html?w.mathworks.com.
    10. https://www.phyworld.idv.tw/Nature/Jun_2/htm/B3_4-4_POINT.html
    11. Duane, C.B., Close-range camera calibration. Photogramm. Eng, 1971. 37(8): p. 855-866.
    12. Fryer, J.G. and D.C. Brown, Lens distortion for close-range photogrammetry. Photogrammetric engineering and remote sensing, 1986. 52(1): p. 51-58.
    13. Spong, M.W., S. Hutchinson, and M. Vidyasagar, Robot modeling and control. Vol. 3. 2006: Wiley New York.
    14. Hartley, R. and A. Zisserman, Multiple view geometry in computer vision. 2003: Cambridge university press.
    15. https://docs.opencv.org/3.4/d9/d0c/group__calib3d.html
    16. Greco, Marinella & Materazzi, Marzia & Pampaloni, Enrico & Pezzati, Luca & Rocchini, Claudio & Scopigno, Roberto. (2002). Three-dimensional modelling of statues: The Minerva of Arezzo. Journal of Cultural Heritage - J CULT HERIT. 3. 325-331. 10.1016/S1296-2074(02)01242-6.
    17. Burger, Wilhelm. (2016). Zhang's Camera Calibration Algorithm: In-Depth Tutorial and Implementation.
    18. Le Thai Son , M ,(2016) "Non-contacting 3D Measurement System Integrating Webcam Camera and Laser Projector for Fast Industrial Robot Assembly Implementations"
    19. https://docs.opencv.org/3.4/dd/d1a/group__imgproc__feature.html
    20. https://docs.opencv.org/3.4/da/d97/tutorial_threshold_inRange.html
    21. Zhang, T., & Suen, C. (1984). A fast parallel algorithm for thinning digital patterns. Commun. ACM, 27, 236-239.
    22. https://homepages.inf.ed.ac.uk/rbf/HIPR2/thin.htm
    23. https://homepages.inf.ed.ac.uk/rbf/HIPR2/gsmooth.htm
    24. https://docs.opencv.org/4.5.2/d4/d13/tutorial_py_filtering.html
    25. Li, Y., Zhou, J., Huang, F., & Liu, L. (2017). Sub-Pixel Extraction of Laser Stripe Center Using an Improved Gray-Gravity Method †. Sensors, 17(4), 814. MDPI AG. Retrieved from http://dx.doi.org/10.3390/s17040814
    26. Usamentiaga, R., & García, D. (2019). Multi-camera calibration for accurate geometric measurements in industrial environments. Measurement, 134, 345-358.
    27. Wu, X., Li, Z., & Wen, P. (2017). An automatic shoe-groove feature extraction method based on robot and structural laser scanning. International Journal of Advanced Robotic Systems. https://doi.org/10.1177/1729881416678135

    無法下載圖示 全文公開日期 2026/08/17 (校內網路)
    全文公開日期 2026/08/17 (校外網路)
    全文公開日期 2026/08/17 (國家圖書館:臺灣博碩士論文系統)
    QR CODE