簡易檢索 / 詳目顯示

研究生: 徐鴻哲
Hung-Che Hsu
論文名稱: 結合SLAM室內導航之家用物件搜尋和即時登錄系統開發
Development of Search and Real-time Registration System on Household Objects for SLAM Based Indoor Navigation Localization Update
指導教授: 林其禹
Chyi-Yeu Lin
口試委員: 林柏廷
Po-Ting Lin
范欽雄
Chin-Shyurng Fahn
學位類別: 碩士
Master
系所名稱: 工程學院 - 機械工程系
Department of Mechanical Engineering
論文出版年: 2019
畢業學年度: 107
語文別: 中文
論文頁數: 58
中文關鍵詞: 室內自主機器人物件註冊系統座標資料庫影像深度學習特徵提取之物件辨識系統密度聚類算法
外文關鍵詞: service robots, personal object registration system, object searching system, coordinates database
相關次數: 點閱:300下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

本論文研究目的在於建立一套可讓室內自走機器人可有效進行物件搜尋的系統,包含室內自走機器人對物件的初始登錄、移動間看到物件時的更新登錄,並整合成一系列可操作流程架構。
機器人在建立室內地圖後,提供使用者註冊預搜尋物件之影像,同時利用機械視覺標註物品座標並建立座標資料庫,利用此資料庫結合導航系統達成完成智慧機器人了解地圖物件資訊與搜索之目標功能。本研究設計一物件註冊系統,使用RGB-D攝影機擷取預註冊物件之去背影像,並建立該物件資料庫。物件搜尋系統則以SIFT演算法取得偵測特徵點和影像深度學習,提取當前機器人視野影像之物件定界框,利用該定界框投射在點陣雲圖中計算該物件世界座標位置。為減少環境光線變化不穩定因素,本研究利用DBSCAN密度聚類算法規畫一套可適應此定位不穩定之座標歸納系統,可有效並修正估測座標位置誤差。本研究提出之可操作影像註冊系統與物件搜索系統皆可與一般機器人SLAM結合,並有效及時更新物件座標位置。


This research aims to build an effective system for indoor service robots to search for objects. The system is formed by an integrated easy-to-operation structure, which includes an object initial-registration module and real-time in-motion registration module when an object appears to inside the view of the robot.
After the robot builds the indoor map, the users provide the images of the objects to be searched for registration, the vision system will register the positions of the objects in the map, and the data set embedded to the map can be used by the robot for object searching. The object registration system uses RGBD camera to capture the image of the object and removes the background before the SIFT features of this object are created for recognition and the recognition bounding box is used for definition of the object position. In order to reduce the ill-effect of varied illumination conditions to the object recognition, this research implements DBSCAN technique to stabilize and reduce the error of the object positions. This innovative object registration and search system can be integrated to SLAM navigation systems, and provide the effective object search capabilities.

目錄 摘要 IV Abstract V 目錄 VI 表目錄 VIII 第1章 緒論 1 1.1 前言 1 1.2 研究背景與動機 1 1.3 研究目的 2 1.4 文獻回顧 3 1.4.1 RGBD-SLAM 3 1.4.2 數學形態學(mathematical morphology) 4 1.4.3 機器人作業系統(Robot Operating System,ROS) 5 1.5 論文架構 6 第2章 實驗硬體設備與研究測試環境 7 2.1 自走機器人系統架構簡介 7 2.2 自走機器人硬體架構 9 2.2.1 車體部分 9 2.3 驅動系統簡介 10 2.3.1 驅動控制核心 10 2.3.2 驅動馬達 12 2.4 感測器硬體介紹 13 2.4.1 距離感測器 13 2.4.2 RGBD影像感測器 15 第3章 系統設計與實現 16 3.1 系統控制流程 16 3.2 RTAB-MAP SLAM定位 17 3.3 個人化物件登入系統 20 3.3.1 影像二質化 20 3.3.2 侵蝕與膨脹 21 3.4 影像辨識系統 24 3.4.1 個人化物件辨識 24 3.4.2 YOLOv3深度學習物件辨識 27 3.5 機器人與目標之旋轉矩陣 29 3.5.1 空間旋轉矩陣 30 3.6 基於密度的聚類算法(DBSCAN) 32 3.7 資料庫更新系統 33 第4章 實驗結果與討論 34 4.1 實驗環境介紹 34 4.2 個人化物件註冊系統 35 4.3 物件搜索導航系統 42 4.4 實驗結果討論 47 第5章 結論與未來展望 48 5.1 結論 48 5.2 未來展望 48 參考文獻 49

參考文獻
1. SONY公司, https://direct.sony.com/aibo/ .last accessed July 2019
2. Designboom, https://www.designboom.com/technology/vava-mobile-pet-cam-robot-01-11-2019/ .last accessed July 2019
3. 小米公司, https://www.mi.com/tw/mi-robot-vacuum/ .last accessed July 2019
4. Hugh Durrant-Whyte, et al. "Simultaneous Localisation and Mapping (SLAM):
Part I The Essential Algorithms." 2006 IEEE Robotics & Automation Magazine
5. D. Nister, O. Naroditsky, J.Bergen. "Visual odometry." Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
6. David G. Lowe. "Distinctive Image Features from Scale-Invariant Keypoints" Accepted for publication in the International Journal of Computer Vision, 2004.
7. HerbertBay, AndreasEssa, TinneTuytelaarsb, LucVan Gool. "Speeded-Up Robust Features (SURF)" Computer Vision and Image Understanding Volume 110, Issue 3, June 2008, Pages 346-359
8. Ethan Rublee, Vincent Rabaud, Kurt Konolige, Gary Bradski. "ORB: an efficient alternative to SIFT or SURF " 2011 International Conference on Computer Vision.
9. Martin A. Fischler, Robert C. Bolles "Random Sample Consensus: A Paradigm for Model Fitting with Apphcatlons to Image Analysis and Automated Cartography"
10. Mahalanobis distanc, https://en.wikipedia.org/wiki/Mahalanobis_distance
11. Mathematical morphology, https://en.wikipedia.org/wiki/Mathematical_morphology
12. Robot Operating System (ROS), http://www.iceira.ntu.edu.tw/project-plans/195-robot-operating-system-ros
13. Kinect v2基礎介紹, https://en.wikipedia.org/wiki/Kinect
14. Yingzhong Tian, Xining Liu, Long Li and Wenbin Wang, et al. "Intensity-Assisted ICP for Fast Registration of 2D-LIDAR" Sensors 2019, 19, 2124; doi:10.3390/s19092124
15. Larry Li. "Time-of-Flight Camera – An Introduction SLOA190B" January 2014 Revised May 2014
16. M. Labbé and F. Michaud, "RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operation," in Journal of Field Robotics, vol. 36, no. 2, pp. 416–446, 2019.
17. Lo¨ıc Schwaller, St´ephane Robin and Michael Stumpf. "A closed-form approach to Bayesian inference in tree-structured graphical models." arXiv:1504.02723v4 [stat.ML] May 2017
18. J. Redmon and A. Farhadi. "Yolov3: An incremental improvement." arXiv preprint arXiv:1804.02767, 2018.
19. Gaussian_pyramid, https://en.wikipedia.org/wiki/Pyramid_(image_processing)#Gaussian_pyramid
20. Difference of Gaussians , https://en.wikipedia.org/wiki/Difference_of_Gaussians
21. Saad Albawi, Tareq Abed Mohammed, Saad Al-Zawi."Understanding of a convolutional neural network." 2017 International Conference on Engineering and Technology (ICET)
22. Shuran Song, Samuel P. Lichtenberg, Jianxiong Xiao."SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite" Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2015)
23. DBSCAN (Density-Based Spatial Clustering of Applications with Noise. https://de.wikipedia.org/wiki/DBSCAN

無法下載圖示 全文公開日期 2024/08/25 (校內網路)
全文公開日期 2024/08/25 (校外網路)
全文公開日期 2024/08/25 (國家圖書館:臺灣博碩士論文系統)
QR CODE