簡易檢索 / 詳目顯示

研究生: 羅濟玄
Ji-Xuan Luo
論文名稱: 具有深度影像之特定人員跟隨移動機器人
A Specific Person Tracking Mobile Robot with Depth Image
指導教授: 施慶隆
Ching-Long Shih
口試委員: 李文猶
Wen-Yo Lee
王乃堅
Nai-Jian Wang
吳修明
Hsiu-Ming Wu
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2023
畢業學年度: 111
語文別: 中文
論文頁數: 68
中文關鍵詞: 人體追蹤移動機器人障礙物偵測避障問題路徑規劃
外文關鍵詞: human tracking, mobile robot, obstacle detection, obstacle avoidance, path planning
相關次數: 點閱:193下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本文主要目的為設計出一套追蹤系統,使移動機器人能在多目標物同時移動之情況下,跟蹤特定目標物,並同時閃避障礙物。本文著重討論人體追蹤;先使用人體偵測系統,檢測出畫面中所有的人體訊息。接著,藉由檢測每一個人體的外觀資訓及位置資訊,來判別並鎖定想追蹤的目標物。本文的人體追蹤系統主要參考物件跟蹤的經典演算法deepsort。經過重新設計架構內容後,使跟蹤系統保有原先的跟蹤能力。同時,也改善原架構在追蹤目標物脫離畫面後,便再無法重新追蹤其的致命缺點。在偵測人體的部分,本文的設計雖然與原系統一樣,採用預先訓練好的模型,但在特徵提取的部分,則無須和原架構一樣,必須額外訓練一個提取特徵的模型。最後將RGB 影像結合深度影像,進一步得知目標物及障礙物的世界座標後,最後進行路徑規劃,達成跟蹤目標物及避開障礙物的任務。


    The main purpose of this paper is to design a tracking system, so that the mobile robot can track a specific target when multiple targets are moving. When tracking the specific target, the mobile robot also has to dodge the obstacles in front of it at the same time. The paper focuses on the object tracking. First, we use the human body detection system to detect the entire human body that appears on the screen. Then, by detecting the appearance information and motion information of each human body, the target to be tracked is identified and locked. The human body tracking system in this paper mainly refers to the classic algorithm deepsort for object detection. After redesigning the concept of deepsort, the tracking system cames up with not only retains its original tracking system ability but also improves its fatal flaw too, which is that it cannot track the specific target again after the target leaves its sight. In the problem of detecting the human body, although the same pre-trained model is used as the original tracking system does. When running the feature extraction stage, it does not need to train an additional feature extraction model like the original system has to. After the RGB image is combined with the depth image, tracking the world coordinates of the specific target and obstacles are obtained. Finally, the tracking path is planned for the mobile robot to follow the specific target and avoid the obstacles in front of it.

    摘要 I Abstract II 目錄 III 圖目錄 V 表目錄 VIII 第1章 緒論 1 1.1 研究動機與目的 1 1.2 文獻回顧 1 1.3 論文大綱 2 第2章 系統架構與控制流程 4 2.1 系統架構 4 2.2移動機器人硬體介紹 4 2.3移動機器人控制流程 10 第3章 人體追蹤 12 3.1 外觀資訊 13 3.2 位置資訊 14 3.3 演算法匹配 15 3.4 追蹤目標物的流程 17 3.4.1 前置作業 18 3.4.2 執行追蹤 22 3.4.3 重新尋找 25 第4章 移動機器人運動控制及障礙物檢測 27 4.1 障礙物之檢測 27 4.1.1 偵測障礙物 27 4.1.2 障礙的定位 32 4.2 移動機器人運動控制 34 4.3 跟蹤目標物及避障之策略 38 4.3.1 避障之路徑規劃 39 4.3.2 跟蹤目標物之路徑 40 第5章 實驗結果與討論 41 5.1 目標物特徵提取 42 5.2 障礙物的檢測結果 44 5.3 不同情況目標物追蹤結果 48 5.4移動機器人追蹤結果 52 第6章 結論與建議 57 6.1 結論 57 6.2 建議 58 參考資料 59

    1. Nicolai Wojke, Alex Bewley, Dietrich Paulus, Simple Online and Realtime Tracking with a Deep Association Metric, 2017.
    2. Esmael Hamuda, Improved Image Processing-based Crop Detection Using Kalman Filtering and the Hungarian Algorithm, 2018.
    3. T. Hellstrom, Kinematics Equations for Differential Drive and Articulated Steering, Department of Computing Science, Umea University, 2011.
    4. Redhwan Algabri and Mun-Taek Choi, Deep-Learning-Based Indoor Human Following of Mobile Robot Using Color Feature, 2020.
    5. Songmin Jia, Liang Zhao, Xiuzhi Li, Wei Cui, Jinbo Sheng, Autonomous Robot Human Detecting and Tracking Based on Stereo Vision, 2011.
    6. Ma'te' Petho˝, A'da'm Nagy, Tama's Zsedrovits, A Bio-motivated Vision System and Artificial Neural Metwork for Autonomous UAV Obstacle Avoidance, 2020.
    7. Piyush Juyal and Sachin Sharma, Locating People in Real-World for Assisting Crowd Behaviour Analysis Using SSD and Deep SORT Algorithm, 2021.
    8. 施慶隆, 李文猶, 機電整合控制:多軸運動設計與應用, 全華圖書, 2015.

    QR CODE