簡易檢索 / 詳目顯示

研究生: 莊孟穎
Meng-Ying Chuang
論文名稱: 用於三維重建之自主微型飛行器的視覺追蹤控制
Visual Tracking Control of Autonomous Micro Aerial Vehicle for 3D Reconstruction
指導教授: 金台齡
Tai-Lin Chin
口試委員: 陳建中
Jiann-Jone Chen
蔡明忠
Ming-Jong Tsai
陳建宇
Chen-Chien Yu
學位類別: 碩士
Master
系所名稱: 電資學院 - 資訊工程系
Department of Computer Science and Information Engineering
論文出版年: 2017
畢業學年度: 105
語文別: 中文
論文頁數: 59
中文關鍵詞: 視覺追蹤控制無人機三維重建
外文關鍵詞: Visual tracking control, UAV, 3D reconstruction
相關次數: 點閱:446下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

以無人機進行航空拍攝已成為現今攝影技術的革新,許多拍攝場景皆應用到無人機進行動態攝影,但無人機在操控上需要經由反覆的練習,方能熟悉控制以確保無人機飛行能準確到達理想位置及飛行時的穩定性,因此本文旨在利用電腦視覺結合控制理論以重建三維環境模型為目的,藉由微型飛行器自主完成。
本論文以三個研究方向去實現,單眼相機定位、視覺追蹤控制和三維重建,在相機定位部分因考量其穩健性,希望能適用於各場景,因此已標誌定位,進行相機位置推算;視覺追蹤控制部分,藉由標誌取得之相機姿態位置,由四旋翼機的動力學推導並引入PID控制器進行軌跡追蹤;最後以三維重建技術評估飛行拍攝結果。
經由實驗分析飛行軌跡誤差、執行時間和重建結果分析,驗證本論文研究方法之可行性,可協助使用者實現一套自主拍攝並重建三維環境的系統。


It is an achieved technology innovation for aerial photography with unmanned aerial vehicle nowadays. Recording video with designed trajectory and letting it follow the path has been applied in many shooting applications. Hence, this thesis’s purpose is to build a 3D environment reconstruction by autonomous Micro Aerial Vehicle (MAV).
Three kinds of research purposes are described in this thesis in order to achieve goals, which are monocular camera localization, visual tracking control and 3D reconstruction. The camera localization is considered to apply in many environments robustly so that it adopted marker-base to estimate the camera pose. And these markers are defined by list of binary codifications for detecting and pose estimating. The visual tracking control navigates quadrotor by camera pose and control strategy. The control strategy is obtained from derive dynamic of quadrotor and PID controller for trajectory tracking. In the end, it evaluated aerial photograph outcome by 3D reconstruction.
The experimental result shows flight trajectory, execution time and analysis of reconstruction to verify this thesis’s proposal is feasible in real world. Therefore, the result also verifies that it can help user to shoot video and build 3D environment reconstruction.

中文摘要 I 英文摘要 II 目錄 III 圖目錄 V 表目錄 VI 1. 論文介紹 1 1.1. 研究動機 1 1.2. 研究目的 1 1.3. 論文貢獻 2 1.4. 論文組織 2 2. 文獻探討 3 2.1. 相機位置估測 3 2.2. 飛行控制演算法 4 3. 實驗方法 4 3.1. ArUco標誌 5 3.1.1. 動態門檻二值化 5 3.1.2. 輪廓提取 6 3.1.3. 近似多邊形 9 3.1.4. 標誌辨識碼 12 3.1.5. 相機位置估測 15 n點透視問題 15 剛體運動計算 18 3.1.6. 建立多標誌定位 22 3.2. 控制策略 22 3.2.1. 動力學模型 23 3.2.2. 軌跡追蹤以PID控制器 25 3.3. 三維環境重建 28 3.3.1. 運動回復結構 28 特徵點偵測和匹配 29 累增的運動回復結構 30 3.3.2. 多視角立體視覺和表面重建 31 4. 實驗結果 31 4.1. 實驗設置 31 4.1.1. 硬體平台 31 4.1.2. 軟體系統 32 4.2. 飛行軌跡評估 33 4.3. 三維重建結果 37 5. 結論 47 文獻參考 48

[1]S. Garrido-Jurado, R. Munoz-Salinas, F. J. Madrid-Cuevas, and M. J. Marin-Jimenez, "Automatic generation and detection of highly reliable fiducial markers under occlusion," Pattern Recognition, vol. 47, no. 6, pp. 2280-2292, 2014.
[2]S. Fuhrmann, F. Langguth, N. Moehrle, M. Waechter, and M. Goesele, "MVE - An image-based reconstruction environment," Computers and Graphics (Pergamon), vol. 53, pp. 44-53, 2015.
[3]C. Gebhardt, B. Hepp, T. Nageli, S. Stevi, and O. Hilliges, "Airways: Optimization-based planning of quadrotor trajectories according to high-level user goals," in 34th Annual Conference on Human Factors in Computing Systems, pp. 2508-2519, 2016.
[4]N. Joubert, M. Roberts, A. Truong, F. Berthouzoz, and P. Hanrahan, "An interactive tool for designing quadrotor camera shots," ACM Transactions on Graphics, vol. 34, no. 6, 2015.
[5]S. Espositoa, P. Fallavollitaa, W. Wahbehb, C. Nardinocchic, and M. Balsia, "Performance evaluation of UAV photogrammetric 3D reconstruction," in 2014 IEEE Geoscience and Remote Sensing Symposium, pp. 4788-4791, 2014.
[6]F. Fraundorfer, "Building and site reconstruction from small scale unmanned aerial vehicles (UAV's)," in 2015 Joint Urban Remote Sensing Event (JURSE), pp. 1-4, 2015.
[7]J. Lienard, A. Vogs, D. Gatziolis, and N. Strigul, "Embedded, real-time UAV control for improved, image-based 3D scene reconstruction," Measurement: Journal of the International Measurement Confederation, vol. 81, pp. 264-269, 2016.
[8]J. Liu, H. Wang, X. Liu, F. Li, G. Sun, and P. Song, "An automated 3D reconstruction method of UAV images," in Applied Optics and Photonics, China: Telescope and Space Optical Instrumentation, vol. 9678, p. Chinese Society for Optical Engineering, 2015.
[9]H. Kato and M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system," in Augmented Reality, 1999. (IWAR '99) Proceedings. 2nd IEEE and ACM International Workshop on, pp. 85-94, 1999.
[10]L. Calvet, P. Gurdjos, and V. Charvillat, "Camera tracking based on circular point factorization," in Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 2128-2131, 2012.
[11]G. Klein and D. Murray, "Parallel Tracking and Mapping for Small AR Workspaces," in 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225-234, 2007.
[12]M. Blosch, S. Weiss, D. Scaramuzza, and R. Siegwart, "Vision based MAV navigation in unknown and unstructured environments," in 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 21-28, 2010.
[13]L. Kneip, M. Chli, and R. Siegwart, "Robust real-time visual odometry with a single camera and an IMU," in 2011 22nd British Machine Vision Conference, 2011.
[14]C. Forster, M. Pizzoli, and D. Scaramuzza, "SVO: Fast semi-direct monocular visual odometry," in 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 15-22, 2014.
[15]S. Garrido-Jurado, R. Munoz-Salinas, F. J. Madrid-Cuevas, and R. Medina-Carnicer, "Generation of fiducial marker dictionaries using Mixed Integer Linear Programming," Pattern Recognition, vol. 51, pp. 481-491, 2016.
[16]M. A. Olivares-Mendez, C. Fu, S. Kannan, H. Voos, and P. Campoy, "Using the Cross-Entropy Method for Control Optimization: A Case Study of See-and-Avoid on Unmanned Aerial Vehicles," Mediterranean Conference on Control and Automation (MED), 2014.
[17]J. Pestana, J. L. Sanchez-Lopez, P. d. l. Puente, A. Carrio, and P. Campoy, "A Vision-based Quadrotor Swarm for the participation in the 2013 International Micro Air Vehicle Competition," in International Conference on Unmanned Aircraft Systems (ICUAS), pp. 617-622, 2014.
[18]D. Mellinger, N. Michael, and V. Kumar, "Trajectory generation and control for precise aggressive maneuvers with quadrotors," in Springer Tracts in Advanced Robotics, vol. 31, pp. 664-674, 2012.
[19]D. Mellinger and V. Kumar, "Minimum snap trajectory generation and control for quadrotors," in IEEE International Conference on Robotics and Automation (ICRA), pp. 2520-2525, 2011.
[20]M. Müller, S. Lupashin, and R. D. Andrea, "Quadrocopter ball juggling," in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5113-5120, 2011.
[21]D. A. Mercado, P. Castillo, and R. Lozano, "Quadrotor's trajectory tracking control using monocular vision navigation," in 2015 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 844-850, 2015.
[22]L. V. Santana, A. S. Brandão, M. Sarcinelli-Filho, and R. Carelli, "A trajectory tracking and 3D positioning controller for the AR.Drone quadrotor," in 2014 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 756-767, 2014.
[23]C. Teulière, L. Eck, and E. Marchand, "Chasing a moving target from a flying UAV," in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4929-4934, 2011.
[24]S. Suzuki and K. Abe, "Topological Structural Analysis of Digitized Binary Images by Border Following " Computer Vision, Graphics, and Image Processing, vol. 30, no. 1, pp. 32-46, 1985.
[25]N. Otsu, "A Threshold Selection Method from Gray-Level Histograms," IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, 1979.
[26]V. Lepetit, F. Moreno-Noguer, and P. Fua, "EPnP: An accurate O(n) solution to the PnP problem," International Journal of Computer Vision, vol. 81, no. 2, pp. 155-166, 2009.
[27]K. S. Arun, T. S. Huang, and S. D. Blostein, "Least-Squares Fitting of Two 3-D Point Sets," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-9, no. 5, pp. 698-700, 1987.
[28]P. Moulon, P. Monasse, and R. Marlet, "Adaptive structure from motion with a contrario model estimation," in 11th Asian Conference on Computer Vision, vol. 7727 LNCS, pp. 257-270, 2013.
[29]D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[30]M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz, "Multi-view stereo for community photo collections," in 2007 IEEE 11th International Conference on Computer Vision, 2007.
[31]S. Fuhrmann and M. Goesele, "Floating scale surface reconstruction," in 41st International Conference and Exhibition on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2014, vol. 33, 2014.
[32]Pixhawk. https://pixhawk.org/.
[33]PX4. http://px4.io/.
[34]APM. http://ardupilot.org/.

QR CODE