簡易檢索 / 詳目顯示

研究生: 袁有容
Yu-jung Yuan
論文名稱: 一個強健的即時前方彎曲道路的車道線追蹤及曲率估測系統
A Robust Lane Tracking and Curvature Estimation System in Real Time for Forward Curved Roads
指導教授: 范欽雄
Chin-Shyurng Fahn
口試委員: 李建德
none
王聖智
none
馮輝文
none
學位類別: 碩士
Master
系所名稱: 電資學院 - 資訊工程系
Department of Computer Science and Information Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 英文
論文頁數: 66
中文關鍵詞: 駕駛輔助系統車道線偵測機器視覺即時車道追蹤曲率估測拋物線擬合
外文關鍵詞: Driving assistant system, lane detection, machine vision, real-time lane tracking, curvature estimation, parabola fitting
相關次數: 點閱:255下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

在智慧型運輸系統(ITS)蓬勃的發展下,智慧型車輛技術也是發展的趨勢,而不只是強調安全性的駕駛輔助系統,也越來越多學術界跟產業界注重因乘坐車子產生不適感而研發的技術,我們可以藉由得知前方道路的曲率,而對汽車座椅做適當的角度調整以抵銷離心力。智慧型車輛技術為多方面發展的,而其中車道線偵測是基本且重要的技術。
在本篇論文中,我們提出一個基於機器視覺的即時車道偵測及追蹤系統,並且從我們的道路模型估計前方的車道曲率。利用逆透視轉換(Inverse Perspective Mapping)將影像轉換為真實世界座標,並利用Mean shift跟Hough transform偵測道路線,再用卡爾曼濾波器進行車道線追蹤,經過拋物線擬合之後,我們就可以得到前方道路的曲率估計值。
我們針對連續彎道並在不同的環境下進行實驗,我們提出的方法可以有效的偵測到彎曲道路,在多彎道的郊區環境下能達到99.4%的偵測率,而在有切換車道狀況的高速公路的環境下也能達到94.5%的偵測率;計算前方道路曲率跟實際的曲率誤差值小於0.01,整體運算速度可達每秒23~30幀畫面。


In the vigorous development of Intelligent Transportation Systems (ITS), intelligent vehicle technology is the focus of development. Not just the emphasis on safety driving assistant system, more and more academia and industry attention to the developed technology of the resolution of the discomfort by taking a car. We can through obtaining the curvature of the forward lane, while the angle of the car seat to make the appropriate adjustments to offset the centrifugal force. Intelligent vehicle technology for a wide range of development, especially for lane detection is a fundamental and important technology.
In this paper, we propose a based on machine vision lane detection and tracking system in real-time. And estimate the curvature of the forward lane from our lane model. The use of Inverse Perspective Mapping (IPM) convert images to the world coordinate system, and using mean shift with the Hough transform to detect lane markings, then the lane tracking with Kalman filter. After the parabola fitting, we can get the curvature of forward lane.
We carry on the experiments for the continuous curve in different environments; our proposed method can effectively detect the curved lane. The detection rate is 99.4% in multi-curves suburban environment, and the detection rate of 94.5% in the state of switch lanes in the freeway environment. The error value is less than 0.01 between our estimated curvature of the forward lane and the actual curvature. The overall performance is 23 to 30 frames per second.

摘要 i Abstract ii 致謝 iii List of Figures vi List of Tables ix Chapter 1 Introduction 1 1.1 Overview 1 1.2 Motivation 1 1.3 System Description 2 1.4 Thesis Organization 3 Chapter 2 Background and Related Work 4 2.1 Reviews of Lane Detection 4 2.1.1 Feature-based Lane Detection 5 2.1.2 Model-based Lane Detection 7 2.2 Reviews of Lane Tracking 9 Chapter 3 Lane Region Analysis 12 3.1 Horizon Localization 12 3.1.1 Averaging Every Row of Gray Values 12 3.1.2 The Regional Minimum Point Search 13 3.2 Lane Region Analysis 15 3.3 Inverse Perspective Mapping 16 3.3.1 Introduction of IPM 16 3.3.2 Inverse Perspective Mapping Method 18 Chapter 4 Lane Detection 21 4.1 Introduction of Mean Shift and Hough Transform 21 4.1.1 Mean Shift Method 21 4.1.2 Hough Transform Method 24 4.2 Set ROIs 26 4.3 Proposed Lane Detection Method 29 Chapter 5 Lane Tracking and Curvature Estimation 37 5.1 Kalman Filter 37 5.2 Curvature Estimation 40 5.2.1 Parabola Fitting 41 5.2.2 Lane Curvature Estimation 42 Chapter 6 Experimental Results and Discussion 46 6.1 Experiment Setup 46 6.2 Results of Lane Detection and Tracking 48 6.3 Results of Lane Curvature Estimation 55 Chapter 7 Conclusions and Future Works 59 7.1 Conclusions 59 7.2 Future Works 61 References 62

[1] S. Ezell, “Explaining International IT Application Leadership: Intelligent
Transportation Systems,” in Proceedings of the Information Technology &
Innovation Foundation, Washington, DC, January 2010.
[2] S. C. Kuo, Feasibility Study of the Anti-motionsick Car Seat System, Master
Thesis, Department of Mechanical Engineering, National Taiwan University of
Science and Technology, Taipei, Taiwan, August 2011, available at:
http://pc01.lib.ntust.edu.tw/ETD-db/ETD-search-c/view_etd?URN=etd-0803111
-140714.
[3] S. Chen, C. Hsu and K. Yu, "An Inertial Sensing Based System for Lane
Curvature Estimation," Society of Automotive Engineers Technical Paper, No.
2013-01-0689, April 2013.
[4] J. Huang, et al., "A new method of unstructured road detection based on HSV
color space and road features," in Proceedings of the International Conference on Information Acquisition, ICIA'07, pp. 596-601, Seogwipo-si, 2007.
[5] H. Y. Cheng, C. C. Yu, C. C. Tseng, K. C. Fan, J. N. Hwang and B. S. Jeng,
“Environment classification and hierarchical lane detection for structured and
unstructured roads,” Institution of Engineering and Technology Transactions on
Computer Vision, vol. 4, no.1, pp. 37-49, March 2010.
[6] T. E. Rodolfo and T. T. Miguel, “A comparison of gradient versus color and
texture analysis for lane detection and tracking,” in Proceedings of the Latin
American Robotics Symposium (LARS), pp. 1-6, Valparaiso, Oct. 2009.
[7] Y. He, H. Wang, and B. Zhang, “Color-based road detection in urban traffic
scenes,” IEEE Transactions on Intelligent Transportation Systems, vol. 5, no. 4, pp.309-318, Dec. 2004.
[8] C. Rasmussen, “Combining laser range, color, and texture cues for autonomous road following,” in Proceedings of the IEEE International Conference on Robotics and Automation, vol.4, pp. 4320-4325, Washington, DC, 2002.
[9] Y. R. Huang, Y. L. Pan, “Fast Algorithm for Structured and Unstructured Road Detection,” in Proceedings of the IEEE International Congress on Image and
Signal Processing, pp. 1-5, Tianjin, China, 2009.
[10] Y. Wang, N. Dahnoun, and A. Achim, “A novel system for robust lane detection and tracking,” Signal Processing, vol. 92, no. 2, pp 319-334, Feb. 2012.
[11] N. Apostoloff and A. Zelinsky, “Robust vision based lane tracking using multiple cues and particle filtering,” in Proceedings of the IEEE Intelligent Vehicles Symposium, pp. 558-563, San Diego, CA, Jun. 2003.
[12] H. Yoo, U. Yang, and K. Sohn, “Gradient-Enhancing Conversion for
Illumination-Robust Lane Detection,” IEEE Transactions on Intelligent
Transportation Systems, vol.14, no.3, pp. 1083-1094, Sept. 2013.
[13] C.R. Jung and C.R. Kelber, “Lane following and lane departure using a
linear-parabolic model,” Image and Vision Computing, pp. 1192-1202, July
2005.
[14] J. Wang and X. An, “A Multi-step Curved Lane Detection Algorithm Based on
Hyperbola-Pair Model,” in Proceedings of the 2010 IEEE International
Conference on Automation and Logistics, pp. 132-137, Hong Kong and Macau,
August 2010.
[15] C. Nuthong and T. Charoenpong, “Lane Detection using Smoothing Spline,” in Proceedings of the 2010 3rd International Congress on Image and Signal
Processing (CISP), vol. 2, pp. 989-993, Yantai, China, 2010
[16] K. H. Lim, K. P. Seng, and L. M. Ang, “River Flow Lane Detection and Kalman Filtering-Based B-Spline Lane Tracking,” International Journal of Vehicular Technology, vol. 2012, 2012.
[17] R. Jiang, R. Klette, T. Vaudrey and S. Wang, “Lane detection and tracking using a new lane model and distance transform,” Machine Vision and Applications, vol.
22, no. 4 , pp. 721-737, July 2011.
[18] Z. Kim, “Robust lane detection and tracking in challenging scenarios.” IEEE Transactions on Intelligent Transportation Systems, vol. 9, no.1, pp. 16-26, March 2008.
[19] K. H. Lim, K. P. SENG, L. M. Ang and S. W. Chin, “Lane Detection and
Kalman-based Linear-Parabolic Lane Tracking,” in Proceedings of the
International Conference on Intelligent Human-Machine Systems and
Cybernetics, vol. 2, pp. 351-354, Hangzhou, Zhejiang, China, 2009.
[20] M. Thuy, F. P. León, “Lane Detection and Tracking Based on Lidar Data,”
Metrology and Measurement System, vol. 17, no. 3, pp. 311-322, 2010.
[21] E. Cuevas, D. Zaldivar, and R. Rojas, "Kalman filter for vision tracking,"
Technical Report B, Freie University Berlin, Berlin, Germany, pp. 05-12, 2005.
[22] G. Liu, F. Worgotter and I. Markelic, “Lane Shape Estimation Using a
Partitioned Particle Filter for Autonomous Driving,” in Proceedings of the IEEE
International Conference on Robotics and Automation (ICRA), pp. 1627-633,
Shanghai, China, May 2011.
[23] H. Dahmani, M. Chadli, A. Rabhi and A. El Hajjaji, “Road curvature estimation for vehicle lane departure detection using a robust Takagi–Sugeno fuzzy observer,” Vehicle System Dynamics: International Journal of Vehicle
Mechanics and Mobility, vol.51, no.5, pp 581-599, Dec. 2013.
[24]A. Eidehall and F. Gustafsson, "Combined road prediction and target tracking in
collision avoidance," in Proceedings of the IEEE Intelligent Vehicles
Symposium, pp. 619-624, Parma, Italy, 2004.
[25] S. Zhou, et al., "A novel lane detection based on geometrical model and gabor
filter," in Proceedings of the IEEE Intelligent Vehicles Symposium, pp. 59-64,
San Diego, CA, 2010.
[26]K. H. Lim, K. P. Seng, and L. M. Ang, “Improvement of lane marks extraction
technique under different road conditions,” in Proceedings of the 3rd IEEE
International Conference on Computer Science and Information Technology
(ICCSIT’10), pp. 80-84, Chengdu, China, July 2010.
[27]M. Bertozzi and A. Broggi, “GOLD: A Parallel Real-Time Stereo Vision System
for Generic Obstacle and Lane Detection,” IEEE Transactions on Image
Processing, vol. 7, no. 1, pp. 62-81, January 1998.
[28] M. Bertozzi, A. Broggi, A. Fascioli, “Stereo Inverse Perspective Mapping:
Theory and Applications,” Image and Computing, vol. 16, no. 8, pp. 585-590,
June 1998.
[29] K. Fukunaga and L. D. Hostetler, "The Estimation of the Gradient of a Density
Function, with Applications in Pattern Recognition,"IEEE Transactions on
Information Theory, vol. 21, no.1, pp. 32-40,January 1975.
[30] D. Comaniciu and P. Meer, “Mean shift: A robust approach toward feature space
analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.
24, no.5, pp. 603-619, May 2002.
[31]R. O. Duda and P. E. Hart, "Use of the Hough Transformation to Detect Lines
and Curves in Pictures," Communications of the ACM, vol. 15, no.1, pp. 11-15,
January 1972.
[32] F. O. Gorman, M. Clowes, “Finding picture edges through collinearity of feature points,” IEEE Transactions on Computers, vol. C-25, no.4, pp. 449-456, 1976.
[33] E.D. Dickmanns, B.D. Mysliwetz, “Recursive 3-d road and relative ego-state
recognition”, IEEE Transactions on Pattern Analysis and Machine Intelligence,
vol. 14, no.2, pp. 199-213, 1992.
[34] J. C. McCall and M. M. Trivedi, "Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation," IEEE Transactions on
Intelligent Transportation Systems, vol. 7, no.1, pp. 20-37, 2006.
[35] R. Danescu, S. Nedevschi, M. M. Meinecke, T. B. To, “A Stereovision-Based
Probabilistic Lane Tracker for Difficult Road Scenarios,” in Proceedings of the
IEEE Intelligent Vehicles Symposium, pp. 536-541, Eindhoven, Netherlands,
June 2008.
[36] K.H. Lim, A. C. Le Ngo, K. P. Seng, and L.-M. Ang, “UNMCVIER AutoVision
database,” in Proceedings of the International Conference on Computer
Applications and Industrial Electronics (ICCAIE ’10), pp. 650-654, Kuala
Lumpur, Malaysia, December 2010.

無法下載圖示 全文公開日期 2019/07/25 (校內網路)
全文公開日期 2024/07/25 (校外網路)
全文公開日期 2024/07/25 (國家圖書館:臺灣博碩士論文系統)
QR CODE