Author: |
王韻婷 Yun-Ting Wang |
---|---|
Thesis Title: |
以DSP實現即時雙眼視覺之目標物量測系統 The Implementation of a Real-Time Object Estimating System Using the Binocular Stereo Vision Based on DSP |
Advisor: |
蔡超人
Chau-ren Tsai |
Committee: |
王文智
Wen-jieh Wang 蘇順豐 Shun-feng Su 郭景明 Jing-ming Guo |
Degree: |
碩士 Master |
Department: |
電資學院 - 電機工程系 Department of Electrical Engineering |
Thesis Publication Year: | 2007 |
Graduation Academic Year: | 95 |
Language: | 中文 |
Pages: | 96 |
Keywords (in Chinese): | 立體視覺 、雙眼視覺 、數位信號處理器 、景深 、三維座標 |
Keywords (in other languages): | stereo vision, binocular vision, DSP, depth, 3-D coordinate |
Reference times: | Clicks: 549 Downloads: 3 |
Share: |
School Collection Retrieve National Library Collection Retrieve Error Report |
以往大部份的影像處理系統,多是以個人電腦為基礎架構,然而隨著科技進步,數位訊號處理器(DSP:Digital Signal Processor)的功能比以往更加強大,傳統以個人電腦為基礎的影像處理系統,效率低且不適於獨立運作,而DSP所建構的系統(DSP-based System)在大量且複雜的運算處理上,準確度高且效能也高,同時體積小,方便獨立運作,能滿足大部分系統在「即時性」的需求,本論文利用德州儀器生產的數位訊號處理器TMS320DM642 EVM作為我們的開發平台,建立一套即時的雙眼視覺之目標物量測系統。在影像輸出與輸入的部份,我們利用EDMA(Enhanced Direct Memory Access)控制器開啟DMA通道,直接擷取與輸出影像資料,接著將擷取進來的影像用背景相減法得到移動物體區塊,計算影像特徵條件並經過判斷後,可偵測出目標物的影像,將影像的質心座標當作一組立體影像的對應點,根據雙眼視覺的原理,計算出目標物在立體空間中的三維座標,並利用DSP的Timer模組求出執行時間,計算出三維移動速率,最後將得到的目標物資訊透過RS-232傳送到一台個人電腦上的VB端,VB端會將接收到的資料顯示在視窗介面上,並儲存成文字檔案。系統完成後,我們可以從LCD螢幕上看到目標物的影像,並透過VB的視窗介面觀看目標物的即時資訊,同時也可以藉由VB所儲存的文字資料來分析目標物的移動軌跡與誤差率等。
Formerly most of digital image process systems are based on personal computer, the PC is high consuming power and lower efficiency of the system, so it’s not suitable for stand-alone systems. In recent years, the constant advancement in technology increased the processing speed of Digital Signal Processor (DSP) and expanded its functionality, DSP is highly accurate and efficient in processing high volume and complex algorithms, not only are DSP-based systems small size and suitable for stand-alone but also meet most systems’ requirement for real-time performance.
We combine TI TMS320DM642 EVM and two CCD (Charge Coupled Devices) to be the research developing platform for our binocular vision system and use EDMA controller to create DMA gateway so that we can capture and display images directly without using CPU’s resources. At first, the binocular CCD intercept two stereo images, then the system separates the target and the background from the pair images by using image processing methods, and then counts the center coordinate of each target images for stereo matching. By measuring the difference between two center coordinate of target images, the system can calculate the distance from the CCD base to the target object, and so do the 3-D coordinate and the moving velocity of target object, finally we transmit target information to VB through RS-232. After receiving the information, VB will display the information on the interface and save the information as a text file.
[1] T. C. Chen and K. L. Chung, “An Efficient Randomized Algorithm for Detecting Circles,” Computer Vision and Image Understanding, Vol. 83, pp. 172-191, 2001.
[2] H. K. Yuen, J. Illingworth and J. Kittler, “Detecting Partially Occluded Ellipses Using the Hough Transform,” Image and Vision Computing, Vol. 7, No. 1, pp. 31-37, 1989.
[3] C. T. Ho and L. H. Chen, “A Fast Ellipse/Circle Detector Using Geometric Symmetry,” Pattern Recognition, Vol. 28, No. 1, pp. 117-124, 1995.
[4] S. C. Zhang and Z. Q. Liu, “A Robust, Real-Time Ellipse Detector,” Pattern Recognition, Vol. 38, No. 2, pp. 273-287, 2005.
[5] S. Birchfield, “Elliptical Head Tracking Using Intensity Gradients and Color Histograms,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 232-237, 1998.
[6] C. R. Wren, A. Azarbayejani, T. Darrell and A. Pentland, “Pfinder: Realtime Tracking of the Human Body,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, pp. 780-785, 1997.
[7] I. Haritaoglu, D. Harwood and L. S. Davis, “Hydra: Multiple People Detection and Tracking Using Silhouettes,” Proceedings of the Second IEEE Workshop on Visual Surveillance, pp. 6-13, June 26, 1999.
[8] M. Petrou and P. Bosdogianni, Image Processing: the fundamentals, John Wiley & Sons, pp. 125-154, 2001.
[9] C. C. Han, M. Liao, H. Y., G. J. Yu and L. H. Chen, “Fast Face Detection Via Morphology-Based Pre-Processing,” Pattern Recognition, Vol. 33 No. 10, pp. 1701-1712, 2000.
[10] S. J. Ko and Y. H. Lee, “Center Weighted Median Filters and Their Applications to Image Enhancement,” IEEE transactions on circuits and systems, Vol. 38, No. 9, pp. 984-993, 1991.
[11] T. Chen and H. R. Wu, “Adaptive Impulse Detection Using Center-Weighted Median Filters,” IEEE Signal Processing Letters, Vol. 8, No. 1, pp. 1-3, 2001.
[12] E. R. Davies, Machine Vision: Theory, Algorithms, Practicalities, 3rd Edition, Elsevier Science and Technology, pp. 445-454, 609-619, January 2005.
[13] D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach, Prentice Hall, pp. 215-250, January 2003.
[14] L. D. Stefano, M. Marchionni and S. Mattoccia, “A Fast Area-Based Stereo Matching Algorithm,” Image and Vision Computing, Vol. 22, No. 12, pp. 983-1005, 2004.
[15] H. Jahn, “Parallel Epipolar Stereo Matching,” Proceedings of International Conference on Pattern Recognition, Vol. 15, No. 1, pp. 402-405, 2000.
[16] D. Marr and T. Poggio, “Cooperative Computation of Stereo Disparity,” Science, Vol. 194, pp. 283-287, 1976.
[17] D. Schreiber, B. Alefs and M. Clabian, “Single Camera Lane Detection and Tracking,” IEEE Conference on Intelligent Transportation Systems, pp. 13-16, 2005.
[18] 陳毓淞,車輛前景移動物體影像的即時偵測系統之實現,國立臺灣科技大學電機工程研究所,2006。
[19] H. C. Birnbaum著,塗紹基譯,相機,眾文圖書股份有限公司,pp. 56-63,台北,1983。
[20] 宋汝濬著,攝影學,藝術圖書公司,pp. 31-46,台北,1991。
[21] A. N. Ansari and M. Abdel-Mottaleb, “Automatic Facial Feature Extraction and 3D Face Modeling Using Two Orthogonal Views with Application to 3D Face Recognition,” Pattern Recognition, Vol. 38, No. 12, pp. 2549-2563, 2005.
[22] A. P. Tirumalai, B. G. Schunck and R. C. Jain, “Dynamic Stereo with Self-Calibration,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, pp. 1184-1189, 1992.
[23] W. Y. Yau and H. Wang, “Fast Relative Depth Computation for an Active Stereo Vision System,” Real-Time Imaging, Vol. 5, pp. 189-202, 1999.
[24] Y. Ma, S. Soatto, J. Kosecka and S. Sastry, An Invitation to 3-D Vision: From Images to Geometric Models, Springer-Verlag, New York, pp. 117-124, 391-394, November 2003.
[25] Z. Zhang, “A Flexible New Technique for Camera Calibration,” Technical Report MSR-TR-98-71, Microsoft Research, December 2, 1998.
[26] S. T. Barnard and W. B. Thompson, “Disparity Analysis of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 2, pp. 330-340, 1980.
[27] Texas Instruments Inc., TMS320C6000 DSP/BIOS User’s Guide, May 2000.
[28] Texas Instruments Inc., TMS320C6000 DSP 32-Bit Timer Reference Guide, January 2005.
[29] Texas Instruments Inc., TMS320C6000 Chip Support Library API User’s Guide, December 2002.
[30] Texas Instruments Inc., TMS320C6000 DSP Interrupt Selector Reference Guide, January 2004.
[31] Texas Instruments Inc., TL16C752B 3.3-V Dual UART with 64-byte FIFO, August 2000.