簡易檢索 / 詳目顯示

研究生: 張顥騰
Hao-Teng Chang
論文名稱: 擴增投影於影像強化之研究
Study on Enhancing Image Appearance by Augmented Projection System
指導教授: 林宗翰
Tzung-Han Lin
口試委員: 溫照華
Chao-hua Wen
孫沛立
Pei-Li Sun
唐政元
none
學位類別: 碩士
Master
系所名稱: 應用科技學院 - 色彩與照明科技研究所
Graduate Institute of Color and Illumination Technology
論文出版年: 2013
畢業學年度: 101
語文別: 中文
論文頁數: 64
中文關鍵詞: 擴增實境投影仿射影像處理電腦視覺
外文關鍵詞: Augmented Reality, Projection, Homography, Image Processing, Computer Vision
相關次數: 點閱:241下載:14
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 隨著科技的進步與生活上的改變,過去傳統的展示或一貫的宣傳手法也許讓人覺得單調乏味,若能增加些不同觀賞效果,也許可以營造不同的氣氛與新感受。因此,本研究利用結合影像擷取裝置與投影設備,搭配電腦圖學與電腦視覺的應用,對現有的實際圖像做即時的擴增投影之效果,讓影像呈現不同的視覺感受。
    基於上述之研究目的,本研究使用彩色CCD與微型投影機組成擴增投影系統裝置。使用本裝置之前,需先對CCD與投影機進行校正動作,使得影像投影誤差在9 pixel以下;再對相機的色彩做迴歸校正。最後利用幾種影像特效模式與使用影像編輯軟體之內建特效匯入系統進行實驗。在實驗結果中,邊緣強化的強化程度可隨使用者喜好所自行設定;對比強化的效果在實驗結果中是顯著的,而透過外部影像編輯軟體所套用的效果裡,具外型變化程度大的效果較為明顯,如磚塊、蝕刻特效等,而彩色炭筆的測試例則以人像效果最為顯著;油畫與水彩方面,因此類特效在顏色視覺上做較多調整,在投影上對實際影像之呈現較為困難,無法看出其特效。本研究亦針對具反光之材質作測試,然而受限於局部光線聚集而無法作判別與運算,此為本論文執行上為一大限制。且考量到光線的因素導致影像的呈現方面問題,本研究結果也僅適於暗室之條件下。
    由於本論文用投影擴增裝置對實際影像上作不同特效之展現,所採用的測試影像與處理方式僅於數種,在後續的研究中希望能夠在不同的影像處理方式、硬體設備與環境因素等作相關實驗之探討與改進,讓此設置之呈現上更為精準,也更能廣泛的應用在不同的地方上


    As technology advances and changes in life, the traditional display or promotion may make people tedious or monotonous. If people can add some different ornamental effect, it will probably create a different atmosphere and a different visual feeling. Therefore, this study reveals an augmented system, which is fabricated by one CCD and one projector. Based on computer graphics and computer vision technology, this augmented projection system can project a virtual image onto a real image. As a consequence, the augmented image presents a different visual experience.
    Based on above research purposes, this study utilizes the CCD camera and mini-projector to present a real-time augmented projection system. First of all, we calibrate the CCD and projector individually. The calibration induces a projection error which is less than 1 pixel. To improve the accuracy between the captured image and projective image, we use homography to represent the projective projection phenomenon. This helps us to map a projective image onto the original image very well. Then, we process this undistorted image for specific effect, and map this protective mask by homography. Finally, we project the mask onto the image via mini-projector. Besides, the color calibration for the CCD is also revealed.
    In this paper, we use nine test images and five testing modes to verified this concept. In experiment results, the degree of enhancement can be set according their preference; In the auto-adjustment mode, as the result as we saw, it’s not suitable for portrait images. We also use the image manipulation software, such as PhotoImpact, to apply special effects. In couple examples, the results are not apparent because these render effects only change the color appearance. The real image doesn’t change too much. But in some mode such as colorful pencil render, it truly changes a lot on actual image perception.
    Finally, we test on a glossy surface, the high-reflection area cannot make discrimination for augmenting a mash image. So, this is a native limitation for our system

    誌謝 i 中文摘要 ii ABSTRACT iii 目錄 iv 圖目錄 vi 表目錄 ix Chapter 1 緒論 1 1.1 研究動機 1 1.2 研究限制 2 1.3 研究架構 2 1.4 論文架構 3 Chapter 2 文獻探討 4 2.1 空間座標之投影轉換 4 2.2 校正 6 2.2.1 針孔相機 6 2.2.2 扭曲現象 8 2.2.3 仿射矩陣 10 2.3 色彩空間 13 2.3.1 RGB色彩空間 13 2.3.2 HSV色彩空間 14 2.4 影像計算 16 2.4.1 邊緣偵測 16 2.4.2 邊緣偵測方式 17 2.4.3 Canny Edge邊緣偵測 17 2.5 投影與擴增實境 20 Chapter 3 研究方法 21 3.1 系統簡介 21 3.2 開發環境 21 3.2.1 設備介紹 22 3.2.2 實驗設置與環境 24 3.2.3 系統流程簡介 25 3.3 幾何校正 26 3.4 仿射運算 30 3.5 相機色彩校正 31 3.6 影像處理 33 3.7 軟體運作流程 33 Chapter 4 研究結果 35 4.1 邊緣強化實驗結果 36 4.2 對比強化實驗結果 40 4.3 色彩增強實驗結果 43 4.4 其他測試例 46 4.4.1 高反光材質 46 4.4.2 負片特效 47 4.4.3 水彩特效 50 4.4.4 油畫特效 52 4.4.5 磚塊特效 54 4.4.6 蝕刻特效 56 4.4.7 彩色炭筆特效 58 Chapter 5 結論與建議 60 5.1 結論 60 5.2 未來建議 61 參考文獻 62

    [1] Wagner, Daniel., "Handheld Augmented Reality." Dissertation of Graz University of Technology, Graz, Austria, October 1st, 2007
    [2] 鄭仁富、莊書怡,"2012年台灣行動廣告市場規模與應用趨勢:展示類廣告較去年成長一倍,成為行動廣告市場成長動能",資策會FIND/經濟部技術處「科技化服務價值鏈研究與推動計畫」,2012。
    [3] " Mobile Augmented Reality: Entertainment, LBS & Retail Strategies 2012-2017行動擴增實境(AR):娛樂•LBS•零售策略",市場調查報告書,Juniper Research,2012。
    [4] "Opportunities for Augmented Reality: 2013-2020, A MARKET FORECAST AND TECHNOLOGY ASSESSMENTAR (擴增實境)的機會:市場預測•技術評估",市場調查報告書,SmarTech Markets Publishing LLC,2013。
    [5] Hartley, Richard, and Andrew Zisserman., Multiple view geometry in computer vision. Vol. 2. Cambridge, 2000.
    [6] Tsai, Roger., "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses." Robotics and Automation, IEEE Journal of 3.4 (1987): 323-344.
    [7] Zhang, Zhengyou., "A flexible new technique for camera calibration." Pattern Analysis and Machine Intelligence, IEEE Transactions on 22.11 (2000): 1330-1334.
    [8] Zhang, Zhengyou., "Camera calibration with one-dimensional objects." Pattern Analysis and Machine Intelligence, IEEE Transactions on 26.7 (2004): 892-899.
    [9] Zhang, Zhengyou., "Flexible camera calibration by viewing a plane from unknown orientations." Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on. Vol. 1. IEEE, 1999.
    [10] Chou, Huei-Lin, and Tsai, Wen-Hsiang., "A new approach to robot location by house corners." Pattern Recognition 19.6 (1986): 439-451.
    [11] Chen, Chu-Song, Chi-Kuo Yu, and Yi-Ping Hung., "New calibration-free approach for augmented reality based on parameterized cuboid structure."Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on. Vol. 1. IEEE, 1999.
    [12] Maybank, Stephen J., and Olivier D. Faugeras., "A theory of self-calibration of a moving camera." International Journal of Computer Vision 8.2 (1992): 123-151.
    [13] Sturm, Peter F., and Stephen J. Maybank., "On plane-based camera calibration: A general algorithm, singularities, applications." Computer Vision and Pattern Recognition, 1999. IEEE Computer Society Conference on.. Vol. 1. IEEE, 1999.
    [14] Wei, G-Q., and S. D. Ma., "A complete two-plane camera calibration method and experimental comparisons." Computer Vision, 1993. Proceedings., Fourth International Conference on. IEEE, 1993.
    [15] Weng, Juyang, Paul Cohen, and Marc Herniou., "Camera calibration with distortion models and accuracy evaluation." Pattern Analysis and Machine Intelligence, IEEE Transactions on 14.10 (1992): 965-980
    [16] Camera Calibration Toolbox for Matlab, http://www.vision.caltech.edu/ bouguetj/calib_doc/.
    [17] 陳鴻興、黃日鋒、詹文鑫、胡國瑞、徐道義、孫沛立、羅梅君,顯示色彩工程學,全華圖書股份有限公司,台北,2011。
    [18] 大田登,色彩工程學:理論與應用,全華圖書股份有限公司,台北,2008。
    [19] Prewitt, Judith MS., Object enhancement and extraction. Vol. 75. Academic Press, New York, 1970.
    [20] Davis, Larry S., "A survey of edge detection techniques." Computer graphics and image processing 4.3 (1975): 248-270.
    [21] Canny, John., "A computational approach to edge detection." Pattern Analysis and Machine Intelligence, IEEE Transactions on 6 (1986): 679-698.
    [22] Harris, Chris, and Mike Stephens., "A combined corner and edge detector." Proceeding of the Alvey vision conference. Vol. 15. 1988.
    [23] Smith, Stephen M., and J. Michael Brady., "SUSAN—A new approach to low level image processing." International journal of computer vision 23.1 (1997): 45-78.
    [24] Lowe, David G., "Object recognition from local scale-invariant features." Computer vision, 1999. The proceedings of the seventh IEEE international conference on. Vol. 2. IEEE, 1999.
    [25] 鐘國亮,影像處理與電腦視覺,臺灣東華書局股份有限公司,台北,2002。
    [26] Sutherland, Ivan E., "A head-mounted three dimensional display." Proceedings of the December 9-11, 1968, fall joint computer conference, part I. ACM, 1968.
    [27] 郭世文,擴增實境應用於博物館展示的初探,科技博物,12(4),25-37,2008。
    [28] 陳怡如,數位行銷這樣做,數位時代,200,168-169,2011。
    [29] 黃家琳,「互動式廣告看板設計之研究」,台灣師範大學圖文傳播學系,2011。
    [30] Raskar, Ramesh, et al., "Multi-projector displays using camera-based registration." Visualization'99. Proceedings. IEEE, 1999.
    [31] Zhou, Jin, et al., "Multi-projector display with continuous self-calibration."Proceedings of the 5th ACM/IEEE International Workshop on Projector camera systems. ACM, 2008.
    [32] Zhang, Song, and Peisen S. Huang., "Novel method for structured light system calibration." Optical Engineering 45.8 (2006): 083601-083601.
    [33] Lanman, Douglas, and Gabriel Taubin., "Build your own 3D scanner: 3D photography for beginners." ACM SIGGRAPH 2009 Courses. ACM, 2009.
    [34] Bradley, Derek, Gerhard Roth, and Prosenjit Bose., "Augmented reality on cloth with realistic illumination." Machine Vision and Applications 20.2 (2009): 85-92.
    [35] Hilsmann, Anna, and Peter Eisert., "Optical flow based tracking and retexturing of garments." Image Processing, 2008. ICIP 2008. 15th IEEE International Conference on. IEEE, 2008.
    [36] Cushen, George A., and Mark S. Nixon., "Markerless Real-Time garment retexturing from monocular 3D reconstruction." Signal and Image Processing Applications (ICSIPA), 2011 IEEE International Conference on. IEEE, 2011.
    [37] Sukthankar, Rahul, Robert G. Stockton, and Matthew D. Mullin., "Smarter presentations: Exploiting homography in camera-projector systems." Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on. Vol. 1. IEEE, 2001.
    [38] M.R. Luo, G. Cui and B. Rigg.,(2001) The Development of the CIE 2000 Colour-Difference Formular: CIEDE2000, COLOR research and application, 26(5): 340-350.
    [39] G. Hong, M.R. Luo and P.A. Rhodes., “A Study of Digital Camera Colorimetric Characterization based on Polynomial Modeling.” Color Research and Application, 26(1), 76-84. 2001.
    [40] 陳重吉,「數位相機色彩校正模式之研究」,世新大學圖文傳播暨數位出版學系,2005年。
    [41] 林宜賢、曹學民、簡培元,「適應性色彩影像增強方法之研究」, 2011 The International Conference on Advanced Information Technologies,2011年4月22日~23日。

    QR CODE