簡易檢索 / 詳目顯示

研究生: 林和緯
He-wei Lin
論文名稱: 一種高效頻寬的立體視訊串流系統
A Bandwidth-Efficient Stereo Video Streaming System
指導教授: 花凱龍
Kai-lung Hua
口試委員: 金台齡
Tai-Lin Chin
賴祐吉
Yu-Chi Lai
鄭文皇
Wen-huang Cheng,
學位類別: 碩士
Master
系所名稱: 電資學院 - 資訊工程系
Department of Computer Science and Information Engineering
論文出版年: 2013
畢業學年度: 102
語文別: 中文
論文頁數: 54
中文關鍵詞: 紅藍立體影像立體視訊串流空間性去馬賽克時間性去馬賽克立體匹配
外文關鍵詞: Temporal demosaicing, Spatial demosaicing, Stereo video streaming, Anaglyph, Stereo matching
相關次數: 點閱:246下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 立體影片的傳輸流程在立體視覺的應用上是重要的一環,例如在網路上播放立體影片時,必須藉由傳輸的過程,才可以讓使用者觀看到立體影片。在此論文中,我們主要探討紅藍立體影片的傳輸方式。傳統的做法是將影片中每張幀的色彩通道予以壓縮,因而整體傳輸的效能較差。在本篇論文中,我們提出兩種改善的傳輸流程。在第一種方法中,由於我們使用的是紅藍立體影像,我們提出只需針對合成紅藍立體影像中的色彩通道部分進行壓縮,此方法可比傳統方法減少所需壓縮色彩通道的一半。而在第二種方法中,我們藉由將去馬賽克的部分由前處理的階段移到後處理的階段中,達到減少所需壓縮的資料量,並且為了克服還原立體影片的品質不佳,我們提出一種新穎的去馬賽克方法,利用梯度的局部立體匹配方法和空間及時間上的去馬賽克的方法來改進輸出立體影片的品質。實驗結果顯示,此二種方法可以大幅改善傳統立體影片的傳輸效率。


    Stereo video streaming is a very important topic since stereo video is more and more popular in recent years. In this thesis, we consider the stereo video streaming of anaglyph class which displays the red component of the left view and green/blue components of the right view. In traditional anaglyph streaming system, it transmits all RGB components of both left and right views and results in consuming a lot of bandwidth. In this thesis, we present two novel solutions to improve the traditional anaglyph streaming system. For the first proposed method, we transmit the only components that will be viewed by the users and we rearrange the data format to satisfy the standard video compression algorithm. For the second method, we propose to perform video demosaicing in the post-processing stage instead of in the traditional pre-processing stage. In addition, we develop a gradient-based stereo matching technique that is integrated with the proposed demosaicing algorithm. Experimental results show that the proposed anaglyph video streaming system outperforms several state-of-the-art algorithms in both objective and subjective comparisons.

    中文摘要 ...................................... i Abstract....................................... ii 目錄 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii 圖目錄 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv 1介紹 ....................................... 1 2方法 ....................................... 7 2.1 Proposed-444 method . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2 Proposed-420monomethod . . . . . . . . . . . . . . . . . . . . . . . . 12 2.3 Demosaicing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 2.3.1 Spatial demosaicing方法 . . . . . . . . . . . . . . . . . . . . . 15 2.3.2 temporal demosaicing方法. . . . . . . . . . . . . . . . . . . . 24 2.3.3 Fusion ............................... 30 3實驗結果與討論 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 4結論與未來工作 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 參考文獻 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 iii

    [1] A. S. Ahmadiyah, G.-M. Su, K.-L. Hua, and Y.-C. Lai, “An efficient anaglyph
    stereo video compressionpipeline,” Proc. SPIE, Three-Dimensional Image Processing
    (3DIP)and Applications, vol. 8650, pp. 482–485, Feb. 2013.
    [2] H. S. Malvar, L.-W. He, and R. Cutler, “High-quality linear interpolation for
    demosaicing of bayer-patterned color images,” IEEE ICASSP, vol. 3, pp. iii–
    485–8 vol.3, May 2004.
    [3] B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M.
    Mersereau, “Demosaicking: Color filter array interpolation,” IEEE Signal Processing
    Magazine, vol. 22, pp. 44–54, Jan. 2005.
    [4] A.Vetro,T.Wiegand,andG.J.Sullivan, “Overviewofthestereoandmultiview
    video codingextensions oftheh.264/mpeg-4avc standard,” IEEEProc., vol.99,
    pp. 626–642, Apr. 2011.

    [5] R.LukacandK.N.Plataniotis, “Single-sensorimaging,” Color Image Processing:
    Methods and Applications, 2008.
    [6] B. E. Bayer, “Color imaging array,” U.S. Patent 3 971 065, Jun. 20 1976.
    [7] S.-Y. Lee and A. Ortega, “A novel approach of image compression in digital
    cameras with a bayer color filter array,” Proc. IEEE Int. Conf. Image Processing,
    vol. 3, pp. 482–485, Opt. 2001.
    [8] C. C. Koh, J. Mukherjee, and S. K. Mitra, “New efficient methods of image
    compression in digital cameras with color filter array,” IEEE Trans. on Consumer
    Electronics, vol. 49, pp. 1448–1456, Nov. 2003.
    [9] F. Gastaldi, C. C. Koh, M. Carli, A. Neri, and S. K. Mitra, “Compression
    of videos captured via bayer patterned color filter array,” 13th European
    Signal Processing Conference on European Association for Signal Pro-
    cessing(EURASIP), Set. 2005.
    [10] C. Doutre, P. Nasiopoulos, and K. N. Plataniotis, “H.264-based compression
    of bayer pattern video sequences,” IEEE Trans. on Circuits and Systems for
    Video Technology, vol. 18, pp. 725–734, Jun. 2008.
    [11] H. Chen, M. Sun, and E. Steinbach, “Compression of bayer-pattern video sequences
    using adjuusted chroma subsampling,” IEEE Trans. on Circuits and
    Systems for Video Technology, vol. 19, pp. 1891–1896, Dec. 2009.
    [12] I.A.IdesesandL.P.Yaroslavsky, “Newmethodstoproducehighquality color
    anaglyphs for 3-d visualization,” International Conference on Image Analysis
    and Recognition, ICIAR, vol. 3212, pp. 273–280, Oct. 2004.
    [13] I. Ideses and L. Yaroslavsky, “Three methods that improve the visual quality
    of colour anaglyphs,” Jounal of Optics A: Pure and Applied Optics, vol. 7,
    pp. 755–762, Nov. 2005.

    [14] D. F. McAllister, Y. Zhou, and S. Sullivan, “Methods of computing color
    anaglyphs,” Proc. SPIE, Stereoscopic Displays and Application, vol. 7524, Jan.
    2010.
    [15] H.SanftmannandD.Weiskopf, “Anaglyph stereowithoutghosting,” Computer
    Graphics Forum, vol. 30, pp. 1251–1259, Jun. 2011.
    [16] X. Wu and L. Zhang, “Temporal color video demosaicking via motion estimation
    and data fusion,” IEEE Trans. on Circuits and Systems for Video Technology,
    vol. 16, pp. 231–240, Feb. 2006.
    [17] X. Wu and L. Zhang, “Improvement of color video demosaicking in temporal
    domain,” IEEE Trans. on Image Processing, vol.15,pp.3138–3151,Oct.2006.
    [18] P. Longere, X. Zhang, P. B. Delahunt, and D. H. Brainard, “Perceptual assessment
    ofdemosaicing algorithmperformance,” Proc.IEEE, vol.90,pp.123–132,
    Jan. 2002.
    [19] J.E.Adams, “Intersectionsbetweencolorplaneinterpolationand otherimage
    processingfunctionsin electronicphotography,”Proc. SPIE, Cameras and Systems
    for Electronic Photography and Scientific Imaging, vol.2416,pp.144–151,
    Mar. 1995.
    [20] D. R. Cok and E. L. Company, “Signal processing method and apparatus for
    producing interploated chrominance value in a sampled color image signal,”
    U.S. Patent 4 642 678, vol. 16, Feb. 10 1987.
    [21] J.E.Adams, “Designofpractical colorfilterarray interpolationalgorithmsfor
    digital cameras,” Proc. SPIE, Real-Time Imaging, vol.3028,pp.117–125,Apr.
    1997.
    [22] J. F. Hamilton and J. E. Adams, “Adaptive color plane interpolation in single
    sensor color electronic camera,” U.S. Patent 5 629 734, May 13 1997.
    [23] E. Chang, S. Cheung, and D. Y. Pan, “Color filter array recovery using a
    threshold-based variable numberofgradients,” Proc. SPIE, Sensors, Cameras,
    and Applications for Digital Photography, vol. 3650, pp. 36–43, Jan. 23 1999.
    [24] X. Li, B. Gunturk, and L. Zhang, “Image demosaicing: A systematic survey,”
    Proc. SPIE, Visual Communications and Image Processing, vol. 6822, Jan.
    2008.
    [25] “http://www.pokescope.com/tutorial/jpeg/jpeganaglyphs.html.”
    [26] I. Pekkucuksen and Y. Altunbasak, “Multiscale gradients-based color filter arrayinterpolation,”
    IEEETrans. onImageProcessing,vol.22,pp.157–165, Jan.
    2013.
    [27] M.J.Gay,“Digitally controlled videoprocessorwith accurategrey-scale,” IEEE
    Trans. on Consumer Electronics, vol. 38, pp. 91–100, May 1992.
    [28] J. Canny, “A computational approach to edge detection,” IEEE Trans. on
    Pattern Analysis and Machine Intelligence, vol. PAMI-8, pp. 679–698, Nov.
    1986.
    [29] R. M. Haralick, S. R. Sternberg, and X. Zhuang, “Image analysis using mathematical
    morphology,” IEEETrans. onPatternAnalysis andMachineIntelligence,
    vol. PAMI-9, pp. 532–550, Jul. 1987.
    [30] C. L. Zitnick, S. B. Kang, and M. Uyttendaele, “High-quality video view interpolation
    using a layered representation,” ACM SIGRAPH, vol.9,pp.600–608,
    Apr. 2004.

    QR CODE