簡易檢索 / 詳目顯示

研究生: 余俊緯
Chun-Wei Yu
論文名稱: 植基於優化理論的通用式彩度抽樣策略及其在馬賽克視訊壓縮的應用
Novel Chroma Subsampling Strategy based on Mathematical Optimization for Compressing Mosaic Videos with Arbitrary RGB Color Filter Arrays in H.264/AVC and HEVC
指導教授: 鍾國亮
Kuo-liang Chung
口試委員: 蔡文祥
Wen-hsiang Tsai
范國清
Kuo-chin Fan
廖弘源
Mark Liao
洪西進
Shi-jinn Horng
學位類別: 碩士
Master
系所名稱: 電資學院 - 資訊工程系
Department of Computer Science and Information Engineering
論文出版年: 2015
畢業學年度: 103
語文別: 英文
論文頁數: 34
中文關鍵詞: 任意樣式之色彩濾波陣列彩度抽樣H.264/AVCHEVC數學最佳化馬賽克視訊
外文關鍵詞: Arbitrary RGB color filter arrays, Chroma subsampling, H.264/AVC, HEVC, Mathematical optimization, Mosaic videos
相關次數: 點閱:333下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 為了節省製造成本,多數的數位攝影機採用了單一感測器的技術搭配色彩濾波陣列來捕捉真實世界的場景。由於在每一個像素位置上僅有紅、綠、藍三者其中之一的顏色感測器,因此這類的視訊影片常被稱為馬賽克視訊。為了節省儲存空間與增進傳輸效能,如何達到良好的品質與容量權衡對馬賽克視訊壓縮是十分重要的。在本篇論文中,基於數學最佳化的技巧,我們提出了一個新穎的彩度抽樣策略,而其可適用於在 H.264/AVC 與 HEVC 中壓縮任意色彩濾波陣列樣式的馬賽克視訊。針對每個將被抽樣成 4:2:0 格式的 2 × 2YUV 區塊,本論文透過最小化原始的馬賽克區塊和抽樣後 YUV 區塊轉換回去的馬賽克區塊彼此之間的失真,來產生出更恰當的抽樣 U 、 V 彩度值。 透過本篇論文的數學最佳化策略,抽樣後的 U 、 V 值可以同時將原始的馬賽克區塊上 R 、 G 、 B 像素對重建馬賽克區塊的重要性皆納入考量。

    實驗結果顯示,在利用 H.264/AVC 和 HEVC 視訊壓縮標準來壓縮任意色彩濾波陣列樣式的馬賽克視訊時,本論文所提出的彩度抽樣策略不論是和目前最新的方法─陳等人及楊等人的方法,或是和三個傳統常用的抽樣策略相比,在相近的時間需求下,都有著最佳的品質與容量權衡。


    To save the manufacturing cost, most color digital video cameras employ a single-sensor technology with a red-green-blue (RGB) color filter array (CFA) to capture the real-world scenes. Due to only one primary color measured at each pixel location, the captured videos are usually referred to as the mosaic videos. For the purposes of economical storage and transmission, it is very important to achieve a good trade-off between the quality and bitrate when compressing mosaic videos with different RGB-CFA structures. In this paper, based on mathematical optimization technique, a novel chroma subsampling strategy is presented for compressing mosaic videos with arbitrary RGB-CFA structures in H.264/AVC and HEVC. For each 2 × 2 YUV block to be subsampled with 4:2:0 format, the proposed strategy determines the proper sampled U and V components by minimizing, prior to compression, the quality distortion between the original co-located mosaic block and the mosaic block conversed from the current subsampled YUV block. Through the mathematical optimization formulated in the proposed strategy, the significance of the sampled U and V components for reconstructing R, G, and B pixels can be simultaneously taken into consideration. Experimental results demonstrate that the proposed chroma subsampling strategy has the best quality and bitrate trade-off at a similar execution-time requirement for compressing mosaic videos with arbitrary RGB-CFA structures in H.264/AVC and HEVC when compared with the state-of-the-art ones by Chen et al. and Yang et al. as well as the three commonly used ones.

    教授推薦書 i 論文口試委員審定書 ii 中文摘要 iii Abstract iv 誌謝 v Table of Contents vi List of Tables vii List of Figures ix 1 Introduction 1 2 Demosaicking-first Mosaic Video Compression Schemes and the Related Chroma Subsampling Strategies 6 2.1 Demosaicking-first mosaic video compression schemes 6 2.2 Related chroma subsampling strategies and their drawbacks 7 3 Proposed Chroma Subsampling Strategy based on Mathematical Optimization 10 4 Experimental Results 15 4.1 Comparison in terms of quality and bitrate trade-off 16 4.2 Comparison in terms of execution-time 26 5 Conclusion 30

    [1] B. E. Bayer, “Color imaging array,” U.S. Patent 3 971 065, Jul. 1976.
    [2] G. Bjontegaard, “Calculation of average PSNR differences between RD curves,”VECG-M33, ITU-T VECG meeting, Austin, Texas, 2–4, Apr. 2001.
    [3] B. Bross, W. J. Han, J. R. Ohm, G. J. Sullivan, and T. Wiegand, “High efficiency video coding (HEVC) text specification draft 10,” document JCTVC-L1003, Jan. 2013.
    [4] H. Chen, M. Sun, E. Steinbach,“ Compression of Bayer-pattern video sequences using adjusted chroma subsampling,” IEEE Trans. Circuits and Systems for Video Technology, vol. 19, no. 12, pp. 1891–1896, Dec. 2009.
    [5] K. H. Chung, Y. H. Chan, “Color demosaicking using variance of color differences,” IEEE Trans. Image Processing, vol. 16, no. 7, pp. 2944–2955, Oct. 2006.
    [6] K. L. Chung, W. J. Yang, W. M. Yan, C. S. Fuh, “New joint demosaicing and arbitrary-ratio resizing algorithm for color filter array using DCT approach,” IEEE Trans. Consumer Electronics, vol. 56, no. 2, pp. 783–791, Feb. 2010.
    [7] C. Doutre, P. Nasiopoulos, K. N. Plataniotis, “H.264-based compression of Bayer pattern video sequences”, IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 6, pp. 725–734, Jun. 2008.
    [8] C. Doutre, P. Nasiopoulos, “Modified H.264 intra prediction for compression of video and images captured with a color filter array,” in Proc. of IEEE International Conference on Image Processing, Nov. 2009, pp. 3401–3404.
    [9] Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification, document ITU-T Rec. H.264/ISO/IEC 14 496-10 AVC, Joint Video Team of ISO/IEC and ITU-T, May 2003.
    [10] S. Ferradans, M. Bertalmio, and V. Caselles, “Geometry-based demosaicking,” IEEE Trans. Image Processing, vol. 18, no. 3, pp. 665–670, Mar. 2009.
    [11] F. Gastaldi, C. C. Koh, M. Carli, A. Neri, S. K. Mitra, “Compression of videos captured via Bayer patterned color filter arrays,” in Proc. of 13th European Signal Processing Conference, Sept. 2005, pp. 983–992.
    [12] Generic coding of moving pictures and associated audio (MPEG-2), document ISO/IEC 13818, Jul. 1995.
    [13] B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schaffer, R. M. Murserau, “Demosaicking: color filter array interpolation,” IEEE Signal Processing Magazine, vol. 22, no. 1, pp. 44–54, Jan. 2005.
    [14] K. Hirakawa and P. J. Wolfe, “Spatio-spectral color filter array design for optimal image recovery,” IEEE Trans. Image Processing, vol. 17, no. 10, pp. 1876–1890, Oct. 2008.
    [15] ITU-T Recommendation J.144, “Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference,” International Telecommunication Union, Telecommunication Standardization Sector, Mar. 2004.
    [16] S. Y. Lee, A. Ortega, “A novel approach of image compression in digital cameras with a Bayer color filter array,” in Proc. of IEEE International Conference on Image Processing, Oct. 2001, pp. 482–485.
    [17] J. S. J. Li and S. Randhawa, “Color filter array demosaicking using highorder interpolation techniques with a weighted median filter for sharp color edge preservation,” IEEE Trans. Image Processing, vol. 18, no. 9, pp. 1946–1957, Sept. 2009.
    [18] W. Lu, Y. P. Tang, “Color filter array demosaicking: New method and performance measures,” IEEE Trans. Image Processing, vol. 12, no. 10, pp. 1194–1210, Oct. 2003.
    [19] R. Lukac, K. N. Plataniotis, “Normalized color-ratio modeling for CFA interpolation,” IEEE Trans. Consumer Electronics, vol. 50, no. 2, pp. 737–745, Feb. 2004.
    [20] R. Lukac, K. N. Plataniotis, “Universal demosaicking for imaging pipelines with an RGB color filter array,” Pattern Recognition, vol. 38, no. 11, pp. 2208–2212, Apr. 2005.
    [21] R. Lukac, K. N. Plataniotis, “Color filter arrays: Design and performance analysis,” IEEE Trans. Consumer Electronics, vol. 51, no. 4, pp. 1260–1267, Apr. 2005.
    [22] H. S. Malvar, G. J. Sullivan, “Progressive-to-lossless compression of color-filter-array images using macropixel spectral-spatial transformation,” in Proc. of Data Compression Conference, Apr. 2012, pp. 3–12.
    [23] S. C. Pei, I. K. Tam, “Effective color interpolation in CCD color filter arrays using signal correlation,” IEEE Trans. Circuits and Systems for Video Technology, vol. 13, no. 6, pp.503–513, Jun. 2003.
    [24] M. Pinson, S. Wolf, “A new standardized method for objectively measuring video quality,” IEEE Trans. Broadcasting, vol. 50, no. 3, pp. 312–322, Sept. 2004.
    [25] X. Wu and N. Zhung, “Primary-consistent soft-decision color demosaicking for digital cameras,” IEEE Trans. Image Processing, vol. 13, no. 9, pp. 1263–1274, Sept. 2004.
    [26] X. Wu and X. Zhang, “Joint color decrosstalk and demosaicking for CFA cameras,” IEEE Trans. Image Processing, vol. 19, no. 12, pp. 3181–3189, Dec. 2010.
    [27] W. J. Yang, K. L. Chung, W. N. Yang, L. C. Lin, “Universal chroma subsampling strategy for compressing mosaic video sequences with arbitrary RGB color filter arrays in H.264/AVC,” IEEE Trans. Circuits and Systems for Video Technology, vol. 23, no. 4, pp. 591–606, Apr. 2013.
    [28] Batch video quality metric software 2.0 [Online]. Available: http://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx.
    [29] Kodak True Color Image Collection [Online]. Available: http://r0k.us/graphics/kodak/.
    [30] [Online]. Available: http://140.118.175.164/CWYu/ChromaSubsampling/.

    QR CODE