研究生: |
邱昱穎 YU-YING CHIU |
---|---|
論文名稱: |
利用深度資訊加速FVC/H.266 畫面內編碼單位決策 Exploit Depth Information to speedup Intra Coding Unit Decision in FVC/H.266 |
指導教授: |
陳建中
Jiann-Jone Chen |
口試委員: |
陳建中
Jiann-Jone Chen 吳怡樂 Yi-Leh Wu 蔡耀弘 Yao-Hong Tsai |
學位類別: |
碩士 Master |
系所名稱: |
電資學院 - 電機工程系 Department of Electrical Engineering |
論文出版年: | 2018 |
畢業學年度: | 106 |
語文別: | 中文 |
論文頁數: | 66 |
中文關鍵詞: | 視訊編碼 、畫面內編碼 、深度資訊 |
外文關鍵詞: | FVC, H.266, intra |
相關次數: | 點閱:195 下載:4 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
多媒體通信傳播品質日漸提升,其中高畫質視訊處理技術更是顯著提升,高效率視訊編碼(HEVC/H.265)即為了處理高畫質視頻需求而制定,但也僅支援解析度2K的視訊。最近幾年來已經出現高解析度4K甚至8K的視訊,高解析度的視訊必定是未來發展的主流,因此聯合視訊探索小組(Joint Video Exploration Team, JVET),從2015年開始招開會議討論新的視訊壓縮標準FVC/H.266(Future Video Coding),參考軟體為JEM(Joint Exploration Model),JEM是在HEVC參考軟體HM(HEVC Test Model)的基礎上發展而來,預計在近幾年發布為國際視訊壓縮的標準。
FVC/H.266與HEVC/H.265相比具有更好的編碼效能,相對的編碼架構複雜度也大大的提升,其中最大的不同在於CU(Coding Unit)使用QTBT(Quadtree plus Binary Tree)的區塊編碼結構,在QTBT結構中消除了多個分割類型的概念,即拋棄了CU、PU(Predict Unit)及TU(Transform Unit)分離的概念,提供更靈活的CU分割類型,且支援大小從最小8×8到最大256×256的正方形區塊,甚至一個CU可以有一個正方形或者矩形的形狀,因此編碼時間也大幅增加,在畫面內編碼增加的更是明顯,所以如何在畫面內編碼單位決策中加速,就是要來探討的問題。針對此問題,本論文提出在QTBT結構中參考鄰近深度資訊,利用鄰近LCU( Largest Coding Unit)區塊平均深度來判斷是否適合提前終止(early termination)CU切割的方法。實驗結果顯示,我們所提出的方法,整體而言在BDBR僅上升0.31%的情況下,編碼時間上可以達到25.423%的加速效果,達到降低FVC/H.266運算複雜度之目的。
Multimedia communication has been widely applied by many with the help of high efficient video coding (HEVC) techniques. The HEVC/H.265 now support mostly for 2K video, but 4K and 8K video will become the mainstream in the near future. The JVET started to develop the FVC/H.266 (Future Video Coding) standard for the ultra-high definition video (UHDV) since 2015, whose reference software JEM (Joint Exploration Model) is developed based on the HM (HEVC TestModel).
The FVC/H.266 performs better than the HEVC/H.265 but requires higher time complexity as well. The FVC/H.266 adopts Quadtree plus Binary Tree (QTBT) structure for Coding Units (CU). It eliminates the complex hierarchical decomposition structure among the CU, Prediction Unit (PU) and Transform Unit (TU), in which the block size can be from 8×8 to 256×256. We study how to speed up the FVC/H.266 intra-frame coding process. We proposed to reference the average depth information of neighboring Largest Coding Unit (LCU) to determine whether to early terminate CU decomposition or not. Experiments showed that the proposed method can save up 25.423% of processing time, while the BDBR rises only 0.31%, as compared to the JEM system program.
[1] G. J. Sullivan, et al, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Trans. Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, Sep 2012.
[2] J. Chen, et al, “Algorithm description of Joint Exploration Test Model 4 (JEM4),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 4th Meeting, Doc. JVET-D1001, Chengdu, October 2016.
[3] H. Huang, et al, “EE2.1: Quadtree plus binary tree structure integration with JEM tools,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-C0024, Geneva, May 2016.
[4] M. Karczewicz and E. Alshina, “JVET AHG report: Tool evaluation (AHG1),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and 86 ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-F0001, Hobart, Mar. 2017.
[5] J. Chen, et al, “Algorithm description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting, Doc. JVET- G1001-v1, Torino, July 2017.
[6] J. Lainema, et al, “Intra Coding of the HEVC standard,” IEEE Trans. Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1792-1801, Dec 2012.
[7] J. Chen, et al, “Further improvements to HMKTA-1.0,” ITU-T SG16/Q6, Doc. VCEG-AZ07, Jun. 2015.
[8] J. Chen, et al, “Algorithm description of Joint Exploration Test Model 1,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 2nd Meeting, Doc. JVET-B0021, San Diego, Feb 2016.
[9] J. Chen, et al, “Coding tools investigation for next generation video coding,” ITU-T SG16/Q6, Doc. COM16-C806, Feb. 2015.
[10] W. J. Chien, et al, “Modification of merge candidate derivation,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 2nd Meeting, Doc. JVET-B0058, San Diego, Feb 2016.
[11] A. Said, et al, “Position dependent intra prediction combination,” ITU-T SG16/Q6, Doc. COM16-C1016, Oct. 2015.
[12] http://blog.sina.com.cn/s/blog_520811730101m9y2.html
[13] M. W. Park, et al, “Cross-check of JVET-C0024 (QTBT),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-C0024, Geneva, May 2016.
[14] H. Huang, et al, “AHG5: Speed-up for JEM-3.1,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 4th Meeting, Doc. JVET-D0077, Chengdu, Oct. 2016.
[15] H.-Y. Jiang, “Fast intra coding unit partition decision in H.266/FVC based on spatial features,” M.Eng. Thesis, National Central University, June 2017.
[16] S. Cho and M. Kim, “Fast CU splitting and pruning forsuboptimal CU partitioning in HEVC intra coding,” IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 9, pp. 1555–1564, Sep. 2013.
[17] J.-H. Lee et al, “Fast coding algorithm based on adaptive coding depth range selection for HEVC,” IEEE Int. Conf. Cons. Electron-Berlin, pp. 31–33, 2012
[18] K. Goswami, et al, “Early coding unit (CU) splitting termination algorithm for high efficiencyvideo coding (HEVC),” Electron. Telecommun. Res. Inst. J., vol. 36, no. 3, pp. 407–417, 2014
[19] G. Correa, et al, “Complexity control of high efficiency video encoders for power-constrained devices,” IEEE Trans. Consum. Electron., vol. 57, no. 4, pp. 1866–1874, Nov. 2011.
[20] W.-J. Hsu and H.-M. Hang, “Fast coding unit decision algorithm for HEVC,” in Proc. Asia-Pacific Signal Inf. Process. Assoc. Annu. Summit Conf. pp. 1-5, Oct. Nov. 2013.
[21] S. Liquan, et al, “An effective CU size decision method for HEVC encoders,” IEEE Trans. Multimedia, vol. 15, no. 2, pp. 465–470, Feb. 2013.
[22] J.-H. Lee, et al, “Fast encoding algorithm for high-efficiency video coding (HEVC) system based on spatio-temporal correlation,” J. Real-Time Image Processing, pp.1-12, 2015.
[23] L. Shen, Z. Zhang, and P. An, “Fast CU size decision and mode decision algorithm for HEVC intra coding,” IEEE Trans. Consumer Electronics, vol. 59, no. 1, pp. 207-213, Feb. 2013.