簡易檢索 / 詳目顯示

研究生: 邱昱穎
YU-YING CHIU
論文名稱: 利用深度資訊加速FVC/H.266 畫面內編碼單位決策
Exploit Depth Information to speedup Intra Coding Unit Decision in FVC/H.266
指導教授: 陳建中
Jiann-Jone Chen
口試委員: 陳建中
Jiann-Jone Chen
吳怡樂
Yi-Leh Wu
蔡耀弘
Yao-Hong Tsai
學位類別: 碩士
Master
系所名稱: 電資學院 - 電機工程系
Department of Electrical Engineering
論文出版年: 2018
畢業學年度: 106
語文別: 中文
論文頁數: 66
中文關鍵詞: 視訊編碼畫面內編碼深度資訊
外文關鍵詞: FVC, H.266, intra
相關次數: 點閱:195下載:4
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

多媒體通信傳播品質日漸提升,其中高畫質視訊處理技術更是顯著提升,高效率視訊編碼(HEVC/H.265)即為了處理高畫質視頻需求而制定,但也僅支援解析度2K的視訊。最近幾年來已經出現高解析度4K甚至8K的視訊,高解析度的視訊必定是未來發展的主流,因此聯合視訊探索小組(Joint Video Exploration Team, JVET),從2015年開始招開會議討論新的視訊壓縮標準FVC/H.266(Future Video Coding),參考軟體為JEM(Joint Exploration Model),JEM是在HEVC參考軟體HM(HEVC Test Model)的基礎上發展而來,預計在近幾年發布為國際視訊壓縮的標準。
FVC/H.266與HEVC/H.265相比具有更好的編碼效能,相對的編碼架構複雜度也大大的提升,其中最大的不同在於CU(Coding Unit)使用QTBT(Quadtree plus Binary Tree)的區塊編碼結構,在QTBT結構中消除了多個分割類型的概念,即拋棄了CU、PU(Predict Unit)及TU(Transform Unit)分離的概念,提供更靈活的CU分割類型,且支援大小從最小8×8到最大256×256的正方形區塊,甚至一個CU可以有一個正方形或者矩形的形狀,因此編碼時間也大幅增加,在畫面內編碼增加的更是明顯,所以如何在畫面內編碼單位決策中加速,就是要來探討的問題。針對此問題,本論文提出在QTBT結構中參考鄰近深度資訊,利用鄰近LCU( Largest Coding Unit)區塊平均深度來判斷是否適合提前終止(early termination)CU切割的方法。實驗結果顯示,我們所提出的方法,整體而言在BDBR僅上升0.31%的情況下,編碼時間上可以達到25.423%的加速效果,達到降低FVC/H.266運算複雜度之目的。


Multimedia communication has been widely applied by many with the help of high efficient video coding (HEVC) techniques. The HEVC/H.265 now support mostly for 2K video, but 4K and 8K video will become the mainstream in the near future. The JVET started to develop the FVC/H.266 (Future Video Coding) standard for the ultra-high definition video (UHDV) since 2015, whose reference software JEM (Joint Exploration Model) is developed based on the HM (HEVC TestModel).
The FVC/H.266 performs better than the HEVC/H.265 but requires higher time complexity as well. The FVC/H.266 adopts Quadtree plus Binary Tree (QTBT) structure for Coding Units (CU). It eliminates the complex hierarchical decomposition structure among the CU, Prediction Unit (PU) and Transform Unit (TU), in which the block size can be from 8×8 to 256×256. We study how to speed up the FVC/H.266 intra-frame coding process. We proposed to reference the average depth information of neighboring Largest Coding Unit (LCU) to determine whether to early terminate CU decomposition or not. Experiments showed that the proposed method can save up 25.423% of processing time, while the BDBR rises only 0.31%, as compared to the JEM system program.

摘要 1 Abstract 2 致謝 3 目錄 4 圖目錄 6 表目錄 8 第一章 緒論 9 1.1 研究背景 9 1.2 研究動機與目的 9 1.3 論文組織 11 第二章 背景知識 12 2.1 FVC/H.266視訊編碼介紹 12 2.1.1 FVC制定 12 2.1.2 FVC/H.266與HEVC/H.265差異 13 2.1.3 FVC/H.266編碼流程 14 2.2 FVC/H.266編碼架構介紹 15 2.2.1 編碼單位(Coding Unit, CU) 15 2.2.2 預測單位(Prediction Unit, PU) 21 2.2.3 轉換單位(Transform Unit, TU) 31 2.2.4 率失真最佳化(Rate-Distortion Optimization Routine) 32 2.2.5 轉換與量化(Transform and Quantization) 34 2.2.6 熵編碼(Entropy Encoding) 35 第三章 FVC/H.266加速編碼單位方法相關研究 37 3.1 FVC/H.266編碼複雜度分析 37 3.2 相關文獻探討 39 3.2.1 FVC/H.266編碼單位快速決策方法相關文獻 39 3.2.2 HEVC/H.265編碼單位快速決策方法相關文獻 42 第四章 利用深度資訊加速FVC/H.266畫面內編碼單位決策 45 4.1 四分樹加速方法 45 4.2 二分樹加速方法 51 4.3 提出快速決策流程 55 第五章 實驗結果與討論 57 5.1 實驗環境設置 57 5.2 實驗結果 60 第六章 結論與未來研究探討 62 6.1 結論 62 6.2 未來研究探討 63 參考文獻 64

[1] G. J. Sullivan, et al, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Trans. Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, Sep 2012.
[2] J. Chen, et al, “Algorithm description of Joint Exploration Test Model 4 (JEM4),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 4th Meeting, Doc. JVET-D1001, Chengdu, October 2016.
[3] H. Huang, et al, “EE2.1: Quadtree plus binary tree structure integration with JEM tools,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-C0024, Geneva, May 2016.
[4] M. Karczewicz and E. Alshina, “JVET AHG report: Tool evaluation (AHG1),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and 86 ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-F0001, Hobart, Mar. 2017.
[5] J. Chen, et al, “Algorithm description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting, Doc. JVET- G1001-v1, Torino, July 2017.
[6] J. Lainema, et al, “Intra Coding of the HEVC standard,” IEEE Trans. Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1792-1801, Dec 2012.
[7] J. Chen, et al, “Further improvements to HMKTA-1.0,” ITU-T SG16/Q6, Doc. VCEG-AZ07, Jun. 2015.
[8] J. Chen, et al, “Algorithm description of Joint Exploration Test Model 1,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 2nd Meeting, Doc. JVET-B0021, San Diego, Feb 2016.
[9] J. Chen, et al, “Coding tools investigation for next generation video coding,” ITU-T SG16/Q6, Doc. COM16-C806, Feb. 2015.
[10] W. J. Chien, et al, “Modification of merge candidate derivation,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 2nd Meeting, Doc. JVET-B0058, San Diego, Feb 2016.
[11] A. Said, et al, “Position dependent intra prediction combination,” ITU-T SG16/Q6, Doc. COM16-C1016, Oct. 2015.
[12] http://blog.sina.com.cn/s/blog_520811730101m9y2.html
[13] M. W. Park, et al, “Cross-check of JVET-C0024 (QTBT),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-C0024, Geneva, May 2016.
[14] H. Huang, et al, “AHG5: Speed-up for JEM-3.1,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 4th Meeting, Doc. JVET-D0077, Chengdu, Oct. 2016.
[15] H.-Y. Jiang, “Fast intra coding unit partition decision in H.266/FVC based on spatial features,” M.Eng. Thesis, National Central University, June 2017.
[16] S. Cho and M. Kim, “Fast CU splitting and pruning forsuboptimal CU partitioning in HEVC intra coding,” IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 9, pp. 1555–1564, Sep. 2013.
[17] J.-H. Lee et al, “Fast coding algorithm based on adaptive coding depth range selection for HEVC,” IEEE Int. Conf. Cons. Electron-Berlin, pp. 31–33, 2012
[18] K. Goswami, et al, “Early coding unit (CU) splitting termination algorithm for high efficiencyvideo coding (HEVC),” Electron. Telecommun. Res. Inst. J., vol. 36, no. 3, pp. 407–417, 2014
[19] G. Correa, et al, “Complexity control of high efficiency video encoders for power-constrained devices,” IEEE Trans. Consum. Electron., vol. 57, no. 4, pp. 1866–1874, Nov. 2011.
[20] W.-J. Hsu and H.-M. Hang, “Fast coding unit decision algorithm for HEVC,” in Proc. Asia-Pacific Signal Inf. Process. Assoc. Annu. Summit Conf. pp. 1-5, Oct. Nov. 2013.
[21] S. Liquan, et al, “An effective CU size decision method for HEVC encoders,” IEEE Trans. Multimedia, vol. 15, no. 2, pp. 465–470, Feb. 2013.
[22] J.-H. Lee, et al, “Fast encoding algorithm for high-efficiency video coding (HEVC) system based on spatio-temporal correlation,” J. Real-Time Image Processing, pp.1-12, 2015.
[23] L. Shen, Z. Zhang, and P. An, “Fast CU size decision and mode decision algorithm for HEVC intra coding,” IEEE Trans. Consumer Electronics, vol. 59, no. 1, pp. 207-213, Feb. 2013.

QR CODE