研究生: |
吳興旺 Xing-Wang Wu |
---|---|
論文名稱: |
植基於3D模型的影片修補技術 Video Completion Using 3D Model |
指導教授: |
姚智原
Chih-Yuan Yao |
口試委員: |
林昭宏
Chao-Hung Lin 賴祐吉 Yu-Chi Lai 李潤容 Ruen-Rone Lee 戴文凱 Wen-Kai Tai |
學位類別: |
碩士 Master |
系所名稱: |
電資學院 - 資訊工程系 Department of Computer Science and Information Engineering |
論文出版年: | 2014 |
畢業學年度: | 102 |
語文別: | 中文 |
論文頁數: | 49 |
中文關鍵詞: | 影片修補 、移除背景 |
外文關鍵詞: | video inpainting, video completion, video restoration |
相關次數: | 點閱:466 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
一段影片裡,人物在移動的過程中,其局部或全部的影像被物體所遮蔽,欲移除造成遮蔽的物體,這時需修補人物在遮蔽物後的動作和背景,此方法稱為影片修補。
傳統的影片處理方法,在對於影片的修補方面,分為兩部分:a) 修補前景(人物)被遮蔽時的動作;b) 移除遮蔽物後,修補其位置的背景。針對修補前景這部分,我們提出一個新的影片修補方法,來解決傳統影片修補可能會造成的缺陷,例如人物身體部分的缺失、人物的跳動、非真實移動物體的陰影(ghost shadow)、人物動作不連續的現象等等。
我們的方法,利用影片中的人物影像來驅動三維模型,使我們三維模型的動作是自然且連續,並且產生完整的貼圖,使人物的影像具有完整性。
In some videos, objects might be occluded by barrier while moving. If we want to remove the barrier, needing to use the method called “video inpainting” to reconstruct the occluded regions.
In previous video inpainting methods, it could be divided into two part: a) reconstruct the motion of the moving objects; b) reconstruct the background after removing the occluded region.
For reconstructing motion of moving objects, we present a new method to deal with the defects occurred in previous method. For example, some parts of the objects might be lost or result in objects flicking, ghost shadow, discontinuous motion of objects and so on.
In our method, we use the character image in the video to drive 3D model to make the motion smooth, continuous. Then we get the texture remaining the integrity of the character. The result of video inpainting using our method conquers the artifact of previous method.
[1] Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Transactions on Graphics, 28(3):1, 2009.
[2] Scott D Cohen and Leonidas J Guibas. Partial Matching of Planar Polylines Under Similarity Transformations. (January):1--10, 1997.
[3] Soheil Darabi. Image Melding : Combining Inconsistent Images using Patch-based Synthesis. 2003.
[4] M. Granados, J. Tompkin, K. Kim, O. Grau, J. Kautz, and C. Theobalt. How Not to Be Seen - Object Removal from Videos of Crowded Scenes. Computer Graphics Forum}, 31(2pt1):219--228, May 2012.
[5] James Hays and Alexei~A Efros. Scene Completion Using Millions of Photographs. 1(212):1--7, 2007.
[6] Vivek Kwatra, Irfan Essa, Aaron Bobick, and Nipun Kwatra. Texture optimization for example-based synthesis. ACM SIGGRAPH 2005 Papers on - SIGGRAPH '05, page 795, 2005.
[7] Yin Li, Jian Sun, Chi-keung Tang, and Heung-yeung Shum. Lazy Snapping.pages 303--308, 2001.
[8] Kedar a Patwardhan, Guillermo Sapiro, and Marcelo Bertalmio. Video inpainting under constrained camera motion. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society}, 16(2):545--53, February 2007.
[9] Patrick Perez, Michel Gangnet, and Andrew Blake. Poisson image editing. ACM SIGGRAPH 2003 Papers on - SIGGRAPH '03}, page 313, 2003.
[10] Olga Sorkine, Daniel Cohen-or Yaron, Marc Alexa, and R Christian. Laplacian Surface Editing. 2003.
[11] Jian Sun and Jiaya Jia. Image Completion with Structure Propagation. 2003.
[12] Yonatan Wexler, Eli Shechtman, and Michal Irani. Space-time completion of video. IEEE transactions on pattern analysis and machine intelligence, 29(3):463--76, March 2007.
[13] Johannes Zimmermann, Andrew Nealen, and Marc Alexa. SilSketch: automated sketch-based editing of surface meshes. Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling - SBIM '07, page~23, 2007.