簡易檢索 / 詳目顯示

研究生: 林天水
Tian-Shui Lin
論文名稱: 結合範例影像修復法與CIE色彩空間進行中式水墨畫自動修復
Automatic Restoration of Chinese Brush Painting by Combining Exemplar-Based Image Inpainting and CIE Color Space
指導教授: 陳鴻興
Hung-Shing Chen
口試委員: 貝蘇章
羅梅君
孫沛立
陳鴻興
謝翠如
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2022
畢業學年度: 110
語文別: 中文
論文頁數: 105
中文關鍵詞: 影像修復逐像素填充法逐區塊填充法影像分割
外文關鍵詞: image restoration, pixel-based filling approach, patch-based filling approach, image segmentation
相關次數: 點閱:299下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 中國清朝皇帝時常在閱覽過不少宮廷收藏之水墨畫作後,在畫作空白處用毛筆寫作題文 (墨字)、以及蓋上自己的御用印章 (紅字),用來表達自身的感想,但此舉大大影響原作的藝術價值、以及後人觀賞原作的不適觀感。為了能保留畫作內容的完整性,本研究在不同色彩空間中使用2種影像修復演算法來自動移除水墨畫上的部分圖案,結合Python 程式語言與 OpenCV 函式庫,去偵測中式水墨畫上面的特定位置,並用不同色彩空間 (CIELAB 和YCrCb) 的提取方式去做比較,提取後的結果當作遮罩,最後進行繪畫影像的還原與修復 (移除紅色印章或墨色毛筆字,以及青綠山形的提取),使用的修復演算法包含運用逐像素填充法的「快速匹配法 (Fast Marching Method)」和利用逐區塊填充法的「基於範例影像修復法 (Exemplar-Based Image Inpainting)」。本研究設計成自動提取圖畫的紅色、墨色或青綠色區域,把提取的結果當作影像修復用的遮罩,並利用兩種色彩空間去比較較為合適的遮罩,來證明不管是什麼修復方式都需要採用較佳的色彩空間,才能讓色彩取樣達到較好效果。


    It is observered that the emperors of Qing Dynasty often wrote inscriptions and put their own royal seal on the blank spaces of the famous Chinese brush paintings in order to express their personal feelings. However, this kind of behavior greatly affected the artistic value of the original work and the uncomfortable perception of the original work for future generations. In order to preserve the integrity of the content of the paintings, this research evaluated the performances of two image inpainting algorithms (Fast Marching Method and Exemplar-Based Image Inpainting) applying in two color spaces (CIELAB and YCrCb) to remove some specific patterns on the paintings. By using Python + OpenCV program to detect specific position on the ancient paintings in CIELAB or YCrCb color spaces, and the extracted results was used as the inpainting mask. Finally, the painting images were restored and repaired (including the removals of the red seal or ink brush writing, and the extraction of the green mountain shape). The test restoration algorithms include Fast Marching Method using pixel-based filling approach and Exemplar-Based Image Inpainting using patch-based filling approach. This research proved that no matter what the restoration methods were adopted, the better color space was needed.

    摘要 i Abstract ii 致謝 iii 目錄 iv 圖目錄 vii 表目錄 x 第一章 緒論 1 1.1 研究背景與動機 1 1.2 文章架構 3 第二章 相關文獻探討 5 2.1 影像分割 5 2.2 影像修復法 5 2.2.1 快速匹配法 7 2.2.2 基於範例影像修復法 11 2.3 二值化影像設定值處理 14 2.3.1 二值化處理 14 2.3.2 反二值化處理 15 2.3.3 自我調整處理 (閾值決定法) 15 2.3.4 OTSU二值化閾值處理法 (閾值決定法) 17 第三章 實驗原理 20 3.1 色彩度量學 20 3.1.1 色彩視覺 20 3.1.2 CIE 色彩系統 22 3.2 顯示器色彩訊號轉換 28 3.3 色彩訊號轉換演算法 28 第四章 實驗設計 31 4.1 實驗設備 31 4.2 實驗設計 33 4.2.1 閾值決定視覺評價實驗 34 4.2.2 實驗 1:紅色印章抽取 36 4.2.3 實驗 2:墨色毛筆字抽取 37 4.2.4 實驗 3:青綠山形抽取 37 4.3 實驗流程 39 第五章 實驗結果 41 5.1 閾值決定視覺評價實驗 41 5.2 實驗 1:紅色印章抽取 41 5.2.1 元朝 - 趙孟頫《鵲華秋色圖》 41 5.2.2 明朝 - 沈周 《鳩聲喚雨》 48 5.2.3 北宋 - 宋徽宗 《溪山秋色圖》 51 5.2.4 明朝 - 唐寅 《採菊圖》 53 5.2.5 明朝 - 徐賁 《畫山水》 56 5.3 實驗 2:墨色毛筆字抽取 58 5.3.1 元朝 - 趙孟頫《鵲華秋色圖》 58 5.3.2 明朝 - 沈周 《鳩聲喚雨》 60 5.3.3 北宋- 宋徽宗 《溪山秋色圖》 61 5.3.4 明朝 - 唐寅 《採菊圖》 61 5.3.5 明朝 - 徐賁 《畫山水》 62 5.4 實驗 3:青綠山形抽取 63 5.4.1 元朝 - 趙孟頫《鵲華秋色圖》 63 5.4.2 清朝 - 康熙《康熙台灣輿圖修復版》(北台灣) 67 5.4.3 北宋 - 王希孟《千里江山圖卷》 70 第六章 結論與未來方向 74 6.1 結論 74 6.2 未來方向 75 參考資料 76 附錄 1 二值化遮罩影像 79 附錄 2 直方圖 83 附錄 3 程式碼說明 91

    [1] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, “Image inpainting,” in Proc. ACM Conf. Comp. Graphics (SIGGRAPH), New Orleans, LA, pp. 417-424, July 2000.
    [2] T. F. Chan, J. Shen, “Non-texture inpainting by curvature–driven diffusions,” J.Vis. Comm. Image Rep., vol. 4, no. 12, pp. 436-449, 2001.
    [3] C. A. Z. Barcelos, M. A. Batista, “Image restoration using digital inpainting and noise removal,” Image and Vision Computing, vol. 25, no. 1, pp. 61-69, Jan. 2007.
    [4] A. Telea, “An image inpainting technique based on the Fast Marching Method,” Journal of Graphics Tools, vol. 9, no. 1, pp. 23-34, 2004.
    [5] T. F. Chan, J. Shen, “Mathematical models for local nontexture inpaintings,” SIAM Journal on Applied Mathematics, vol. 62, no. 3, pp. 1019-1043, 2002.
    [6] J. Shen, S. H. Kang, and T. F. Chan, “Euler’s elastica and curvature-based inpainting,” SIAM Journal on Applied Mathematics, vol. 63, no. 2, pp. 564-592, 2003.
    [7] A. Tsai, A. Yezzi, and A. S. Willsky, “Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification,” IEEE Trans. Image Process., vol. 10, no. 8, pp. 1169-1186, 2001.
    [8] S. Esedoglu, “Digital inpainting based on the Mumford-Shah-Euler image model,” European Journal of Applied Mathematics, vol.13, no. 4, pp. 353-370, 2003.
    [9] R. Bornard, E. Lecan, L. Laborelli, and J. H. Chenot, “Missing data correction in still images and image sequences,” in ACM Multimedia, France, Dec. 2002.
    [10] A. Criminisi, P. Perez, and K. Toyama, “Region filling and object removal by Exemplar-Based image inpainting,” IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sept. 2004.
    [11] M. Bertalmio, L. Vese, G. Sapiro, and S. Osher, “Simultaneous structure and texture image inpainting,” IEEE Trans. Image Process., vol. 12, no. 8, pp. 882-889, Aug. 2003.
    [12] X. Shao, Z. Liu, and H. Li, “An image inpainting approach based on the Poisson equation,” Second International Conference on Document Image Analysis for Libraries, DIAL, art. no. 1612979, pp. 368-372, 2006.
    [13] L. L. Zhao, L. Shen, and R. C. Hong, “Survey on image inpainting research progress,” Computer Science, vol. 48, no. 3, Mar. 2021.
    [14] N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Trans. Man and Cybernetics, vol. 9, no.1, pp. 377-393, 1979.
    [15] T. Jiang, S. Y. Chen, Q. Li, K. L. Zhang, and Y. Chang, “Image inpainting of wind tunnel test based on Otsu method and FMM,” Acta Aeronautica et Astronautica Sinica, vol. 41, no. 2, 2020.
    [16] H. S. Chen, S. H. Chen, Y. H. Chao, M. R. Luo, and P. L. Sun, “Applying image-based color palette for achieving high image quality of displays,” Color Research and Application, vol. 39, no. 2, pp. 154-168, 2014.
    [17] 李立宗 編著,科班出身的 AI 人必修課:OpenCV 影像處理,使用 python,深智數位股份有限公司,臺北市,2019。
    [18] 黃日鋒、詹文鑫、陳鴻興、胡國瑞、徐道義、孫沛立、羅梅君 合著,陳鴻 興 編審,顯示色彩工程學,全華圖書股份有限公司,新北市,2011。
    [19] 魏碩廷、陳鴻興、徐明景、李文淵、謝翠如、吳瑞卿、孫沛立 合著,陳鴻 興 總編輯,色彩新論- 從心理設計到科學應用,五南圖書出版股份有限公司,臺北市,2019。
    [20] 陳鴻興、蕭琇霙 合著,圖解現代色彩學,五南圖書出版股份有限公司,臺北市,2018。
    [21] 繆鵬 編著,CV+深度學習: AI最完整的跨套件Python人工智慧電腦視覺,深智數位股份有限公司,臺北市,2019。
    [22] H. S. Chen, S. M. Chen, C. Y. Jiang, Y. C. Zhang, C. Y. Lin, C. E. Lin, and J. A. Lee, “Computational tongue color simulation in tongue diagnosis,” Color Research and Application, 2021.
    [23] OpenCV Color conversions, https://docs.opencv.org/3.4/de/d25/imgproc_color_conversions.html, 2021.
    [24] Confidence Ellipse, http://www.real-statistics.com/, 2021.
    [25] 繪製二維數據集的置信橢圓, https://hg95.github.io/posts/3b0a2e38/, 2021.
    [26] J. Howse, “OpenCV Computer Vision with Python,” Packt Publishing, 2013.
    [27] 謝梁、魯穎、勞虹嵐 合著,廖信彥 審校,Python深度學習實作:Keras快速上手,博碩文化股份有限公司,新北市,2018。
    [28] 張元翔 編著,數位影像處理 : Python程式實作,全華圖書股份有限公司,新北市,2019。
    [29] 黃日鉦 編著,人工智慧與深度學習:理論與Python實踐,碁峰資訊股份有限公司,臺北市,2020。

    [30] J. Minichino, J. Howse 合著,劉波、苗貝貝、史斌 編譯,OpenCV 3計算機視覺 : Python語言實現,機械工業出版社,2016。
    [31] EIZO White Paper: Color matching between sRGB monitors and wide color gamut monitors, www.eizo.com.tw/, 2021.
    [32] 故宮書畫典藏資料檢索系統, https://painting.npm.gov.tw/, 2021.
    [33] J. A. Sethian, “A fast marching level set method for monotonically advancing fronts,” Proc. Nat. Acad. Sci. U.S.A., vol. 93, no. 4, pp. 1591-1595, 1996.
    [34] R. Catanuto, G. Morabito, and S. Toumpis, “Optical routing in massively dense networks: Practical issues and dynamic programming interpretation,” in Wireless Communication Systems. ISWCS '06. 3rd International Symposium on, pp. 83-87, 2006.
    [35] M. Kalantari, M. Shayman, “Routing in wireless Ad Hoc networks by analogy to electrostatic theory,” IEEE International Conference on Communications, Paris, France, vol. 7, pp.4028-4033, 2004.
    [36] Image Thresholding, https://docs.opencv.org/4.x/d7/d4d/tutorial_py_thresholding.html, 2021.
    [37] A. A. Efros, T. K. Leung, “Texture synthesis by nonparametric sampling,” in IEEE Int. Conf. Computer Vision, Corfu, Greece, pp. 1033-1038, Sept. 1999.
    [38] A. Arash, G. R. Raquel, “Color Conversion in Deep Autoencoders,” Society for Imaging Science and Technology, pp. 89-98, Oct. 2021.
    [39] S. C. Pei, Y. C. Zeng, and C. H. Chang, “Virtual restoration of ancient Chinese paintings using color contrast enhancement and lacuna texture synthesis,” IEEE Trans. Image Process., vol. 13, no. 3, pp. 416-429, Mar. 2004.
    [40] S. C. Pei, Y. M. Chiu, “Background adjustment and saturation enhancement in ancient Chinese paintings,” IEEE Trans. Image Process., vol. 15, no. 10, pp. 3230-3234, Oct. 2006.
    [41] J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” IEEE Conf. Computer Vision and Pattern Recognition, pp.3431-3440, 2015.
    [42] Image segmentation, https://en.wikipedia.org/wiki/Image_segmentation, 2021.

    無法下載圖示 全文公開日期 2024/01/21 (校內網路)
    全文公開日期 2026/01/21 (校外網路)
    全文公開日期 2026/01/21 (國家圖書館:臺灣博碩士論文系統)
    QR CODE