簡易檢索 / 詳目顯示

研究生: 蔡秉辰
Ping-Chen Tsai
論文名稱: 基於深度顯著性為導向且應用於AMOLED立體顯示器之像素暗化省電演算法
Depth-Guided Pixel Dimming with Saliency-Oriented Power-Saving Transformation for Stereoscope AMOLED Displays
指導教授: 阮聖彰
Shanq-Jang Ruan
口試委員: 阮聖彰
Shanq-Jang Ruan
李佩君
Pei-Jun Lee
沈中安
Chung-An Shen
學位類別: 碩士
Master
系所名稱: 電資學院 - 電子工程系
Department of Electronic and Computer Engineering
論文出版年: 2018
畢業學年度: 106
語文別: 英文
論文頁數: 63
中文關鍵詞: 像素暗化省電主動矩陣式有機發光二極體螢幕視差立體成像
外文關鍵詞: Pixel Dimming, Power-Saving, AMOLED Display, Disparity, Stereoscopy
相關次數: 點閱:227下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 虛擬實境(Virtual Reality) 擁有更佳場景浸入式(Immersive) 的體驗,使其逐漸成為人類娛樂的主流,對於虛擬實境所需求的螢幕顯示技術,主動矩陣式有機發光二極體(Active-Matrix Organic Light Emitting Diodes) 具有高彩度的顯示效果,較有效率的功耗以及較低的餘暉(Persistence),成為了最佳的技術選擇,然而主動矩陣式有機發光二極體螢幕在智慧型手機的功耗上是最主要的元件,因此有許多研究利用主動矩陣式有機發光二極體的特性來降低功耗並同時保留視覺的品質,本論文根據人眼如何在虛擬實境中運作提出一個感知型顯著導向轉換(Perceptually Saliency-Oriented Transformation),讓主動矩陣式有機發光二極體螢幕省電的同時能提供一個在虛擬實境的環境中合適的感知品質,實驗結果顯示,本論文的方法能達到56.22% 的省電效率並且擁有與現存的技術相同優異的感知品質,再者,本論文的主觀實驗(Subjective Experiment) 中證明該方法相較於現存的方法在虛擬實境的環境中能提供更佳感知品質。


    With the better experience of immersive scene, the virtual reality (VR) becomes the
    main stream of entertainment. Featuring high chromatic displaying performance, relatively higher efficiency in power and low persistence, the Active-Matrix Organic Lighting-Emitting Diode (AMOLED) is the best-choice display technique for VR. Due to the AMOLED’s heavy burden of power consumption on smartphone, many works leverage the property of AMOLED to lower the power consumption while preserving the visual quality. This paper proposes a perceptually saliency-oriented transformation by incorporating the concept of how eyes work in VR environment to provide a more suitable perceptual quality while saving more power consumption. Experimental Results show the proposed method preserves up to 56.22% of the power with high perceptual quality as other existing techniques. Furthermore, the subjective experiment demonstrates the proposed method provides a better perceptual quality for VR environment.

    1 Introduction ...1.1 Virtual Reality ...1.2 AMOLED on VR ...1.3 AMOLED on Smartphone ...1.4 Overview of Power-Saving Techniques on AMOLED ...1.5 Motivation and Contribution ...1.6 Organization of This Thesis 2 Related Works ...2.1 AMOLED Display Power Modeling ...2.2 Human Visual System ...2.3 Disparity Map ...2.4 Dynamic Pixel Dimmer [53] 3 Proposed Method ...3.1 Depth Perception ...3.2 Histogram Segmentation ...3.3 Hierarchical Linear Weighting ...3.4 Blue-Spectrum Suppression 4 Experimental Results ...4.1 Assessment Setup for Power Measurement ...4.2 Perceptual Quality Assessment Tools ...4.3 Objective Visual Quality Evaluation ...4.4 Subjective Experiment Setup ...4.5 Subjective Visual Quality Evaluation 5 Conclusion

    [1] G. Wetzstein, “The Human Visual System,” https://stanford.edu/class/ee267/, 2006. [Online]. Available: https://stanford.edu/class/ee267/lectures/lecture5.pdf. [Accessed: 14- Jun- 2018].
    [2] N. Barrial, “Open source VR headset, an alternative to the costly Oculus Rift?” http://www.makery.info/. [Online]. Available: http://www.makery.info/en/2016/01/12/le-casque-vr-open-source-une-alternative-a-un-oculus-rift-tres-cher/. [Accessed: 14-Jun-2018].
    [3] Google Inc., https://vr.google.com/. [Online]. Available: https://vr.google.com/cardboard/. [Accessed: 14-Jun-2018].
    [4] Google Inc., https://vr.google.com/. [Online]. Available: https://vr.google.com/daydream/?. [Accessed: 14-Jun-2018].
    [5] Samsung Electronics Co., Ltd., “Gear VR with Controller,” https://www.samsung.com/. [Online]. Available: https://www.samsung.com/us/mobile/virtual-reality/gear-vr/gear-vr-with-controller--galaxy-note8-edition--sm-r325nzvaxar/. [Accessed: 14-Jun-2018].
    [6] S. Hayden, “Oculus Go Pre-order Page Hits Amazon, Best Buy Stocks Shelves,” https://www.roadtovr.com/, 2018. [Online]. Available: https://www.roadtovr.com/oculus-go-pre-order-page-hits-amazon-best-buy-stocks-shelves/. [Accessed: 14-Jun-2018].
    [7] Levono Ltd., “Mirage Solo with Daydream,” https:// www.lenovo.com/. [Online]. Available: https://www.lenovo.com/us/en/virtual-reality-and-smart-devices/virtual-and-augmented-reality/lenovo-mirage-solo/Mirage-Solo/p/ZZIRZRHVR01#galleryPhoto. [Accessed: 14-Jun-2018].
    [8] HTC Co., https://www.vive.com/. [Online]. Available: https://www.vive.com/cn/product/vive-focus-en/. [Accessed: 14-Jun-2018].
    [9] Sony Co., https://www.playstation.com/. [Online]. Available: https://www.playstation.com/en-gb/explore/playstation-vr/. [Accessed: 14-Jun-2018].
    [10] HTC Co., Ltd., https://www.vive.com/. [Online]. Available: https://www.vive.com/eu/setup/vive/. [Accessed: 14-Jun-2018].
    [11] Wikipedia, “Oculus Rift,” https://en.wikipedia.org/. [Online]. Available: https://en.wikipedia.org/wiki/Oculus_Rift. [Accessed: 14-Jun-2018].
    [12] M. Abrash, “Down the VR rabbit hole: Fixing judder,” http://blogs.valvesoftware.com/. [Online]. Available: http://blogs.valvesoftware.com/abrash/down-the-vr-rabbit-hole-fixing-judder/. [Accessed: 14-Jun-2018].
    [13] B. Geffroy, P. Le Roy, and C. Prat, “Organic light-emitting diode (OLED) technology: Materials devices and display technologies,” Polymer Int., vol. 55, no. 6, pp. 572-582, Jun. 2006.
    [14] D. Shin, Y. Kim, N. Chang and M. Pedram, “Dynamic voltage scaling of OLED displays,” in Proc. 48th ACM/EDAC/IEEE Design Automation Conf., New York, NY, USA, Jun. 2011, pp. 53-58.
    [15] L. Sui, “Strategy Analytics: Xiaomi Soars as Global Smartphone Shipments Hit 360 Million in Q2 2017,” https://www.strategyanalytics.com/, 2017. [Online].
    Available: https://www.strategyanalytics.com/strategy-analytics/news/strategy-analytics-press-releases/strategy-analytics-press-release/2017/08/01/strategy-analytics-xiaomi-soars-as-global-smartphone-shipments-hit-360-million-in-q2-2017.
    [Accessed: 14- Jun- 2018].
    [16] International Data Corporation, “Smartphone Volumes Decline Slightly in the Second Quarter of 2017 Amid Anticipation of Strong Second Half Product Launches, According to IDC,” https://www.idc.com/, 2017. [Online]. Available: https://www.idc.com/getdoc.jsp?containerId=prUS42935817. [Accessed: 14- Jun- 2018].
    [17] Display Supply Chain Consultants LLC., “DSCC’s Latest Quarterly OLED Supply/
    Demand and Capital Spending Report Upgrades OLED Shipments, Revenues and Equipment Spending,” https://www.displaysupplychain.com/, 2017. [Online]. Available: http://www.displaysupplychain.com/oled-q317.html. [Accessed: 14- Jun- 2018].
    [18] X. Chen, Y. Chen, Z. Ma, and F. C. A. Fernandes, “How is energy consumed in smartphone display applications?,” in Proc. 14th ACM Workshop on Mobile Computing Systems and Applications, HotMobile ’13, New York, NY, USA, Feb. 2013, no. 3, pp. 1–6.
    [19] D. Li, S. Hao, J. Gui, and W. G. J. Halfond, “An Empirical Study of the Energy Consumption of Android Applications,” in Proc. IEEE Int. Conf. Software Maintenance
    and Evolution, Victoria, BC, Canada, Sept. 2014, pp. 121-130.
    [20] M. Dong and L. Zhong, “Power Modeling and Optimization for OLED Displays,” IEEE Trans. Mobile Comput., vol. 11, no. 9, pp. 1587-1599, Sept. 2012.
    [21] A. Carroll and G. Heiser, “An Analysis of Power Consumption in a Smartphone,” in Proc. USENIX Ann. Technical Conf. (USENIXATC), Berkeley, CA, USA, Jun. 2010,
    pp. 21-21.
    [22] M. Dong and L. Zhong, “Chameleon: A Color-Adaptive Web Browser for Mobile OLED Displays,” IEEE Trans. Mobile Comput., vol. 11, no. 5, pp. 724-738, May 2012.
    [23] C.-K. Kang, C.-H. Lin, and P.-C. Hsiu, “A win-win camera: Quality-enhanced power-saving images on mobile OLED displays,” in Proc. IEEE/ACM Int. Symp. Low Power Electronics and Design, Rome, Italy, Jul. 2015, pp. 267-272.
    [24] X. Chen, J. Zheng, Y. Chen, M. Zhao, and C.-J. Xue, “Quality-retaining OLED dynamic voltage scaling for video streaming applications on mobile devices,” in Proc. 49th ACM/EDAC/IEEE Design Automation Conf., San Francisco, CA, USA, Jun. 2012, pp. 1000-1005.
    [25] B.-H. Lee and Y.-J. Kim, “ESC-DVS: Dynamic Voltage Scaling Using Entropy-Based Scene Change Detection for AMOLED Displays,” IEEE J. Electron Devices Soc., vol. 5, no. 3, pp. 193-208, May 2017.
    [26] X. Chen, J. Zeng, Y. Chen, W. Zhang, and H. Li, “Fine-grained dynamic voltage scaling on OLED display,” in Proc. 17th Asia and South Pacific Design Automation Conf., Sydney, NSW, Australia, Jan. 2012, pp. 807-812.
    [27] J.-H. Park, Z. Maregn, and Y.-J. Kim, “Color transformation-based dynamic voltage scaling for mobile AMOLED displays,” IEICE Electron. Express, vol. 12, no. 8, pp. 20150239-20150239, Apr. 2015.
    [28] S. Kim, S. Hyun, T. Heo, D. Im, and J. Huh, “Blind: Power saving color transform method for OLED displays,” in Proc. IEEE Int. Conf. Consumer Electronics, Las Vegas, NV, USA, Jan. 2016, pp. 500-501.
    [29] Y.-T. Peng, F.-C. Cheng, L.-M. Jan, and S.-J. Ruan, “Histogram shrinking for power-saving contrast enhancement,” in Proc. 20th IEEE Int. Conf. Image Processing, Melbourne, VIC, Australia, Sept. 2013, pp. 891-894.
    [30] C.-L. Wu, C.-Y. Lee, T.-C. Tsai, L.-H. Chang, and Y.-S. Lin, “Dual equalization diffusion for AMOLED power saving,” in Proc. SID Symp. Digest of Technical Papers, vol. 41, no. 1, May 2010, pp.1454-1457.
    [31] C. Lee, C. Lee, Y.-Y. Lee, and C.-S. Kim, “Power-Constrained Contrast Enhancement for Emissive Displays Based on Histogram Equalization,” IEEE Trans. Image Process., vol. 21, no. 1, pp. 80-93, Jan. 2012.
    [32] Y.-O. Nam, D.-Y. Choi, and B. C. Song, “Power-Constrained Contrast Enhancement Algorithm Using Multiscale Retinex for OLED Display,” IEEE Trans. Image Process., vol. 23, no. 8, pp. 3308-3320, Aug. 2014.
    [33] J. Shin and R.-H. Park, “Power-constrained contrast enhancement using locality preserving histogram equalization,” in Proc. IEEE Int. Conf. Consumer Electronics, Las Vegas, NV, USA, Jan. 2015, pp. 273-274.
    [34] S.-J. Kang, “Image-Quality-Based Power Control Technique for Organic Light Emitting Diode Displays,” J. Display Technol., vol. 11, no. 1, pp. 104-109, Jan. 2015.
    [35] S.-J. Kang, “Perceptual Quality-Aware Power Reduction Technique for Organic Light Emitting Diodes,” J. Display Technol., vol. 12, no. 6, pp. 519-525, Jun. 2016.
    [36] J.-H. Choi, O.-Y. Lee, M.-Y. Lee, K.-J. Kang, and J.-O. Kim, “JND-Based Power
    Consumption Reduction for OLED Displays,” IEICE Trans. Fundamentals, vol. E99.A, no. 9, pp. 1691-1699, Sept. 2016.
    [37] T. K. Wee and R. K. Balan, “Adaptive Display Power Management for OLED Displays,” in Proc. 1st ACM Int. Workshop on Mobile Gaming, MobileGames ’12, New
    York, NY, USA, Aug. 2012, pp. 25-30.
    [38] K. W. Tan, T. Okoshi, A. Misra, and R. K. Balan, “FOCUS: a usable & effective
    approach to OLED display power management,” in Proc. 2013 ACM Int. Joint Conf. Pervasive and Ubiquitous Computing, UbiComp ’13, Zurich, Switzerland, Sept. 2013, pp. 573-582.
    [39] H.-Y. Lin, P.-C. Hsiu, and T.-W. Kuo, “ShiftMask: Dynamic OLED power shifting based on visual acuity for interactive mobile applications,” in Proc. 2017 IEEE/ACM
    Int. Symp. Low Power Electronics, Taipei, Taiwan, July 2017, pp. 1-6.
    [40] C.-H. Lin, C.-K. Kang, and P.-C. Hsiu, “Catch your attention: Quality-retaining power saving on mobile OLED displays,” in Proc. 51th ACM/EDAC/IEEE Design Automation Conf., San Francisco, CA, USA, Jun. 2014, pp. 1-6.
    [41] H. Chen, J. Wang, W. Chen, H. Qu, and W. Chen, “An image-space energy-saving visualization scheme for OLED displays,” J. Computers and Graphics, vol. 38, pp. 61-68, Feb. 2014.
    [42] K. Liu, Z. Zhou, Y. Zhuang, M. Dai, and P. Kuang, “A log-function power-constrained algorithm for OLED displays,” in Proc. 2015 IEEE Region 10 Conf., TENCON 2015, Macao, China, Nov. 2015, pp. 1-5.
    [43] C.-H. Lin, C.-K. Kang, and P.-C. Hsiu, “CURA: A Framework for Quality-Retaining Power Saving on Mobile OLED Displays,” ACM Trans. Embed. Comput. Syst., vol. 15, no. 76, pp. 1-25, Aug. 2016.
    [44] M. Park and M. Song, “Saving Power in Video Playback on OLED Displays by Acceptable Changes to Perceived Brightness,” J. Display Technol., vol. 12, pp. 483-490, May 2016.
    [45] K. S.-H. Lo, C.-H. Yeh, and W.-J. Huang, “Robust OLED displays dimming algorithm based on visual perceptual analysis techniques,” in Proc. 2017 IEEE int. Conf. Consumer Electronics - Taiwan, Taipei, Taiwan, Jun. 2017, pp. 319-320.
    [46] T.-C. Chang and S. S.-D. Xu, “Real-time quality-on-demand energy-saving schemes for OLED-based displays,” in Proc. 2013 IEEE Int. Symp. Industrial Electronics, Taipei, Taiwan, May 2013, pp. 1-5.
    [47] T.-C. Chang, S. S.-D. Xu, and S.-F. Su, “SSIM-Based Quality-on-Demand Energy-
    Saving Schemes for OLED Displays,” IEEE Trans. Syst. Man Cybern. A., Syst. Humans, vol. 46, no. 5, pp. 623-635, Aug. 2015.
    [48] P. K. Choubey, A. K. Singh, R. B. Bankapur, Vaisakh P C SB, and Manoj Prabhu B, “Content aware targeted image manipulation to reduce power consumption in OLED panels,” in Proc. 2015 8th IEEE Int. Conf. Contemporary Computing, Noida, India, Aug. 2015, pp. 467-471.
    [49] X. Chen, Y. Chen, and C. J. Xue, “DaTuM: Dynamic tone mapping technique for OLED display power saving based on video classification,” in Proc. 2015 52nd ACM/EDAC/IEEE Design Automation Conf., San Francisco, CA, USA, Jun. 2015, pp. 1-6.
    [50] P. Chondro and S.-J. Ruan, “Perceptually Hue-Oriented Power-Saving Scheme with Overexposure Corrector for AMOLED Displays,” J. Display Technol., vol. 12, no. 8, pp. 791-800, Aug. 2016.
    [51] B. Anand, L. Kecen, and A. L. Ananda, “PARVAI —HVS aware adaptive display power management for mobile games,” in Proc. 2014 7th IEEE Int. Conf. Mobile Computing and Ubiquitous Networking, Singapore, Apr. 2014, pp. 21-26.
    [52] X. Chen, J. Mao, J. Gao, K. W. Nixon, and Y. Chen, “MORPh: Mobile OLED-friendly recording and playback system for low power video streaming,” in Proc. 2016 53rd ACM/EDAC/IEEE Design Automation Conf., Austin, TX, USA, Aug. 2016, pp. 1-6.
    [53] P. Chondro, C.-H. Chang, S.-J. Ruan, and C.-A. Shen, “Advanced Multimedia Power Saving Method using Dynamic Pixel Dimmer on AMOLED Displays,” IEEE Trans. Circuits Syst. Video Technol., vol. PP, no. 99, pp. 1-1, Jul. 2017.
    [54] H. Su, C. Jung, S. Wang, and Y. Du, “Readability Enhancement of Displayed Images Under Ambient Light,” IEEE Trans. Circuits Syst. Video Technol., vol. PP, no. 99, pp. 1-1, Mar. 2017.
    [55] S. Ferradans, M. Beralmio, E. Provenzi, and V. Caselles, “An analysis of visual adaptation and contrast perception for tone mapping,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 2001-2012, Mar. 2011.
    [56] V. Sacek, “Eye spectral response,” Telescope-optics.net, 2006. [Online]. Available: http://www.telescope-optics.net/eye_spectral_response.htm. [Accessed: 20- Dec- 2017].
    [57] A. J. Zele and D. Cao, “Vision under mesopic and scotopic illumination,” Front. Psychol., vol. 5, no. 1594, pp. 1-15, Jan. 2015.
    [58] A. M. Rohalyab and H. R. Wilson, “The effect of contrast on perceived depth and depth discrimination,” J. Vision Research, vol. 39, no. 1, pp. 9-18, Jan. 1999.
    [59] H. Hirschmuller, “Stereo Processing by Semiglobal Matching and Mutual Information,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 328-341, Feb. 2008.
    [60] K. He, J. Sun, and X. Tang, “Single Image Haze Removal Using Dark Channel Prior,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 2341-2353, Dec. 2011.
    [61] A. Ford and A. Roberts, “Colour Space Conversions,” 1998. pp. 3-7 [Online]. Available: https://poynton.ca/PDFs/coloureq.pdf. [Accessed: 29- Dec- 2017].
    [62] M. Mahy, L. V. Eycken, and A. Oosterlinck, “Evaluation of Uniform Color Spaces Developed after the Adoption of CIELAB and CIELUV,” Color Res. Appl., vol. 19, no. 2, pp. 105-121, Apr. 1994.
    [63] W. Lin and C.-C. J. Kuo, “Perceptual visual quality metrics: A survey,” J. Vis. Commun. Image Represent., vol. 22, no. 4, pp. 297-312, May. 2011.
    [64] L. Zhang, L. Zhang, X. Mou, and D. Zhang, “A comprehensive evaluation of full reference image quality assessment algorithms,” in Proc. 2012 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 1477-1480.
    [65] N. Ponomarenko et al., “Color image database TID2013: Peculiarities and preliminary results,” in Proc. 4th Eur. Workshop Vis. Inf. Process., Paris, France, Jun. 2013, pp. 106–111.
    [66] L. Zhang, Y. Shen, and H. Li, “VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment,” IEEE Trans. Image Process., vol. 23, no. 10, pp. 4270-4281, Aug. 2014.
    [67] J.-M. Geusebroek, R. Van den Boomgaard, A. W. M. Smeulders, and A. Dev, “Color invariance,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 12, pp. 1338-1350, Dec. 2001.
    [68] L. Zhang, Y. Shen, and H. Li, “VSI: A Visual Saliency based IQA Index,” Sse.tongji.edu.cn, 2014. [Online]. Available: http://sse.tongji.edu.cn/linzhang/IQA/VSI/VSI.htm. [Accessed: 14 Mar. 2018].
    [69] A. Liu, W. Lin, and M. Narwaria, “Image quality assessment based on gradient similarity,” IEEE Trans. Image Process., vol. 21, no. 4, pp. 1500-1512, Apr. 2012.
    [70] G. Legge and J. Foley, “Contrast masking in human vision,” J. Opt. Soc. Amer., vol. 70, no. 12, pp. 1458-1471, 1980.
    [71] A. Liu, W. Lin, M. Paul, C. Deng, and F. Zhang, “Just noticeable difference for images with decomposition model for separating edge and textured regions,” IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1648-1652, Nov. 2010.
    [72] B. Jähne, H. Haußecker, and P. Geißler, Handbook of Computer Vision and Applications. New York, NY, USA: Academic, 1999.
    [73] L. Zhang, D. Zhang, X. Mou, and D. Zhang, “FSIM: A feature similarity index for image quality assessment,” IEEE Trans. Image Process., vol. 20, no. 8, pp. 2378-2386, Aug. 2011.
    [74] P. Kovesi, “Image features from phase congruency,” Videre: J. Comp. Vis. Res., vol. 1, no. 3, pp. 1-26, 1999.
    [75] H. R. Sheikh and A. C. Bovik, “Image information and visual quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006.
    [76] H. Hirschmüller and D. Scharstein, “Evaluation of cost functions for stereo matching,” in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 17-22.
    [77] Methodology for the Subjective Assessment of the Quality of Television Pictures, ITU-R Rec. BT.500-13, ITU-R, Geneva, Switzerland, 2012.
    [78] Methods for the subjective assessment of video quality, audio quality and audiovisual quality of Internet video and distribution quality television in any environment, ITUT Rec. P.913, ITU-T, 2014.

    無法下載圖示 全文公開日期 2023/07/30 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE