簡易檢索 / 詳目顯示

研究生: 黃采媛
Tsai-Yuan Huang
論文名稱: 探討漫畫元素輔助虛擬實境敘事之設計方法
Investigating Design Methods for Enhancing VR Storytelling with Comic Elements
指導教授: 余能豪
Neng-Hao Yu
口試委員: 許峻誠
梁容輝
學位類別: 碩士
Master
系所名稱: 設計學院 - 設計系
Department of Design
論文出版年: 2023
畢業學年度: 112
語文別: 中文
論文頁數: 78
中文關鍵詞: 虛擬實境互動敘事漫畫元素
外文關鍵詞: Virtual reality, interactive storytelling, comic elements
相關次數: 點閱:346下載:7
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

隨著頭戴顯示器和電腦圖學技術的不斷成熟,虛擬實境為導演提供了一個嶄新的平台來講述故事。觀眾穿戴頭戴式顯示器,能夠快速地脫離現實世界,深度沉浸於導演所創建的虛擬環境中。近年來,虛擬實境敘事作品也逐漸進入主流電影節展現新媒體潛力。本研究利用文獻回顧和內容分析方法,深入探討如何透過漫畫元素來增強虛擬實境敘事,將漫畫元素視為輔助虛擬實境敘事的工具。我們分析了虛擬實境作為敘事媒體的特性,整理了虛擬實境的敘事技巧以及漫畫元素的特性。最終,我們歸納出三個主要用途:強調故事重點、引導視點和行動,以及維持過渡場景的存在感。此外,我們還提出了七種使用情境:強調情感、強調動作、引導視點、引導行動、遮蔽視線轉場、保持視覺連續性轉場以及互動轉場。針對每種使用情境,我們提出了具體的設計建議,以滿足不同的情境需求。我們期望這些建議能夠為未來虛擬實境敘事創作者提供有關如何運用漫畫元素來豐富故事呈現之參考,以漫畫式的敘事文體為觀眾帶來獨特的沉浸式觀賞體驗,同時豐富虛擬實境敘事內容的情感表達。


As head-mounted displays and computer graphics technology continue to mature, virtual reality has provided filmmakers with a new platform for storytelling. Viewers wear headsets that swiftly transport them away from the real world, immersing them in virtual environments crafted by directors. Over the past six years, virtual reality narrative works have gradually made their way into mainstream film festivals, showcasing the potential of new media. This study employs a literature review and content analysis to delve into how comic elements can be used to enhance virtual reality storytelling, viewing comic elements as tools to complement virtual reality narratives. We analyze the characteristics of virtual reality as a narrative medium, categorize narrative techniques in virtual reality, and identify the properties of comic elements. In the end, we identify three primary purposes: emphasizing the focus of a story, guiding viewpoints and actions, and maintaining presence during transitions. Furthermore, we propose seven usage scenarios: emphasizing emotions, emphasizing actions, guiding viewpoints, guiding actions, obscuring line-of-sight transitions, maintaining visual continuity transitions, and interactive transitions. For each usage scenario, we provide specific design recommendations to meet different contextual needs. We hope that these suggestions will serve as a reference for future virtual reality storytellers on how to enrich storytelling using comic elements, bringing a unique immersive viewing experience in a comic-style narrative genre, while enhancing emotional expression in virtual reality narratives.

中文摘要 I ABSTRACT II 誌謝 III 目錄 IV 圖目錄 V 表目錄 VIII 一、緒論 1 1.1 研究背景與動機 1 二、文獻探討 4 2.1 虛擬實境作為敘事媒體之特點 4 2.2 虛擬實境敘事設計考量 7 2.3 漫畫元素 25 2.4 漫畫元素輔助虛擬實境敘事的可能性 30 2.5 文獻探討小結 34 三、研究方法 36 四、漫畫元素增強虛擬實境敘事的設計考量 40 4.1 強調故事重點 43 4.2 視點與動作引導 53 4.3 轉場維持存在感 60 4.4 其他設計重點 64 五、未來展望 66 5.1 因應未來科技發展而產生的敘事型態 66 5.2 畫格增加VR體驗的豐富性 66 5.3 漫畫元素給予MR介面元件設計的啟發 67 六、結論 69 七、參考文獻 70

[1] A. A. Berger, Narratives in popular culture, media, and everyday life, Sage, 1997.
[2] S. B. Chatman, Story and discourse: Narrative structure in fiction and film, Cornell university press, 1978.
[3] G. Genette, Narrative discourse: An essay in method (Vol. 3), Cornell University Press., 1983.
[4] R. Aylett and S. Louchart, "Towards a narrative theory of virtual reality," Virtual Reality, pp. 2--9, 2003.
[5] K. Dooley, Cinematic virtual reality: A critical study of 21st century approaches and practices, Springer, 2021.
[6] J. Bucher, Storytelling for virtual reality: Methods and principles for crafting immersive narratives, Routledge, 2017.
[7] R. Henrikson, Facilitating Real-Time Sketch-Based Storyboards for Stereoscopic and Virtual Reality Environments, University of Toronto (Canada), 2017.
[8] R. F. S. "Cuts & Transitions 101," 2016. [Online]. Available: https://www.youtube.com/watch?v=OAH0MoAv2CI&t=3s.
[9] Crow: The Legend. [Film]. Baobab Studios, 2018.
[10] 林謙耘, "探討虛擬實境敘事中的規範以及方法," 國立政治大學, 2019.
[11] 李語豪, "探討VR敘事技巧 - 以VR動畫「女子」之創作為例," 國立臺灣科技大學, 2021.
[12] M. Slater and S. Wilbur, "A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments," Presence: Teleoperators & Virtual Environments, pp. 603--616, 1997.
[13] N. De la Peña, . P. Weil, J. Llobera, B. Spanlang, D. Friedman, M. V. Sanchez-Vives and M. Slater, "Immersive journalism: Immersive virtual reality for the first-person experience of news," Presence, pp. 291-301, 2010.
[14] S. Ulrike, "Embodiment and presence in virtual worlds: a review," Journal of Information Technology, pp. 434--449, 2010.
[15] D. Zeltzer, "Autonomy, interaction, and presence," Presence: Teleoperators \& Virtual Environments, pp. 127--132, 1992.
[16] B. G. Witmer and M. J. Singer, "Measuring presence in virtual environments: A presence questionnaire," Presence, pp. 225--240, 1998.
[17] J. Mateer, "Directing for Cinematic Virtual Reality: how the traditional film director’s craft applies to immersive environments and notions of presence," Journal of media practice, pp. 14--25, 2017.
[18] R. Henrikson, B. Araujo, F. Chevalier, K. Singh and R. Balakrishnan, "Multi-device storyboards for cinematic narratives in VR," in Proceedings of the 29th Annual Symposium on User Interface Software and Technolog, 2016.
[19] E. T. Hall, "A system for the notation of proxemic behavior," American anthropologist, vol. 65, pp. 1003--1026, 1963.
[20] Madrid Noir. [Film]. No Ghost // Atlas V, 2021.
[21] Manifest 99. [Film]. Flight School Studio, 2017.
[22] K. Kilteni, R. Groten and M. Slater, "The sense of embodiment in virtual reality," Presence: Teleoperators and Virtual Environments, vol. 21, pp. 373--387, 2012.
[23] T. L. Taylor, "Living digitally: Embodiment in virtual worlds," in The social life of avatars: Presence and interaction in shared virtual environments, Springer, 2002, pp. 40--62.
[24] U. Schultze, "Embodiment and presence in virtual worlds: a review," Journal of Information Technology, vol. 25, pp. 434--449, 2010.
[25] Y. Yao, "Analyzing the Transition of Footage and Narrative Logic of Movies and Videos based on Virtual Reality Technology," in 2017 5th International Education, Economics, Social Science, Arts, Sports and Management Engineering Conference (IEESASM 2017), 2018.
[26] S. B. Chatman, Story and discourse: Narrative structure in fiction and film, Cornell university press, 1978.
[27] 黎慕嫻, "敘事性的時間問題," 南華大學, 2004.
[28] J. E. Cutting, "Event segmentation and seven types of narrative discontinuity in popular movies," Acta psychologica, vol. 149, pp. 69--77, 2014.
[29] J. Cutting and C. Iricinschi, "Re-presentations of space in hollywood movies: An event-indexing analysis," Cognitive Science, vol. 39, pp. 434--456, 2015.
[30] A. Serrano, V. Sitzmann, J. Ruiz-Borau, G. Wetzstein, D. Gutierrez and B. Masia, "Movie editing and cognitive event segmentation in virtual reality video," ACM Transactions on Graphics (TOG), vol. 36, pp. 1--12, 2017.
[31] W. Murch, In the Blink of an Eye, Silman-James Press Los Angeles, 2001.
[32] D. Bordwell, Narration in the fiction film, Routledge, 2013.
[33] D. Bordwell, K. Thompson and J. Smith, Film art: An introduction, McGraw-Hill New York, 1993.
[34] J. R. Gutierrez and J. Pinkava, Directors, Son of Jaguar. [Film]. Google Spotlight Stories, 2017.
[35] A. Pavel, B. Hartmann and M. Agrawala, "Shot orientation controls for interactive cinematography with 360 video," in Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017.
[36] Is Anna OK?. [Film]. Aardman Digital, 2018.
[37] Wolves in the Walls. [Film]. Fable Studio, Inc., 2020.
[38] Dear Angelica. [Film]. Meta Quest, 2017.
[39] D. Dolan and M. Parets, "Redefining the axiom of story: The VR and 360 video complex," 2016. [Online]. Available: https://techcrunch.com/2016/01/14/redefining-the-axiom-of-story-the-vr-and-360-video-complex/.
[40] D. F. Nicolae, "Spectator perspectives in virtual reality cinematography. The witness, the hero and the impersonator," Ekphrasis. Images, Cinema, Theory, Media, vol. 20, pp. 168--180, 2018.
[41] S. W. Bindman, L. M. Castaneda, M. Scanlon and A. Cechony, "Am I a bunny? The impact of high and low immersion platforms and viewers' perceptions of role on presence, narrative engagement, and empathy during an animated 360 video," in Proceedings of the 2018 CHI conference on human factors in computing systems, 2018.
[42] R. M. Baños, C. Botella, A. Garcia-Palacios, H. Villa, C. Perpiñá and M. Alcaniz, "Presence and reality judgment in virtual environments: a unitary construct?," CyberPsychology & Behavior, vol. 3, no. 3, pp. 327--335, 2000.
[43] R. M. Langerak, K. Prince, C. M. Herdman and J. Wade, "Embodiment in virtual reality," Can J Exp Psychol, vol. 70, no. 4, p. 388, 2016.
[44] I. Big Brane Studios, "Sushi Ben," 2023.
[45] J. Campbell, "Delusions of dialogue: control and choice in interactive art," Leonardo, vol. 33, pp. 133--136, 2000.
[46] A. Mangen, "Hypertext fiction reading: haptics and immersion," Journal of research in reading, vol. 31, pp. 404--419, 2008.
[47] M.-L. Ryan, "Beyond myth and metaphor: Narrative in digital media," Poetics Today, vol. 23, pp. 581--609, 2002.
[48] N. Elnahla, "Black Mirror: Bandersnatch and how Netflix manipulates us, the new gods," Consumption Markets & Culture, vol. 23, pp. 506--511, 2020.
[49] K. Gansing, "The myth of interactivity or the interactive myth?: Interactive film as an imaginary genre," Digital Arts and Culture, RMIT University Melbourne, http://hypertext. rmit. edu. au/dac/papers, pp. 39--45, 2003.
[50] J. H. Murray, Hamlet on the Holodeck, updated edition: The Future of Narrative in Cyberspace, MIT press, 2017.
[51] R. Silva and D. Brandão, "Narrative Objects in Virtual Reality," Perspectives on Design and Digital Communication: Research, Innovations and Best Practices, pp. 117--139, 2021.
[52] J. Murray, "Did it make you cry? Creating dramatic agency in immersive environments," in International Conference on Virtual Storytelling, 2005.
[53] E. Moreno, B. MacIntyre and J. D. Bolter, "Alice’s adventures in new media: An exploration of interactive narratives in augmented reality," in Conference on Communication of Art, Science and Technology, 2001.
[54] The Book of Distance. [Film]. ONF / NFB, 2020.
[55] S. Rothe, H. Hußmann and M. Allary, "Diegetic cues for guiding the viewer in cinematic virtual reality," in Proceedings of the 23rd ACM symposium on virtual reality software and technology, 2017.
[56] S. Rothe and H. Hußmann, "Guiding the viewer in cinematic virtual reality by diegetic cues," in Augmented Reality, Virtual Reality, and Computer Graphics: 5th International Conference, 2018.
[57] S. Rothe, D. Buschek and H. Hußmann, "Guidance in cinematic virtual reality-taxonomy, research status and challenges," Multimodal Technologies and Interaction, vol. 3, p. 19, 2019.
[58] S. Hu, J. Malloch and D. Reilly, "A Comparative Evaluation of Techniques for Locating Out of View Targets in Virtual Reality," in Graphics Interface 2021, 2020.
[59] T. Beck and S. Rothe, "Applying diegetic cues to an interactive virtual reality experience," in 2021 IEEE Conference on Games (CoG), 2021.
[60] D. Lange, T. C. Stratmann, U. Gruenefeld and S. Boll, "Hivefive: Immersion preserving attention guidance in virtual reality," in Proceedings of the 2020 CHI conference on human factors in computing systems, 2020.
[61] C. Cao, Z. Shi and M. Yu, "Automatic generation of diegetic guidance in cinematic virtual reality," in 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2020.
[62] L. T. Nielsen, M. B. Møller, S. D. Hartmeyer, T. C. Ljung, N. C. Nilsson, R. Nordahl and S. Serafin, "Missing the point: an exploration of how to guide users' attention during cinematic virtual reality," in Proceedings of the 22nd ACM conference on virtual reality software and technology, 2016.
[63] E. Souriau, "La structure de l’univers filmique et le vocabulaire de la filmologie," Revue internationale de filmologie, vol. 2, pp. 231--240, 1951.
[64] B. C. Kress, "Optical architectures for augmented-, virtual-, and mixed-reality headsets," 2020.
[65] Extron, "Environmental Considerations and Human Factors for Videowall Design," [Online]. Available: https://www.extron.com/article/environconhumanfact.
[66] R. Musil, "HMD Geometry Database," 2023. [Online]. Available: https://risa2000.github.io/hmdgdb/.
[67] S. Treue, "Visual attention: the where, what, how and why of saliency," Current opinion in neurobiology, vol. 13, pp. 428--432, 2003.
[68] INVASION!. [Film]. Baobab Studios Inc., 2016.
[69] B. Cleary and M. O'Connor, Directors, GLIMPSE. [Film]. Astrea, 2022.
[70] A. Sussman and J. M. Ward, "Game-changing eye-tracking studies reveal how we actually see architecture," Common edge, vol. 27, 2017.
[71] O. Samples, "First Hand," Oculus, 2022.
[72] D. Kuhnert , "Hand Physics Lab," Holonautic, 2021.
[73] The Line. [Film]. ARVORE Immersive Experiences, 2020.
[74] Paper Birds. [Film]. 3DAR, 2020.
[75] J. Jerald, The VR book: Human-centered design for virtual reality, Morgan & Claypool, 2015.
[76] We Wait. [Film]. BBC Media Applications Technologies Ltd, 2016.
[77] N. Cohn, "Visual narrative comprehension: Universal or not?," Psychonomic Bulletin & Review, vol. 27, pp. 266--285, 2020.
[78] 朱善傑 和 鐘世凱 , "動畫中漫畫表現形式研究-以漫畫造型與漫畫符號爲中心," 藝術學報, 2004.
[79] J. M. Kennedy, "Metaphor in pictures," Perception, vol. 11, pp. 589--605, 1982.
[80] C. Forceville, "Visual representations of the idealized cognitive model of anger in the Asterix album La Zizanie," Journal of pragmatics, vol. 37, pp. 69--88, 2005.
[81] M. Walker, The lexicon of comicana, 1980.
[82] S. McCloud, Making comics: Storytelling secrets of comics, manga and graphic novels, New York, 2006.
[83] S. McCloud and M. Martin, Understanding comics: The invisible art, Kitchen sink press Northampton, MA, 1993.
[84] C. Forceville, T. Veale and K. Feyaerts, "Balloonics: The visuals of balloons in comics," The rise and reason of comics and graphic literature: Critical essays on the form, pp. 56--73, 2010.
[85] M. Krampen, "Ferdinand de Saussure and the Development of Semiology," in Classics of semiotics, Springer, 1987, pp. 59--88.
[86] C. S. Peirce, Peirce on signs: Writings on semiotic, UNC Press Books, 1991.
[87] N. Cohn, "A visual lexicon," Public Journal of Semiotics, vol. 1, no. 1, pp. 35--56, 2007.
[88] 手塚治虫, 漫畫入門, 臺北市:武陵, 1979.
[89] 冨樫義博, Artist, ハンター×ハンター. [Art]. 集英社, 1998.
[90] 諫山創, Artist, 進撃の巨人. [Art]. 講談社, 2009.
[91] 金城宗幸, Artist, ブルーロック. [Art]. 講談社, 2018.
[92] 冨樫義博, 幽☆遊☆白書, 集英社, 1990.
[93] Horang, "SphereToon," 2020.
[94] O. Aki, "VR MANGA WORLD for STYLY," 2019.
[95] D. Peixe, Director, The Remedy. [Film]. 2019.
[96] Nic&Sam, Director, _HELLO. [Film]. 2021.
[97] NightMara. [Film]. So Meta Studios, 2021.
[98] E. Madojemu, Director, Mescaform Hill - The Missing Five. [Film]. 2022.
[99] Yuhan Li and Chiayin Chang, Directors, Out of the Cave. [Film]. 2022.
[100] 探灵VLOG. [Film]. PICO, 2022.
[101] G. f. Developers, "Designing Screen Interfaces for VR (Google I/O '17)," 20 5 2017. [Online]. Available: https://www.youtube.com/watch?v=ES9jArHRFHQ.
[102] A. Inc., "Design for spatial input," 06 06 2023. [Online]. Available: https://developer.apple.com/videos/play/wwdc2023/10073?time=142.
[103] A. Inc., "Principles of spatial design," 06 06 2023. [Online]. Available: https://developer.apple.com/videos/play/wwdc2023/10072/?time=759.
[104] OpenAI, "Introducing ChatGPT," 2022 . [Online]. Available: https://openai.com/blog/chatgpt.
[105] J. Spataro, "https://blogs.microsoft.com/blog/2023/03/16/introducing-microsoft-365-copilot-your-copilot-for-work/," Microsoft, 2023. [Online]. Available: https://blogs.microsoft.com/blog/2023/03/16/introducing-microsoft-365-copilot-your-copilot-for-work/.
[106] B. Labs, "Blockade Labs Skybox - AI-Generated 3D Worlds," 2023. [Online]. Available: https://skybox.blockadelabs.com/.
[107] M. AI, "AudioCraft: AI research for audio," Meta, 2023. [Online]. Available: https://audiocraft.metademolab.com/.
[108] "An AI that writes music," Musico, [Online]. Available: https://www.musi-co.com/.
[109] "The full story of Thailand’s extraordinary cave rescue," BBC News Services, 2018. [Online]. Available: https://www.bbc.com/news/world-asia-44791998.
[110] D. Han, D. Kim and I. Cho, "PORTAL: Portal Widget for Remote Target Acquisition and Control in Immersive Virtual Environments," in Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology, 2022.
[111] H. Pohl, K. Lilija, J. McIntosh and K. Hornbæk, "Poros: configurable proxies for distant interactions in VR," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021.
[112] Y.-T. Lin, Y.-C. Liao, S.-Y. Teng, Y.-J. Chung, L. Chan and B.-Y. Chen, "Outside-in: Visualizing out-of-sight regions-of-interest in a 360 video using spatial picture-in-picture previews," in Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017.
[113] O. Samanci, Embodying comics: Reinventing comics and animation for a digital performance, Georgia Institute of Technology, 2009.
[114] Ranjit Kumar 著;胡龍騰、黃瑋瑩、潘中道譯,研究方法: 步驟化學習指南(台北市:學富文化,民89年),頁130.
[115] Eisenhardt, K. M. (1989). Building theories from case study research. Academy of management review, 14(4), 532-550.
[116] Meta Quest. [Online]. Available: https://www.meta.com/tw/en/quest/.
[117] Google Spotlight Stories. [Online]. Available: https://www.youtube.com/@spotlightstories
[118] Virtual Reality Titles. [Online]. Available: https://store.steampowered.com/vr/
[119] Viveport. [Online]. https://www.viveport.com/
[120] PICO. [Online]. https://www.picoxr.com/global
[121] ShapesXR. [Online]. https://www.shapesxr.com/

QR CODE