簡易檢索 / 詳目顯示

研究生: 謝婷如
Ting-Ru Hsieh
論文名稱: 雙感官管道刺激電子繪本對國中學生閱讀動機、認知負荷、沉浸狀態及閱讀理解之影響與其眼動歷程分析
Effects of Dual Channels on Junior High School Students’ Reading Motivation, Cognitive Load, Flow, Reading Comprehension and Attention Distribution with Electronic Picture Books
指導教授: 高宜敏
Gloria Yi-Ming Kao
口試委員: 陳學志
Hsueh-Chih Chen
陳志銘
Chih-Ming Chen
學位類別: 碩士
Master
系所名稱: 人文社會學院 - 數位學習與教育研究所
Graduate Institute of Digital Learning and Education
論文出版年: 2016
畢業學年度: 104
語文別: 中文
論文頁數: 103
中文關鍵詞: 電子繪本眼動追蹤認知負荷沉浸狀態閱讀動機
外文關鍵詞: reading 
相關次數: 點閱:442下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究旨在探討加入具有同儕聲音作為聲音旁白的繪本是否能降低國中學生的閱讀負荷,與找尋對閱讀萌發動機與沈浸之關鍵,並以眼動觀察其閱讀歷程。本研究以新北市某兩所國中七年級學生作為實驗施測對象,以眼睛狀況與家長及個人意願為基礎篩選條件,挑選75名國中學生進入眼動階段,最後成功取得樣本數為62名;研究素材使用包含聲音刺激元素的三種電子繪本形式(閱聽:圖+聲音、聽讀:圖+文+聲音、同儕錄音:圖+文+同儕聲音)與傳統的圖文電子繪本(圖+文)共四組,透過閱讀動機、認知負荷、沉浸狀態與閱讀理解等各維度分析,並輔以眼動儀觀察學生閱讀時的注意力分佈,深入了解其閱讀認知歷程。結果顯示,加入第三方聲音旁白能有較高的閱讀動機與沉浸狀態,且從眼動數據也可看出,總凝視次數或主角、文字及關鍵圖區的凝視次數都顯著高於圖文版本;另外,加入同儕聲音做為旁白,比第三方聲音更能引導閱讀者全面的觀察圖片細節,進而在需要閱讀圖片才能答題的推論理解部分顯著較高,從熱視圖與眼動軌跡也可看出,同儕錄音版本的視覺的確較全面的分佈在畫面的各處,但閱聽版本的視覺軌跡卻都集中在聲音旁白有提到的區塊。綜合上述,不同的聲音旁白能在不同的面向帶來助益,現場教師應以教學需求,選擇適合的聲音旁白操弄方式加入閱讀素材或教學活動中,協助學生找到最適合自己的閱讀方式。


    This study aimed to explore whether electronic picture books(e-books) narrated by a peer could reduce junior high school students’ cognitive load as well as raise their motivation and trigger their flow to read. The entire process of reading was recorded by an eye-tracker for the purpose of identifying the key points and reading patterns for different versions of an e-book. Participants were 75 7th graders from two junior high schools, and only 62 students eye movement were successfully collected. The experiment compared not only three versions of e-book equipped with sound elements, including a sound-based version (pictures+sound), a mixed version with subtitles (pictures+words+sound), and a peer voice version with subtitles (pictures+words+peer voice), but also a traditional picture-based version (picture +words). The result showed that sound element cause significantly reading motivation and flow. The eye movement data also showed that total fixation duration or fixation count on role, text and key area of AOI significantly higher than picture-based version. Additional, took peer voice as sound element, could led students read picture details more comprehensive, and get higher scores on reading comprehension test. The heatmap and scanpath also showed the fixation points on peer voice version with subtitles would evenly distributed on the picture, but the fixation points on sound-based version would gather on some area that sound element mention. In sum, basing on teaching objectives, teachers can choose a suitable way mentioned above that adds sound elements into reading materials to help the students find a more efficient way to read.

    第一章 緒論 1 1.1研究背景與動機 1 1.2研究目的 7 1.3研究問題 8 1.4研究範圍與限制 9 第二章 文獻探討 10 2.1電子繪本 10 2.2多媒體學習理論與認知負荷 12 2.3 眼動追蹤技術與相關研究 21 第三章 研究方法 29 3.1研究架構與假設 29 3.2實驗流程 32 3.3研究對象 33 3.4研究工具 33 3.5分析方法 41 3.6前導性實驗結果 42 第四章 實驗結果與分析 49 4.1 不同型式繪本對國中學生注意力分佈狀況之影響 49 4.2 不同型式繪本對國中學生閱讀動機之影響 67 4.3 不同型式繪本對國中學生認知負荷之影響 69 4.4 不同型式繪本對國中學生沉浸狀態之影響 71 4.5 不同型式繪本對國中學生故事閱讀理解之影響 72 第五章 研究結論與建議 77 5.1 結論與討論 77 5.2 建議 80 參考文獻 82 中文部分 82 英文部分 83 附錄一 前測_閱讀動機調查表 90 附錄二 後測_閱讀動機與沈浸狀態與認知負荷調查表 92 附錄三 故事閱讀理解 96 附錄四 受試者眼動追蹤實驗同意書(家長) 97 附錄五 受試者眼動追蹤實驗同意書(學生) 98 附錄六 繪本情節解說與示意圖 99

    中文部分
    沈妮薇(2011)。以眼動儀分析圖文編排對國小低年級學童繪本閱讀注意力之影響。國立臺東大學教育學系教學科技碩士論文,未出版,臺東縣。
    曾由佳、陶振超(2015)。以眼球追蹤探討搜尋網頁呈現方式與位置對決策之影響。國立交通大學碩士論文,未出版,新竹市。
    盧秀琴、陳月雲(2008)。應用電子繪本提升學童動物生長之描述概念。教育與實踐周刊,21(2),33-62。
    陳慧卿(2003)。國小二年級學童對電子童書與紙本童書之閱讀能力研究 ,朝陽科技大學幼兒保育系碩士論文,未出版,臺中市。
    沈佳慧(2008)。閱讀後教學活動對台灣兒童學習單字的影響。國立臺北市立教育大學博士論文,未出版,台北市。
    邱琬媜(2008)。親子共讀無字圖繪書歷程之互動與反應。國立台南教育大學 碩士論文,未出版,台南市。
    林怡君(2006)。國小學童閱讀互動式光碟故事書與紙本童書之閱讀理解重述能力之差異比較。國立台南大學碩士論文,未出版,台南市。
    賴孟龍、陳彥樺(2012)。以眼動方法探究幼兒閱讀繪本時的注意力偏好。幼兒教保研究期刊,8,81-96。
    郭蕙琪(2013)。紙本繪本與電子童書對幼兒閱讀理解成效之探討。國立臺北護理健康大學碩士論文,未出版,台北市。
    楊雅婷、陳奕樺(2013)。紙筆與數位繪本教學對學生創造力之影響。全球華人計算機教育應用學報,9(1),99-125。
    洪美珍(2000)。電子童書閱讀型態及其對兒童閱讀影響之研究。國立台東師範學院碩士論文,未出版,台東縣。
    洪文瓊(1998)。電子童書對傳統童書的挑戰及其教育價值。出版界,56期,頁42-48。
    王又亭(2011)。以眼球追蹤方法初探高中生教科書之圖文閱讀歷程與概念理解。國立臺灣師範大學碩士論文,未出版,台北市。
    林珊如(2010)。數位時代的閱讀: 青少年網路閱讀的爭議與未來。圖書資訊學刊,2,29-53。
    臺灣PISA國家研究中心(2014)。臺灣PISA 2012精簡報告。取自:http://pisa.nutn.edu.tw/download/data/TaiwanPISA2012ShortReport.PDF

    英文部分
    Allen, J., & Gonzalez, K. (1998). There's room for me here. York, ME: Stenhouse Publishers.
    Bus, A. G., Van Ijzendoorn, M. H., & Pellegrini, A. D. (1995). Joint book reading makes for success in learning to read: A meta-analysis on intergenerational transmission of literacy. Review of educational research, 65(1), 1-21.
    Beccue, B., Vila, J., & Whitley, L. K. (2001). The effects of adding audio instructions to a multimedia computer based training environment. Journal of Educational Multimedia and Hypermedia, 10(1), 47-67.
    Canham, M., & Hegarty, M. (2010). Effects of knowledge and display design on comprehension of complex graphics. Learning and Instruction, 20(2), 155-166.
    Clark, R. C., Nguyen, F., & Sweller, J. (2011). Efficiency in learning: Evidence-based guidelines to manage cognitive load. Hoboken, NJ: John Wiley & Sons.
    Chou, M. J., & Cheng, J. C. (2015). Parent-Child Aesthetic Shared Reading with Young Children. Universal Journal of Educational Research, 3(11), 871-876.
    Doty, D. E., Popplewell, S. C., & Byers, G. O. (2001). Interactive CD-ROM storybooks and young readers’ reading comprehension. Journal of Research on Computing in Education, 33(4), 374-384.
    DesJardin, J. L., Ambrose, S. E., & Eisenberg, L. S. (2009). Literacy skills in children with cochlear implants: The importance of early oral language and joint storybook reading. Journal of Deaf Studies and Deaf Education, 14, 22-43.
    Evans, M. A., Shaw, D., & Bell, M. (2000). Home literacy experiences and their influence on early literacy skills. Canadian Journal of Experimental Psychology, 54, 65-75.
    Evans, M. A., & Saint-Aubin, J. (2005). What children are looking at during shared storybook reading Evidence from eye movement monitoring. Psychological Science, 16(11), 913-920.
    Evans, M. A., & Shaw, D. (2008). Home grown for reading: Parental contributions to young children’s emergent literacy and word recognition. Canadian Psychology, 49, 89-95.
    Fletcher, J., Greenwood, J., & Parkhill, F. (2010). Are schools meeting their clients' expectations? Parents voice their perceptions about children learning to read in schools today. Teaching and Teacher Education, 26(3), 438-446.
    Feathers, K. M., & Arya, P. (2015). Exploring Young Children's Use of Illustrations in a Picturebook. Language and Literacy, 17(1), 42.
    Glazer, J. I. (1997). Introduction to children’s literature (2nd Ed.). Upper Saddle River, NJ: Prentice-Hall.
    Gros, B. (2003). The impact of digital games in education. First Monday, 8(7), Retrieved March 8, 2008, from http://firstmondayorg/issues/issue8_7/gros/index.html
    Grimshaw, S., Dungworth, N., McKnight, C., & Morris, A. (2007). Electronic books: Children's reading and comprehension. British Journal of Educational Technology, 38(4), 583-599.
    Gillam, S. L., & Gillam, R. B. (2016). Narrative Discourse Intervention for School-Aged Children With Language Impairment: Supporting Knowledge in Language and Literacy. Topics in Language Disorders, 36(1), 20-34.
    Huey, E. (1908). The psychology and pedagogy of reading. Cambridge, MA: The MIT Press.
    Hegarty, M., & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32(6), 717-742.
    Hannus, M., & Hyönä, J. (1999). Utilization of illustrations during learning of science textbook passages among low- and high-ability children. Contemporary Educational Psychology, 24, 95-123.
    Hawkins, D. T. (2000). Electronic books: A major publishing revolution. General considerations and issues, 24(4), 14-28.
    Higham, S., Tonsing, K. M., & Alant, E. (2010). Teachers' interactions during storybook reading: A rural african perspective. Early Education and Development, 21, 392-411.
    Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013), A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Computers & Education, 69, 121-130.
    Iatsun, I., Larabi, M. C., & Fernandez-Maloigne, C. (2015). Investigation and modeling of visual fatigue caused by S3D content using eye-tracking. Displays, 39, 11-25.
    Johansson, G., & Backlund, F. (1960). A Versatile Eye-movement Recorder. Scandinavian journal of psychology, 1(1), 181-186.
    Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87, 329-354.
    de Jong, M. T., & Bus, A. G. (2003). How well suited are electronic books to supporting literacy?. Journal of Early Childhood Literacy, 3(2), 147-164.
    Justice, L. M., Kaderavek, J. N., Fan, X., Sofka, A., & Hunt, A. (2009). Accelerating preschoolers' early literacy development through classroom-based teacher–child storybook reading and explicit print referencing. Language, Speech, and Hearing Services in Schools, 40, 67-85.
    de Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2010). Attention guidance in learning from a complex animation: Seeing is understanding? Learning and Instruction, 20, 111-122.
    Kuo, A. A., Franke, T. M., Regalado, M., & Halfon, N. (2004). Parent report of reading to young children. Pediatrics, 113(5), 1944-1951.
    Korat, O. (2010). Reading electronic books as a support for vocabulary, story comprehension and word reading in kindergarten and first grade. Computers & Education, 55(1), 24-31.
    Korat, O., & Shamir, A. (2012). Direct and indirect teaching: Using e-books for supporting vocabulary, word reading, and story comprehension for young children. Journal of Educational Computing Research, 46(2), 135-152.
    Krejtz, I., Szarkowska, A., Krejtz, K., Walczak, A., & Duchowski, A. (2012, March). Audio description as an aural guide of children's visual attention: evidence from an eye-tracking study. In Proceedings of the symposium on eye tracking research and applications (pp. 99-106). ACM.
    Lewin, C. (1996). Improving talking book software design: Emulating the supportive tutor. Bradford, UK: Center for Information Technology in Education, The Open University.
    Lefever-Davis, S., & Pearman, C. (2005). Early readers and electronic texts: CD-ROM storybook features that influence reading behaviors. The Reading Teacher, 58(5), 446-454.
    Li, Z., & Mao, X. (2012). Emotional eye movement generation based on geneva emotion wheel for virtual agents. Journal of Visual Languages & Computing, 23(5), 299-310.
    Lai, M. L., Tsai, M. J., Yang, F. Y., Hsu, C. Y., Liu, T. C., Lee, S. W. Y., ... & Tsai, C. C. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, 90-115.
    Lin, C. C., & Wu, Y. C. (2013). The effects of different presentation modes of multimedia annotations on sentential listening comprehension. In L. H. Wong et al. (Eds.). Proceedings of the 21st international conference on computers in education. Indonesia: Asia-Pacific Society for Computers in Education.
    Mayer, R. (1993). Illustrations that instruct. In R. Glaser (Ed.), Advances in instructional psychology (vol. 40, pp 253-284). Hillsdale, NJ: Lawrence Erlbaum Associates.
    Mayer, R. E. (2001). Multimedia Learning. New York: Cambridge University press.
    Mayer, R. E. (2005). The Cambridge Handbook of Multimedia Learning. Cambridge: Cambridge University Press.
    Mayer, R. E. (2009). Multimedia Learning (2nd Ed.). New York: Cambridge University press.
    Mayer, R. E., & Sims, V. K. (1994). For whom is a picture worth a thousand words? Extensions of a dual coding theory of multimedia learning. Journal of Educational Psychology, 86(3), 389-401.
    Mousavi, S. Y., Low, R. & Sweller, J. (1995). Reducing Cognitive Load by Mixing Auditory and Visual Presentation Modes. Journal of Educational Psychology, 87(2), 319-334.
    Matthew, K. I. (1996). The impact of CD-ROM storybooks on children’s reading comprehension and reading attitude. Journal of Educational Multimedia and Hypermedia, 5(3), 379-394.
    Mckenna, M. C. (1998). Electronic texts and the transformation of beginning reading. In D. Reinking, M. Mckenna, L. D. Labbo, & R. Kieffer (Eds.), Handbook of literacy and technology: Transformations in a post-typographic world (pp.45-59). Mahwah, NJ: Erlabum.
    Maynard, S., Mcknight, C., & Keady, M. (1999). Children’s classics in the electronic medium. The Lion and The Unicorn, 23, 184-201.
    Moreno, R., & Mayer, R. E. (1999). Cognitive Prnciples of Multimedia Learning:The Role of Modality and Contiguity. Journal of Educational Psychology, 91(2), 358-368.
    Moreno, R., and Mayer, R.E. (2000). A Coherence Effect in Multimedia Learning: The Case for Minimizing Irrelevant Sounds in the Design of Multimedia Instructional Messages. Journal of Educational Psychology, 92(1), 117-125.
    Meili, H., & Qian, F. (2010). An Evaluation Research on Usability of Taobao's Homepage and Main Search Engine Based on Eye Tracking. InSystem Science, Engineering Design and Manufacturing Informatization (ICSEM), 2010 International Conference on (Vol. 2, pp. 23-26). IEEE
    Miyamoto, D., Blanc, G., & Kadobayashi, Y. (2015). Eye Can Tell: On the Correlation Between Eye Movement and Phishing Identification. In Arik, S., Huang, T., Lai, W., K., & Liu, Q (Eds), Neural Information Processing (pp. 223-232). Cham, Switzerland: Springer International Publishing. Doi: 10.1007/978-3-319-26555-1_26
    Nodelman, P. (1988). Words about pictures: The narrative art of children's picture books. Athens, GA: University of Georgia Press.
    Oller, J., & Tullius, J. (1973). Reading skills of non-native speakers of English. International Review of Applied Linguistics in Language and Teaching, 11(1), 69-79.
    Okolo, C., & Hayes, R. (1996). The impact of animation in CD-ROM books on student’s reading behaviors and comprehension. Retrieved from ERIC Document Reproduction Service NO. ED 395434.
    Osborn, S. (2001). Picture books for young adult readers. ALAN Review, 28(3), 24-26.
    Paivio, A. (1990). Mental representations: A dual coding approach: Oxford University Press, USA.
    Paas, F. G. W. C. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive load approach. Journal of Educational Psychology, 84(4), 429- 434.
    Pearman, C. J. (2008). Independent reading of CD-ROM storybooks: measuring comprehension with oral retellings. The Reading teacher, 61(8), 594-602.
    Pearman, C. J., & Chang, C. W. (2010). Scaffolding or distracting: CD-ROM storybooks and young readers. TechTrends, 54(4), 52-57.OECD (2015). Students, Computers and Learning: Making the Connection, PISA, Paris, France: OECD Publishing. Retrieved from http://dx.doi.org/10.1787/9789264239555-en
    Ratliff, F., & Riggs, L. A. (1950). Involuntary motions of the eye during monocular fixation. Journal of experimental psychology, 40(6), 687.
    Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological bulletin, 124(3), 372.
    Roy-Charland, A., Saint-Aubin, J., & Evans, M. A. (2007). Eye movements in shared book reading with children from kindergarten to grade 4. Reading and Writing, 20(9), 909-931.
    Sullivan, H. S. (1953). The interpersonal theory of psychiatry. New York: Norton.
    Shackel, B. (1960). Pilot study in electro-oculography. The British journal of ophthalmology, 44(2), 89.
    Sweller, J., Van Merrienboer, J. J., & Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educational psychology review, 10(3), 251-296..
    Shiratuddin, N., Hassan, S., & Landoni, M. (2003). A usability study for promoting eContent in higher education. Journal of Educational Technology & Society, 6(4), 112-124.
    Shamir, A., & Korat, O. (2006). How to Select CD‐ROM Storybooks for Young Children: The Teacher's Role. The Reading Teacher, 59(6), 532-543.
    Schliesman, M. (2007). Never Too Old: Picture Books to Share with Older Children and Teens. Cooperative Children's Book Center. Retrieved 2007, from https://ccbc.education.wisc.edu/books/detailListBooks.asp?idBookLists=259
    Schmidt-Weigand, F., Kohert, A., & Glowalla, U. (2010). A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction, 20(2), 100-110.
    Van Dijken, M. J., Bus, A. G., & de Jong, M. T. (2011). Open access to living books on the internet: A new chance to bridge the linguistic gap for at-risk preschoolers? European Journal of Special Needs Education, 26(3), 299-310.
    Wetzel, C. D., Radtke, P. H., & Stern, H. W. (1994). Instructional effectiveness of video media. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    Wang, Q., Yang, S., Liu, M., Cao, Z., & Ma, Q. (2014). An eye-tracking study of website complexity from cognitive load perspective. Decision support systems, 62, 1-10.
    Williams, K. E., Barrett, M. S., Welch, G. F., Abad, V., & Broughton, M. (2015). Associations between early shared music activities in the home and later child outcomes: Findings from the Longitudinal Study of Australian Children. Early Childhood Research Quarterly, 31, 113-124.
    Willoughby, D., Evans, M. A., & Nowak, S. (2015). Do ABC ebooks boost engagement and learning in preschoolers? An experimental study comparing ebooks with paper ABC and storybook controls. Computers & Education, 82, 107-117.
    Walczak, A. (2016). Foreign Language Class with Audio Description: A Case Study. In Researching Audio Description (pp. 187-204). Palgrave Macmillan UK.
    Zarrella, D. (2011). The Science of Social Timing Part 1: Social Networks. Kissmetrics. Retrieved Jun 16, 2011, from https://blog.kissmetrics.com/science-of-social-timing-1/

    QR CODE