簡易檢索 / 詳目顯示

研究生: 潘則文
Tse-wen Pan
論文名稱: 以眼動追蹤技術探討利用電子書學習西班牙語彙歷程與成效之研究
Using eye-tracking techniques to explore the learning process and achievement in reading Spanish vocabulary e-books
指導教授: 蔡孟蓉
Meng-Jung Tsai
口試委員: 楊芳瑩
Fang-Ying Yang
洪紹挺
Shao-Ting Hung
學位類別: 碩士
Master
系所名稱: 人文社會學院 - 數位學習與教育研究所
Graduate Institute of Digital Learning and Education
論文出版年: 2015
畢業學年度: 103
語文別: 中文
論文頁數: 80
中文關鍵詞: 認知歷程眼球運動文字提示電子書西班牙語靜態圖片動態圖片多媒體表徵學習成效
外文關鍵詞: text cuing, Spanish, graphic, multimedia representation, cognitive process
相關次數: 點閱:373下載:4
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 為了解中文輔助與圖片表徵(動/靜態圖片)對於成人閱讀西班牙語顏色詞彙電子書的認知歷程與學習成效之影響,並探討讀者閱讀時視覺注意力分布對學習成效的預測性,本研究以便利取樣方式選取20名大學以上、無西班牙語背景之成人做為實驗對象,以重複測量方式讓受試者閱讀四種圖文組合(2x2:中文輔助[有中文vs無中文] x圖片表徵[動態圖片vs靜態圖片])的電子書,並採用眼動追蹤技術與紙筆測驗分別檢驗學習者閱讀時的認知歷程與閱讀後的學習成效。研究中蒐集之眼動指標與後測成績使用描述性統計、相依樣本重複量數雙因子變異數分析、相依樣本重複量數單因子變異數分析、相依樣本t檢定、皮爾森相關分析、迴歸分析等統計等方法進行資料處理。研究結果發現,動態圖片顯著讓學習者獲得較佳的學習成效,此外,在有中文輔助搭配動態圖片組合的學習教材中,閱讀動態圖片之平均凝視時間越長可預測較佳的學習成效。有趣的是,學習者本身認為最容易學習的中文輔助靜態圖片組合教材反而得到最差的學習成效,同時學習者在有中文輔助的教材中雖然對西文投入較多注意力,但卻得到較差的學習成效,這些結果似乎顯示中文輔助學習西文可能干擾了學習者對西文在長期記憶的建構。本研究結果建議未來研究可針對其他詞彙類型進行更深入的認知歷程與學習成效探究,以提供教師、語言學習電子書之設計者與相關研究人員更完整的教學、設計與研究建議。


    This study aimed to explore the visual behaviors and the effects of native language cuing and graphic designs on learning Spanish vocabularies via E-book reading. A repeated measure experimental design of 20 participants was used in this study. Four types of representations (with or without Chinese cuing v.s. static or dynamic graphic) were randomly assigned to 20 Spanish vocabularies for each participant and all participants read the vocabularies in a random order. An eye-tracking system (ASL Mobile Eye) was used to track and record each participant’s eye fixations while reading the e-book. A comprehension test was examined as an immediate posttest and a delayed posttest. Repeated 2x2 ANOVAs with post-hoc comparisons, one-way ANOVAs, paired t-tests, Pearson’s correlation analyses and regression analyses were used for data analyses. The results revealed that dynamic graphics had a significant better impact on learners’ immediate posttest scores. In reading the vocabularies represented by dynamic graphics with Chinese cuing, it was found that the learners’ average fixation duration on the dynamic graphic area significantly and positively predicted their learning performance. Meanwhile, when reading the vocabularies with Chinese cuing, the learners who paid more visual attention on Spanish texts and had more inter-scanning counts between Spanish and Chinese texts tended to have lower posttest scores. It was interesting to find that the learners had significantly lower scores on the vocabularies with Chinese cuing and static graphics, however, this was reported by the learners as the easiest type of e-book designs to learn. In conclusion, the results suggested that the constructions of the Spanish vocabularies in long-term memory may have been interfered with the Chinese cuing provided in the E-book. And the dynamic graphic seems to be better than the static graphic for learning second foreign language via E-book reading. Future studies could further explore the possible influence of types of vocabularies to provide more insights and suggestions for language instructors, language E-book designers and researchers.

    第一章 緒論 1 第一節 研究背景與動機 1 第二節 研究目的 3 第三節 研究問題 3 第四節 名詞解釋 4 第二章 文獻探討 5 第一節 多媒體學習理論 5 一、 多媒體學習理論基礎 5 二、 多媒體學習的理論相關研究 8 三、 多媒體與電腦輔助語言學習 11 第二節 電子書學習相關研究 13 一、 電子書的定義、類別與特性 13 二、 電子書在學習上之相關研究 13 三、 電子書與語言學習之相關研究 15 第三節 眼動追蹤與認知歷程 17 一、 眼球運動研究基礎理論 17 二、 多媒體閱讀與眼動研究 19 第四節 小結 21 第三章 研究方法 22 第一節 研究架構 22 第二節 研究對象 23 第三節 研究工具 24 一、 背景問卷 24 二、 眼球運動追蹤系統 24 三、 西班牙文電子書學習成效測驗 25 四、 事後訪談 25 第四節 實驗素材 25 第五節 實驗流程 28 一、 第一階段:填寫實驗同意書與背景問卷 29 二、 第二階段:配戴眼動儀與眼球校正程序 29 三、 第三階段:閱讀多媒體電子書 29 四、 第四階段:立即後測、事後訪談與延宕後測 29 第六節 資料處理 30 一、 立即後測與延宕後測資料處理 30 二、 事後訪談資料處理 30 三、 眼動指標資料處理 30 第七節 資料分析 33 一、 描述性統計分析 33 二、 重複量數雙因子變異數分析 33 三、 重複量數單因子變異數分析 33 四、 成對樣本t檢定 33 五、 皮爾森相關分析與迴歸分析 33 第四章 研究結果 34 第一節 學習成效差異分析 34 一、 立即後測得分比較 35 二、 延宕後測得分比較 36 三、 自我陳述教材易學程度分析 38 第二節 視覺注意力分布差異分析 40 一、 頁面總閱讀時間差異分析 40 二、 西文區塊視覺注意力分布差異分析 41 三、 中文區塊視覺注意力分布差異分析 47 四、 動圖區塊視覺注意力分布差異分析 47 五、 靜圖區塊視覺注意力分布差異分析 48 六、 來回掃視次數分析 49 第三節 視覺注意力分布情形與學習成效關聯性 51 一、 中動組合與後測成績的相關性 51 二、 中靜組合與後測成績的相關性 51 三、 西動與後測成績的相關性 52 四、 西靜組合與後測成績的相關性 52 五、 來回掃視次數與後測成績的相關性 55 六、 中文輔助素材眼動指標相關性 56 第四節 視覺注意力分布對學習成效的預測性 58 一、 中動組合的動態圖片視覺注意力分布對學習成效的預測性 58 二、 中靜組合的西班牙文視覺注意力分布對延宕後測的預測性 59 第五章 結論與建議 60 第一節 結論與討論 60 一、 圖文組合對學習成效的影響 60 二、 圖文組合對視覺注意力分布的影響 62 三、 視覺注意力分布與學習成效間的關聯性 65 四、 視覺注意力分布對學習成效的預測性 66 五、 小結 66 第二節 建議 67 一、 對教材設計者與教師的建議 67 二、 對未來研究之建議 67 參考文獻 69 附錄一 背景問卷 75 附錄二 後測題目 77

    中文
    邱月玲、許良榮(2003)。不同的科學圖文配置對學生閱讀學習的影響-以「月相概念」為例。台中師院學報,17,283-310。
    英文
    Abraham, L. B. (2007). Second-language reading comprehension and vocabulary learning with multimedia. Hispania, 98-108.
    Anderson, J. R. (2010). Cognitive Psychology and Its Implications. New York: Worth Publishers.
    Baddeley, A. (1992). Working memory. Science, 255(5044), 556-559.
    Baek, Y. K., & Layne, B. H. (1988). Color, graphics, and animation in a computer-assisted learning tutorial lesson. Journal of computer-based instruction, 15, 131-135.
    Burk, R. (2001). E-book devices and the marketplace: in search of customers. Library Hi Tech, 19(4), 325-31.
    Boucheix, J. M., & Lowe, R. K. (2010). An eye tracking comparison of external pointing cues and internal continuous cues in learning with complex animations. Learning and instruction, 20(2), 123-135.
    Cagiltay, K., & Tekman, H. G. (2010). Change detection in desktop virtual environments: An eye-tracking study. Computers in human behavior, 26(6), 1305-1313.
    Cherry, E. C. (1953). Some experiments on the recognition of speech, with one and
    with two ears. The Journal of the acoustical society of America, 25(5), 975-979.
    Cox, A., Ormes, S., MOHAMMED, H., & KERR, M. (2001). E-books. Library & information briefings, (96), 1-14.
    de Koning, B. B., Tabbers, H. K., Rikers, R. M., & Paas, F. (2010). Attention guidance in learning from a complex animation: Seeing is understanding?. Learning and Instruction, 20(2), 111-122.
    Hoffler, T. N., & Leutner, D. (2007). Instructional animation versus static pictures: A meta-analysis. Learning and instruction, 17(6), 722-738.
    Holmqvist, K., Nystrom, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. London, England: Oxford University Press.
    Huang, H. C. (2013). E-reading and e-discussion: EFL learners' perceptions of an e-book reading program. Computer Assisted Language Learning, 26(3), 258-281.
    Huang, Y. M., Liang, T. H., Su, Y. N., & Chen, N. S. (2012). Empowering personalized learning with an interactive e-book learning system for elementary school students. Educational Technology Research and Development, 60(4), 703-722.
    Hyona, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20(2), 172-176.
    Jonides, J. (1983). Further towards a model of the mind's eye's movement. Bulletin of the Psychonomic Society, 21(4), 247-250.
    Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological review, 87, 329-354.
    Kang, Y. Y., Wang, M. J. J., & Lin, R. (2009). Usability evaluation of E-books. Displays, 30(2), 49-52.
    Kim, K., & Mundy, P. (2012). Joint attention, social-cognition, and recognition memory in adults. Frontiers in human neuroscience, 6, 172.
    Korat, O. (2010). Reading electronic books as a support for vocabulary, story comprehension and word reading in kindergarten and first grade. Computers & Education, 1(55), 24-31.
    Korat, O., & Shamir, A. (2004). Do Hebrew electronic books differ from Dutch electronic books? A replication of a Dutch content analysis. Journal of Computer Assisted Learning, 20(4), 257-268. doi: 10.1111/j.1365-2729.2004.00078.
    Korat, O., & Shamir, A. (2008). The educational electronic book as a tool for supporting children’s emergent literacy in low versus middle SES groups. Computers & Education, 50(1), 110-124.
    Korat, O., & Shamir, A. (2012). Direct and indirect teaching: Using e-books for supporting vocabulary, word reading, and story comprehension for young children. Journal of Educational Computing Research, 46(2), 135-152.
    Lai, J. Y., & Chang, C. Y. (2011). User attitudes toward dedicated e-book readers for reading: The effects of convenience, compatibility and media richness. Online Information Review, 35(4), 558-580.
    Lai, M. L., Tsai, M. J., Yang, F. Y., Hsu, C. Y., Liu, T. C., Lee, S. W. Y., ... & Tsai, C. C. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, 90-115.
    Lam, P., Lam, S.L., Lam, J. & McNaught, C. (2009). Usability and usefulness of eBooks on PPCs: How students' opinions vary over time. Australasian Journal of Educational Technology, 25(1), 30-44.
    Lenders, O. (2008). Electronic glossing–is it worth the effort? Computer Assisted Language Learning, 21(5), 457-481.
    Li, L. Y., Chen, G. D., & Yang, S. J. (2013). Construction of cognitive maps to improve e-book reading and navigation. Computers & Education, 60(1), 32-39.
    Liu, H. C., & Chuang, H. H. (2011). An examination of cognitive processing of multimedia information based on viewers' eye movements. Interactive Learning Environments, 19(5), 503-517.
    Loman, N. L., & Mayer, R. E. (1983). Signaling techniques that increase the understandability of expository prose. Journal of Educational Psychology, 75(3), 402.
    Mason, L., Pluchino, P. & Tornatora, M. C. (2013). Effects of picture labeling on science text processing and learning: Evidence from eye movements. Reading Research Quarterly, 48(2), 199-214.
    Mayer, R. (2009). Multimedia Learning. (2nd ed.). NY: Cambridge University Press.
    Naumann, J., Richter, T., Flender, J., Christmann, U., & Groeben, N. (2007). Signaling in expository hypertexts compensates for deficits in reading skill. Journal of Educational Psychology, 99(4), 791-807.
    Ozcelik, E., Karakus, T., Kursun, E., & Cagiltay, K. (2009). An eye-tracking study of how color coding affects multimedia learning. Computers & Education, 53(2), 445-453.
    Paivio, A. (1986). Mental representations: A dual coding approach. NY: Oxford University Press.
    Plass, J.L., Chun, D.M., Mayer, R.E. & Leutner, D. (1998). Supporting visual and verbal learning preferences in a second-language multimedia learning environment. Journal of Educational Psychology, 90(1), 25-36.
    Radach, R., & Kennedy, A. (2004). Theoretical perspectives on eye movements in reading: Past controversies, current issues, and an agenda for future research. European Journal of Cognitive Psychology, 16(1-2), 3-26.
    Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological bulletin, 124(3), 372.
    Raynor, M., & Iggulden, H. (2008). Online anatomy and physiology: piloting the use of an anatomy and physiology e-book–VLE hybrid in pre-registration and post-qualifying nursing programmes at the University of Salford. Health Information & Libraries Journal. 2(25), 98-105. doi: 10.1111/j.1471–1842.2007.00748.x.
    Rehder, B., & Hoffman, A. B. (2005). Eyetracking and selective attention in category learning. Cognitive Psychology, 51(1), 1-41.
    Rockinson-Szapkiw, A.J., Courduff, J., Carter, K. & Bennett, D. (2013). Electronic Versus Traditional Print Textbooks: A Comparison Study on the Influence of University Students’ Learning. Computers & Education, 63, 259-266. doi: 10.1016/j.compedu.2012.11.022 / CrossRef link
    Rose, E. (2011). The Phenomenology of On-screen Reading: University Students' Lived Experience of digitised text. British Journal of Educational Technology, 42(3), 515-526. doi: 10.1111/j.1467-8535.2009.01043.x.
    Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010). A closer look at split visual attention in system-and self-paced instruction in multimedia learning. Learning and Instruction, 20(2), 100-110.
    Shamir, A., Korat, O., & Barbi, N. (2008). The effects of CD-ROM storybook reading on low SES kindergarteners’ emergent literacy as a function of learning context. Computers & Education, 51(1), 354-367.
    Shih, B. Y., Chen, T. H., Cheng, M. H., Chen, C. Y., & Chen, B. W. (2013). How to manipulate interactive E-book on learning natural catastrophe—An example of structural mechanics using power machine. Natural hazards, 65(3), 1637-1652.
    Smeets, D. J. H., & Bus, A. G. (2012). Interactive electronic storybooks for kindergartners to promote vocabulary growth. Journal of Experimental Child Psychology, 1(112), 36-55.
    Stirling, A., & Birt, J. (2013) An Enriched Multimedia eBook Application to Facilitate Learning of Anatomy. Anatomical Sciences Education, 1(7), 19-27. doi: 10.1002/ase.1373.
    Vassiliou, M., & Rowley, J. (2008). Progressing the definition of “e-book”. Library Hi Tech, 26(3), 355-368.
    Wong, A., Marcus, N., Ayres, P., Smith, L., Cooper, G. A., Paas, F., & Sweller, J. (2009). Instructional animations can be superior to statics when learning human motor skills. Computers in Human Behavior, 25(2), 339-347.
    Woody, W. D., Daniel, D. B., & Baker, C. A. (2010). E-books or textbooks: Students prefer textbooks. Computers & Education, 55(3), 945-948.

    無法下載圖示 全文公開日期 2020/02/09 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)
    全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
    QR CODE