簡易檢索 / 詳目顯示

研究生: 林以婷
I-Ting Lin
論文名稱: 以影片字幕學習英語詞彙:探究字幕類型與工作記憶容量之影響
Learning English Vocabulary with Captioned Videos: The Roles of Captioning Types and Working Memory Capacity
指導教授: 謝育芬
Yu-Fen Hsieh
口試委員: 鄧慧君
Hui-Chun Teng
劉彩秀
Tsai-Hsiu Liu
學位類別: 碩士
Master
系所名稱: 人文社會學院 - 應用外語系
Department of Applied Foreign Languages
論文出版年: 2020
畢業學年度: 108
語文別: 英文
論文頁數: 85
中文關鍵詞: 字幕影片工作記憶英語詞彙學習
外文關鍵詞: Video captioning, Working Memory Capacity, Vocabulary learning
相關次數: 點閱:387下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

本研究旨在探討影片字幕類型與工作記憶容量對於台灣大學生英文詞彙學習之效用。受試者為80名台灣北部大學生且皆為中文母語人士,其英語程度為中低級(多益成績介於400到550分)。字幕影片之呈現模式為下列四種之一,包含:(1)無字幕,(2)完整字幕,(3)完整字幕附帶重點字標示,(4)完整字幕附帶重點字標示及第一語言註釋。受試者於實驗第一階段接受工作記憶(OSPAN) 測驗,根據受試結果將80名受試者分為高工作記憶組(42人)及低工作記憶組(38人)。實驗第二階段將兩組受試者隨機分配到其中一種字幕模式中,並觀看其字幕模式之兩部影片各兩次,觀看過程中不得筆記、暫停或回放。影片觀看結束後,依序完成聽力理解測驗及三項詞彙測驗(包含詞形辨識、詞義辨識、詞義回想)。研究結果顯示,字幕呈現方式顯著影響詞彙學習成果。根據量化分析結果,在詞形辨識測驗中,完整字幕附帶重點字標示組及完整字幕加註第一語言註釋組表現顯著優於控制組。而在詞義辨識及詞義回想測驗中,加註第一語言註釋組得分最高且顯著優於其他三組,表示第一語言註釋對於三方面的詞彙學習幫助最大,並有助強化新詞學習時詞形和詞意之連結。在工作記憶及其與字幕類型之交互作用方面,本研究結果顯示,高、低工作記憶組間無顯著差異,且未有顯著交互作用效果。然而透過仔細觀察受試者的平均分數發現,低工作記憶組將注意力集中於詞型多過詞義,而高工作記憶組使用第一語言註釋學習新詞的能力較佳。


Audiovisual material has been an effective pedagogical tool for vocabulary acquisition and could be enhanced by different types of captions. Though positive captioning effects on vocabulary learning have been revealed, definite conclusion of the effectiveness of newly designed types of captions (e.g. captioning with L1 gloss) on the learning of different types of vocabulary knowledge (e.g. meaning recognition or meaning recall) cannot yet to be drawn due to limited and inconclusive research results. Besides, learner’s individual difference such as working memory capacity is less studied but might impact on captioning effects. Thus, the current study aims to examine the effects of captioning and working memory capacity on learner’s vocabulary learning. 80 Taiwanese college EFL students of low-intermediate level of English proficiency were recruited to complete working memory (OSPAN) test. Based on the OSPAN results, participants were divided into two groups, including high-span group (N=42) and low-span group (N=38) to join the video captioning experiment. Two videos with four different captioning types: (1) no caption (NC), (2) full caption (FC), (3) full caption with highlighted target-word (FCHTW), and (4) full caption with highlighted target-word and L1 gloss (FCL1) were presented, and all participants were randomly assigned to one of the four conditions. After watching each video twice, participants completed one listening comprehension test and three vocabulary tests testing three aspects of vocabulary learning (i.e., form recognition, meaning recognition, and meaning recall) for each video.
Two-way multivariate analysis of covariance (MANCOVA) was used to analyze the effects of video captioning types as well as individual’s working memory capacity on Taiwanese EFL learners’ vocabulary learning. The results showed that caption types significantly affected learners’ vocabulary gains in all three aspects of vocabulary learning. In terms of form recognition, FCL1 and FCHTW group significantly outscored the NC group. As for the learning of word meanings, FCL1 group performed significantly better than all the other groups. However, though learners’ differences in WMC showed no significant effect on their vocabulary learning, and the interaction effects of caption types and working memory capacity on vocabulary gains was not statistically found as well, it was observed that low-span learners seemed to allocate their attention more to the word form while high-span learners were better able to use L1 gloss to learn the word meanings.

ABSTRACT (Chinese) ABSTRACT Acknowledgement Table of Contents List of Figures List of Tables CHAPTER ONE: INTRODUCTION 1.1 Background and Motivation 1.2 Purpose of the Study and Research Questions 1.3 Definition of Terms 1.4 Significance of the Study 1.5 Organization of the Study CHAPTER TWO: LITERATURE REVIEW 2.1 Captioning Effects on Vocabulary Learning 2.2 Working Memory Capacity CHAPTER THREE: METHODOLOGY 3.1 Participants 3.2 Materials 3.2.1 Videos 3.3 Instruments 3.3.1 Working Memory Test 3.3.2 Comprehension Tests (Refer to Appendix A) 3.3.3 Vocabulary Tests (Refer to Appendix B, C and, D) 3.4 Procedure 3.5 Data Analysis CHAPTER FOUR: RESULTS 4.1 Vocabulary Tests 4.1.1 Form Recognition 4.1.2 Meaning Recognition 4.1.3 Meaning Recall 4.2 Working Memory Capacity 4.3 Results of Interactive Effects between Caption Types and WMC CHAPTER FIVE: DISSCUSSION AND CONCLUSION 5.1 Summary of the Study 5.2 Discussions of the Major Findings 5.2.1 Research Question 1 5.2.2 Research Question 2 5.2.3 Research Question 3 5.3 Pedagogical Implications 5.4 Limitations and Suggestions 5.5 Conclusion REFERENCES Appendices Appendix A: Comprehension Test Appendix B: Vocabulary test: Form recognition Appendix C: Vocabulary test: Meaning recognition Appendix D: Vocabulary test: Meaning recall

Aldera, A. S., & Mohsen, M. A. (2013). Annotations in captioned animation: Effects on vocabulary learning and listening skills. Computers & Education, 68, 60–75.
Al-Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5(1), 202–232.
Baddeley, A. D., & Hitch, G. (1974). Working Memory. Psychology of Learning and Motivation, 47–89. doi:10.1016/s0079-7421(08)60452-1 
Bajrami, L., & Ismaili, M. (2016). The role of video materials in EFL classrooms. Procedia-Social and Behavioral Sciences, 232, 502–506.
Baltova, I. (1999). Multisensory language teaching in a multidimensional curriculum: The use of authentic bimodal video in core French. Canadian Modern Language Review, 56(1), 31–48.
Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics, 23(04), 509–533.
Brett, P. (1995). Multimedia for listening comprehension: The design of a multimedia-based resource for developing listening skills. System, 23(1), 77–85.
Brinton, D. (2001). The use of media in language teaching. In M. Celce-Murcia (Ed.), Teaching English as a second or foreign language (pp. 459–476). Boston, MA: Heinle & Heinle.
Chen, Y. R., Liu, Y. T., & Todd, A. G. (2018). Transient but effective? Captioning and adolescent EFL learners’ spoken vocabulary acquisition. English Teaching & Learning, 42(1), 25–56.
Chun, D. M., & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary acquisition. The Modern Language Journal, 80, 183–197.
Cowan, N. (2008) What are the differences between long-term, short-term, and working memory?. Progress in Brain Research, 169, 323–338. https:// doi.org/10/1016/S0079-6123(07)00020-9.
Danan, M. (1992). Reversed subtitling and dual coding theory: New directions for foreign language instruction. Language learning, 42(4), 497–527.
Danan, M. (2004). Captioning and subtitling: Undervalued language learning strategies. Meta: Journal des traducteurs/Meta: Translators' Journal, 49(1), 67–77.
Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Memory and Language, 19(4), 450.
Daneman, M., & Merikle, P. M. (1996). Working memory and language comprehension: A meta-analysis. Psychonomic Bulletin & Review, 3(4), 422–433.
Engle, R.W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11, 19–23.
Guillory, H. G. (1998). The effects of keyword captions to authentic French video on learner comprehension. CALICO Journal, 15(1-3), 89–108.
Hazrat, M. (2015). The roles of working memory components in vocabulary knowledge. International Journal of English Language and Literature Studies, 4(2), 58–67.
Hsieh, Y. (2019). Effects of video captioning on EFL vocabulary learning and listening comprehension. Computer Assisted Language Learning, 1–23. DOI: 10.1080/09588221.2019.1577898
Hsu, C. K., Hwang, G. J., Chang, Y. T., & Chang, C. K. (2013). Effects of video caption modes on English listening comprehension and vocabulary acquisition using handheld devices. Journal of Educational Technology & Society, 16(1), 403–414.
Hu, C. F. (2003). Phonological memory, phonological awareness, and foreign language word learning. Language learning, 53(3), 429–462.
Huang, P. W. (2020) A Meta-analytic Investigation of the Effects of Captioned Video on Vocabulary Learning: An Update (Master Thesis, National Taiwan University of Science and Technology, Taipei, Taiwan).
Hui, W. (2007). The effects of captions on Chinese EFL students’ incidental vocabulary acquisition. Media in Foreign Language Instruction, 30(4), 9–16.
Hulstijn, J. H. (2001). Intentional and incidental second language vocabulary learning: A reappraisal of elaboration, rehearsal and automaticity. In P. Robinson (Ed.), Cognition and second language instruction (pp. 258–286). Cambridge: Cambridge University Press.
Ibarra Santacruz, D., & Martínez Ortega, D. (2018) Can Working Memory Strategies Enhance English Vocabulary Learning? How, 25(2), 29–47.
Jones, L. (2003). Supporting listening comprehension and vocabulary acquisition with multimedia annotations: The students’ voice. CALICO Journal, 21(1), 41–65.
Jones, L., & Plass, J. L. (2002). Supporting listening comprehension and vocabulary acquisition with multimedia annotations. The Modern Language Journal, 86, 546–561.
Linck, J. A., Osthus, P., Koeth, J. T., & Bunting, M. F. (2014). Working memory and second language comprehension and production: A meta-analysis. Psychonomic bulletin & review, 21(4), 861–883.
Liu, N., & Nation, I. P. (1985). Factors affecting guessing vocabulary in context. RELC journal, 16(1), 33–42.
Lwo, L., & Lin, M. C. T. (2012). The effects of captions in teenagers’ multimedia L2 learning. ReCALL, 24(2), 188–208.
Markham, P. (1999). Captioned videotapes and second-language listening word recognition. Foreign Language Annals, 32(3), 321–328.
Martin, K. I., & Ellis, N. C. (2012). The roles of phonological short-term memory and working memory in L2 grammar and vocabulary learning. Studies in Second Language Acquisition, 34(3), 379–413.
Matielo, R., Oliveira, R. P. D., & Baretta, L. (2018). Subtitling, Working Memory, and L2 Learning: A Correlational Study. Revista Brasileira de Linguística Aplicada, 18(3), 665–696.
Mayer, R. E. (2005). The Cambridge handbook of multimedia learning. New York, NY: Cambridge University Press.
Mayer, R. E.(Ed.). (2014). The Cambridge handbook of multimedia learning. New York: Cambridge University Press.
Miller, G. A., Galanter, E., & Pribram, K. H. (1960). Plans and the structure of behavior. Henry Holt and Co. https://doi.org/10.1037/10039-000
Montero Perez, M., Peters, E., & Desmet, P. (2018). Vocabulary learning through viewing video: the effect of two enhancement techniques. Computer Assisted Language Learning, 31(1-2), 1–26.
Montero Perez, M., Peters, E., Clarebout, G., & Desmet, P. (2014). Effects of captioning on video comprehension and incidental vocabulary learning. Language Learning and Technology, 18(1), 118–141.
Montero Perez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739.
Nation, I. S. P. (1990). Teaching and Learning Vocabulary. New York: Newbury House.
Neuman, S. B., & Koskinen, P. (1992). Captioned television as comprehensible input: Effects of incidental word learning from context for language minority students. Reading Research Quarterly, 27(1), 95–106.
Paivio, A. (2007). Mind and its evolution: A dual coding theoretical approach. Mahwah, NJ: Erlbaum.
Park, M. (2004). The Effects of Paritial Captions on Korean EFL Learners’ Listening Comprehension. Unpublished doctoral dissertation. University of Texas at Austin.
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (1998). Supporting visual and verbal learning preferences in a second language multimedia learning environment. Journal of Educational Psychology, 90, 25–36.
Plass, J., & Jones, L. (2005). Multimedia learning in second language acquisition. In R. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 467–488). New York: Cambridge University Press.
Rodgers, M. P. H., & Webb, S. (2017). The effects of captions on EFL learners’ comprehension of English –language television programs. CALICO Journal, 34(1), 20–38.
Schmitt, N. (2008) Instructed second language vocabulary learning. Language Teaching Research, 12(3), 329–363.
Schneider, W. J., & McGrew, K. S. (2012). The Cattell-Horn-Carroll model of intelligence. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, Tests, and Issues (p. 99–144). The Guilford Press.
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive science, 12(2), 257–285.
Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. The Cambridge Handbook of Multimedia Learning, 3(2), 19–30.
Sydorenko, T. (2010). Modality of input and vocabulary acquisition. Language Learning & Technology, 14(2), 50–73.
Teng, F. (2018). Incidental vocabulary learning for primary school students: The effects of L2 caption type and word exposure frequency. The Australian Educational Researcher,46(1), 113–136.
Unsworth, N., Heitz, R. P., Schrock, J. C., & Engle, R. W. (2005). An automated version of the operation span task. Behavior Research Methods, 37(3), 498–505.
Winke, P., Gass, S., & Syodorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86.
Yeldham, M. (2018). Viewing L2 captioned videos: what's in it for the listener?. Computer Assisted Language Learning, 31(4), 367–389.

無法下載圖示 全文公開日期 2025/08/18 (校內網路)
全文公開日期 本全文未授權公開 (校外網路)
全文公開日期 本全文未授權公開 (國家圖書館:臺灣博碩士論文系統)
QR CODE