研究生: |
李燕芬 Yen-Fen Lee |
---|---|
論文名稱: |
基於聊天機器人回饋機制的自律學習模式對學習成績、學習動機、學習態度、自律表現、反思、後設認知察覺傾向的影響 Effects of chatbot-assisted self-regulated learning on learning achievement, motivation, learning attitudes, self-regulated learning performance, reflection, and meta-cognition tendency |
指導教授: |
黃國禎
Gwo-Jen Hwang |
口試委員: |
楊接期
Jie-Chi Yang 楊凱翔 YANG, KAI-HSIANG 許庭嘉 Hsu, Ting-Chia 王淑玲 Shu-Ling Wan |
學位類別: |
博士 Doctor |
系所名稱: |
應用科技學院 - 應用科技研究所 Graduate Institute of Applied Science and Technology |
論文出版年: | 2022 |
畢業學年度: | 110 |
語文別: | 中文 |
論文頁數: | 75 |
中文關鍵詞: | 自律學習 、回饋策略 、聊天機器人 、反思 、後設認知 |
外文關鍵詞: | Self-regulated learning, feedback strategies, chatbots, reflection, meta-cognition |
相關次數: | 點閱:486 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
自律學習是一種學習方法;學習者透過設定目標與計劃,策略的實行與監控,和對結果進行反思與評價的循環模式,來改善學習成效。因此,如何幫助學生培養自律學習能力,已成為重要的議題。在自律學習循環中,學生個人的反思品質是自律學習表現及改善學習成果的關鍵因素;而教師提供的回饋往往對於學生的反思品質有很大的影響。然而,研究指出,教師經常面對眾多學生,無法給予個別的回饋。為了解決這個問題,本研究提出基於聊天機器人回饋機制的自律學習模式,在自律學習過程中,提供個人即時回饋,來促進學生的反思品質。因此,本研究嘗試開發基於聊天機器人回饋機制的自律學習模式,為了探討這個系統的成效,本研究將這個模式應用於多媒體導論課程之「網站製作」單元進行。參與實驗的對象為大學二年級學生,共 47名學生,所有參與實驗的學生來自同一個班級。實驗組由23名學生組成,並採用基於聊天機器人輔助自律學習模式進行學習;另外,控制組由24名學生組成,並採用一般自律學習模式進行學習。由實驗結果顯示,基於聊天機器人回饋機制的自律學習模式,有助於提升學生的作品實作成績、學習動機、自律表現、反思、後設認知察覺傾向。
Self-regulated learning is an approach to learning in which learners improve their learning outcomes through a cycle of setting goals and plans, implementing and monitoring strategies, and reflecting on and evaluating results. Therefore, it's an important issue to help students develop self-regulated learning skills. In the SRL cycle, the quality of students' reflections is a critical factor in SRL performance and improved learning outcomes. The feedback provided by teachers often has a significant impact on the quality of students' thoughts. However, research has shown that teachers are often confronted with many students and cannot give individual feedback. For this problem, this study proposes self-regulated learning with a chatbot-guided feedback mechanism, which provides personal and immediate feedback during the self-regulated learning process to promote the quality of students' reflection. This study applied the model to the "Website Design" module of the Introduction to Multimedia course. A total of 47 students, all from the same class, were enrolled in the experiment as second-year university students. The experimental group consisted of 23 students who learned using the Self-regulated learning with a chatbot-guided feedback mechanism. The control group consisted of 24 students who knew using the conventional self-regulated learning. The experiment results showed that the self-regulatory learning mode based on the feedback mechanism of the chatbots helped improve students' performance, motivation, self-regulatory performance, reflection, and meta-cognition tendency.
Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207-210. doi: 10.1016/j.chb.2019.03.025
Azevedo, R., Moos, D. C., Greene, J. A., Winters, F. I., & Cromley, J. G. (2008). Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?. Educational Technology Research and Development, 56(1), 45-72. doi:10.1007/s11423-007-9067-0
Bandura, A., & Jourden, F. J. (1991). Self-regulatory mechanisms governing the impact of social comparison on complex decision making. Journal of personality and social psychology, 60(6), 941.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213–238. doi: 10.3102/00346543061002213.
Bardach, L., Klassen, R. M., Durksen, T. L., Rushby, J. V., Bostwick, K. C., & Sheridan, L. (2021). The power of feedback and reflection: Testing an online scenario-based learning intervention for student teachers. Computers & Education, 169, 104194. doi:10.1016/j.compedu.2021.104194
Barnard, L., Lan, W. Y., To, Y. M., Paton, V. O., & Lai, S. L. (2009). Measuring self-regulation in online and blended learning environments. The internet and higher education, 12(1), 1-6. doi:10.1016/j.iheduc.2008.10.005
Belski, R., & Belski, I. (2014). Cultivating student skills in self-regulated learning through evaluation of task complexity. Teaching in Higher Education, 19(5), 459-469. doi:10.1080/13562517.2014.880685
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in education: principles, policy & practice, 18(1), 5-25.
Bhargava, M., Varshney, R., & Anita, R. (2020). Emotionally intelligent chatbot for mental healthcare and suicide prevention. International Journal of Advanced Science and Technology, 29(6), 2597-2605.
Bii, P., Too, J., & Mukwa, C. (2018). Teacher Attitude towards Use of Chatbots in Routine Teaching. Universal Journal of Educational Research, 6(7), 1586-1597. doi:10.13189/ujer.2018.060719
Broadbent, J., Panadero, E., & Fuller-Tyszkiewicz, M. (2020). Effects of mobile-app learning diaries vs online training on specific self-regulated learning components. Educational Technology Research and Development, 68, 2351-2372. doi:10.1007/s11423-020-09781-6
Brown, G. T., Peterson, E. R., & Yao, E. S. (2016). Student conceptions of feedback: Impact on self‐regulation, self‐efficacy, and academic achievement. British Journal of Educational Psychology, 86(4), 606-629. doi:10.1111/bjep.12126
Bui, T., & Loebbecke, C. (1996). Supporting cognitive feedback using system dynamics: a demand model of the global system of mobile telecommunication. Decision Support Systems, 17(2), 83-98. doi:10.1016/0167-9236(95)00017-8
Butler, D., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281. doi:10.3102/00346543065003245
Cho, V., Mansfield, K. C., & Claughton, J. (2020). The past and future technology in classroom management and school discipline: A systematic review. Teaching and Teacher Education, 90, 103037. doi:10.1016/j.tate.2020.103037
Cohen, J. (1960). Kappa: Coefficient of concordance. Educ Psych Measurement, 20(37), 37-46.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of applied psychology, 78(1), 98.
Chang, C. Y., Hwang, G. J., & Gau, M. L. (2022). Promoting students' learning achievement and self‐efficacy: A mobile chatbot approach for nursing training. British Journal of Educational Technology, 53(1), 171-188. doi:10.1111/bjet.13158
Chen, X., Xie, H., & Hwang, G. J. (2020). A multi-perspective study on artificial intelligence in education: Grants, conferences, journals, software tools, institutions, and researchers. Computers and Education: Artificial Intelligence, 1, 100005. doi:10.1016/j.caeai.2020.100005
Chen, X., Xie, H., Zou, D., & Hwang, G. J. (2020). Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence, 1, 100002. doi: 10.1016/j.caeai.2021.100033
Chen, Y. L., & Hsu, C. C. (2020). Self-regulated mobile game-based English learning in a virtual reality environment. Computers & Education, 154, 1039. doi:10. 10.1016/j.compedu.2020.103910
D’Silva, G., Jani, M., Jadhav, V., Bhoir, A., Amin, P., Vasudevan, H., ... & Narvekar, M. (2020). Career Counselling Chatbot Using Cognitive Science and Artificial Intelligence. In Advanced Computing Technologies and Applications (pp. 1-9). Springer
Durall, E., & Kapros, E. (2020). Co-design for a competency self-assessment chatbot and survey in science education. In International Conference on Human-Computer Interaction (pp. 13-24). Springer, Cham.
Ellis, S., Carette, B., Anseel, F., & Lievens, F. (2014). Systematic reflection: Implications for learning from failures and successes. Current Directions in Psychological Science, 23(1), 67–72. doi:10.1177/0963721413504106
Epstein, J., & Klinkenberg, W. D. (2001). From Eliza to Internet: A brief history of computerized assessment. Computers in human behavior, 17(3), 295-314. doi:10.1016/S0747-5632(01)00004-8
Fraile, J., Panadero, E., & Pardo, R. (2017). Co-creating rubrics: The effects on self-regulated learning, self-efficacy and performance of establishing assessment criteria with students. Studies in Educational Evaluation, 53, 69-76. doi:10.1016/j.stueduc.2017.03.003
Fryer, L. K., Nakao, K., & Thompson, A. (2019). Chatbot learning partners: Connecting learning experiences, interest and competence. Computers in Human Behavior, 93, 279-289. doi:10.1016/j.chb.2018.12.023
Grant, C. & Zeichner, K. (1984). On Becoming a Reflective Teacher. In C. Grant (Ed.), Preparing for reflective teaching. Boston: Allyn and Bacon.
Higgins, R., Hartley, P., & Skelton, A. (2001). Getting the message across: the problem of communicating assessment feedback. Teaching in higher education, 6(2), 269-274. doi:10.1080/13562510120045230
Honicke, T., & Broadbent, J. (2016). The influence of academic self-efficacy on academic performance: A systematic review. Educational Research Review, 17, 63-84. doi:10.1016/j.edurev.2015.11.002
Hwang, G. J., Xie, H., Wah, B. W., & Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1, 100001. doi:10.1016/j.caeai.2020.100001
Hwang, G. J., Yang, T. C., Tsai, C. C., & Yang, Stephen J. H. (2009). A context-aware ubiquitous learning environment for conducting complex science experiments. Computers & Education, 53(2), 402-413. doi:10.1016/j.compedu.2009.02.016
Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013), A concept map-embedded educational computer game for improving students’ learning performance in natural science courses, Computers & Education, 69, 121-130. doi:10.1016/j.compedu.2013.07.008
Jenson, J. D. (2011). Promoting Self-Regulation and Critical Reflection through Writing Students' Use of Electronic Portfolio. International Journal of ePortfolio, 1(1), 49-60.
Jonsson, A. (2013). Facilitating productive use of feedback in higher education. Active learning in higher education, 14(1), 63-76.
Kember, D., Leung, D. Y., Jones, A., Loke, A. Y., McKay, J., Sinclair, K., ... & Yeung, E. (2000). Development of a questionnaire to measure the level of reflective thinking. Assessment & evaluation in higher education, 25(4), doi:381-395. 10.1080/713611442
Khlaisang, J. (2017). Proposing a new pedagogy-based website design: A usability test with lifelong learners. Education and Information Technologies, 22(4), 1713-1735. doi:10.1007/s10639-016-9514-9
Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017). Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Computers & education, 104, 18-33.
Kitsantas, A. (2002). Test preparation and performance: A self-regulatory analysis. The journal of experimental education, 70(2), 101-113. doi:10.1080/00220970209599501
Kostons, D., Van Gog, T., & Paas, F. (2012). Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning. Learning and instruction, 22(2), 121-132. doi:10.1016/j.learninstruc.2011.08.004
Kuhl, J. (1984). Volitional aspects of achievement motivation and learned helplessness: Toward a comprehensive theory of action control. In Progress in experimental personality research (Vol. 13, pp. 99-171).
Lai, C. L., & Hwang, G. J. (2014). Effects of mobile learning time on students’ conception of collaboration, communication, complex problem-solving, meta-cognitive awareness and creativity. International Journal of Mobile Learning and Organisation, 8(3), 276-291.
Lai, C. L., & Hwang, G. J. (2016). A self-regulated flipped classroom approach to improving students’ learning performance in a mathematics course. Computers & Education, 100, 126-140. doi: 10.1016/j.compedu.2016.05.006
Leenknecht, M., Wijnia, L., Köhlen, M., Fryer, L., Rikers, R., & Loyens, S. (2021). Formative assessment as practice: the role of students’ motivation. Assessment & Evaluation in Higher Education, 46(2), 236-255. doi:10.1080/02602938.2020.1765228
Leris, D., Sein-Echaluce, M. L., Hernández, M., & Bueno, C. (2017). Validation of indicators for implementing an adaptive platform for MOOCs. Computers in Human Behavior, 72, 783-795.
Limone, P., Sinatra, M., Ceglie, F., & Monacis, L. (2020). Examining procrastination among university students through the lens of the self-regulated learning model. Behavioral Sciences, 10(12), 184. doi:10.3390/bs10120184
Lin, M. P. C., & Chang, D. (2020). Enhancing Post-secondary Writers’ Writing Skills with a Chatbot. Journal of Educational Technology & Society, 23(1), 78-92.
Lu, H., & Wang, Y. (2022). The effects of different interventions on self-regulated learning of pre-service teachers in a blended academic course. Computers & Education, 180, 104444. doi:10.1016/j.compedu.2022.104444
Mackey, T. P., & Ho, J. (2008). Exploring the relationships between Web usability and students’ perceived learning in Web-based multimedia (WBMM) tutorials. Computers & Education, 50(1), 386-409. doi:10.1016/j.compedu.2006.08.006
Masui, C., & De Corte, E. (2005). Learning to reflect and to attribute constructively as basic components of self‐regulated learning. British Journal of Educational Psychology, 75(3), 351-372. doi:10.1348/000709905X25030
Moriuchi, E., Landers, V. M., Colton, D., & Hair, N. (2021). Engagement with chatbots versus augmented reality interactive technology in e-commerce. Journal of Strategic Marketing, 29(5), 375-389. doi:10.1080/0965254X.2020.1740766
Nguyen, L. T., & Ikeda, M. (2015). The effects of ePortfolio-based learning model on student self-regulated learning. Active Learning in Higher Education, 16(3), 197-209. doi:10.1177/1469787415589532
Nicol, D. J., & Macfarlane‐Dick, D. (2006). Formative assessment and self‐regulated learning: A model and seven principles of good feedback practice. Studies in higher education, 31(2), 199-218. doi:10.1080/03075070600572090
Nückles, M., Hübner, S., & Renkl, A. (2009). Enhancing self-regulated learning by writing learning protocols. Learning and instruction, 19(3), 259-271. doi:10.1016/j.learninstruc.2008.05.002
Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: a systematic review. Computers and Education: Artificial Intelligence, 2, 100033.
Paans, C., Molenaar, I., Segers, E., & Verhoeven, L. (2019). Temporal variation in children's self-regulated hypermedia learning. Computers in Human Behavior, 96, 246-258. doi:10.1016/j.chb.2018.04.002
Pallud, J., & Straub, D. W. (2014). Effective website design for experience-influenced environments: The case of high culture museums. Information & Management, 51(3), 359-373. doi:10.1016/j.im.2014.02.010
Panadero, E., Brown, G. T., & Strijbos, J. W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational psychology review, 28(4), 803-830.
Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in psychology, 8, 422. doi.org/10.3389/fpsyg.2017.00422
Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22, 74-98. doi:10.1016/j.edurev.2017.08.004
Paschoal, L. N., de Oliveira, M. M., & Chicon, P. M. M. (2018). A chatterbot sensitive to student's context to help on software engineering education. In 2018 XLIV Latin American Computer Conference (CLEI) (pp. 839-848). IEEE.
Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of educational psychology, 82(1), 33. doi:10.1037/0022-0663.82.1.33
Pintrich, P.R., Smith, D.A.F., Garcia, T., & McKeachie, W.J. (1991). A manual for the use of the motivated strategies for learning questionnaire (MSLQ). MI: National Center for Research to Improve Postsecondary Teaching and Learning. (ERIC Document Reproduction Service No. ED 338122)
Pintrich, P. R., & Schunk, D. H. (2002). Motivation in education: Theory, research, and applications (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.
Rajaobelina, L., & Ricard, L. (2021). Classifying potential users of live chat services and chatbots. Journal of Financial Services Marketing, 26(2), 81-94.
Reese-Durham, N. (2005). Peer evaluation as an active learning technique. Journal of Instructional Psychology, 32(4), 328–345.
Rhim, J., Kwak, M., Gong, Y., & Gweon, G. (2022). Application of humanization to survey chatbots: Change in chatbot perception, interaction experience, and survey data quality. Computers in Human Behavior, 126, 107034. doi:10.1016/j.chb.2021.107034
Roblyer, M. D., McDaniel, M., Webb, M., Herman, J., & Witty, J. V. (2010). Findings on Facebook in higher education: A comparison of college faculty and student uses and perceptions of social networking sites. The Internet and higher education, 13(3), 134-140. doi:10.1016/j.iheduc.2010.03.002
Schunk, D. H. (1989). Attributions and Perceptions of Efficacy during Self-Regulated Learning by Remedial Readers. Paper presented at the Annual Meeting of the American Educational Research Association.
Schweisfurth, M. (2015). Learner-centred pedagogy: Towards a post-2015 agenda for teaching and learning. International Journal of Educational Development, 40, 259-266. doi:10.1016/j.ijedudev.2014.10.011
Sheehan, B., Jin, H. S., & Gottlieb, U. (2020). Customer service chatbots: Anthropomorphism and adoption. Journal of Business Research, 115, 14-24. doi:10.1016/j.jbusres.2020.04.030
Shumanov, M., & Johnson, L. (2021). Making conversations with chatbots more personalized. Computers in Human Behavior, 117, 106627. doi:10.1016/j.chb.2020.106627
Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571–581. doi:10.1037/0022-0663.85.4.571
Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education, 151, 103862. doi:10.1016/j.compedu.2020.103862
Sotolongo, N., & Copulsky, J. (2018). Conversational marketing: Creating compelling customer connections. Applied Marketing Analytics, 4(1), 6-21.
Stipek, D. J. (1993). Motivation to learn: From theory to practice (2nd ed.) Needham Heights, MA: Allyn & Bacon.
Sun, J. C. Y., Wu, Y. T., & Lee, W. I. (2017). The effect of the flipped classroom approach to OpenCourseWare instruction on students’ self‐regulation. British Journal of Educational Technology, 48(3), 713-729. doi:10.1111/bjet.12444
Sun, Z., Xie, K., & Anderman, L. H. (2018). The role of self-regulated learning in students' success in flipped undergraduate math courses. The internet and higher education, 36, 41-53. doi:10.1016/j.iheduc.2017.09.003
Tang, K. Y., Chang, C. Y., & Hwang, G. J. (2021). Trends in artificial intelligence-supported e-learning: a systematic review and co-citation network analysis (1998–2019). Interactive Learning Environments, 1-19.
To, J. (2021). Using learner-centred feedback design to promote students’ engagement with feedback. Higher Education Research & Development, 1-16. doi:10.1080/07294360.2021.1882403
van Alten, D. C., Phielix, C., Janssen, J., & Kester, L. (2020). Self-regulated learning support in flipped learning videos enhances learning outcomes. Computers & Education, 158, 104000. doi:10.1016/j.edurev.2015.11.002
Verstege, S., Pijeira-Díaz, H. J., Noroozi, O., Biemans, H., & Diederen, J. (2019). Relations between students' perceived levels of self-regulation and their corresponding learning behavior and outcomes in a virtual experiment environment. Computers in Human Behavior, 100, 325-334. doi:10.1016/j.chb.2019.02.020
Vygotsky, L. S., & Cole, M. (1978). Mind in society: Development of higher psychological processes. Harvard university press.
Wang, L. C., & Chen, M. P. (2010). The effects of game strategy and preference‐matching on flow experience and programming performance in game‐based learning. Innovations in Education and Teaching International, 47(1), 39-52. doi:10.1080/14703290903525838
Wang, S. L., & Lin, S. S. J. (2007a). The application of social cognitive theory to web-based learning through NetPorts. British Journal of Educational Technology, 38(4), 600–612.
Wang, S. L., & Wu, P. Y. (2008). The role of feedback and self-efficacy on web-based learning: The social cognitive perspective. Computers & Education, 51(4), 1589-1598.
Wong, J., Baars, M., Davis, D., Van Der Zee, T., Houben, G. J., & Paas, F. (2019). Supporting self-regulated learning in online learning environments and MOOCs: A systematic review. International Journal of Human–Computer Interaction, 35(4-5), 356-373. doi:10.1080/10447318.2018.1543084
Xiao, Y., & Yang, M. (2019). Formative assessment and self-regulated learning: How formative assessment supports students' self-regulation in English language learning. System, 81, 39-49. doi:10.1016/j.system.2019.01.004
Yan, Z., & Brown, G. T. (2017). A cyclical self-assessment process: Towards a model of how students engage in self-assessment. Assessment & Evaluation in Higher Education, 42(8), 1247-1262. doi:10.1080/02602938.2016.1260091.
Yan, Z. (2018). Student self-assessment practices: the role of gender, school level and goal orientation. Assessment in Education: Principles, Policy & Practice, 25(2), 183-199. doi:10.1080/0969594X.2016.1218324.
Yan, Z. (2020). Self-assessment in the process of self-regulated learning and its relationship with academic achievement. Assessment & Evaluation in Higher Education, 45(2), 224-238. doi:10.1080/02602938.2019.1629390
Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation technology with micro-learning: The impact of chatbot-based learning on students’ learning motivation and performance. Journal of Educational Computing Research, 59(1), 154-177. doi:10.1177/0735633120952067
Yoon, M., Hill, J., & Kim, D. (2021). Designing supports for promoting self-regulated learning in the flipped classroom. Journal of Computing in Higher Education, 33(2), 398-418. doi:10.1007/s12528-021-09269-z
Zimmerman, B. J. (1989). A social cognitive view of self-regulated academic learning. Journal of educational psychology, 81(3), 329.
Risemberg, R., & Zimmerman, B. J. (1992). Self‐regulated learning in gifted students. Roeper review, 15(2), 98-101.
Zimmerman, B. J. (1998). Developing self-fulfilling cycles of academic regulation: An analysis of exemplary instructional models. In D. H. Schunk & B. J. Zimmerman (Eds.), Selfregulated learning: From teaching to self-reflective practice (pp. 1-19). New York:Guilford.
Zimmerman, B. J. (2006). Development and adaptation of expertise: The role of self-regulatory processes and beliefs. The Cambridge handbook of expertise and expert performance, 186, 705-722.
Zimmerman, B. J., and Moylan, A. R. (2009). “Self-regulation: where metacognition and motivation intersect,” in Handbook of Metacognition in Education, eds D. J. Hacker, J. Dunlosky, and A. C. Graesser (New York, NY: Routledge), 299–315.