簡易檢索 / 詳目顯示

研究生: 陳巧蓁
Qiao-Zhen Chen
論文名稱: 以眼球追蹤技術探討中學生對數位表情符號之辨 識:自閉症學生與一般正常發展學生之比較
Exploring how high school students recognize digital emoticons by using eye-tracking techniques: A comparison between autistic and typical development students
指導教授: 邱國力
Guo-Li Chiou
蔡今中
Chin-Chung Tsai
口試委員: 蔡孟蓉
Meng-Jung Tsai
邱國力
Guo-Li Chiou
學位類別: 碩士
Master
系所名稱: 人文社會學院 - 數位學習與教育研究所
Graduate Institute of Digital Learning and Education
論文出版年: 2018
畢業學年度: 106
語文別: 中文
論文頁數: 103
中文關鍵詞: 自閉症情緒辨識眼動儀表情符號
外文關鍵詞: eye-tracking techniques, emoji
相關次數: 點閱:417下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

本研究旨在利用眼球追蹤技術探討自閉症學生和一般正常發展學生的情緒表情辨
識任務,以進一步瞭解自閉症患者在面對不同圖片格式的數位表情符號時,其辨識率與
視覺注意力分布和一般正常發展學生是否有所差異。為達上述目的,本研究採用實驗研
究法,以新北市某中學之 7-9 年級的學生為研究對象,共招募一般發展學生 29 位、自閉
症學生 6 位,進行數位表情符號情緒辨識測驗(簡稱「 REFE 測驗」),並透過眼球追蹤
技術針對其辨識表情符號的歷程進行眼動資料的資料收集與分析。研究結果發現:(一)
自閉症學生與一般正常發展學生在判讀三種圖片格式(卡通圖片、圖像表情符號、 顏文
字)的表情辨識率無顯著差異;(二)自閉症學生與一般正常發展學生在數位表情符號情
緒辨識測驗中,視覺注意力之分布呈現組間顯著差異,兩組學生在觀看卡通圖片時,自
閉症學生傾向凝視於臉孔的下半部,與一般正常發展學生傾向凝視臉孔的上半部不同,
此外,在辨識圖像表情符號時,自閉症學生較不會把視覺注意力放在眉毛的位置;然而,
兩組學生在辨識顏文字的眼動歷程卻無顯著的差異;(三)自閉症學生與一般正常發展
學生在辨識表情符號時,眼動指標與表情辨識率之間有顯著相關性,當學生在觀看卡通
圖片時,在眼睛及鼻子的凝視時間與辨識率呈現顯著的相關性,以及當學生在判讀較複
雜的表情符號時,會需要更多的時間以及非眼睛的線索來做為判斷的依據。


The purpose of this study was to investigate how high school students recognize different formats of digital emoticons by using eye-tracking techniques. In particular, this study adopted an experimental design to examine the difference in the recognition of digital emoticons between autism spectrum disorder (ASD) and typically-developing (TD) students in terms of the rate of accurate recognition of the digital emoticons and eight eye-movement indices. The participants in this study were 29 TD students and 6 ASD students. The two groups of students were asked to recognize 18 digital emoticons represented by three different formats (cartoon pictures, emoji images, and emoticon images) and six different sorts of emotional expressions (happiness, anger, sadness, surprise, disgust, and fear). An eye-tracker was used to record the participants’ eye movements while they were recognizing the digital emoticons. The results of this study indicate that the two groups had no significant difference in the rates of accurate recognition of the digital emoticons with respect to the three formats and six sorts. Nonetheless, the two groups showed different patterns of visual attention while recognizing the digital emoticons. The ADS students tended to pay more attention to the lower part of the faces of the cartoon pictures, while the TD students were more likely to focus on the upper part of the face. In addition, the ASD students paid less attention to eyebrows than TD students while watching the emoji images. However, the two groups had no difference in all eight eye-movement indices while recognizing the emoticon images. Moreover, there are some significant correlations between the rates of accurate recognition of the digital emoticons and the eye-movement indices. The rates of accurate recognition appear to positively correlate with the fixation durations on the eyes of the cartoon pictures but negatively correlated with the fixation durations on the eye in the emoji images and emoticon images.

第一章 緒論 1 第一節 研究背景與動機 1 第二節 研究動機 2 第三節 名詞解釋 3 第四節 研究問題 4 第二章 文獻探討 5 第一節 自閉症的心智與學習特質 5 第二節 情緒的定義與發展理論 7 第三節 臉部表情理論與辨識相關研究 15 第四節 研究假設 18 第三章 研究方法 20 第一節 研究設計 20 第二節 研究對象 21 第三節 研究工具 22 第四節 資料收集與處理 28 第四章 結果與討論 32 第一節 情緒辨識作業分析 32 第二節 情緒辨識測驗的眼動追蹤作業表現 37 第三節 情緒辨識與眼動追縱作業間相關表現 54 第四章 研究假設驗證 66 第五章 結論 70 第一節 研究發現 70 第二節 建議 72 第三節 研究限制 73 參考文獻 75 附錄一 研究同意書 81 附錄二 第一次預試問卷 82 附錄三 第二次預試問卷 87

王淑俐(1995)。青少年的情緒問題,研究與對策。台北:合記。
何兆煒(2007)。解開網路符號的密碼-以符號學觀點分析網路文化之表情符號。南華大學社會研究所網路社會學通訊期刊,65。
何薇玲(2016)。兒童發展與輔導。台北:高點。
宋維村(2000)。自閉症學生輔導手冊。臺南市:國立台南師範學院。
李宏鎰(2007)。注意力不足型 ADHD 成人之學習策略。中華心理衛生學刊,20(4),317-341。
李明洋、薛育青(2009)。自閉症孩童,智障孩童與一般孩童表情辨識與眼神辨位之比較研究。特殊教育學報,29,33-56。
李義正(2005)。網路人際互動之非言詞傳播研究─以臺灣地區網路圖形符號為例。國立台中技術學院商業設計研究所碩士論文。
易之新(譯)(2004)。心理學家的面相術(原作者:Paul Ekman)。台北市:心靈工坊。
林寶貴(2004)。溝通障礙:理論與實務。台北:心理。
國立編譯館(2000年)。教育大辭書。台北市:文景書局。
張春興(1990)。從情緒發展理論的演變論情意教育。教育心理學報,23,1-12。
張春興(2013)。現代心理學。台北:東華。
教育部(2012)。身心障礙及資賦優異學生鑑定辦法。臺北:教育部。
莊素芬(譯)(1999)。情绪發展與EQ教育(原作者:Marion C. Hyson)。台北:桂冠。
莫少依、張正芬(2014)。不共脈絡性: 輕症自閉症學生的人際互動特徵。特殊教育研究學刊,39(2),33-59。
陳李綢(2008)。中學生情緒智慧測量與適應性指標研究。教育心理學報,39,61-81。
陳皎眉、楊家雯(2009)。情緒調節與情緒管理。T&D 飛訊,81,1-18。
陳學志、賴惠德、邱發忠(2010)。眼球追蹤技術在學習與教育上的應用。教育科學研究期刊,55(4),39-68。
黃淑芬(2007)。大學生使用即時通訊表情符號影響情緒感知之研究。國立中正大學電訊傳播研究所碩士論文。
萬芝安(2014)。有“XD”就不怕生?表情符號與社交程度對溝通滿意度影響之研究。國立交通大學傳播研究所2014年年會論文。
臺灣精神醫學會(2014)。DSM-5精神疾病診斷準則手册。台北:合記。
劉奕岑(2012)。情緒與情緒表情符號的關連性研究。樹德科技大學學報,14(1), 185-215。
譚春虹(譯)(2014)。用情商的力量構築幸福的一生(原作者:Kelly Morth)。台北:華智文化

Arnold, M. B.(1960). Emotion and personality, Vol. 1. New York: Columbia University Press.
Association, A. P. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). Washington, DC: American Psychiatric Pub.
Bal, E., Harden, E., Lamb, D., VanHecke, A. V., Denver, J. W., & Porges, S. W. (2010). Emotion recognition in children with autism spectrum disorders: Relations to eye gaze and autonomic state. Journal of Autism and Developmental Disorders, 40(3), 358-370.
Baron-Cohen, S. (1997). Mindblindness: An essay on autism and theory of mind. MA: MIT Press/Bradford Books.
Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985). Does the autistic child have a “theory of mind”?. Cognition, 21(1), 37-46.
Birdwhistell, R. L. (1970). Kinesics and Context: Essays on Body Motion Communication. University of Pennsylvania Press, Incorporated. Retrieved from https://books.google.com.tw/books?id=FZLJMmJlDBIC
Bridges, K. M. B. (1932). Emotional development in early infancy. Child Development, 3, 324-341.
Cannon, W. B. (1927). The James-Lange theory of emotions: A critical examination and an alternative theory. The American Journal of Psychology, 39(1/4), 106-124.
Carlson, J. G., & Hatfield, E. (1992). Psychology of emotion. New York: Harcourt Brace Jovanovich.
Crouzet, S. M., Kirchner, H., & Thorpe, S. J. (2010). Fast saccades toward faces: face detection in just 100 ms. Journal of Vision, 10(4), 1-17.
Denham, S. A., & Kochanoff, A. (2002). Children’s understanding of emtion.the Wisdom of Feelings. New York: Guilford.
Ekman, P. (1992). Facial expressions of emotion: New findings, new questions. Psychological Science, 3(1), 34-38.
Ekman, P. and Friesen, W.V. (1976). Pictures of facial affect. Palo Alto, California:
Consulting Psychologists Press.
Ekman, P. and Friesen, W.V. (1976). Pictures of facial affect. Palo Alto, California:
Consulting Psychologists Press.
Ekman, P. and Friesen, W.V. (1976). Pictures of facial affect. Palo Alto, California:
Consulting Psychologists Press.
Ekman, P., & Friesen, W.V. (1976). Pictures of facial affect. Palo Alto, California: Consulting Psychologists Press.
Emojineering Part 1: Machine Learning for Emoji Trends. (2015, December 8). Retrieved from the World Wide Web: http://instagram-engineering.tumblr.com/post/117889701472/emojineering-part-1-machine-learning-for-emoji
Faja, S., Webb, S. J., Merkle, K., Aylward, E., & Dawson, G. (2009). Brief report: Face configuration accuracy and processing speed among adults with high-functioning autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(3), 532-538.
Frijda, N. H. (1986). The emotions: Studies in emotion and social interaction. Paris: Maison de Sciences de l'Homme.
Frith, U. (1989). Autism: Explaining the enigma. Oxford, UK: Basil Blackwell.
Goleman, D. (1995). Emotional Intelligence. New York: Bantam Books.
Gosselin, P., & Simard, J. (1999). Children’s knowledge of facial expressions of emotions: Distinguishing fear and surprise. The Journal of Genetic Psychology, 160(2), 181-193.
Grelotti, D. J., Klin, A. J., Gauthier, I., Skudlarski, P., Cohen, D. J., Gore, J. C., …Schultz, R. T. (2005). fMRI activation of the fusiform gyrus and amygdala to cartoon characters but not to faces in a boy with autism. Neuropsychologia, 43(3), 373-385.
Halberstadt, A. G., Denham, S. A., & Dunsmore, J. C. (2001). Affective social competence. Social Development, 10(1), 79-119.
Hatfield, E., Cacioppo, J. T., & Rapson, R. L. (1993). Emotional contagion. Current Directions in Psychological Science, 2(3), 96-100.
Hess, M. (2014). Development of a new emotion recognition test with emoticons for adolescents with poor social skills (Doctoral dissertation, California State University, Northridge).
Hothersall, D. (1985). Psychology. Columbus, OH: Bell and Howell.
Izard, C. E. (1971). The face of emotion. New York: Appleton-Century-Crofts.
Izard, C. E. (1978). On the ontogenesis of emotions and emotion-cognition relationships in infancy. In The development of affect (pp. 389-413). Springer, Boston, MA.
James, W. (1884). What is an emotion? Mind, 9(34), 188-205.
Kanner, L. (1943). Autistic disturbances of affective contact. Nervous Child, 2, 217-250.
Kleinginna, P. R., & Kleinginna, A. M. (1981). A categorized list of emotion definitions, with suggestions for a consensual definition. Motivation and emotion, 5(4), 345-379.
Kleinman, J., Marciano, P. L., & Ault, R. L. (2001). Advanced theory of mind in high-functioning adults with autism. Journal of Autism and Developmental Disorders, 31(1), 29-36.
Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Defining and quantifying the social phenotype in autism. American Journal of Psychiatry, 159(6), 895-908.
Lai, M.-L., Tsai, M.-J., Yang, F.-Y., Hsu, C.-Y., Liu, T.-C., Lee, S. W.-Y., …Tsai, C.-C. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, 90-115.
Langdell, T. (1978). Recognition of faces: An approach to the study of autism. Journal of Child Psychology and Psychiatry, 19(3), 255-268.
Lazarus, R. S. (1991). Emotion and adaptation. New York, US: Oxford University Press.
Mayer, J. D., & Salovey, P. (1993). The intelligence of emotional intelligence. Intelligence, 17(4), 433-442.
Mehrabian, A., & Ferris, S. R. (1967). Inference of attitudes from nonverbal communication in two channels. Journal of Consulting Psychology, 31(3), 248-252.
Miller, H. J., Kluver, D., Thebault-Spieker, J., Terveen, L. G., & Hecht, B. J. (2017). Understanding emoji ambiguity in context: the role of text in emoji-related miscommunication. In Proceedings of the 11th International Conference on Web and Social Media, ICWSM (pp. 152-161). AAAI Press.
Miyahara, M., Bray, A., Tsujii, M., Fujita, C., & Sugiyama, T. (2007). Reaction time of facial affect recognition in Asperger’s disorder for cartoon and real, static and moving faces. Child Psychiatry and Human Development, 38(2), 121-134.
Oatley, K., & Johnson-Laird, P. N. (1987). Towards a cognitive theory of emotions. Cognition and Emotion, 1(1), 29-50.
Odom, R. D., & Lemond, C. M. (1972). Developmental differences in the perception and production of facial expressions. Child Development, 43(2), 359-369.
Ozonoff, S. (1995). Executive functions in autism. In E. Schopler & G. Mesibov (Eds.), Learning and cognition in autism (pp. 199-219). New York: Plenum Press.
Parrott, W. G. (2001). Emotions in social psychology: Essential readings. New York, US: Psychology Press.
Pelphrey, K. A., Sasson, N. J., Reznick, J. S., Paul, G., Goldman, B. D., & Piven, J. (2002). Visual scanning of faces in autism. Journal of Autism and Developmental Disorders, 32(4), 249-261.
Plutchik, R. (1980). A general psychoevolutionary theory of emotion. In R. Plutchik & H. Kellerman (Eds.), Emotion: Theory, research, and experience: Vol. 1. Theories of emotion (pp. 3-31). New York: Academic.
Porges, S. W., Cohn, J. F., Bal, E., & Lamb, D. (2007). The Dynamic Affect Recognition Evaluation (DARE) software. Chicago: University of Illinois-Chicago.
Power, M., & Dalgleish, T. (2015). Cognition and emotion: From order to disorder. Hove, England: Psychology press.
Rosset, D. B., Rondan, C., DaFonseca, D., Santos, A., Assouline, B., & Deruelle, C. (2008). Typical emotion processing for cartoon but not for real faces in children with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 38(5), 919-925.
Ryan, M., Murray, J., & Ruffman, T. (2009). Aging and the perception of emotion: Processing vocal expressions alone and with faces. Experimental Aging Research, 36(1), 1-22.
Schachter, S., & Singer, J. (1962). Cognitive, social, and physiological determinants of emotional state. Psychological Review, 69(5), 379-399.
Scherer, K. R. (2005). What are emotions? And how can they be measured? Social Science Information, 44(4), 695-729.
Van derGeest, J. N., Kemner, C., Verbaten, M. N., & VanEngeland, H. (2002). Gaze behavior of children with pervasive developmental disorder toward human faces: A fixation time study. Journal of Child Psychology and Psychiatry, 43(5), 669-678.
Yi, L., Fan, Y., Quinn, P. C., Feng, C., Huang, D., Li, J., …Lee, K. (2013). Abnormality in face scanning by children with autism spectrum disorder is limited to the eye region: Evidence from multi-method analyses of eye tracking data. Journal of Vision, 13(10), 1-13.

無法下載圖示 全文公開日期 2023/07/25 (校內網路)
全文公開日期 2028/07/25 (校外網路)
全文公開日期 2028/07/25 (國家圖書館:臺灣博碩士論文系統)
QR CODE