Summary

探索孤立的表达式和电影剪辑的使用与创伤性脑损伤的人评价情感识别

Published: May 15, 2016
doi:

Summary

本文介绍了如何实现的行为任务电池检查孤立的面部和声音的情感表达情感识别,并使用商业电视和电影剪辑一个新的任务,以评估多式联运情绪识别,包括上下文线索。

Abstract

目前的研究提出了60人,创伤性脑损伤(TBI)和孤立情感的面部表情控制60,隔离声乐情感的表达,和多模式( ,影片剪辑)的刺激,包括上下文线索。所有的刺激均通过计算机呈现。被要求参加者以确定如何将人在每一个刺激是使用强迫选择格式的感觉。此外,为影片剪辑,参与者们必须表明他们响应刺激的感觉,和强度的水平与他们经历过的情感。

Introduction

创伤性脑损伤(TBI)影响世界各地的1每年大约有10万人。 TBI之后,认识到使用非语言线索,例如面部和声音表达情感人的能力( ,说话的语气),和上下文线索,往往是显著损害2-7。由于成功的人际交往和质量的关系至少部分依赖于别人的情绪7-10准确的解释,这并不奇怪,随着情感识别困难已报告有助于TBI后3,8常见的穷人的社会后果, 11,12。

研究人员通过调查情感识别与TBI往往集中于孤立的线索,尤其是识别使用静态照片2面部情感表情。虽然这项工作一直是很重要的,通知有利于治疗的发展克,它没有充分代表一个人的认识和解读情感的肢体语言会在日常交往的能力。不仅静态图像提供更多的时间来诠释刻画情感,他们也通常只描绘了顶点表达13-16( ,最大表示)。此外,静态图像缺乏与运动12,13,15发生的时间线索,并不能代表在日常生活中遇到的情感迅速变化的面部表情。此外,有证据表明,静态和动态视觉表达式在脑的不同区域进行处理,以向动态刺激17-24更准确的响应。

由人TBI声乐情感识别也进行了研究,既没有意义的语言内容。它已经提出的词句内容的存在增加,因为精确INTE感知需求rpretation要求有发言权的非语言语调与包括口头消息25语义内容的同时处理。虽然许多研究已经显示提高了人声的识别在没有有意义词句内容,Dimoska 等人 25发现在性能上没有差异影响。他们认为,人有脑外伤朝情感句子的语义内容的偏见;所以即使当内容在语义上是中性或淘汰,他们继续把重点放在句子中的口头信息。因此,他们的结果并没有清楚地显示有意义的语言内容是否有助于或阻碍声乐情感表达。

此外,可以陪非语言线索声乐有意义的语言内容,背景也通过社会情况本身提供。情境提供了有关在其下产生的情感表达,能这样就大大的情况下背景资料注量表达的解释。当评估一个人的感觉如何,我们使用环境来确定的情况是与人的需要和期望是一致的。这最终会影响一个人的感觉,所以情境的知识应当引起别人的情绪26更准确的推理。要做到这一点的能力被称为心理理论,发现是显著受损以下TBI 6,27-31的结构。 Milders 8.31报告,患有TBI有做出准确的判断有关,并理解简要事迹人物的意图和感受显著困难。

虽然这些研究都强调非语言和情境情感处理赤字,这是很难一概而论的结果到这些线索发生一起彼此和社会背景下的日常社会交往。为了更好地理解人们如何与TBI在日常社会交往诠释情感,我们需要使用在本质上多刺激。只有两个以前的研究已包括多式联运刺激作为调查的一部分进入人们的TBI过程的情感线索如何。麦当劳和桑德斯15和威廉姆斯和木提取16情感评估测试(EET),这是社会推理测试 26 意识的一部分的刺激。该EET由护身符录像,显示男性和女性角色刻画的非语言线索的情感,而与人交谈的。在谈话中口头上的内容是语义中性;关于演员的感受,不提供上下文信息线索。因此,需要处理和同时做这与非语言的面部和声音线索被淘汰整合有意义的语言内容。这些研究的结果表明,人的TBI分别significanTLY比他们从多刺激的识别能力,情绪控制不准确。因为无论是研究中考虑对情感表达的语义解释或语境信息的影响,它增加此类信息是否有助于处理,因为增加intersensory冗余的或消极的影响观感,因为增加认知需求仍不清楚。

本文概述了一套用于隔离比较面部和声音的情绪线索的知觉任务,而有意义的情境中同时出现的这些线索的看法。该隔离任务的非语言情感识别较大测试的一部分- 非言语准确的诊断分析2(DANVA2)32。在这个协议中,我们使用了成人面孔 (DANVA-面)和成人同期声 (DANVA-音色)测验。每个分测验的包括24个刺激,每个描绘快乐,悲伤,愤怒,和恐惧情绪六个交涉。该DANVA2要求参与者识别情感用强迫选择格式(4个选项)描绘。这里,第五选项(不知)用于两个子测试。时间显示出每一个面部表情量是从两个秒增加到五秒钟以确保我们正在评估影响的肯定和没有处理的速度。我们没有改变成人同期声分测验超出了强迫选择响应格式添加额外的选择。参与者只有一次听到每个句子。没有在任一任务提供了反馈。

电影剪辑被用来评估情境中同时发生的面部和声音情感线索的看法。虽然这些片段中的语言内容没有明确说明是什么在剪辑的人物都心照不宣,这是有意义的情境。来自共抽取十五剪辑mmercial电影和电视连续剧,包括在研究中,每45至103(平均= 71.87)秒。反馈这个任务时未提供给与会者。有三个片段分别代表如下情感类:高兴,悲伤,愤怒,恐惧,中性。这些片段是基于与年轻人进行的一项研究结果选择(N = 70) 祖潘,B.&巴贝奇,从电影剪辑和叙事文本DR情感启发刺激。手稿提交到J SOC心理误区 。在这项研究中,参与者赠送了每个目标的情感类六个电影剪辑和六个中立的电影剪辑,从24到127秒(平均=77.3秒)。而目标是包括相对短的电影剪辑,选择用于包含每个剪辑需要有足够的上下文信息,它可以通过观看者,而不必从它溶于33膜的附加 ​​知识来理解。

<p class ="“jove_content”">选择当前研究的素材已经从电影剪辑和叙事文本祖潘和巴贝奇学习情感启发刺激被正确识别,上面提到的83和幸福的89%的目标的情感,86 – 93 %,持续伤心,63 – 为生气93%,77 – 96%的恐惧,以及81 – 中性87%。而具有相同数量的每种情感类别的范例的就像在DANVA2任务(N = 6)将是理想的,我们选择了3种,由于电影剪辑刺激的长度的增加相比,在DANVA-面刺激和DANVA-声音任务。

从这些任务的数据是从60名学员收集与TBI和60年龄和性别匹配的对照。参与者被视为单独或小团体(最大值= 3)和三个任务的顺序跨越测试会议是随机的。

Protocol

该协议被批准在布鲁克大学和卡罗来纳康复机构审查委员会。 1.在测试之前对于15电影剪辑创建3个单独的列表,列出每个剪辑以不同的限制令。 确保每个清单开始,以中性刺激,而且针对相同的情感没有两个剪辑连续发生结束。 在桌面创建电影为了演示每个列表上单独的文件夹和标签的订单名称的文件夹( 例如 ,订购1)。 15剪辑保存到?…

Representative Results

此任务电池被用来比较情绪识别为孤立情感表达式( 即 ,面仅;仅话音)和合并的情感表达一个情境中发生的( 即 ,面部和声音)。共60(男37例,女23例)的参与者中重度颅脑损伤的21岁至63岁之间(平均= 40.98)和60(男38例,女22),年龄相合的控制(范围= 18至63;平均= 40.64)完成了三项任务。参与这项研究中,参与者需要一种TBI有无论是格拉斯哥昏迷量表?…

Discussion

这份手稿描述了用于评估人的情绪TBI识别能力三个任务。上述方法的目的是孤立地比较响应精度面部和声音情感线索,以有意义的情境中同时出现的这些线索的看法。电影剪辑被列入目前的研究,因为他们的日常情景逼近使他们比情感表达的孤立表现更加生态有效。当执行这个协议与人的脑损伤,必须考虑个人的视觉扫描技术,确保刺激和响应表是完全可见是非常重要的。为了帮助此,响应片创?…

Divulgazioni

The authors have nothing to disclose.

Acknowledgements

This work was supported by the Humanities Research Institute at Brock University in St. Catharines, Ontario, Canada and by the Cannon Research Center at Carolinas Rehabilitation in Charlotte, North Carolina, USA.

Materials

Diagnostic Analysis of Nonverbal Accuracy-2 Department of Pychology, Emory University. Atlanta, GA DANVA-Faces subtest, DANVA-Voices subtest
Computer Apple iMac Desktop, 27" display
Statistical Analysis Software SPSS University Licensed software for data analysis
Happy Film Clip 1 Sweet Home Alabama, D&D Films, 2002, Director: A Tennant A man surprises his girlfriend by proposing in a jewelry store
Happy Film Clip 2 Wedding Crashers, New Line Cinema, 2005, Director: D. Dobkin A couple is sitting on the beach and flirting while playing a hand game
Happy Film Clip 3 Reme-mber the Titans, Jerry Bruckheimer Films, 2000, Director: B. Yakin An African American football coach and his family are accepted by their community when the school team wins the football championship
Sad Film Clip 1 Grey's Anatomy, ABC, 2006, Director: P. Horton A father is only able to communicate with his family using his eyes. 
Sad Film Clip 2 Armageddon, Touchstone Pictures, 1998, Director: M. Bay A daughter is saying goodbye to her father who is in space on a dangerous mission
Sad Film Clip 3 Grey's Anatomy, ABC, 2006, Director: M. Tinker A woman is heartbroken her fiance has died
Angry Film Clip 1 Anne of Green Gables, Canadian Broadcast Corporation, 1985, Director: K. Sullivan An older woman speaks openly about a child's physical appearance in front of her
Angry Film Clip 2 Enough, Columbia Pictures, 2002, Director: M. Apted A wife confronts her husband about an affair when she smells another woman's perfume on his clothing
Angry Film Clip 3 Pretty Woman, Touchstone Pictures, 1990, Director: G. Marshall A call girl attempts to purchase clothing in an expensive boutique and is turned away
Fearful Film Clip 1 Blood Diamond, Warner Bros Pictures, 2006, Director: E. Zwick Numerous vehicles carrying militia approach a man and his son while they are out walking
Fearful Film Clip 2 The Life Before Her Eyes, 2929 Productions, 2007, Directors: V. Perelman Two teenaged gilrs are talking in the school bathroom when they hear gunshots that continue to get closer
Fearful Film Clip 3 The Sixth Sense, Barry Mendel Productions, 1999, Director: M. N. Shyamalan A young boy enters the kitchen in the middle of the night and finds his mother behaving very atypically
Neutral Film Clip 1 The Other Sister, Mandeville Films, 1999, Director: G. Marshall A mother and daughter are discussing an art book while sitting in their living room
Neutral Film Clip 2 The Game, Polygram Filmed Entertainment, 1999, Director: D. Fincher One gentleman is explaining the rules of a game to another
Neutral Film Clip 3 The Notebook, New Line Cinema, 2004, Director: N. Cassavetes An older gentleman and his doctor are conversing during a routine check-up

Riferimenti

  1. Langlois, J., Rutland-Brown, W., Wald, M. The epidemiology and impact of traumatic brain injury: A brief overview. J. Head Trauma Rehabil. 21 (5), 375-378 (2006).
  2. Babbage, D. R., Yim, J., Zupan, B., Neumann, D., Tomita, M. R., Willer, B. Meta-analysis of facial affect recognition difficulties after traumatic brain injury. Neuropsychology. 25 (3), 277-285 (2011).
  3. Neumann, D., Zupan, B., Tomita, M., Willer, B. Training emotional processing in persons with brain injury. J. Head Trauma Rehabil. 24, 313-323 (2009).
  4. Bornhofen, C., McDonald, S. Treating deficits in emotion perception following traumatic brain injury. Neuropsychol Rehabil. 18 (1), 22-44 (2008).
  5. Zupan, B., Neumann, D., Babbage, D. R., Willer, B. The importance of vocal affect to bimodal processing of emotion: implications for individuals with traumatic brain injury. J Commun Disord. 42 (1), 1-17 (2009).
  6. Bibby, H., McDonald, S. Theory of mind after traumatic brain injury. Neuropsychologia. 43 (1), 99-114 (2005).
  7. Ferstl, E. C., Rinck, M., von Cramon, D. Y. Emotional and temporal aspects of situation model processing during text comprehension: an event-related fMRI study. J. Cogn. Neurosci. 17 (5), 724-739 (2005).
  8. Milders, M., Fuchs, S., Crawford, J. R. Neuropsychological impairments and changes in emotional and social behaviour following severe traumatic brain injury. J. Clin. Exp. Neuropsychol. 25 (2), 157-172 (2003).
  9. Spikman, J., Milders, M., Visser-Keizer, A., Westerhof-Evers, H., Herben-Dekker, M., van der Naalt, J. Deficits in facial emotion recognition indicate behavioral changes and impaired self-awareness after moderate to severe tramatic brain injury. PloS One. 8 (6), e65581 (2013).
  10. Zupan, B., Neumann, D. Affect Recognition in Traumatic Brain Injury: Responses to Unimodal and Multimodal Media. J. Head Trauma Rehabil. 29 (4), E1-E12 (2013).
  11. Radice-Neumann, D., Zupan, B., Babbage, D. R., Willer, B. Overview of impaired facial affect recognition in persons with traumatic brain injury. Brain Inj. 21 (8), 807-816 (2007).
  12. McDonald, S. Are You Crying or Laughing? Emotion Recognition Deficits After Severe Traumatic Brain Injury. Brain Impair. 6 (01), 56-67 (2005).
  13. Cunningham, D. W., Wallraven, C. Dynamic information for the recognition of conversational expressions. J. Vis. 9 (13), 1-17 (2009).
  14. Elfenbein, H. A., Marsh, A. A., Ambady, W. I. N. Emotional Intelligence and the Recognition of Emotion from Facid Expressions. The Wisdom in Feeling: Psychological Processes in Emotional Intelligence. , 37-59 (2002).
  15. McDonald, S., Saunders, J. C. Differential impairment in recognition of emotion across different media in people with severe traumatic brain injury. J. Int Neuropsycho. Soc. : JINS. 11 (4), 392-399 (2005).
  16. Williams, C., Wood, R. L. Impairment in the recognition of emotion across different media following traumatic brain injury. J. Clin. Exp. Neuropsychol. 32 (2), 113-122 (2010).
  17. Adolphs, R., Tranel, D., Damasio, A. R. Dissociable neural systems for recognizing emotions. Brain Cogn. 52 (1), 61-69 (2003).
  18. Biele, C., Grabowska, A. Sex differences in perception of emotion intensity in dynamic and static facial expressions. Exp. Brain Res. 171, 1-6 (2006).
  19. Collignon, O., Girard, S., et al. Audio-visual integration of emotion expression. Brain Res. 1242, 126-135 (2008).
  20. LaBar, K. S., Crupain, M. J., Voyvodic, J. T., McCarthy, G. Dynamic perception of facial affect and identity in the human brain. Cereb. Cortex. 13 (10), 1023-1033 (2003).
  21. Mayes, A. K., Pipingas, A., Silberstein, R. B., Johnston, P. Steady state visually evoked potential correlates of static and dynamic emotional face processing. Brain Topogr. 22 (3), 145-157 (2009).
  22. Sato, W., Yoshikawa, S. Enhanced Experience of Emotional Arousal in Response to Dynamic Facial Expressions. J. Nonverbal Behav. 31 (2), 119-135 (2007).
  23. Schulz, J., Pilz, K. S. Natural facial motion enhances cortical responses to faces. Exp. Brain Res. 194 (3), 465-475 (2009).
  24. O’Toole, A., Roark, D., Abdi, H. Recognizing moving faces: A psychological and neural synthesis. Trends Cogn. Sci. 6 (6), 261-266 (2002).
  25. Dimoska, A., McDonald, S., Pell, M. C., Tate, R. L., James, C. M. Recognizing vocal expressions of emotion in patients with social skills deficits following traumatic brain injury. J. Int. Neuropsyco. Soc.: JINS. 16 (2), 369-382 (2010).
  26. McDonald, S., Flanagan, S., Rollins, J., Kinch, J. TASIT: A new clinical tool for assessing social perception after traumatic brain injury. J. Head Trauma Rehab. 18 (3), 219-238 (2003).
  27. Channon, S., Pellijeff, A., Rule, A. Social cognition after head injury: sarcasm and theory of mind. Brain Lang. 93 (2), 123-134 (2005).
  28. Henry, J. D., Phillips, L. H., Crawford, J. R., Theodorou, G., Summers, F. Cognitive and psychosocial correlates of alexithymia following traumatic brain injury. Neuropsychologia. 44 (1), 62-72 (2006).
  29. Martìn-Rodrìguez, J. F., Leòn-Carriòn, J. Theory of mind deficits in patients with acquired brain injury: a quantitative review. Neuropsychologia. 48 (5), 1181-1191 (2010).
  30. McDonald, S., Flanagan, S. Social perception deficits after traumatic brain injury: interaction between emotion recognition, mentalizing ability, and social communication. Neuropsychology. 18 (3), 572-579 (2004).
  31. Milders, M., Ietswaart, M., Crawford, J. R., Currie, D. Impairments in theory of mind shortly after traumatic brain injury and at 1-year follow-up. Neuropsychology. 20 (4), 400-408 (2006).
  32. Nowicki, S. . The Manual for the Receptive Tests of the Diagnostic Analysis of Nonverbal Accuracy 2 (DANVA2). , (2008).
  33. Gross, J. J., Levenson, R. W. Emotion Elicitation Using Films. Cogn. Emot. 9 (1), 87-108 (1995).
  34. Spell, L. A., Frank, E. Recognition of Nonverbal Communication of Affect Following Traumatic Brain Injury. J. Nonverbal Behav. 24 (4), 285-300 (2000).
  35. Edgar, C., McRorie, M., Sneddon, I. Emotional intelligence, personality and the decoding of non-verbal expressions of emotion. Pers. Ind. Dif. 52, 295-300 (2012).
  36. Nowicki, S., Mitchell, J. Accuracy in Identifying Affect in Child and Adult Faces and Voices and Social Competence in Preschool Children. Genet. Soc. Gen. Psychol. 124 (1), (1998).
  37. Astesano, C., Besson, M., Alter, K. Brain potentials during semantic and prosodic processing in French. Cogn. Brain Res. 18, 172-184 (2004).
  38. Kotz, S. A., Paulmann, S. When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Res. 115, 107-118 (2007).
  39. Paulmann, S., Pell, M. D., Kotz, S. How aging affects the recognition of emotional speech. Brain Lang. 104 (3), 262-269 (2008).
  40. Pell, M. D., Jaywant, A., Monetta, L., Kotz, S. A. Emotional speech processing: disentangling the effects of prosody and semantic cues. Cogn. Emot. 25 (5), 834-853 (2011).
  41. Bänziger, T., Scherer, K. R. Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus. Affective Computing and Intelligent Interaction, LNCS 4738. , 476-487 (2007).
  42. Busselle, R., Bilandzic, H. Fictionality and Perceived Realism in Experiencing Stories: A Model of Narrative Comprehension and Engagement. Commun. Theory. 18 (2), 255-280 (2008).
  43. Zagalo, N., Barker, A., Branco, V. Story reaction structures to emotion detection. Proceedings of the 1st ACM Work. Story Represent. Mech. Context – SRMC. 04, 33-38 (2004).
  44. Hagemann, D., Naumann, E., Maier, S., Becker, G., Lurken, A., Bartussek, D. The Assessment of Affective Reactivity Using Films: Validity, Reliability and Sex Differences. Pers. Ind. Dif. 26, 627-639 (1999).
  45. Hewig, J., Hagemann, D., Seifert, J., Gollwitzer, M., Naumann, E., Bartussek, D. Brief Report. A revised film set for the induction of basic emotions. Cogn. Emot. 19 (7), 1095-1109 (2005).
  46. Wranik, T., Scherer, K. R. Why Do I Get Angry? A Componential Appraisal Approach. International Handbook of Anger. , 243-266 (2010).
  47. Neumann, D., Zupan, B., Malec, J. F., Hammond, F. M. Relationships between alexithymia, affect recognition, and empathy after traumatic brain injury. J. Head Trauma Rehabil. 29 (1), E18-E27 (2013).
  48. Russell, J. A. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychol. Bull. 115 (1), 102-141 (1994).

Play Video

Citazione di questo articolo
Zupan, B., Neumann, D. Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury. J. Vis. Exp. (111), e53774, doi:10.3791/53774 (2016).

View Video