外国语

外国语 ›› 2023, Vol. 46 ›› Issue (4): 68-81.

• 语言研究 • 上一篇    

社会心理语言学视域下言者个体与群体身份的编码和解码

陈文均1, 胡砚冰1, 蒋晓鸣1,2   

  1. 1. 上海外国语大学 语言研究院, 上海 201620;
    2. 上海外国语大学 语言科学与多语智能应用重点总实验室, 上海 201620
  • 收稿日期:2022-09-04 发布日期:2023-08-03
  • 通讯作者: 蒋晓鸣(通讯作者)(1983-),男,上海人,博士,教授,上海市曙光学者。研究方向:心理与神经语言学、实验语言学、言语交际与言语障碍、嗓音编码与解码、神经语用学。
  • 作者简介:陈文均(1999-),男,四川遂宁人,硕士研究生。研究方向:心理与神经语言学、嗓音编码与解码；胡砚冰(1996-),男,甘肃天水人,博士研究生。研究方向:心理与神经语言学、嗓音表情解码与嗓音产出。
  • 基金资助:
    上海市哲学社会科学规划课题 (2018BYY019);上海市教育发展基金会和上海市教育委员会"曙光计划" (20SG31);上海市自然科学基金面上项目(22ZR1460200);上海外国语大学第五届"导师学术引领计划项目"(2022113001)

Encoding and Decoding Mechanisms for Speakers’ Individual and Group Identities: A Social Psycholinguistics Perspective

CHEN Wenjun1, HU Yanbing1, JIANG Xiaoming1,2   

  1. 1. Institute of Linguistics, Shanghai International Studies University, Shanghai 201620, China;
    2. Key Laboratory of Language Science and Multilingual Intelligence Applications, Shanghai International Studies University, Shanghai 201620, China
  • Received:2022-09-04 Published:2023-08-03

摘要： 言语交流中,听者如何快速有效地感知言者的身份和个性是社会心理语言学的重要问题。关注言者间身份变异解码的传统研究发现听者区分言者间身份的正确率受听者音系知识及言者基频和声道长度的影响。新近研究发现,言者会因交际意图变化而调整发声策略(语言结构、语言风格和发声生理基础),听者能通过适应言者内部的变异进而识别言者身份。本文回顾了音系规则对身份编码的特殊制约,梳理底层声学参数如何表征言者间及内部身份变异进而影响言者身份感知;在引入内/外群体概念后,进一步探讨言者在群体身份渗透意图下会采用不同发声策略这一现象如何支持交际调节理论。基于以上提出言语互动场景下的言者身份编码及解码模型,并展望三个研究方向。

关键词: 言者身份, 嗓音表情, 交际意图, 社会分组, 社会心理语言学

Abstract: How listeners quickly and effectively perceive speakers’ identity and personality in verbal communication remains a widely researched topic for social psycholinguistics.Traditional research focusing on the perception of between-speaker identity variation reported that the correct rate for between-speaker differentiation is subject to listeners’ phonological knowledge and speakers’ Fundamental Frequency (F0) and Vocal Tract Length (VTL).Recent research has found that speakers modulate their vocalisation strategies (language structure, language style and physiological basis of vocalisation) according to their changing communicative intentions, whereas listeners could adapt to within-speaker variations and recognise speakers’ identities.This article reviews the unique constraints on speaker identity encoding imposed by phonological rules and unpacks how underlying acoustic parameters characterise within-and between-speaker identity variations that influence speaker identity perception.It further introduces the concept of in-/out-group and explores how the phenomenon where speakers would adopt varied vocalisation strategies when motivated by group identity permutation intentions supports the Communication Accommodation Theory (CAT).Based on such, it proposes Speaker Identity Encoding and Decoding Model for Verbal Interaction Scenarios and calls for future research in three directions.

Key words: speaker identification, vocal expression, communication intention, social grouping, social psycholinguistics

中图分类号: 

  • H030
[1] Austin, J.L. How to Do Things with Words [M].Oxford:Oxford university press, 1975.
[2] Begus, K., Gliga, T.& V.Southgate.Infants' preferences for native speakers are associated with an expectation of information[J]. Proceedings of the National Academy of Sciences, 2016, 113(44):12397-12402.
[3] Belin, P., Fecteau, S.& C.Bedard.Thinking the voice:neural correlates of voice perception[J]. Trends in Cognitive Sciences, 2004, 8(3):129-135.
[4] Bernhold, Q.S.& H.Giles.Vocal accommodation and mimicry[J]. Journal of Nonverbal Behavior, 2020, 44(1):41-62.
[5] Borkowska, B.& B.Pawlowski.Female voice frequency in the context of dominance and attractiveness perception[J]. Animal Behaviour, 2011, 82(1):55-59.
[6] Braber, N., Cummings, L.& L.Morrish. Exploring Language and Linguistics[M].Cambridge:Cambridge University Press, 2015.
[7] Chen, X., Li, Z., Setlur, S.& W.Xu.Exploring racial and gender disparities in voice biometrics[J]. Scientific Reports, 2022, 12(1):1-12.
[8] Coupland, N. Style:Language Variation and Identity[M].Cambridge:Cambridge University Press, 2007.
[9] Dahl, K.L.& L.A.Mahler.Acoustic features of transfeminine voices and perceptions of voice femininity[J]. Journal of Voice, 2020, 34(6):961-e919.
[10] Di Cesare, G., Cuccio, V., Marchi, M., Sciutti, A.& G.Rizzolatti.Communicative and affective components in processing auditory vitality forms:An fMRI study[J]. Cerebral Cortex, 2022, 32(5):909-918.
[11] Fecher, N.& E.K.Johnson.By 4.5 months, linguistic experience already affects infants' talker processing abilities[J]. Child Development, 2019, 90(5):1535-1543.
[12] Fleming, D., Giordano, B.L., Caldara, R.& P.Belin.A language-familiarity effect for speaker discrimination without comprehension[J]. Proceedings of the National Academy of Sciences, 2014, 111(38):13795-13798.
[13] Formisano, E., De Martino, F., Bonte, M.& R.Goebel." Who" is saying" what"? Brain-based decoding of human voice and speech[J]. Science, 2008, 322(5903):970-973.
[14] Frühholz, S.& P.Belin. The Oxford Handbook of Voice Perception [M].Oxford:Oxford University Press, 2018.
[15] Frühholz, S.& S.R.Schweinberger.Nonverbal auditory communication-evidence for integrated neural systems for voice signal production and perception[J]. Progress in Neurobiology, 2021, 199:101948.
[16] Giles, H., Coupland, J., Coupland, N.& K.Oatley. Contexts of accommodation:Developments in applied sociolinguistics: Cambridge University Press, 1991.
[17] Giles, H., Scholes, J.& L.Young.Stereotypes of male and female speech:A British study[J]. Central States Speech Journal, 1983, (4):255-256.
[18] Goldsmith, J.A., Riggle, J.& C.L.Alan. The Handbook of Phonological Theory[M].New York:John Wiley & Sons, 2014.
[19] Grice, H.P.Logic and conversation[M]//Peter Cole, Morgan, J.L., Speech acts. New York:Academic Press, 1975, 41-58.
[20] Grill-Spector, K., Henson, R.& A.Martin.Repetition and the brain:neural models of stimulus-specific effects[J]. Trends in Cognitive Sciences, 2006, 10(1):14-23.
[21] Hardy, T.L.D., Boliek, C.A., Wells, K., Dearden, C., Zalmanowitz, C.& J.M.Rieger.Pretreatment acoustic predictors of gender, femininity, and naturalness ratings in individuals with male-to-female gender identity[J]. American Journal of Speech-Language Pathology, 2016, 25(2):125-137.
[22] Harrington, F.H.& L.D.Mech.Wolf howling and its role in territory maintenance[J]. Behaviour, 1979, 68(3-4):207-249.
[23] Harrington, J., Palethorpe, S.& C.I.Watson.Does the Queen speak the Queen's English?[J]. Nature, 2000, 408(6815):927-928.
[24] Hauser, M.D., Chomsky, N.& W.T.Fitch.The faculty of language:what is it, who has it, and how did it evolve?[J]. Science, 2002, 298(5598):1569-1579.
[25] Hogg, M.A.Masculine and feminine speech in dyads and groups:A study of speech style and gender salience[J]. Journal of Language and Social Psychology, 1985, 4(2):99-112.
[26] Hogg, M.A.Social Identity Theory[M]//Shelley McKeown, R.H., Neil Ferguson, Understanding Peace and Conflict Through Social Identity Theory:Contemporary Global Perspectives. Switzerland:Springer, 2016, 3-17.
[27] Jia, Y., Zhang, Y., Weiss, R., Wang, Q., Shen, J., Ren, F., Nguyen, P., Pang, R., Lopez Moreno, I.& Y.Wu.Transfer learning from speaker verification to multispeaker text-to-speech synthesis[J]. Advances in Neural Information Processing Systems, 2018, 31.
[28] Jiang, X., Gossack-Keenan, K.& M.D.Pell.To believe or not to believe? How voice and accent information in speech alter listener impressions of trust[J]. Quarterly Journal of Experimental Psychology, 2020, 73(1):55-79.
[29] Jiang, X., Li, Y.& X.Zhou.Is it over-respectful or disrespectful? Differential patterns of brain activity in perceiving pragmatic violation of social status information during utterance comprehension[J]. Neuropsychologia, 2013, 51(11):2210-2223.
[30] Jiang, X.& M.D.Pell.The sound of confidence and doubt[J]. Speech Communication, 2017, 88:106-126.
[31] Johnson, K.The ΔF method of vocal tract length normalization for vowels[J]. Laboratory Phonology, 2020, 11(1):10.
[32] Kamide, Y.Learning individual talkers' structural preferences[J]. Cognition, 2012, 124(1):66-71.
[33] Kharitonov, E., Copet, J., Lakhotia, K., Nguyen, T.A., Tomasello, P., Lee, A., Elkahky, A., Hsu, W.-N., Mohamed, A.& E.Dupoux.textless-lib:a Library for Textless Spoken Language Processing[J]. 2022, arXiv preprint arXiv: 2202.07359.
[34] Kim, J., Toutios, A., Lee, S.& S.S.Narayanan.Vocal tract shaping of emotional speech[J]. Computer Speech & Language, 2020, 64:101100.
[35] Kinzler, K.D.Language as a social cue[J]. Annual Review of Psychology, 2021, 72:241-264.
[36] Kinzler, K.D., Dupoux, E.& E.S.Spelke.'Native'objects and collaborators:Infants' object choices and acts of giving reflect favor for native over foreign speakers[J]. Journal of Cognition Development, 2012, 13(1):67-81.
[37] Kreuk, F., Polyak, A., Copet, J., Kharitonov, E., Nguyen, T.-A., Rivière, M., Hsu, W.-N., Mohamed, A., Dupoux, E.& Y.Adi.Textless speech emotion conversion using decomposed and discrete representations[J].2021, arXiv preprint arXiv: 2111.07402.
[38] Kroczek, L.O.H.& T.C.Gunter.The time course of speaker-specific language processing[J]. Cortex, 2021, 141, 311-321.
[39] Kuhl, P.K.Who's talking?[J]. Science, 2011, 333(6042):529-530.
[40] Labov, W. The Social Stratification of English in New York City [M].Cambridge:Cambridge University Press, 2006.
[41] Lammert, A.C.& S.S.Narayanan.On short-time estimation of vocal tract length from formant frequencies[J]. PloS One, 2015, 10(7):e0132193.
[42] Latinus, M.& P.Belin.Anti-voice adaptation suggests prototype-based coding of voice identity[J]. Frontiers in Psychology, 2011, 2, 175.
[43] Lavan, N., Burston, L.F., Ladwa, P., Merriman, S.E., Knight, S.& C.McGettigan.Breaking voice identity perception:Expressive voices are more confusable for listeners[J]. Quarterly Journal of Experimental Psychology, 2019a, 72(9):2240-2248.
[44] Lavan, N., Burton, A.M., Scott, S.K.& C.McGettigan.Flexible voices:Identity perception from variable vocal signals[J]. Psychonomic Bulletin Review, 2019b, 26(1):90-102.
[45] Lavan, N., Knight, S.& C.McGettigan.Listeners form average-based representations of individual voice identities[J]. Nature Communications, 2019c, 10(1):1-9.
[46] Leipold, S., Abrams, D.A., Karraker, S.& V.Menon.Neural decoding of emotional prosody in voice-sensitive auditory cortex predicts social communication abilities in children[J]. Cerebral Cortex, 2023, 33(3):709-728.
[47] Levi, S.V., Harel, D.& R.G.Schwartz.Language ability and the familiar talker advantage:Generalizing to unfamiliar talkers is what matters[J]. Journal of Speech, Language, Hearing Research, 2019, 62(5):1427-1436.
[48] Martin, A.E.& M.L.Slepian.The primacy of gender:Gendered cognition underlies the Big Two dimensions of social cognition[J]. Perspectives on Psychological Science, 2021, 16(6):1143-1158.
[49] Nakagawa, S., Shikano, K.& Y.I.Tohkura. Speech, Hearing and Neural Network Models[M].Amsterdam:IOS Press, 1995.
[50] Neumann, K.& C.Welzel.The importance of the voice in male-to-female transsexualism[J]. Journal of Voice, 2004, 18(1):153-167.
[51] Oh, D., Buck, E.A.& A.Todorov.Revealing hidden gender biases in competence impressions of faces[J]. Psychological Science, 2019, 30(1):65-79.
[52] Orena, A.J., Theodore, R.M.& L.Polka.Language exposure facilitates talker learning prior to language comprehension, even in adults[J]. Cognition, 2015, 143:36-40.
[53] Peng, Z., Chen, J., Jin, L., Han, H., Dong, C., Guo, Y., Kong, X., Wan, G.& Z.Wei.Social brain dysfunctionality in individuals with autism spectrum disorder and their first-degree relatives:an activation likelihood estimation meta-analysis[J]. Psychiatry Research:Neuroimaging, 2020, 298:111063.
[54] Pernet, C.R., McAleer, P., Latinus, M., Gorgolewski, K.J., Charest, I., Bestelmeyer, P.E.G., Watson, R.H., Fleming, D., Crabbe, F.& M.Valdes-Sosa.The human voice areas:Spatial organization and inter-individual variability in temporal and extra-temporal cortices[J]. Neuroimage, 2015, 119:164-174.
[55] Perrachione, T.K., Del Tufo, S.N.& J.D.Gabrieli.Human voice recognition depends on language ability[J]. Science, 2011, 333(6042):595-595.
[56] Pisanski, K., Anikin, A.& D.Reby.Static and dynamic formant scaling conveys body size and aggression[J]. Royal Society Open Science, 2021, 9(1):211496.
[57] Pisanski, K., Anikin, A.& D.Reby.Vocal size exaggeration may have contributed to the origins of vocalic complexity[J]. Philosophical Transactions of the Royal Society B, 2022, 377(1841):20200401.
[58] Polka, L., Masapollo, M.& L.Ménard.Setting the stage for speech production:Infants prefer listening to speech sounds with infant vocal resonances[J]. Journal of Speech, Language, 2022, 65(1):109-120.
[59] Reby, D.& K.McComb.Anatomical constraints generate honesty:acoustic cues to age and weight in the roars of red deer stags[J]. Animal Behaviour, 2003, 65(3):519-530.
[60] Regel, S., Coulson, S.& T.C.Gunter.The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony[J]. Brain Research, 2010, 1311:121-135.
[61] Rubin, D.L.Nonlanguage factors affecting undergraduates' judgments of nonnative English-speaking teaching assistants[J]. Research in Higher Education, 1992, 33(4):511-531.
[62] Schirmer, A.Is the voice an auditory face? An ALE meta-analysis comparing vocal and facial emotion processing[J]. Social Cognitive and Affective Neuroscience, 2018, 13(1):1-13.
[63] Šebesta, P., Mendes, F.D.C.& K.J.Pereira.Vocal parameters of speech and singing covary and are related to vocal attractiveness, body measures, and sociosexuality:a cross-cultural study[J]. Frontiers in Psychology, 2019, 10:2029.
[64] Shutts, K., Kinzler, K.D., McKee, C.B.& E.S.Spelke.Social information guides infants' selection of foods[J]. Journal of Cognition Development, 2009, 10(1-2):1-17.
[65] Sorokowski, P., Puts, D., Johnson, J.,Żółkiewicz, O., Oleszkiewicz, A., Sorokowska, A., Kowal, M., Borkowska, B.& K.Pisanski.Voice of authority:professionals lower their vocal frequencies when giving expert advice[J]. Journal of Nonverbal Behavior, 2019, 43(2):257-269.
[66] Tamagawa, R., Watson, C.I., Kuo, I.H., MacDonald, B.A.& E.Broadbent.The effects of synthesized voice accents on user perceptions of robots[J]. International Journal of Social Robotics, 2011, (3):253-262.
[67] Tan, Z.-H.Vocal tract length perturbation for text-dependent speaker verification with autoregressive prediction coding[J]. IEEE Signal Processing Letters, 2021, 28:364-368.
[68] Tang, C., Hamilton, L.S.& E.F.Chang.Intonational speech prosody encoding in the human auditory cortex[J]. Science, 2017, 357(6353):797-801.
[69] Titze, I.R.Physiologic and acoustic differences between male and female voices[J]. The Journal of the Acoustical Society of America, 1989, 85(4):1699-1707.
[70] Voigt, R., Jurafsky, D.& M.Sumner.Between-and within-speaker effects of bilingualism on F0 variation[Z]. Interspeech. San Francisco, The United States, 2016:1122-1126.
[71] von Kriegstein, K., Warren, J.D., Ives, D.T., Patterson, R.D.& T.D.Griffiths.Processing the acoustic effect of size in speech sounds[J]. Neuroimage, 2006, 32(1):368-375.
[72] Walker, M.& C.Perry.It's the words you use and how you say them:electrophysiological correlates of the perception of imitated masculine speech[J]. Language, Cognition and Neuroscience, 2022, 37(1):1-21.
[73] Winters, S.J., Levi, S.V.& D.B.Pisoni.Identification and discrimination of bilingual talkers across languages[J]. The Journal of the Acoustical Society of America, 2008, 123(6):4524-4538.
[74] Xu, H.& J.L.Armony.Influence of emotional prosody, content, and repetition on memory recognition of speaker identity[J]. Quarterly Journal of Experimental Psychology, 2021, 74(7):1185-1201.
[75] Xu, M., Homae, F., Hashimoto, R.-i.& H.Hagiwara.Acoustic cues for the recognition of self-voice and other-voice[J]. Frontiers in Psychology, 2013, (4):735.
[76] Zhang, Y., Ding, Y., Huang, J., Zhou, W., Ling, Z., Hong, B.& X.Wang.Hierarchical cortical networks of "voice patches" for processing voices in human brain[J]. Proceedings of the National Academy of Sciences, 2021, 118(52):e2113887118.
[77] 蒋晓鸣.文化互鉴视角下非言语表情的嗓音编码和解码[J].同济大学学报(社会科学版), 2020, 31(1):116-124.
[78] 束定芳.《语言与社会心理学》评介——兼论社会心理语言学的研究对象、目标及方法[J].外国语(上海外国语学院学报), 1992, (3):10-14.
[79] 束定芳, 张立飞.后"经典"认知语言学:社会转向和实证转向[J].现代外语, 2021, (3):420-429.
[80] 王德春, 孙汝建.社会心理语言学的理论和方法论基础[J].外国语(上海外国语学院学报), 1992a, (4):3-7.
[81] 王德春, 孙汝建.社会心理语言学的学科性质和研究对象[J].外国语(上海外国语学院学报), 1992b, (3):3-9.
[82] 伍可, 陈杰, 李雯婕, 陈洁佳, 刘雷, 刘翠红.人声加工的神经机制[J].心理科学进展, 2020, 28(5):752-765.
[83] 夏志华, 马秋武.同济博士论丛:汉语对话中韵律趋同的实验研究[M].上海:同济大学出版社, 2019.
[84] 周爱保, 胡砚冰, 周滢鑫, 李玉, 李文一, 张号博, 郭彦麟, 胡国庆.听而不"闻"? 人声失认症的神经机制[J].心理科学进展, 2021, 29(3):414.
[1] 刘佳,范琳. 汉语情绪直意词和情绪隐含词加工的ERP研究*[J]. 外国语, 2023, 46(3): 32-45.
[2] 邵士洋,吴平. 中国EFL学习者冠词产出的主(客)观实指性效应研究*[J]. 外国语, 2023, 46(3): 21-31.
[3] 周红照. 形式语义知识驱动的中文伪情感句智能识别模型[J]. 外国语, 2023, 46(3): 13-20.
[4] 张春燕, 冉永平. 人际隐喻视角下and条件复句的语义双重性研究[J]. 外国语, 2023, 46(3): 46-56.
[5] 李琳, 李称鑫, 李小萌. 评价系统视域下的经济话语研究——基于国外学界对中国经济评价的文本挖掘分析[J]. 外国语, 2023, 46(3): 57-69.
[6] 李思旭. 话语标记的形成机制与前沿课题[J]. 外国语, 2023, 46(3): 70-81.
[7] 吕金妹. Web 3.0应用生态中的关联理论新发展及其应用:《智能手机交际》述评[J]. 外国语, 2023, 46(3): 112-119.
[8] 于国栋. 诊疗方案给出方式、诊疗内容与序列位置之关系的会话分析研究[J]. 外国语, 2023, 46(1): 23-33.
[9] 李克. 叙事共情的修辞机制[J]. 外国语, 2022, 45(6): 12-20.
[10] 胡范铸,张虹倩,胡亦名. 共同体构建视域下“共情修辞”的目标、问题、路径——兼论“元主体”“他者意识”“话语权补偿”概念[J]. 外国语, 2022, 45(6): 2-11.
[11] 吴亚欣. 汉语语气词的会话分析研究路径[J]. 外国语, 2022, 45(6): 21-33.
[12] 黄萍, 焦健. 老年维权话语研究的内涵、议题和路径[J]. 外国语, 2022, 45(6): 57-65.
[13] 张鑫. 晚清上海会审公廨中的口译活动与华洋角力[J]. 外国语, 2022, 45(6): 118-125.
[14] 任育新. 身份的联合共构：身份动态建构新探[J]. 外国语, 2022, 45(3): 48-58.
[15] 于国栋. 作为汉语言语交际话题过渡讯号的“唉”[J]. 外国语, 2022, 45(2): 61-71,92.
Viewed
Full text


Abstract

Cited
  Shared   
No Suggested Reading articles found!