Cross-modal Informational Masking of Lipreading by Babble

详细信息    查看全文

• 作者：Joel Myerson ; Brent Spehar ; Nancy Tye-Murray…
• 关键词：Lipreading ; Informational masking ; Speech perception
• 刊名：Attention, Perception, & Psychophysics
• 出版年：2016
• 出版时间：January 2016
• 年：2016
• 卷：78
• 期：1
• 页码：346-354
• 全文大小：516 KB
• 参考文献：American National Standards Institute (ANSI). (1989). Specifications for audiometers (ANSI/ASA S3.6-1989). New York: ANSI.
  Baddeley, A. (1992). Working memory. Science, 255, 556–559.PubMed CrossRef
  Baddeley, A. D. (2000). The phonological loop and the irrelevant speech effect: Some comments on Neath (2000). Psychonomic Bulletin & Review, 7, 544–549.CrossRef
  Banbury, S. P., Macken, W. J., Tremblay, S., & Jones, D. M. (2001). Auditory distraction and short-term memory: Phenomena and practical implications. Human Factors, 43, 12–29.PubMed CrossRef
  Beaman, C. P., & Jones, D. M. (1997). Role of serial order in the irrelevant speech effect: Tests of the changing-state hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23, 459.
  Beaman, C. P., & Jones, D. M. (1998). Irrelevant sound disrupts order information in free recall as in serial recall. The Quarterly Journal of Experimental Psychology: Section A, 51, 615–636.CrossRef
  Bregman, A. S. (1990). Auditory scene analysis: The perceptual organization of sound. Cambridge, MA: MIT Press.
  Bronkhorst, A. W. (2000). The cocktail party phenomenon: A review of research on speech intelligibility in multiple-talker conditions. Acta Acustica United with Acustica, 86, 117–128.
  Brungart, D. S. (2001). Informational and energetic masking effects in the perception of two simultaneous talkers. Journal of the Acoustical Society of America, 109, 1101–1109.PubMed CrossRef
  Campbell, R. (2008). The processing of audio-visual speech: Empirical and neural bases. Philosophical Transactions of the Royal Society, B: Biological Sciences, 363, 1001–1010.PubMedCentral CrossRef
  Campbell, T., Beaman, C. P., & Berry, D. C. (2002). Auditory memory and the irrelevant sound effect: Further evidence for changing-state disruption. Memory, 10, 199–214.PubMed CrossRef
  Cooke, M. (2006). A glimpsing model of speech perception in noise. Journal of the Acoustical Society of America, 119, 1562–1573.PubMed CrossRef
  Cooke, M., Lecumberri, M. L. G., & Barker, J. (2008). The foreign language cocktail party problem: Energetic and informational masking effects in non-native speech perception. Journal of the Acoustical Society of America, 123, 414–427.PubMed CrossRef
  Culling, J. F. (2013). Energetic and informational masking in a simulated restaurant environment. In B. C. J. Moore, R. D. Patterson, I. M. Winter, R. P. Carlyon, & H. E. Gockel (Eds.), Basic Aspects of Hearing, Advamces in Experimental Medicine and Biology (pp. 511–518). New York: Springer.CrossRef
  Davis, H., & Silverman, S. R. (1970). Auditory test hearing aids. In H. Davis & S. R. Silverman (Eds.), Hearing and deafness (pp. 235–279). Holt: Rinehart and Winston.
  Divin, W., Coyle, K., & James, D. T. (2001). The effects of irrelevant speech and articulatory suppression on the serial recall of silently presented lipread digits. British Journal of Psychology, 92, 593–616.PubMed CrossRef
  Ebner, N. C., Riediger, M., & Lindenberger, U. (2010). FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods, 42, 351–362.PubMed CrossRef
  Festen, J. M., & Plomp, R. (1990). Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing. Journal of the Acoustical Society of America, 88, 1725–1736.PubMed CrossRef
  Freyman, R. L., Balakrishnan, U., & Helfer, K. S. (2001). Spatial release from informational masking in speech recognition. Journal of the Acoustical Society of America, 109, 2112–2122.PubMed CrossRef
  Hasher, L., & Zacks, R. T. (1988). Working memory, comprehension, and aging: A review and a new view. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 22, pp. 193–225). San Diego, CA: Academic Press.
  Helfer, K. S., & Freyman, R. L. (2005). The role of visual speech cues in reducing energetic and informational masking. Journal of the Acoustical Society of America, 117, 842–849.PubMed CrossRef
  Helfer, K. S., & Freyman, R. L. (2008). Aging and speech-on-speech masking. Ear and Hearing, 29, 87–98.PubMed PubMedCentral
  Jones, D. M. (1994). Disruption of memory for lip-read lists by irrelevant speech: Further support for the changing state hypothesis. The Quarterly Journal of Experimental Psychology, 47, 143–160.PubMed CrossRef
  Jones, D. M., & Macken, W. J. (1993). Irrelevant tones produce an irrelevant speech effect: implications for phonological coding in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 369–381.
  Jones, D. M., & Macken, W. J. (1995). Auditory babble and cognitive efficiency: Role of number of voices and their location. Journal of Experimental Psychology: Applied, 1, 216–226.
  Jones, D. M., & Tremblay, S. (2000). Interference in memory by process or content? A reply to Neath (2000). Psychonomic Bulletin & Review, 7, 550–558.CrossRef
  Kanwisher, N., & Yovel, G. (2006). The fusiform face area: a cortical region specialized for the perception of faces. Philosophical Transactions of the Royal Society, B: Biological Sciences, 361, 2109–2128.PubMedCentral CrossRef
  Kidd, G., Jr., Mason, C., Richards, V., Gallun, F., & Durlach, N. (2007). Informational masking. In W. Yost, A. Popper & R. Fay (Eds.), Auditory perception of sound sources (Vol. 29, pp. 143-189). New York, NY: Springer.
  Li, L., Daneman, M., Qi, J. G., & Schneider, B. A. (2004). Does the information content of an irrelevant source differentially affect spoken word recognition in younger and older adults? Journal of Experimental Psychology: Human Perception and Performance, 30, 1077–1091.PubMed
  Lustig, C., Hasher, L., & Zacks, R. T. (2007). Inhibitory deficit theory: Recent developments in a “new view”. In D. S. Gorfein & C. M. MacLeod (Eds.), Inhibition in cognition (pp. 145–162). Washington, DC: American Psychological Association.CrossRef
  Macken, W., Phelps, F., & Jones, D. (2009). What causes auditory distraction? Psychonomic Bulletin & Review, 16, 139–144.CrossRef
  McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.PubMed CrossRef
  Meyer, D. E., & Schvaneveldt, R. W. (1971). Facilitation in recognizing pairs of words: Evidence of a dependence between retrieval operations. Journal of Experimental Psychology, 90, 227–234.PubMed CrossRef
  Miller, G. A., & Licklider, J. C. R. (1950). The intelligibility of interrupted speech. Journal of the Acoustical Society of America, 22, 167–173.CrossRef
  Neath, I. (2000). Modeling the effects of irrelevant speech on memory. Psychonomic Bulletin & Review, 7, 403–423.CrossRef
  Schneider, B. A., Li, L., & Daneman, M. (2007). How competing speech interferes with speech comprehension in everyday listening situations. Journal of the American Academy of Audiology, 18, 559–572.PubMed CrossRef
  Sommers, M. S., Tye-Murray, N., & Spehar, B. (2005). Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults. Ear and Hearing, 26, 263–275.PubMed CrossRef
  Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212–215.CrossRef
  Szalma, J. L., & Hancock, P. A. (2011). Noise effects on human performance: a meta-analytic synthesis. Psychological Bulletin, 137, 682–707.PubMed CrossRef
  Tye-Murray, N. (2015). Foundations of aural rehabilitation: Children, adults, and their family members (4th ed.). Clifton Park, NY: Delmar Cengage Learning.
  Tye-Murray, N., & Geers, A. (2001). The Children’s Audiovisual Enhancement Test (CAVET). St. Louis, MO: Central Institute for the Deaf.
  Tyler, R. S., Preece, J. P., & Tye-Murray, N. (1986). The Iowa phoneme and sentence tests. Iowa City, IA: University of Iowa.
  Van Engen, K. J., & Bradlow, A. R. (2007). Sentence recognition in native- and foreign-language multi-talker background noise. Journal of the Acoustical Society of America, 121, 519–526.PubMed PubMedCentral CrossRef
  Wightman, F., Kistler, D., & Brungart, D. (2006). Informational masking of speech in children: Auditory-visual integration. The Journal of the Acoustical Society of America, 119, 3940–3949.PubMed PubMedCentral CrossRef
  
• 作者单位：Joel Myerson (1)
  Brent Spehar (2)
  Nancy Tye-Murray (2)
  Kristin Van Engen (1)
  Sandra Hale (1)
  Mitchell S. Sommers (1)
  
  1. Department of Psychological & Brain Sciences, Washington University, St. Louis, MO, 63130, USA
  2. Department of Otolaryngology, Washington University School of Medicine, St. Louis, MO, USA
  
• 刊物主题：Cognitive Psychology;
• 出版者：Springer US
• ISSN：1943-393X

文摘

Whereas the energetic and informational masking effects of unintelligible babble on auditory speech recognition are well established, the present study is the first to investigate its effects on visual speech recognition. Young and older adults performed two lipreading tasks while simultaneously experiencing either quiet, speech-shaped noise, or 6-talker background babble. Both words at the end of uninformative carrier sentences and key words in everyday sentences were harder to lipread in the presence of babble than in the presence of speech-shaped noise or quiet. Contrary to the inhibitory deficit hypothesis of cognitive aging, babble had equivalent effects on young and older adults. In a follow-up experiment, neither the babble nor the speech-shaped noise stimuli interfered with performance of a face-processing task, indicating that babble selectively interferes with visual speech recognition and not with visual perception tasks per se. The present results demonstrate that babble can produce cross-modal informational masking and suggest a breakdown in audiovisual scene analysis, either because of obligatory monitoring of even uninformative speech sounds or because of obligatory efforts to integrate speech sounds even with uncorrelated mouth movements.