Unmasking the dichoptic mask by sound: spatial congruency matters

详细信息    查看全文

• 作者：Yung-Hao Yang (1)
  Su-Ling Yeh (1) (2) (3)
  
• 关键词：Multisensory integration ; Auditory facilitation ; Binocular rivalry ; Interocular suppression ; Continuous flash suppression
• 刊名：Experimental Brain Research
• 出版年：2014
• 出版时间：April 2014
• 年：2014
• 卷：232
• 期：4
• 页码：1109-1116
• 全文大小：432 KB
• 参考文献：1. Alsius A, Munhall KG (2013) Detection of audiovisual speech correspondences without visual awareness. Psychol Sci 24(4):423鈥?31. doi:10.1177/0956797612457378 CrossRef
  2. Bolognini N, Senna I, Maravita A, Pascual-Leone A, Merabet LB (2010) Auditory enhancement of visual phosphene perception: the effect of temporal and spatial factors and of stimulus intensity. Neurosci Lett 477(3):109鈥?14. doi:10.1016/j.neulet.2010.04.044 CrossRef
  3. Busse L, Roberts KC, Crist RE, Weissman DH, Woldorff MG (2005) The spread of attention across modalities and space in a multisensory object. Proc Natl Acad Sci USA 102(51):18751鈥?8756. doi:10.1073/pnas.0507704102 CrossRef
  4. Chatterjee G, Wu DA, Sheth BR (2011) Phantom flashes caused by interactions across visual space. J Vis 11(2). doi:10.1167/11.2.14
  5. Chen KM, Yeh SL (2009) Asymmetric cross-modal effects in time perception. Acta Psychol 130(3):225鈥?34. doi:10.1016/j.actpsy.2008.12.008 CrossRef
  6. Chen YC, Yeh SL (2012) Look into my eyes and I will see you: unconscious processing of human gaze. Conscious Cogn 21(4):1703鈥?710. doi:10.1016/j.concog.2012.10.001 CrossRef
  7. Chou WL, Yeh SL (2012) Object-based attention occurs regardless of object awareness. Psychon Bull Rev 19(2):225鈥?31. doi:10.3758/s13423-011-0207-5 CrossRef
  8. Costello P, Jiang Y, Baartman B, McGlennen K, He S (2009) Semantic and subword priming during binocular suppression. Conscious Cogn 18(2):375鈥?82. doi:10.1016/j.concog.2009.02.003 CrossRef
  9. de Gelder B, Bertelson P (2003) Multisensory integration, perception and ecological validity. Trends Cogn Sci 7(10):460鈥?67 CrossRef
  10. de Gelder B, Vroomen J, Pourtois G, Weiskrantz L (2000) Affective blindsight: are we blindly led by emotions? Response to Heywood and Kentridge (2000). Trends Cogn Sci 4(4):126鈥?27 CrossRef
  11. de Gelder B, Pourtois G, Weiskrantz L (2002) Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. Proc Natl Acad Sci USA 99(6):4121鈥?126. doi:10.1073/pnas.06201849999/6/4121 CrossRef
  12. Di Luca M, Machulla TK, Ernst MO (2009) Recalibration of multisensory simultaneity: cross-modal transfer coincides with a change in perceptual latency. J Vis 9(12):1鈥?6. doi:10.1167/9.12.7 CrossRef
  13. Dolan RJ, Morris JS, de Gelder B (2001) Crossmodal binding of fear in voice and face. Proc Natl Acad Sci USA 98(17):10006鈥?0010. doi:10.1073/pnas.171288598171288598 CrossRef
  14. Driver J, Spence C (1998) Attention and the crossmodal construction of space. Trends Cogn Sci 2(7):254鈥?62. doi:10.1016/S1364-6613(98)01188-7 CrossRef
  15. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870):429鈥?33. doi:10.1038/415429a CrossRef
  16. Fang F, He S (2005) Cortical responses to invisible objects in the human dorsal and ventral pathways. Nat Neurosci 8(10):1380鈥?385 CrossRef
  17. Freides D (1974) Human information processing and sensory modality: cross-modal functions, information complexity, memory, and deficit. Psychol Bull 81(5):284鈥?10 CrossRef
  18. Godfroy M, Roumes C, Dauchy P (2003) Spatial variations of visual-auditory fusion areas. Perception 32(10):1233鈥?245 CrossRef
  19. Jiang Y, Costello P, He S (2007) Processing of invisible stimuli: advantage of upright faces and recognizable words in overcoming interocular suppression. Psychol Sci 18(4):349鈥?55 CrossRef
  20. Laurienti PJ, Kraft RA, Maldjian JA, Burdette JH, Wallace MT (2004) Semantic congruence is a critical factor in multisensory behavioral performance. Exp Brain Res 158(4):405鈥?14. doi:10.1007/s00221-004-1913-2 CrossRef
  21. Lin Z, He S (2009) Seeing the invisible: the scope and limits of unconscious processing in binocular rivalry. Prog Neurobiol 87(4):195鈥?11. doi:10.1016/j.pneurobio.2008.09.002 CrossRef
  22. Lu ZL, Tse HC, Dosher BA, Lesmes LA, Posner C, Chu W (2009) Intra- and cross-modal cuing of spatial attention: time courses and mechanisms. Vis Res 49(10):1081鈥?096. doi:10.1016/j.visres.2008.05.021 CrossRef
  23. McDonald JJ, Teder-Salejarvi WA, Ward LM (2001) Multisensory integration and crossmodal attention effects in the human brain. Science 292(5523):1791. doi:10.1126/science.292.5523.1791a CrossRef
  24. Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Brain Res Cogn Brain Res 17(1):154鈥?63 CrossRef
  25. Mudrik L, Breska A, Lamy D, Deouell LY (2011) Integration without awareness: expanding the limits of unconscious processing. Psychol Sci 22(6):764鈥?70. doi:10.1177/0956797611408736 CrossRef
  26. Ngo MK, Spence C (2010) Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli. Atten Percept Psychophys 72(6):1654鈥?665. doi:10.3758/APP.72.6.1654 CrossRef
  27. Noesselt T, Fendrich R, Bonath B, Tyll S, Heinze HJ (2005) Closer in time when farther in space鈥搒patial factors in audiovisual temporal integration. Brain Res Cogn Brain Res 25(2):443鈥?58. doi:10.1016/j.cogbrainres.2005.07.005 CrossRef
  28. Perrott DR, Saberi K, Brown K, Strybel TZ (1990) Auditory psychomotor coordination and visual search performance. Percept Psychophys 48(3):214鈥?26 CrossRef
  29. Recanzone GH (2003) Auditory influences on visual temporal rate perception. J Neurophysiol 89(2):1078鈥?093. doi:10.1152/jn.00706.2002 CrossRef
  30. Soto-Faraco S, Lyons J, Gazzaniga M, Spence C, Kingstone A (2002) The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. Brain Res Cogn Brain Res 14(1):139鈥?46 CrossRef
  31. Spence C (2012) Multisensory perception, cognition, and behavior: evaluating the factors modulating multisensory integration. In: Stein BE (ed) The new handbook of multisensory processing. MIT Press, Cambridge, MA
  32. Spence C, Driver J (1997) Audiovisual links in exogenous covert spatial orienting. Percept Psychophys 59(1):1鈥?2 CrossRef
  33. Spence C, McDonald J (2004) The crossmodal consequences of the exogenous spatial orienting of attention. In: Calvert GA, Spence C, Stein BE (eds) The handbook of multisensory processing. MIT Press, Cambridge, MA, pp 3鈥?5
  34. Spence C, McDonald J, Driver J (2004) Exogenous spatial-cuing studies of human crossmodal attention and multisensory integration. In: Spence C, Driver J (eds) Crossmodal space and crossmodal attention. Oxford University, Oxford, pp 277鈥?20 CrossRef
  35. Stein BE, Meredith MA (1990) Multisensory integration. Neural and behavioral solutions for dealing with stimuli from different sensory modalities. Ann N Y Acad Sci 608:51鈥?5; discussion 65鈥?0 CrossRef
  36. Stein BE, Meredith MA, Wallace MT (1993) The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog Brain Res 95:79鈥?0 CrossRef
  37. Stein BE, London N, Wilkinson LK, Price DD (1996) Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J Cogn Neurosci 8(6):497鈥?06 CrossRef
  38. Stein T, Sterzer P, Peelen MV (2012) Privileged detection of conspecifics: evidence from inversion effects during continuous flash suppression. Cognition 125(1):64鈥?9. doi:10.1016/j.cognition.2012.06.005 CrossRef
  39. Stekelenburg JJ, Vroomen J, de Gelder B (2004) Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity. Neurosci Lett 357(3):163鈥?66. doi:10.1016/j.neulet.2003.12.085 CrossRef
  40. Teder-Salejarvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res 14(1):106鈥?14 CrossRef
  41. Teder-Salejarvi WA, Di Russo F, McDonald JJ, Hillyard SA (2005) Effects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17(9):1396鈥?409. doi:10.1162/0898929054985383 CrossRef
  42. Tsuchiya N, Koch C (2005) Continuous flash suppression reduces negative afterimages. Nat Neurosci 8(8):1096鈥?101 CrossRef
  43. Vroomen J, Keetels M (2006) The spatial constraint in intersensory pairing: no role in temporal ventriloquism. J Exp Psychol Hum Percept Perform 32(4):1063鈥?071. doi:10.1037/0096-1523.32.4.1063 CrossRef
  44. Wang L, Weng X, He S (2012) Perceptual grouping without awareness: superiority of Kanizsa triangle in breaking interocular suppression. PLoS ONE 7(6):e40106. doi:0.1371/journal.pone.0040106 CrossRef
  45. Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638鈥?67 CrossRef
  46. Welch RB, DuttonHurt LD, Warren DH (1986) Contributions of audition and vision to temporal rate perception. Percept Psychophys 39(4):294鈥?00 CrossRef
  47. Yang YH, Yeh SL (2011) Accessing the meaning of invisible words. Conscious Cogn 20(2):223鈥?33. doi:10.1016/j.concog.2010.07.005 CrossRef
  48. Yang E, Zald DH, Blake R (2007) Fearful expressions gain preferential access to awareness during continuous flash suppression. Emotion 7(4):882鈥?86. doi:10.1037/1528-3542.7.4.882 CrossRef
  49. Zhou W, Jiang Y, He S, Chen D (2010) Olfaction modulates visual perception in binocular rivalry. Curr Biol 20(15):1356鈥?358. doi:10.1016/j.cub.2010.05.059 CrossRef
  
• 作者单位：Yung-Hao Yang (1)
  Su-Ling Yeh (1) (2) (3)
  
  1. Department of Psychology, National Taiwan University, Taipei, Taiwan
  2. Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taipei, Taiwan
  3. Neurobiology and Cognitive Neuroscience Center, National Taiwan University, Taipei, Taiwan
  
• ISSN：1432-1106

文摘

People tend to look toward where a sound occurs; however, the role of spatial congruency between sound and sight in the effect of sound facilitation on visual detection remains controversial. We propose that the role of spatial congruency depends on the reliability of the information provided by the facilitator; if it is relatively unreliable, adding spatially congruent information can help to unify different sensory inputs to compensate for this unreliability. To test this, we examine the influence of sound location on visual detection with a non-temporal task, presumably unfavorable for sound since it is better for temporal resolution, and predict that spatial congruency should matter in this situation. We used the continuous flash suppression paradigm that makes the visual stimuli invisible to keep the relationship of sound and sight opaque. The sound is on the same depth plane as the visual stimulus (the congruent condition) or on a different plane (the incongruent condition). The target was presented to one eye with luminance contrast gradually increased and continuously masked by flashed Mondrian masks presented to the other eye until the target was released from suppression. We found that sound facilitated visual detection (measured by released-from-suppression time) in the spatially congruent condition but not in the spatially incongruent condition. Together with previous findings in the literature, it is suggested that both task type and modality determine the reliability of the information for multisensory integration and thus determine whether spatial congruency is critical.