时间结构信息在人类知觉中的作用及其脑机制
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:The functional role of temporal structure in human perception: behavioral evidence and neural correlates
  • 作者:胡瑞晨 ; 袁佩君 ; 蒋毅 ; 王莹
  • 英文作者:HU Rui-Chen;YUAN Pei-Jun;JIANG Yi;WANG Ying;State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences;Department of Psychology, University of Chinese Academy of Sciences;
  • 关键词:时间结构 ; 知觉 ; 注意 ; 意识 ; 神经振荡 ; 预期编码
  • 英文关键词:temporal structure;;perception;;attention;;awareness;;neural oscillations;;predictive coding
  • 中文刊名:SLXU
  • 英文刊名:Acta Physiologica Sinica
  • 机构:中国科学院心理研究所,脑与认知科学国家重点实验室,脑科学与智能技术卓越创新中心;中国科学院大学心理学系;
  • 出版日期:2018-12-20 10:14
  • 出版单位:生理学报
  • 年:2019
  • 期:v.71
  • 基金:supported by grants from the National Natural Science Foundation of China (No. 31525011, 31771211 and 31830037);; the Strategic Priority Research Program (No. XDB32010300);; the Key Research Program of Frontier Sciences (No. QYZDB-SSW-SMC030);; the Youth Innovation Promotion Association of the Chinese Academy of Sciences (No. 2018116)
  • 语种:中文;
  • 页:SLXU201901011
  • 页数:12
  • CN:01
  • ISSN:31-1352/Q
  • 分类号:109-120
摘要
外界信息包含了丰富的时间结构,提取这些时间结构信息对于人类适应动态变化的环境具有重要的意义。然而,纵观认知科学领域,目前尚缺乏对这一问题的系统探讨。本文总结了时间结构信息的类型及特性,综述了视觉和听觉过程中,不同类型的时间结构信息广泛参与并调节认知活动的行为证据,及产生这些现象的神经基础。据此,本文提出对时间结构信息的提取和利用是人类认知的基本特点。来自不同通道、源于不同规律的时间结构信息不但可以通过调制神经振荡及诱发预期编码等机制在大脑中得到表达,还可以在此基础上有效调节知觉、注意甚至无意识信息加工等过程。同时,不同的时间结构信息也可能通过各自特异性的加工机制对认知产生影响。上述观点为理解大脑如何利用多样性的时间结构信息优化动态信息处理提供了理论基础,也激发研究者对这些现象背后的脑机制展开更加深入的探索。
        To extract the temporal structure of sensory inputs is of great significance to our adaptive functioning in the dynamic environment. Here we characterize three types of temporal structure information, and review behavioral and neural evidence bearing on the encoding and utilization of such information in visual and auditory perception. The evidence together supports a functional view that the brain not only tracks but also makes use of temporal structure from diverse sources for a broad range of cognitive processes,such as perception, attention, and unconscious information processing. These functions are implemented by brain mechanisms including neural entrainment, predictive coding, as well as more specific mechanisms that vary with the type of temporal regularity and sensory modality. This framework enriches our understanding of how the human brain promotes dynamic information processing by exploiting regularities in ubiquitous temporal structures.
引文
1 Patel AD.Language,music,syntax and the brain.Nat Neurosci 2003;6(7):674-681.
    2 Marslen-Wilson W,Tyler LK.The temporal structure of spoken language understanding.Cognition 1980;8(1):1-71.
    3 Brookshire G,Lu J,Nusbaum HC,Goldin-Meadow S,Casasanto D.Visual cortex entrains to sign language.Proc Natl Acad Sci U S A 2017;114(24):6352-6357.
    4 Chandrasekaran C,Trubanova A,Stillittano S,Caplier A,Ghazanfar AA.The natural statistics of audiovisual speech.PLoS Comput Biol 2009;5(7):e1000436.
    5 Jones MR,Kidd G,Wetzel R.Evidence for rhythmic attention.J Exp Psychol Hum Percept Perform 1981;7(5):1059-1073.
    6 Jones MR,Boltz M.Dynamic attending and responses to time.Psychol Rev 1989;96(3):459-491.
    7 Lee SH,Blake R.Visual form created solely from temporal structure.Science 1999;284(5417):1165-1168.
    8 Blake R,Lee SH.The role of temporal structure in human vision.Behav Cogn Neurosci Rev 2005;4(1):21-42.
    9 Herrmann CS.Human EEG responses to 1-100 Hz flicker:resonance phenomena in visual cortex and their potential correlation to cognitive phenomena.Exp Brain Res 2001;137(3-4):346-353.
    10 Sokoliuk R,VanRullen R.Global and local oscillatory entrainment of visual behavior across retinotopic space.Sci Rep 2016;6:25132.
    11 Henry MJ,Herrmann B,Obleser J.Entrained neural oscillations in multiple frequency bands comodulate behavior.Proc Natl Acad Sci U S A 2014;111(41):14935-14940.
    12 Keitel C,Thut G,Gross J.Visual cortex responses reflect temporal structure of continuous quasi-rhythmic sensory stimulation.Neuroimage 2017;146:58-70.
    13 Giani AS,Ortiz E,Belardinelli P,Kleiner M,Preissl H,Noppeney U.Steady-state responses in MEG demonstrate information integration within but not across the auditory and visual senses.Neuroimage 2012;60(2):1478-1489.
    14 Turk-Browne NB,Junge J,Scholl BJ.The automaticity of visual statistical learning.J Exp Psychol Gen 2005;134(4):552-564.
    15 Turk-Browne NB,Scholl BJ,Chun MM,Johnson MK.Neural evidence of statistical learning:efficient detection of visual regularities without awareness.J Cogn Neurosci2009;21(10):1934-1945.
    16 Zhao J,Al-Aidroos N,Turk-Browne NB.Attention is spontaneously biased toward regularities.Psychol Sci 2013;24(5):667-677.
    17 Nobre AC,van Ede F.Anticipated moments:temporal structure in attention.Nat Rev Neurosci 2018;19(1):34-48.
    18 Ding N,Melloni L,Zhang H,Tian X,Poeppel D.Cortical tracking of hierarchical linguistic structures in connected speech.Nat Neurosci 2016;19(1):158-164.
    19 Doelling KB,Poeppel D.Cortical entrainment to music and its modulation by expertise.Proc Natl Acad Sci U S A 2015;112(45):E6233-E6242.
    20 Winkler I,Haden GP,Ladinig O,Sziller I,Honing H.Newborn infants detect the beat in music.Proc Natl Acad Sci US A 2009;106(7):2468-2471.
    21 Trehub SE.The developmental origins of musicality.Nat Neurosci 2003;6(7):669-673.
    22 Haden GP,Honing H,Torok M,Winkler I.Detecting the temporal structure of sound sequences in newborn infants.Int J Psychophysiol 2015;96(1):23-28.
    23 Koffka K.Principles of Gestalt Psychology.Routledge,1935,106-176.
    24 Alais D,Blake R.Interactions between global motion and local binocular rivalry.Vision Res 1998;38(5):637-644.
    25 Darwin CJ.Auditory grouping.Trends Cogn Sci 1997;1(9):327-333.
    26 Arons B.A review of the cocktail party effect.J Am Voice I/O Soc 1992;12(7):35-50.
    27 Fahle M.Figure-ground discrimination from temporal information.Proc R Soc Lond B 1993;254(1341):199-203.
    28 Rogers-Ramachandran DC,Ramachandran VS.Psychophysical evidence for boundary and surface systems in human vision.Vision Res 1998;38(1):71-77.
    29 Kandil FI,Fahle M.Purely temporal figure-ground segregation.Eur J Neurosci 2001;13(10):2004-2008.
    30 Usher M,Donnelly N.Visual synchrony affects binding and segmentation in perception.Nature 1998;394(6689):179-182.
    31 Stone JV.Object recognition using spatiotemporal signatures.Vision Res 1998;38(7):947-951.
    32 Wang Y,Zhang K.Decomposing the spatiotemporal signature in dynamic 3D object recognition.J Vis 2010;10(10):23.
    33 Johansson G.Visual-perception of biological motion and a model for its analysis.Percept Psychophys 1973;14(2):201-211.
    34 Dittrich WH,Troscianko T,Lea SE,Morgan D.Perception of emotion from dynamic point-light displays represented in dance.Perception 1996;25(6):727-738.
    35 Dittrich WH.Action categories and the perception of biological motion.Perception 1993;22(1):15-22.
    36 Mather G,Murdoch L.Gender discrimination in biological motion displays based on dynamic cues.Proc R Soc Lond BBiol Sci 1994;258(1353):273-279.
    37 Neri P,Morrone MC,Burr DC.Seeing biological motion.Nature 1998;395(6705):894-896.
    38 Lange J,Lappe M.The role of spatial and temporal information in biological motion perception.Adv Cogn Psychol2007;3(4):419-428.
    39 Jones MR.Time,our lost dimension:toward a new theory of perception,attention,and memory.Psychol Rev 1976;83(5):323-355.
    40 Jones MR.Dynamic pattern structure in music:recent theory and research.Percept Psychophys 1987;41(6):621-634.
    41 Jones MR,Johnston HM,Puente J.Effects of auditory pattern structure on anticipatory and reactive attending.Cogn Psychol 2006;53(1):59-96.
    42 Barnes R,Jones MR.Expectancy,attention,and time.Cogn Psychol 2000;41(3):254-311.
    43 Jones MR,Moynihan H,MacKenzie N,Puente J.Temporal aspects of stimulus-driven attending in dynamic arrays.Psychol Sci 2002;13(4):313-319.
    44 Mathewson KE,Prudhomme C,Fabiani M,Beck DM,Lleras A,Gratton G.Making waves in the stream of consciousness:entraining oscillations in EEG alpha and fluctuations in visual awareness with rhythmic visual stimulation.J Cogn Neurosci 2012;24(12):2321-2333.
    45 Miller JE,Carlson LA,McAuley JD.When what you hear influences when you see:listening to an auditory rhythm influences the temporal allocation of visual attention.Psychol Sci 2013;24(1):11-18.
    46 ten Oever S,Schroeder CE,Poeppel D,van Atteveldt N,Zion-Golumbic E.Rhythmicity and cross-modal temporal cues facilitate detection.Neuropsychologia 2014;63:43-50.
    47 Hickok G,Farahbod H,Saberi K.The rhythm of perception:entrainment to acoustic rhythms induces subsequent perceptual oscillation.Psychol Sci 2015;26(7):1006-1013.
    48 Cutler A,Foss DJ.On the role of sentence stress in sentence processing.Lang Speech 1977;20(1):1-10.
    49 Quene H,Port RF.Effects of timing regularity and metrical expectancy on spoken-word perception.Phonetica 2005;62(1):1-13.
    50 Otsuka S,Nishiyama M,Nakahara F,Kawaguchi J.Visual statistical learning based on the perceptual and semantic information of objects.J Exp Psychol Learn Mem Cogn2013;39(1):196-207.
    51 Otsuka S,Koch C,Saiki J.Visual statistical learning produces implicit and explicit knowledge about temporal order information and scene chunks:Evidence from direct and indirect measures.Vis Cogn 2016;24(2):155-172.
    52 Otsuka S,Saiki J.Gift from statistical learning:Visual statistical learning enhances memory for sequence elements and impairs memory for items that disrupt regularities.Cognition 2016;147:113-126.
    53 Otsuka S,Saiki J.Neural correlates of implicit knowledge about statistical regularities.Exp Brain Res 2017;235(12):3573-3583.
    54 Yu RQ,Zhao J.The persistence of the attentional bias to regularities in a changing environment.Atten Percept Psychophys 2015;77(7):2217-2228.
    55 Ten Oever S,Schroeder CE,Poeppel D,van Atteveldt N,Mehta AD,Megevand P,Groppe DM,Zion-Golumbic E.Low-frequency cortical oscillations entrain to subthreshold rhythmic auditory stimuli.J Neurosci 2017;37(19):4903-4912.
    56 Bauer F,Cheadle SW,Parton A,Muller HJ,Usher M.Gamma flicker triggers attentional selection without awareness.Proc Natl Acad Sci U S A 2009;106(5):1666-1671.
    57 Alais D,Locke SM,Leung J,Van der Burg E.No attentional capture from invisible flicker.Sci Rep 2016;6:29296.
    58 van Diepen RM,Born S,Souto D,Gauch A,Kerzel D.Visual flicker in the gamma-band range does not draw attention.JNeurophysiol 2010;103(3):1606-1613.
    59 Faivre N,Koch C.Temporal structure coding with and without awareness.Cognition 2014;131(3):404-414.
    60 Lee M,Blake R,Kim S,Kim CY.Melodic sound enhances visual awareness of congruent musical notes,but only if you can read music.Proc Natl Acad Sci U S A 2015;112(27):8493-8498.
    61 van Gaal S,Naccache L,Meuwese JD,van Loon AM,Leighton AH,Cohen L,Dehaene S.Can the meaning of multiple words be integrated unconsciously?Philos Trans RSoc Lond B Biol Sci 2014;369(1641):20130212.
    62 Zhou J,Lee CL,Li KA,Tien YH,Yeh SL.Does temporal integration occur for unrecognizable words in visual crowding?PLoS One 2016;11(2):e0149355.
    63 Yang YH,Tien YH,Yang PL,Yeh SL.Role of consciousness in temporal integration of semantic information.Cogn Affect Behav Neurosci 2017;17(5):954-972.
    64 Mudrik L,Faivre N,Koch C.Information integration without awareness.Trends Cogn Sci 2014;18(9):488-496.
    65 Buzsaki G.Rhythms of the Brain.Oxford University Press,2006.
    66 Haegens S,Zion Golumbic E.Rhythmic facilitation of sensory processing:A critical review.Neurosci Biobehav Rev 2018;86:150-165.
    67 Zhang X(张雪),Yuan PJ,Wang Y,Jiang Y.Neural entrainment and perception.Prog Biochem Biophys(生物化学与生物物理进展)2016;43(4):308-315(in Chinese with English abstract).
    68 Cravo AM,Rohenkohl G,Wyart V,Nobre AC.Temporal expectation enhances contrast sensitivity by phase entrainment of low-frequency oscillations in visual cortex.J Neurosci2013;33(9):4002-4010.
    69 Henry MJ,Obleser J.Frequency modulation entrains slow neural oscillations and optimizes human listening behavior.Proc Natl Acad Sci U S A 2012;109(49):20095-20100.
    70 Spaak E,de Lange FP,Jensen O.Local entrainment of alpha oscillations by visual stimuli causes cyclic modulation of perception.J Neurosci 2014;34(10):3536-3544.
    71 Kosem A,Gramfort A,van Wassenhove V.Encoding of event timing in the phase of neural oscillations.Neuroimage2014;92:274-284.
    72 Tal I,Large EW,Rabinovitch E,Wei Y,Schroeder CE,Poeppel D,Zion Golumbic E.Neural entrainment to the beat:the“missing-pulse”phenomenon.J Neurosci 2017;37(26):6331-6341.
    73 Nozaradan S,Peretz I,Missal M,Mouraux A.Tagging the neuronal entrainment to beat and meter.J Neurosci 2011;31(28):10234-10240.
    74 Ding N,Melloni L,Yang A,Wang Y,Zhang W,Poeppel D.Characterizing neural entrainment to hierarchical linguistic units using electroencephalography(EEG).Front Hum Neurosci 2017;11:481.
    75 Doelling KB,Arnal LH,Ghitza O,Poeppel D.Acoustic landmarks drive delta-theta oscillations to enable speech comprehension by facilitating perceptual parsing.Neuroimage2014;85 Pt 2:761-768.
    76 Luo H,Poeppel D.Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex.Neuron2007;54(6):1001-1010.
    77 Ahissar E,Nagarajan S,Ahissar M,Protopapas A,Mahncke H,Merzenich MM.Speech comprehension is correlated with temporal response patterns recorded from auditory cortex.Proc Natl Acad Sci U S A 2001;98(23):13367-13372.
    78 Garrido MI,Kilner JM,Stephan KE,Friston KJ.The mismatch negativity:a review of underlying mechanisms.Clin Neurophysiol 2009;120(3):453-463.
    79 N??t?nen R,Tervaniemi M,Sussman E,Paavilainen P,Winkler I.‘Primitive intelligence’in the auditory cortex.Trends Neurosci 2001;24(5):283-288.
    80 Luo Y,Zhou X.ERP evidence for the online processing of rhythmic pattern during Chinese sentence reading.Neuroimage2010;49(3):2836-2849.
    81 Magne C,Astesano C,Aramaki M,Ystad S,Kronland-Martinet R,Besson M.Influence of syllabic lengthening on semantic processing in spoken French:behavioral and electrophysiological evidence.Cereb Cortex 2007;17(11):2659-2668.
    82 Magne C,Jordan DK,Gordon RL.Speech rhythm sensitivity and musical aptitude:ERPs and individual differences.Brain Lang 2016;153-154:13-19.
    83 Marie C,Magne C,Besson M.Musicians and the metric structure of words.J Cogn Neurosci 2011;23(2):294-305.
    84 Rothermich K,Schmidt-Kassow M,Kotz SA.Rhythm’s gonna get you:regular meter facilitates semantic sentence processing.Neuropsychologia 2012;50(2):232-244.
    85 Patel AD,Gibson E,Ratner J,Besson M,Holcomb PJ.Processing syntactic relations in language and music:an event-related potential study.J Cogn Neurosci 1998;10(6):717-733.
    86 Bekinschtein TA,Dehaene S,Rohaut B,Tadel F,Cohen L,Naccache L.Neural signature of the conscious processing of auditory regularities.Proc Natl Acad Sci U S A 2009;106(5):1672-1677.
    87 Kiefer M.The N400 is modulated by unconsciously perceived masked words:further evidence for an automatic spreading activation account of N400 priming effects.Cogn Brain Res 2002;13(1):27-39.
    88 Grahn JA,Brett M.Rhythm and beat perception in motor areas of the brain.J Cogn Neurosci 2007;19(5):893-906.
    89 Grahn JA,Rowe JB.Feeling the beat:premotor and striatal interactions in musicians and nonmusicians during beat perception.J Neurosci 2009;29(23):7540-7548.
    90 Grahn JA,Brett M.Impairment of beat-based rhythm discrimination in Parkinson’s disease.Cortex 2009;45(1):54-61.
    91 Chen JL,Penhune VB,Zatorre RJ.Listening to musical rhythms recruits motor regions of the brain.Cereb Cortex2008;18(12):2844-2854.
    92 Bengtsson SL,Ullen F,Ehrsson HH,Hashimoto T,Kito T,Naito E,Forssberg H,Sadato N.Listening to rhythms activates motor and premotor cortices.Cortex 2009;45(1):62-71.
    93 Merchant H,Harrington DL,Meck WH.Neural basis of the perception and estimation of time.Annu Rev Neurosci2013;36:313-336.
    94 Bouwer FL,Honing H.Temporal attending and prediction influence the perception of metrical rhythm:evidence from reaction times and ERPs.Front Psychol 2015;6:1094.
    95 Morillon B,Schroeder CE,Wyart V,Arnal LH.Temporal prediction in lieu of periodic stimulation.J Neurosci 2016;36(8):2342-2347.
    96 Klimesch W,Sauseng P,Hanslmayr S.EEG alpha oscillations:The inhibition-timing hypothesis.Brain Res Rev2007;53:63-88.
    97 Klimesch W.Alpha-band oscillations,attention,and controlled access to stored information.Trends Cogn Sci 2012;16(12):606-617.
    98 Mathewson KE,Lleras A,Beck DM,Fabiani M,Ro T,Gratton G.Pulsed out of awareness:EEG alpha oscillations represent a pulsed-inhibition of ongoing cortical processing.Front Psychol 2011;2:99.
    99 Ciavarro M,Ambrosini E,Tosoni A,Committeri G,Fattori P,Galletti C.rTMS of medial parieto-occipital cortex interferes with attentional reorienting during attention and reaching tasks.J Cogn Neurosci 2013;25(9):1453-1462.
    100 Ekman M,Kok P,de Lange FP.Time-compressed preplay of anticipated events in human primary visual cortex.Nat Commun 2017;8:15276.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700