Integration of visual and auditory information by Superior Temporal Sulcus neurons responsive to the sight of actions

Nicholas Edward Barraclough, DK Xiao, CI Baker, Michael William Oram, David Ian Perrett

Research output: Contribution to journalArticlepeer-review

250 Citations (Scopus)

Abstract

Processing of complex visual stimuli comprising facial movements, hand actions, and body movements is known to occur in the superior temporal sulcus (STS) Of humans and nonhuman primates. The STS is also thought to play a role in the integration of multimodal sensory input. We investigated whether STS neurons coding the sight of actions also integrated the sound of those actions. For 23% of neurons responsive to the sight of an action, the sound of that action significantly modulated the visual response. The Sound of the action increased or decreased the visually evoked response for an equal number of neurons, in the neurons whose visual response was increased by the addition of sound (but not those neurons whose responses were decreased), the audiovisual integration was dependent upon the sound of the action matching the sight of the action. These results suggest that neurons in the STS form multisensory representations of observed actions.

Original languageEnglish
Pages (from-to)377 - 391
Number of pages15
JournalJournal of Cognitive Neuroscience
Volume17
Issue number3
Publication statusPublished - Mar 2005

Keywords

  • MACAQUE MONKEY
  • MULTISENSORY INTEGRATION
  • POLYSENSORY AREA
  • RHESUS-MONKEY
  • CORTICAL CONNECTIONS
  • BIOLOGICAL MOTION
  • COLLICULUS NEURONS
  • PREMOTOR CORTEX
  • MIRROR NEURONS
  • SENSORY INPUTS

Fingerprint

Dive into the research topics of 'Integration of visual and auditory information by Superior Temporal Sulcus neurons responsive to the sight of actions'. Together they form a unique fingerprint.

Cite this