Cross-modal associations between paintings and sounds: effects of embodiment

Marina Iosifian*, Anton Sidoroff-Dorso, Judith Wolfe

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Downloads (Pure)

Abstract

The present study investigated cross-modal associations between a series of paintings and sounds. We studied the effects of sound congruency (congruent vs. non-congruent sounds) and embodiment (embodied vs. synthetic sounds) on the evaluation of abstract and figurative paintings. Participants evaluated figurative and abstract paintings paired with congruent and non-congruent embodied and synthetic sounds. They also evaluated the perceived meaningfulness of the paintings, aesthetic value and immersive experience of the paintings. Embodied sounds (sounds associated with bodily sensations, bodily movements and touch) were more strongly associated with figurative paintings, while synthetic sounds (non-embodied sounds) were more strongly associated with abstract paintings. Sound congruency increased the perceived meaningfulness, immersive experience and aesthetic value of paintings. Sound embodiment increased immersive experience of paintings.
Original languageEnglish
Pages (from-to)871–888
Number of pages18
JournalPerception
Volume51
Issue number12
Early online date11 Oct 2022
DOIs
Publication statusPublished - 1 Dec 2022

Keywords

  • Cross-modal associations
  • Embodied
  • Aesthetics
  • Art
  • Sound

Cite this