How does music interact with other modes of communication?

(Dr Simon McKerrell)

The following video introduces the topic of multimodality - how music communicates meaning through its interaction with other forms of communication.

In the video below, linguist Gunther Kress, an important scholar in this field, talks about the concept of multimodality and his own approach to it.

Essential Reading
Johnson, Mark L., and Steve Larson. 2003. ‘“Something in the Way She Moves”-Metaphors of Musical Motion’, Metaphor and Symbol, 18: 63–84
Van Leeuwen, Theo. 2004. Introducing Social Semiotics: An Introductory Textbook (Abingdon, Oxon: Routledge), pp. 179-207.
Van Leeuwen, Theo. 2012. ‘Multimodality and Rhythm’, The Encyclopedia of Applied Linguistics (Oxford: Blackwell Publishing Ltd)

Here's the recapped lecture on multimodality: