Synaesthesia – a ‘mixing of the senses’

The 2014 winner of the Paul Bourke Award was Associate Professor Anina Rich, a researcher from Macquarie University. This honour is awarded annually by the Academy of the Social Sciences in Australia to an early researcher who has achieved excellence in their field. As part of the award the winner presents their recent research in a public lecture at their home university. Dr Anina Rich studies how the brain integrates sensory information, particularly focusing on synaesthesia.

People with synaesthesia (synaesthetes) perceive sensory information in a different way. They can experience colours in association with letters, sounds or smells. The most common type of synaesthesia is letter-colour (Figure 1) but there are also other types such as auditory-visual and olfactory-visual synaesthesia. Chiou & Rich (2014) define synaesthesia as a ‘concurrent and distinct experience in a separate or the same modality’.

Figure 1. A representation of the colours one synaesthetes associates with each letter and number.

Figure 1. A representation of the colours one synaesthete associates with each letter and number.

Synaesthesia is present is 0.05-4% of the population and may have a genetic link. Relatives with synaesthesia are common and it is more prevalent in females than males. Many people don’t realise they are a synaesthete as their synaesthetic experience is constant over time and normal for them (perception in general is subjective).

Dr Rich is interested in studying synaesthesia as it may provide information about how information is normally integrated. Synaesthesia is not a medical disorder, there are no deficits associated with it. Many synaesthetes report that the extra sensory information they receive can be used to improve their memory and learning. Dr Rich is interested in seeing if synaesthetes have extra connections in the brain or are just using their connections between brain sections in a different way to the rest of the population.

To test this idea, Dr Rich and her team asked seven auditory-visual synaesthetes to describe the location on a grid of colours and shapes in response to auditory stimulus (Figure 2). Using functional MRI, Dr Rich and her team were able to work out that the occipital lobe in the back of the brain is stimulated when auditory-visual synaesthetes are presented with auditory information.

Figure 2. Examples of the stimuli presented to the auditory-visual synaesthetes (Chiou et al. 2013).

Figure 2. Examples of the stimuli presented to the auditory-visual synaesthetes (Chiou et al. 2013).

In addition, Dr Rich’s team has been investigating the areas of the brain non-synaesthetes use to process information about objects and colours. For example, a lemon is instantly recognisable as a lemon due to its yellow colour. When this colour is changed to something incongruent, like a red lemon, it becomes harder to identify. This object-colour binding is centralised in the anterior temporal lobe of the brain. Dr Rich is now conducting research to see if the same brain location of object-colour binding is seen in synaesthetes and what happens to their synaesthetic experience if the activity of this brain region is temporarily disrupted (Chiou et al. 2014).

Studying synaesthesia and how the brain processes sensory information is important as it can provide information about how learning and experience can alter our perception. As Dr Rich said in her presentation “what we already know has huge influence on what we think we see”. This work has implications for designing environments where people are required to process multiple sources of information, such as airplane cockpits.

To learn more:

Chiou R & Rich AN (2014). The role of conceptual knowledge in understanding synaesthesia: Evaluating contemporary findings from a “hub-and-spokes” perspective. Frontiers in Psychology, 5(105), 2-18. doi:  10.3389/fpsyg.2014.00105.

Chiou R, Stelter M & Rich AN (2013). Beyond colour perception: Auditory-visual synaesthesia induces experiences of geometric objects in specific locations. Cortex, 49(6), 1750-1763.

Chiou R, Sowman PF, Etchell AC & Rich AN (2014).A Conceptual Lemon: Theta Burst Stimulation to the Left Anterior Temporal Lobe Untangles Object Representation and Its Canonical Color. Journal of Cognitive Neuroscience, 26(5) 1066-1074. doi:10.1162/jocn_a_00536.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s