Generative Lighting Design with Synesthesia

Student thesis: Master thesis (including HD thesis)

  • Simon Borst Tyroll
4. Term, Lighting Design (Master Programme)
A system for audiovisual experiences is developed with inspiration from the human neurophysiological condition of synesthesia. Research suggests that synesthesia may be the result of a neural short circuit between the sensory systems in the brain, which is replicated by short circuiting two artificial sensory systems. It is emulated by the use of artificial neural networks (ANN) to replicate the sensory systems of the human brain. An autoencoder (AE) is used to recognise patterns in music, while a compositional pattern producing network (CPPN) is used to generate visual compositions. The AE extracts features from music and used to push the CPPN, which creates movements in the patterns it produces. In an experiment with 30 participants, the system was compared against a spectrogram and a CPPN producing movements based on Perlin noise. Results show that the developed system differentiates itself even in worst case conditions, and has potential for use as a generative design tool for dynamic lighting design. A lighting design was made using the system to show some different compositions of light and music. Further development is imperative to release the full potential of the system, by using a cybernetic approach to generative design.
Publication date28 Sep 2020
Number of pages89
ID: 369669643