Efflorescence

Have you ever wondered how a movie sounds?
Directors and cinematographers work with a carefully crafted colour palette in the movies they make. For example, the warm tints of a Woody Allen picture or Stan Kubrick’s love for the colour red. These palettes often convey a certain atmosphere about the movie to its viewer.

Inspired by this technique, the team set out to capture and convey this atmosphere in a different medium: sound. Every color has its own sound: the hue determines the base scale of a sound, while the saturation creates differences in the pitch, and the brightness corresponds with the sound’s volume.

By analysing every frame of a movie, Processing generates 16 average colours of the current frame. Like in a 16-step sequence synthesizer, sounds are then being generated one by one on a networked beat.

The colours are then remapped into an abstract visual representation, which is projected on a physical structure. The average colours are used to create an enchanting floral-like pattern that showcases the 16 colours.

This performance wants to explore and enhance the boundaries between movie, sound, color and the perception of the viewer