Snapchat and the Royal Philharmonic Orchestra (RPO) have created an innovative, AR lens, The Colours of Music. This groundbreaking project uses cutting-edge technology to translate live music into vibrant visuals, offering a truly multi-sensory journey. But what went into creating this extraordinary experience?
Blending Art and Technology
Snapchat’s Paris AR Studio brought the lens to life, combining machine learning with the expertise of RPO musicians and scientific research. Users can scan a musician through Snapchat, which unlocks an intricate 3D visualization of the music they are playing, with shapes and colours evolving in real-time, reacting to the live performance. Inspired by chromesthesia, this project turns the phenomenon of “seeing” sound into a tangible experience for everyone, especially those who may be hard of hearing.
The Musicians Behind the Magic
Once the lens was ready to be used, we were able to film with RPO musicians Esther Kim (violin) and Jonathan Ayling (cello). They trialled the lens and had a behind-the-scenes look at how the technology works. Esther shared how inspiring it was to see music transformed into visual art, saying, “It’s a reminder of how universal music truly is.” Jonathan added, “This lens brings the emotion of music to life in ways I never imagined.”
Experience the Innovation
Try The Colours of Music lens on Snapchat, via the RPO's profile from Sunday 26 January, or just scan this Snap code:
Or you can join the launch event at Southbank Centre anytime between 11am and 4pm on Sunday 26 January where you will be able to experience the lens with live musicians, no phone needed!