In a Nutshell.
MusIcon™ is a picture where you can move around it and listen to different music moments. The sounds and music change depending on the place and time. MusIcon™ is an image with an interactive soundscape.
Music in its nature includes motion but most times it doesn’t interact with the listener. So I designed a virtual 2D audio canvas where I placed a number of music sources in the space. Every source is like a small orchestra that plays a music relevant with the specific picture’s detail. Some of these music sources are musically related and some other are not. The listener can move around (using the mouse in a computer or his/her finger for a touch device) and listen to different musical moments as he is the composer-mixer. The duration of the music of every source is different so there is no obvious restart point of the mix. Considering also the fact that the movement of every listener is also different, gives us unlimited musical moments. In other words, MusIcon™ is an image with an interactive soundscape.
Point Music Sources vs Music Heatmaps.
My first approach on MusIcons was using point music sources. Every music or sound derived from a single point on the image. This is similar to having speakers around the image. The closer you are on the speaker the louder the sound. You can see this approach on “An Experiment on a Bird in the Air Pump”.
When I started working on Joan Miro’s “Blue II” MusIcon, I wanted the music for the red stroke to be heard only over the red stroke and across it. This was impossible to achieve it using a single point in the middle of the stroke as music source. So, I came up with the idea of Music Heatmap. Music heatmap is a visual representation of the music volume just like a heatmap is a visual representation of the temperature. In our case, is a grayscale image representing the volume of the music from black=0% volume to white=100% volume. Bellow are the heatmaps I created for the “Blue II”:
The Red Stroke
Music heatmaps have many advantages over music sources approach. You can control the spread of the sound and the direction. You can have a sound that stops immediately in an sharp edge or spreads smoothly in another. You can also have the same sound in two or more areas of the image. Finally, if you want to achieve the same result as in point music sources, you can create heatmaps with smooth round circles in the points where you want the music sources to be.
Bellow is “Blue II” MusIcon using the above six music heatmaps:
Hint: place your mouse over the picture and move it around.
Use mouse wheel or double click to zoom in/out. For best experience click full screen.
Click the bulb icon for a visual representation of the soundscape.
MusIcon™ interface is created in Flash using AS3. It is available as flash for the web in my website and as Android application from SlideMe here.
- The images are in hi-resolution so you can zoom in/out using mouse wheel or double click(tap).
- Fullscreen (Theater) mode.
- Visual representation of the music heatmaps (soundscape) and how they trigger by the listener. Every music heatmap is drawn with different color (click the bulb icon).
- Random tour around the MusIcon (click ticket icon). Useful in mobile devices while you are on the go with your earphones.
MusIcon: from Music and Icon.
A couple of months ago I visited Jamie Beck’s “From Me to You” website where I discovered the magic of Cinemagraphs (Jamie Beck and Kevin Burg, creators of Cinemagraphs, define it as “[…] an image that contains within itself a living moment that allows a glimpse of time to be experienced and preserved endlessly”.) I was fascinated by the new dimension that Cinemagraphs give to photography by moving it one step ahead without removing the magic that still pictures have (like occasionally video does). Although you know that this is a loop of some seconds, you can find yourself watching it for minutes. I was first thought to combine Cinemagraphs and music. Then I realized that Cinemagraphs were too distracting combining with music so I decided to use still images. This was the inspiration for creating MusIcon™.
MusIcon is a music space that always changing. I have the belief that the final result, the feeling of the viewer/listener, is similar to Cinemagraphs and gives the illusion of an eternal moment. All these musical moments, because they are constructed from the same sources, have similar qualities and characteristics and this creates the sense of a repetition.