Sonification

Ichographs MdelP

Audiovisual Installation. 1ch HD video| 2ch sound. Dimension Variable.
Ichographs MdelP (Madonna del Prato) is a sound and picture artwork that explores the relationships between colors and frequencies. The famous painting of Raffaello “Madonna del Prato” (Madonna of the Meadow) is decomposed into 10,0000 cubic particles each carrying a frequency relevant to its color (HSV hue value). As we move around, we hear the sound of all these colors/frequency generator particles fly in the space towards the canvas to compose the painting. Warm colors (like red) are higher frequencies and cold colors (like blue) are lower frequencies.

Ichographs is a method of creating soundscapes using visual stimulus and the color-frequency transformation. The painting is transformed into the audio domain and back to visual producing a contemporary amalgamation. As we pass through the various color/frequency layers, we investigate the connections between classical aesthetics and the digital practice, revealing a latent version of the old masterpiece. The final artwork is a contemporary amalgamation of the old painting and the modern abstraction methods, a harmonious dialog between the old and the new, the analog and the digital.

Featured in:

gizmodo-logo hyperallergic_header openCulture
icons-s51ce3b791e

Big_Think_NEW_Logo_BUG

Festivals & Exhibitions:

The Muses Project @ Chania Museum of Contemporary Art, Chania, Greece (July 08, 2017)
FILE 2017, Sao Paulo, Brazil (July 01, 2017)
The Muses Project, Athens, Greece (February 08, 2017)
MADATAC 08 – Festival of New Media Arts, Madrid, Spain (January 12, 2017)
MozFest 2016, London , United Kingdom (October 28, 2016)
AnimaSyros 9.0, Syros, Greece (September 21, 2016)
GENERATE!° LAB, Tübingen, Germany (May 28, 2016)
backup_festival, Weimar, Germany (May 18, 2016)
Creative Tech Week, Brooklyn, United States (April 30, 2016)

Stills

Photos from Veranstaltungen der Shedhalle Tübingen GENERATE!° lab at Tübingen, Germany, where “Ichographs MdelP” was presented.

Technical Information

“Ichographs MdelP”was created using Open Frameworks and Pure Data. The image was divided into 10,000 pieces. Each piece was assigned a frequency depending on its color and more specifically its HSV hue value. Warm colors (like red) are higher frequencies (up to 800Hz) and cold colors (like blue) are lower frequencies (down to 50Hz). Other properties of the color like the saturation and the value (again in HSV color representation) are used for defining the dimensions, the position and the speed of the particle.

Color-Frequency-Relationship

Warm colors (like red) are higher frequencies (up to 800Hz) and cold colors (like blue) are lower frequencies (down to 50Hz)

As the camera moves around we hear the sound that all these 10,000 moving colors/frequency generators are producing. The loudness of each particle is proportional to the distance from viewer. As a result, when we pass over over Madonna’s scarlet dress, we hear the high “red” frequencies; conversely, as it scans fragments of the blue sky, we start hearing the low “blue” frequencies. All the sound data(sound amplitudes) were sent via OSC to a Pure Data  patch with a set of 600 sine-wave generators for producing the sound.

A screenshot from a Pure Data patch containing the 600 sound oscillators.

A screenshot from a Pure Data patch containing the 600 sound oscillators.

Ichographs I

Note: This video has very low frequencies that are essential. Please use an audio system that can reproduce  low-pitched audio frequencies. Built-in laptop speakers and basic desktop speakers are not recommended.

Lumen Prize Logo MADADAC 06 New Media Art Festival cyberfest 2014 AnimaSyros
eufonic lsff_official_selection (h)ear XL

Synopsis:

Ichographs: Emerging soundscapes from visual forms.

“Ichographs I” is an audio and video artwork that explores the relationship between visual forms and audio by transforming colors into frequencies. The image is decomposed in the basic colors that have created it. Every color is a sonic frequency. A total 600 sine wave sound generators are recreating the image in the audio domain while we watch the color tessera come off the image and fly into space. By translating the color data into audible sound we are using famous paintings to create new sonic environments.

Taking as a starting point 9 famous paintings (and one imitation) we are experiencing unique sound colors and textures coming out of each one. Caravaggio’s  dramatic use of light is transformed into a passage from single tone into frequency intensity.  The sound is following the complexity of colors and patterns of Pollock’s drip technique and the reflections of light on the surface of Monet’s water lily pool are producing a multicolor drone.

The paintings are: “Bathers at Asnieres” (1884) Georges Seurat, “Number 1A” (1948) Jackson Pollock, “Rouen Cathedral, West Facade” (1894) Claude Monet, “Powwow” (1969) Gene Davis, “Self-Portrait” (1889) Vincent van Gogh, “That” (1958) Kenneth Noland, “The Japanese Footbridge” (1899) Claude Monet, “Ohhh…Alright…” (1964) Roy Lichtenstein, “Portrait of Vincent van Gogh” (detail) (1925/1928) Imitator of Vincent van Gogh, “Salome with the Head of John the Baptist” (1609) Caravaggio.

The video frames were created using C++ and Cinder library while the sound generated in Pure Data.

Video is in 1080HD and the audio in 5.1 surround.

Festivals & Exhibitions:

SIMULTAN 2015 “TALKING TO STRANGERS”, Timisoara, Romania (October 07, 2015)
AnimaSyros 8.0, Syros, Greece (September 24, 2015)
Lumen Prize 2015 Online Gallery, , (September 01, 2015)
Eufònic Festival, Amposta , Spain (August 28, 2015)
21st International Symposium on Electronic Art (ISEA), Vancouver, Canada (August 14, 2015)
10th Athens ANIMFEST, Athens, Greece (August 14, 2015)
CYBERFEST, New York, United States (January 08, 2015)
MADATAC 06 – Festival of New Media Arts, Madrid, Spain (December 10, 2014)
Universe in Your Pocket, St Petersburg, Russia (October 20, 2014)
Life Science Film Festival 2014, Prague, Czech Republic (October 13, 2014)
(h)ear XL II – Multimedia sound art exhibition, Heerlen, Netherlands (September 26, 2014)

Lumen Prize Logo“Ichograph Triptych – Monet”, a digital artwork derived from “Ichographs I” installation,
was shortlisted for the Lume Prize 2015.

Technical Information:

The project was divided in two parts; the visual and the audio.

The visual part was created in C++ using Cinder library with OpenCV and OSC blocks. The image is analyzed in 600 basic colors in HSV format. Each color corresponds to an audible frequency. Using a specific algorithm, the amplitude and the duration of each frequency is calculated. We can watch each color as a small tessera flying off the image. In its empty place, small dots create the spectrogram of the missing part of the image. The video frames are calculated in 1080 FullHD resolution.

Screenshot of the software that image analyzes the image.

Screenshot of the software that image analyzes the image.

The audio part has been created in Pure Data. Pure data receives the amplitudes and durations of every frequency and using a cosine wave oscillator for every frequency/color, it generates the soundscapes. A 5.1 surround format has been chosen in order to spread the sound generator across the corners of the room.

A screenshot from a Pure Data patch containing the 600 sound oscillators.

A screenshot from a Pure Data patch containing the 600 sound oscillators.

Ichographs at Lo Pati Gallery

“Ichographs I” at Digital Landscapes exhibition at Lo Pati Gallery (Amposta , Spain) for Eufonic festival.

Ichographs - View from inside the projection room

Concept view from inside the projection room.

Screening at Luda Gallery, St Petersburg for Cyberfest media art festival

Screening at Luda Gallery, St Petersburg during Cyberfest media art festival

Photos:

Ichographs.mp4_000046699

“Bathers at Asnieres” (1884) Georges Seurat (Still frame from “Ichographs I”)

Ichographs.mp4_000109699

“Number 1A” (1948) Jackson Pollock (Still frame from “Ichographs I”)

Ichographs.mp4_000156699

“Rouen Cathedral, West Facade” (1894) Claude Monet (Still frame from “Ichographs I”)

Ichographs.mp4_000317499

“That” (1958) Kenneth Noland (Still frame from “Ichographs I”)

Ichographs.mp4_000484867

“Portrait of Vincent van Gogh” (detail) (1925/1928) Imitator of Vincent van Gogh (Still frame from “Ichographs I”)

Ichographs.mp4_000517866

“Salome with the Head of John the Baptist” (1609) Caravaggio (Still frame from “Ichographs I”)

 

>> Read about the digital art derived from “Ichographs I” installation.