STORY TELLING ROOM

I am conducting an in-depth investigation for the realization of a system able to combine gesture and vocal recognition for interactive art, live events and speech based expressive applications. Practically, my goal is to create a flexible platform for collaborative and improvisatory storytelling combining voice and movement. The work advances both conceptual and technical research, relating speech, body, and perfor- mance, using digital technologies and interactive media.

The purpose is to create an immersive audio-visual Story Telling Room that responds to voice and sound inputs. The challenge is to set up an efficient speech feature extraction mechanism using the best microphone conditions possible. Using realtime media chore- ography framework techniques, I am mapping speech to a wide variety of media such as animated glyphs, visual graphics, light fields and soundscapes. My desiderata for mapping speech information centre on reproducibility, maximum sensitivity, and nil latency. My purpose is not to duplicate but to augment the experience of the story that is being unfolded with a performer and audience in ad hoc, improvised situations using speech and voice for expressive purposes.

Visuals: Jérôme Delapierre Sound: Navid Navab Lights: Julian Stein
Special Thanks to Elena Frantova