FABLES is an application that gives new form to spoken word by visualizing the users’ voice as real-time reactive animation.
FABLES presents poetry and narrative as text against a white screen. As the reader speaks the words out loud, the application produces imagery and animation. The animation will take on a variety of forms depending on the reader's pitch and volume. Furthermore, the reader may improvise rhyming words as they speak. The reader’s improvisations will be reflected in the imagery revealed. The core concept is to explore the intimate connections between the experience of speaking, modulating and comprehension. By providing a rich environment to interact with the text, Fables hopes to advocate for active and engaged reading and listening practices.
The body of poetry and fiction created for Fables will be designed to appeal to young readers: i.e. clear, straightforward, action-oriented, exciting, optimistic, and funny. Narrative, playful language, rhymes, vivid imagery and humor will be used to engage the users, improve retention and promote revisiting of text. We hope the content will inspire dialogue on a wide range of issues between generations (culture, class, race, love, aging, integrity, family). While we are thinking of this version of the project primarily for readers of English, we will explore the blending of two or more languages.
FABLES is about giving new forms and movements to the spoken word. In order to inspire a feeling of intimacy the software will articulate the “character” of the speech. Beyond this technological innovation, there is a great depth of creative opportunities to be mined within the realm of speech and meaning. Sometimes the imagery associated with the spoken words will follow closely, other times the imagery will subvert expectation. The project’s intention is to provide users with a starting point for new perspectives on language, speaking and expression.
We hope readers will engage with big questions about how knowledge is transferred, how images are invoked, and how the concept of “reading” has evolved over time. We would like visitors to think creatively and critically while engaging with the application.
FABLES received fiscal sponsorship from NYFA to help build the project into something bigger.