IBM WATSON: REAL-TIME INSTALLATION

PROJECT OVERVIEW

Working with a team of developers at The Mill, I designed and art directed a massive real-time art installation powered by IBM Watson. Language and musical compositions were assigned emotional values by Watson, which we then translated into immersive visualizations that could be navigated by time, emotion and genre.

 

DESIGNING THE SYSTEM

We started by designing a custom piece of hardware capable of sorting massive amounts of data. Next, we designed an accompanying display screen, which served as a legend for the abstract visuals, as well as a user interface. Below are initial mockups for both devices.


LOOK DEVELOPMENT

The look of our data visualizations was inspired by the fluidity of dripping paint and flowing water. Our aim was to translate Watson’s data into a beautiful gestalt of color and texture. To do this, we paired specific visual parameters with various types of data.

 

The second component of our data visualizations was text-based. By analyzing song lyrics, tweets, and news headlines, we were able to generate real-time compositions based on the emotional tone and intensity of specific words, phrases, and sentences.

CREDITS

ROLE: Designer + Art Director

ECD: Rama Allen

DEVELOPERS: Mike Mahn, Éric Renaud-Houde, Clay Budin

STUDIO: The Mill