RobotsMakeTV is a real-time generative show that enables a 3-way authorship dynamic between ML models, human/machine directors, and a live audience.
The system was designed to enable the composition of a variety of evolving AI technologies. Generative AI models enable the creation of contextually-aware scripts, emotional analysis, voice synthesis, animations, and visual assets. Show directors can seamlessly experiment and launch their custom productions to live audiences.
Powering all of this is an event-sourced backend with an API that enables novel forms of interaction and presentation. This resulted in the creation of a realtime control panel for directors, a chat-based interaction loop for live audiences on Twitch, a no-code programming interface for sequencing shows, and ultimately an experimental robot director powered by the latest language models.