Created by Google Arts & Culture Lab artist in residence, Gaël Hugo, Lip Sync is a playful exploration using Google AI to generate discussions on a variety of intriguing cultural topics. Whether you're a content creator, researcher, or writer, Lip Sync brings to life real-time discussions between two animated lips, using pre-generated questions to stimulate conversation and debate.
The experiment uses Gemini - Google’s Multimodal Large Language Model - to analyze the question. Gemini then generates a two person script on the selected topic, which is sent to a Google AI Audio Model to generate the audio in real time.