Waymo Tests Gemini Integration

Waymo is exploring the integration of Google's Gemini AI into its robotaxis as an in-car assistant. A system prompt, comprising over 1,200 lines, details the expected behaviour of the AI assistant within the vehicle. This assistant aims to enhance the rider experience by answering questions and managing in-cabin functions like climate control. It will use simple language and avoid technical jargon.

The assistant is designed with a clear identity as a friendly and helpful AI companion, distinct from the autonomous driving technology itself. Riders can activate the assistant via a button on the in-car screen. The AI will use specific tools to directly control in-car features, rather than relying on external searches.

Waymo has previously used Gemini's knowledge to train its autonomous vehicles for complex scenarios. The company states that they are always working on new features to improve the rider experience, but have not confirmed the release of this feature.