Waymo Tests Gemini Integration

What happened

Waymo is testing the integration of Google's Gemini AI as an in-car assistant within its robotaxis. This assistant, governed by a 1,200-line system prompt, is designed to manage in-cabin functions, such as climate control, and answer rider queries using simplified language. It operates independently of the autonomous driving system, utilising specific tools for direct in-car feature control, activated via an in-car screen button. This expands Waymo's application of Gemini, previously used for autonomous vehicle training scenarios.

Why it matters

The introduction of an AI assistant with direct in-cabin control capabilities establishes a new dependency on the AI's interpretation and execution for critical vehicle environment functions. This increases exposure for platform operators and IT security to potential unintended AI actions or misinterpretations, necessitating heightened due diligence regarding AI behaviour and its interaction with core vehicle systems. This also creates a new accountability gap for rider experience management.