Wednesday, June 24, 2026
HomeTechnologyWaymo is testing Gemini as an in-car AI assistant in its robotaxis

Waymo is testing Gemini as an in-car AI assistant in its robotaxis


Waymo appears to be testing adding Googleโ€™s Gemini AI chatbot to its robotaxis in an effort to integrate an AI assistant that would accompany riders and answer their queries, according to findings by researcher Jane Manchun Wong.

โ€œWhile digging through Waymoโ€™s mobile app code, I discovered the complete system prompt for its unreleased Gemini integration,โ€ Wong wrote in a blog. โ€œThe document, internally titled โ€˜Waymo Ride Assistant Meta-Prompt,โ€™ is a 1,200+ line specification that defines exactly how the AI assistant is expected to behave inside a Waymo vehicle.โ€

The feature hasnโ€™t shipped in public builds, but Wong says the system prompt makes it clear that this is โ€œmore than a simple chatbot.โ€ The assistant is said to have the ability to answer questions, manage certain in-cabin functions like climate control, and, if required, reassure riders.ย 

โ€œWhile we have no details to share today, our team is always tinkering with features to make riding with Waymo delightful, seamless, and useful,โ€ Julia Ilina, a spokesperson for Waymo, told TechCrunch. โ€œSome of these may or may not come to our rider experience.โ€

This wouldnโ€™t be the first time Gemini has been integrated into the Alphabet-owned self-driving companyโ€™s stack. Waymo says it has used Geminiโ€™s โ€œworld knowledgeโ€ to train its autonomous vehicles to navigate complex, rare, and high-stakes scenarios.ย 

Wong writes the assistant is instructed to possess a clear identity and purpose: โ€œa friendly and helpful AI companion integrated into a Waymo autonomous vehicleโ€ whose primary goal is โ€œto enhance the riderโ€™s experience by providing useful information and assistance in a safe, reassuring, and unobtrusive manner.โ€ The bot is directed to use clear, simple language and avoid technical jargon, and is instructed to keep its responses succinct to one to three sentences.ย 

According to the system prompts, when a rider activates the assistant via the in-car screen, Gemini can choose from a set of pre-approved greetings personalized with the riderโ€™s first name. Theย system can also access contextual data about the rider, like how many Waymo trips theyโ€™ve been on.ย 

Techcrunch event

San Francisco
|
October 13-15, 2026

The prompts currently let Gemini access and control in-car features, like the temperature, lighting and music. Notably absent from the function list are volume control, route changes, seat adjustment, and window control, Wong pointed out. If a rider asks for a feature that Gemini canโ€™t control, the bot is to reply with โ€œaspirational phrases,โ€ like, โ€œItโ€™s not something I can do yet.โ€

Interestingly, the assistant is directed to maintain a clear distinction between its identity as Gemini the AI bot and the autonomous driving technology (the Waymo Driver). So when replying to a question such as, โ€œHow do you see the road?โ€ Gemini shouldnโ€™t say โ€œI use a combination of sensors,โ€ and instead should reply, โ€œThe Waymo Driver uses a combination of sensorsโ€ฆโ€

The system prompts include a range of compelling tidbits, such as how the bot is meant to handle being asked questions about competitors like Tesla or the now-defunct Cruise, or which trigger keywords will get it to stop talking.ย 

The assistant is also directed to avoiding speculating on, explaining, confirming, denying, or commenting on real-time driving actions or specific driving events. So if a passenger asks about a video they saw of a Waymo hitting something, the bot is instructed to not answer directly and deflect.

โ€œYour role is not to be a spokesperson for the driving systemโ€™s performance, and you must not adopt a defensive or apologetic tone,โ€ the prompt reads.

The in-car assistant is allowed to answer general knowledge questions like about the weather, the height of the Eiffel Tower, what time the local Trader Joeโ€™s closes, and who won the last World Series. It is not allowed to take real-world actions like ordering food, making reservations, or handling emergencies.ย 

Waymo isnโ€™t the only company integrating AI assistants into driverless vehicles. Tesla is doing something similar with xAIโ€™s Grok. The two different car assistants serve different functions, however. Gemini appears to be programmed to be more pragmatic and ride-focused, while Grok is pitched more as an in-car buddy that can handle long conversations and remember context from previous questions.



Source link

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments

Translate ยป