Mercedes-Benz is taking its in-car virtual assistant to the next level with Google Cloud’s Automotive AI Agent, which debuts later this year in the new Mercedes-Benz CLA. The upgraded system promises to deliver a more conversational and intuitive experience, transforming how drivers and passengers interact with their vehicles.

A Smarter MBUX with Google

The new MBUX Virtual Assistant, part of Mercedes’ next-gen MB.OS operating system, integrates Google’s Gemini AI and runs on the Vertex AI development platform. Unlike the current MBUX Voice Assistant, which handles basic commands like “Hey Mercedes,” this enhanced version can manage complex, multi-turn conversations, provide personalized suggestions, and even ask follow-up questions for clarification.

For example, you could ask, “Is there an Italian restaurant nearby?” The assistant can respond with reviews, menu highlights, or even traffic conditions to the location. It remembers past interactions, allowing you to stop and resume conversations without losing context.

Key Features of the Enhanced MBUX Virtual Assistant

1. Four Personality Traits: The assistant will offer natural, predictive, personal, and empathetic interactions.
2. Google Maps Integration: Access near real-time updates on points of interest, traffic, and personalized recommendations.
3. Conversational Abilities: It supports complex dialogues and follow-up questions, creating a seamless and human-like experience.
4. Multimodal Reasoning: The system can process inputs across multiple contexts for more accurate and relevant responses.

From CES to the CLA

Mercedes introduced the upgraded virtual assistant at CES 2024, but details about its tech stack were sparse until now. Powered by Google Cloud’s Automotive AI Agent, this system is designed to go beyond basic voice commands. While the current MBUX system integrates OpenAI’s ChatGPT and Microsoft Bing for straightforward queries, the new platform’s conversational capabilities make it a game-changer.

Mercedes plans to roll out this enhanced assistant to other models in the future, though specific vehicles haven’t been announced.

Google’s Vision for Automotive AI

The Automotive AI Agent is Google Cloud’s first major step into creating generative AI experiences specifically for automakers. By leveraging Gemini and Vertex AI, Google promises an assistant that’s highly personalized, multilingual, and capable of real-time reasoning.

“This is just the beginning of how agentic capabilities can transform the automotive industry,” said Sundar Pichai, CEO of Google.

Final Thoughts

The collaboration between Google and Mercedes-Benz is a glimpse into the future of automotive tech, where virtual assistants can provide personalized, intelligent, and seamless in-car experiences. With the enhanced MBUX Virtual Assistant debuting in the new CLA, Mercedes-Benz is setting a new standard for how AI can enhance driving.