Daimler to Use Nuance’s conversational AI platform in in-car multimedia system

Nuance Communications, an American based multinational computer software technology corporation with expertise in conversational AI innovations, announced it has collaborated with Daimler to develop and power the Mercedes-Benz User Experience (MBUX) multimedia system.

According to Nuance Communications, the new infotainment system transforms the driver experience as the MBUX multimedia system comprises a fully customized automotive assistant, that was developed specifically for the new A-Class and other future Mercedes models. The MBUX utilizes Nuance Dragon Drive platform to understand and continuously learn the needs and preferences of both drivers and passengers over a period of time. This information is used to provide an increasingly personalized and connected experience.

Instead of the push of a button, the in-car system is activated by a wake-up word. Motorists just have to say, “Hey, Mercedes” to engage the MBUX. Drivers and passengers can interact with the MBUX naturally thanks to the Natural language understanding (NLU) and natural language generation (NLG) of the UX.

Nuance claims that the natural language understanding designed into MBUX recalls what a driver has said previously and can understand references to things that were said in the past, just like humans can. The system is pre-wired to accept flexible, over-the-air updates via the cloud, even for functions designed and embedded directly into the vehicle. As the software model is continuously enriched with new words or with the changing use of language over time, new domains (for example seasonal sports events), virtual assistants and services can be added to broaden the spectrum of information available to the driver at any time.

Sajjad Khan, vice president, Digital Vehicle & Mobility, at Daimler said the new technologies that the company would be using to create new experiences for Mercedes drivers are meant to be user centric. The goal is to make interaction with the car seamless and simple. This is why Daimler worked closely with its long-time partner, Nuance, on the MBUX, and leveraged their expertise in intuitive and natural voice and language solutions. This would help to provide an in-car experience that would help differentiate Mercedes-Benz vehicles in the minds of drivers.

Stefan Ortmanns, executive vice president and general manager, Nuance Automotive said, “In today’s connected world, users demand simple yet highly personalized access to content and services, and the in-car assistant is no exception.”

Nuance has clarified that the Dragon Drive can power MBUX features in as many as 23 languages, which include UK English, US English, French, German, Italian, Dutch, Spanish, Mexican Spanish, Mandarin, Japanese and Korean. Daimler will be launching the MBUX assistant first in the new 2018 A-Class.