Microsoft teams up with VW to make HoloLens work in cars

Image: Microsoft

The new moving platform feature for the HoloLens 2 is designed to let the augmented reality headset work in places like cars. It addresses an issue of moving environments confusing the headset's sensors. Volkswagen has been experimenting with using the headset as a heads-up display in its vehicles.

The augmented reality headset uses a combination of camera sensors and an insturment unit to track movement. In a car, the headset senses movement but sees a static environment, which can conflict with the readings from the two sensors. It was getting sick.

VW discovered this when it started investigating the use of augmented reality headsets to teach drivers how to get around a racetrack faster. It started collaborating with Microsoft to fix the sensor problem and eventually developed a prototype system that allowed a car to display real-time information on a connected headset.

Virtual objects can be placed inside and outside of the vehicle. One image released by Microsoft shows a virtual map on the dashboard of a car, with navigation arrows at key intersections. A second shows the alert to the driver.

Image: Microsoft

VW's existing cars have augmented reality elements. Its recent ID electric cars feature an augmented reality heads-up display that projects data from the car onto the windshield, where it is easier for the driver to see without taking their eyes off the road.

There is no sign of the consumer version of the HoloLens 2 getting a release anytime soon. Microsoft suggests the first beneficiaries of the new project, despite the fact that it is interested in consumer use cases in the longer term.

It's clear that Microsoft is still working on its augmented reality headset platform despite reports earlier this year that the project was experiencing difficulties. Over 40 employees have left the company to support its attempt to pivot into a metaverse company.