8.9 C
New York
Monday, May 13, 2024

With In-Car AR, Drivers Get a New View of the Road Ahead

Somehow, the most jarring thing about the 2020 AMG GLC 63 S Performance Coupe isn’t the fact that Mercedes-Benz gave that captcha-sounding name to a four-door SUV. It’s what happened soon after I punched my address into the navigation system: Nearly a block away from my first turn, the 10.25-inch center screen shrunk the map of San Francisco to make room for a live camera view of the road ahead, with the addition of three floating blue chevrons at the intersection, urging me right onto Folsom Street. Once I’d turned, the map again filled the screen. The transformation repeated itself as I moved onto the Bay Bridge, then Interstate 580, Highway 24, and so on, all the way home.

The addition of augmented reality to navigation is the latest in the unending arms race among upscale auto makers hoping to lure wealthy customers with ever fancier tech. Cadillac just announced that the 2021 Escalade will offer a similar guidance system. Hyundai’s luxury brand, Genesis, is debuting the technology in Korea on the GV80 SUV. And like many such novelties—massage seats, perfume systems, gesture controls—it’s a very cool idea with a lot of room for improvement.

Stay in the know with our Transportation newsletter. Sign up here!

The automakers aren’t the first to give this a go. F-35 pilots get intel on their surroundings from their ($400,000) helmets. Airbus is working on something similar for helicopter pilots battling poor visibility. Google is slowly rolling out augmented-reality walking directions in Maps.

The systems in cars aren’t all that complex. The only hardware addition is a camera built into the front bumper, says Ahsan Habib, an engineer with Telenav, the supplier of Cadillac’s new navi. The rest is software, combining GPS and map data to place those blue chevrons in the camera view, with the street name floating over them. At your destination, Mercedes’ setup adds the house number to the scene. The Escalade can guide you to a nearby parking garage.

Driving the GLC, the upsides of this idea are easy to see. Putting directions in the real world (well, a screen displaying it) means no fiddling with levels of zoom. I didn’t get confused over whether the map kept north at the top of the screen or rotated when I turned. I didn’t have to suffer voice directions interrupting my podcasts, or wonder how quickly I’d cover 500 feet at 45 mph. More fundamentally, I didn’t have to translate a map into real-world understanding. The result is as effective as Lewis Carroll’s mile-for-mile map, without the bother for the farmers. You simply see where you’re meant to go.

The big problem is a familiar one: Like most navigation programs, these newcomers all run on screens. Using the GLC’s system means taking your eyes off the road, at least some of the time. Distracted driving has become a major health hazard, and while smartphones bear much of the blame, a 2018 AAA study found that built-in screens are culpable too. Mercedes product manager Peter Henke says one aim of the augmented-reality scheme is to reduce distraction, reducing the amount of time you need to look at the screen by making navigation information easier to understand.

The better answer might be to get away from the screen altogether, by expanding on the head-up display, which today can project basic info (your speed, the song on the radio, basic directions, and so on) onto a few square inches of windshield.


An augmented-reality system that played out on the windshield would require new tech, starting with projectors that can deliver higher resolution, depth, and a much wider field of view. Concept cars and patents make clear that automakers like the idea, but in an industry where cost and reliability trump most considerations, don’t expect such a shift anytime soon. Henke says it’s not out of the question but is nowhere near imminent. Habib at Telenav says a rudimentary windshield system could hit the road in 5 to 10 years.

Other imperfections in Mercedes’ system could be more easily addressed. In crowded nighttime San Francisco, the chevrons were sometimes hard to make out—an issue that could likely be resolved with some design tweaks. Worse, the chevrons don’t always line up with the turning point, likely because their placement hinges on GPS systems with margins of error measured in yards.

That’s where Chen-Ping Yu comes in. He’s the CEO of Silicon Valley–based Phiar Technologies (pronounced like “fire”), which is making an augmented-reality navigation system that runs on a smartphone. Instead of relying solely on a map and GPS, his tech analyzes the scene in real time to set up digital road signs. By detecting lane lines and the ground, Phiar can lay down a “carpet” of chevrons for the driver to follow. (Putting this kind of thing on a phone doesn’t address the distraction issue, but one can hope drivers would use a windshield-mounted system instead of looking down at the cupholder.) Phiar just released a beta version of its app to 15 users around the US. (It’ll be available on iPhones 7 and up, with an Android version to follow.) Yu aims to open it up to everyone by the end of the year—no Mercedes “coupe” needed.

Related Articles

Latest Articles