Human-Machine Interface (HMI) in Cars: How Automotive UX is Changing Driving
The most important screen in your car isn’t the biggest one—it’s the one that lets you keep your eyes on the road while still getting what you need.
For years, automakers treated the dashboard like a smartphone: bigger screens, more menus, fewer buttons. That era is ending. A quiet correction is underway across the industry, driven by safety research, regulatory pressure, and the simple fact that drivers can’t navigate a touchscreen menu at highway speed without taking their eyes off the road. The new goal isn’t more screen real estate. It’s smarter interaction—voice that understands context, controls that work by feel, and displays that put information where you’re already looking.
Key Takeaways
- Touchscreens consistently underperform physical controls for critical tasks, with studies showing longer off-road glance times and worse lane-keeping .
- Euro NCAP’s 2026 rules require physical controls for turn signals, wipers, hazards, horn, and SOS to earn a five-star rating .
- Voice AI is the new battleground, with BMW integrating Amazon Alexa+ and LLMs for natural conversation .
- Panoramic head-up displays are replacing traditional instrument clusters in premium vehicles, keeping information in the driver’s forward view .
- The Software-Defined Vehicle is shifting HMI from hardware buttons to software-updatable, personalized interfaces .
The Touchscreen Reckoning
The evidence against touchscreen-first design has been accumulating for years. A 2026 review of 73 studies found that touchscreens generally performed worse than physical controls and voice input across driving performance, visual attention, and task completion measures . In one on-road study, 41% of glances at a touchscreen for climate control tasks exceeded two seconds, compared to only 27% when using physical controls .
That two-second threshold matters. At 65 mph, a two-second glance means traveling nearly 200 feet without looking at the road.
Regulators noticed. Euro NCAP’s updated evaluation criteria, effective for 2026, dock a star from any vehicle that doesn’t provide physical controls for five critical functions: turn signals, windshield wipers, hazard lights, the horn, and emergency SOS . The organization isn’t banning touchscreens. It’s simply making the cost of over-reliance visible to consumers in the form of a lower safety rating.
Some automakers are already adjusting. Mercedes-Benz’s CEO publicly reflected on the over-removal of physical buttons, and newer models like the GLC and CLA feature a mix of switches, rotary controls, and traditional buttons alongside screens .
“Making drivers dig through touchscreen menus to access basic controls can increase distraction. The thinking is that the risk of crashes increases as drivers hunt through touchscreen menus to access basic functions.”
Chart: Why Input Method Matters for Driving Safety
The chart below illustrates approximate off-road glance behavior across different input types, based on findings from the touchscreen safety review. Physical buttons keep eyes on the road longest. Touchpads performed worst. Voice, while not perfect, frees both eyes and hands when the system works well.
Illustrative scores derived from findings in the touchscreen safety review . Not a standardized measurement scale.
Voice AI: From Command to Conversation
If touchscreens are the problem, voice is the most promising solution—when it works. The old model of barking rigid commands (“Navigate. Home.”) is being replaced by conversational AI that understands context.
BMW’s next-generation Intelligent Personal Assistant, debuting in the iX3, uses generative AI and Amazon’s Alexa+ platform to enable natural dialogue. Drivers can issue multiple requests in one sentence, ask follow-up questions without re-triggering the assistant, and hold something closer to a conversation than a command session . The system runs alongside BMW’s Panoramic iDrive interface and Operating System X.
The broader automotive voice recognition market reflects this shift, projected to grow from roughly $2.8 billion in 2023 to $11.4 billion by 2033 . But voice has limits. Road noise, passenger conversation, and poor connectivity can all degrade performance. The most effective systems don’t replace other inputs—they hand off between them based on context.
Rivian is taking a different approach, planning to open its vehicle environment to third-party AI agents like Claude and Meta Muse, while keeping driving controls strictly isolated from external AI . The cockpit becomes a platform for intelligence, but safety-critical systems remain walled off.
The Rise of Multimodal Interaction
The consensus among researchers and designers is that no single input method wins. The future is multimodal: voice, touch, gesture, and physical controls working together, with the system selecting the best modality for the context.
A 2026 study of AI-based intelligent cockpits from Tesla, Mercedes-Benz, and NIO identified three principles for effective multimodal design: contextual adaptability (the system knows when to switch modes), cognitive coordination (the interface matches the driver’s mental workload), and information transparency (the driver understands what the system is doing and why) . The study found that cognitive coordination was the strongest predictor of task fluency, while transparency directly determined user trust.
In practice, this means a system that defaults to voice for navigation input, uses physical buttons for climate and volume, and offers touchscreen menus only when the vehicle is parked or moving slowly. It sounds obvious. The industry took a decade to relearn it.
Comparison Table: HMI Approaches Across Vehicle Segments
| HMI Approach | Typical Segment | Key Strength | Key Weakness | Regulatory Fit |
|---|---|---|---|---|
| Touchscreen-dominant | Entry-level to mid | Cost, flexibility, OTA updates | Distraction, poor blind operation | Losing ground under Euro NCAP 2026 |
| Hybrid (screen + physical) | Mainstream to premium | Balances safety and features | Higher parts cost, design complexity | Best current compliance |
| Voice-first + minimal screen | Emerging EVs | Hands-free, eyes-forward potential | Noise sensitivity, privacy concerns | Dependent on implementation |
| Panoramic HUD + CID | Premium | Info in forward view, less cluster clutter | Cost, optical challenges, viewing angles | Strong for driver attention |
The Software-Defined Cockpit
Underneath the interface changes, the architecture of the car is shifting. Traditional vehicles distributed functions across 100 to 150 separate ECUs. Software-Defined Vehicles consolidate those into central computing units and zone controllers, enabling over-the-air updates, feature-on-demand subscriptions, and continuous improvement of the user experience .
For HMI, this means the interface can evolve after purchase. A car that ships with a mediocre menu system can receive a redesign. A voice assistant can gain new capabilities. The display layout can adapt to driver preferences learned over time.
Harman’s presentation at the 2026 Automotive Display Industry Development Forum outlined two cockpit strategies: a wide multi-display layout combining AR HUD, instrument cluster, central display, and passenger display, and a minimalist approach pairing a panoramic HUD with a single central screen . Both rely on software-defined architecture to manage the complexity.
“The vehicle interior is evolving from the classic cockpit into a kind of intelligent living space where mobility, communication, and digital services converge.”
The Trust Problem
Personalization sounds good in marketing. In practice, drivers are skeptical. Deloitte found that 92% of companies believe they deliver effective personalization, but only 48% of consumers agree . JD Power research shows many drivers find in-car technology inconsistent or distracting rather than intuitive.
The gap matters because HMI is where trust is built or lost. When a system responds predictably, communicates clearly, and doesn’t demand attention it hasn’t earned, drivers relax. When it hides basic functions behind menus or misinterprets a voice command for the third time, the opposite happens.
The most successful interfaces won’t be the flashiest. They’ll be the ones that know when to be invisible.
FAQ
Are touchscreens being banned in cars?
Not banned, but penalized. Euro NCAP’s 2026 rules dock a safety star from vehicles lacking physical controls for five critical functions. The U.S. has no equivalent federal rule, but global platforms often follow European standards .
What is a panoramic HUD?
A head-up display that projects information across a wide area of the windshield, replacing or supplementing the traditional instrument cluster. It keeps speed, navigation, and warnings in the driver’s forward field of view .
Will AI voice assistants replace buttons entirely?
No. Research consistently shows physical controls outperform voice and touch for critical, frequently used functions. Voice is gaining ground for navigation, communication, and complex requests, but buttons remain safer for wipers, signals, and climate .
What is a Software-Defined Vehicle?
A car whose features and functions are controlled primarily by software rather than fixed hardware. It can receive over-the-air updates, add features after purchase, and personalize the interface over time .
Do drivers actually prefer touchscreens?
Some do, especially for infotainment and when parked. But for safety-critical tasks while moving, studies show physical controls earn higher ratings for usability, perceived safety, and lower workload .
What is multimodal HMI?
An interface that combines multiple input methods—voice, touch, gesture, physical controls—and selects the best one based on context. The goal is to reduce distraction by matching the input to the task and the driving situation .
The Interface Gets Invisible
The best HMI is the one you don’t notice. A knob that turns without looking. A warning that appears exactly where your eyes already are. A voice assistant that understands “I’m cold” without asking which zone.
The industry spent years chasing screen size and menu depth. The correction now underway isn’t a rejection of technology. It’s a return to a simpler question: what does the driver actually need in this moment, and what’s the least distracting way to deliver it?
The answer, increasingly, is a mix. A screen for richness. A button for certainty. A voice for convenience. And a system smart enough to know the difference.
What’s the worst touchscreen menu you’ve ever had to navigate while driving—and what would you replace it with? Share your take in the comments below.
Trusted sources for automotive HMI research and regulation:
- ScienceDirect: A review of in-vehicle touchscreen safety and usability (2026)
- The Hog Ring: Regulators Say Touchscreens Aren’t Safe (citing Euro NCAP and Automotive News Europe)
- Springer ATZ worldwide: The Future of the Vehicle Interior (2026)
- UBIResearchNet: Automotive Display and UX Evolution in the SDV Era (Harman presentation, 2026)
