The Future of Automotive HMI (Part 1) -Display Types

Johnston Ayala
Automotux
7 min readDec 8, 2020

--

The Human Machine Interface as it relates to automotive has come a long way in just the past few years. New technologies have opened up a world of possibilities offering exciting new ways for drivers and passengers to interact with vehicles and for designers to create new ways to create better accessibility, usability and overall experiences for drivers and passengers alike.

In this series we will be exploring the future of automotive HMI as it relates to UX design. In doing so, one of the first things we want to do is define the different interface display types and some possibilities that might be designed through the vehicle and in doing open new ideas for the future of automotive UX and HMI.

The Cluster

Since the automobiles inception, the instrument cluster that sits directly in front of the driver and behind the wheel has been one of the most important aspects conveying salient information to the driver that is paramount to safety and car control. The cluster was physical created from plastics or metals and this still holds today in some automobiles. However, the cluster is increasingly becoming a digitized graphical interface representing classic controls and icons like speed, rpm, gear,lighting and blinker status. On top of the more traditional representations, the digitization of the cluster has also created a new set of possibilities for designers.

3D navigation has become an added element to the modern instrument cluster (Source: https://www.behance.net/gallery/65565269/HMI-Digital-Dashboard)

Using GPS and 3D and sensor technologies the cluster has now become a popular place to ingrain navigation, animated or otherwise. Electric vehicles obviously now have charging information as opposed to fuel status where drivers can see battery life and miles left on their charge.

A automotive cluster displays music that can be (Source: https://dribbble.com/shots/7249226-Car-HMI)

Music and some infotainment features have also become part of some cluster that can be controlled by physical controls on the wheel or even by touch. Automotive UX designers will have a variety options about what to include and/or exclude within the context of the cluster or to have a cluster at all.

The Central Display

The central display is a touchscreen usually the main hub for controlling climate, entertainment, lighting, seating and navigation. As we saw in looking at the cluster, there may or may not be some overlap for possibilities of features. Since there is no standardization and designers have the opportunity to test new ideas and combinations, interface sizes may be vary greatly while shapes and positioning will work in conjunction with the overall car design and engineering.

The central display may be a seperate interface or be part of a continuous interface that also includes the cluster and passenger display. Some of the most important determinations that UX designers will need to make is what will be included in the central display and which of the controls in the car will be digitized vs. physical. The key component in answering many of these questions are the safety and level of distraction when the user inputs the action. User testing, quick controls and haptics (which we will be discussing in part 2) also play a large role in making these determinations and allow a lot of room for exploration based on the user testing results.

The central display touchscreen is often a main control system for many in-vehicle features. (Source: https://bit.ly/3gq6tkx)

Front Passenger Display

It makes sense that driver-centric design is still a main focus for designers when considering interfaces. However, designers have begun to expand beyond the driver for more controls for the front passenger. By adding an front passenger interface, the passenger using the car HMI can now become a dynamic navigator and assistant. They can relieve the driver of distractions having the option of putting the passenger in control of more complex tasks that might require multiple inputs from the driver be it through voice touch or haptic. With their own interface, the passenger can now also now feel a deeper sense of connection to the vehicle as part of the the overall user experience.

A passenger display for the Porsche Taycan gives the passenger more in-vehicle control. (Source: https://bit.ly/3mWxP4d)

Display Knobs

HMI display knobs are a powerful way that to display salient information on a specific feature or element in the context of the in-car experience such as temperature, drive mode or transmission. Often these smaller interfaces are generally the size of smartwatches and they might be combined with a physical rotary used as input, or be controlled by touch, gesture or voice. Display knobs can be used by designers who want to highlight a prominent feature or allow the driver (or passenger) to control a specific input functions.

HMI display knobs for the Rimac Concept Two allow the driver control a variety of in-car functions. (Source: https://bit.ly/39TiY6U)

Rear Passenger Displays

While there is a lot of focus on entertainment options like movies, music and endless content streaming possibilities, designers are also beginning to incorporate additional personalized features for rear passengers as well. The days of the kids asking “How much longer until we get there,” can be answered in the context of the rear passenger interfaces. With integrated navigation, temperature, and communication options, designers can continue to explore possibilities for features that allow rear passengers to have a deeper connection and sense of control when immersed in the in-car experience.

HUD Display

Another design options that is becoming more popular to be integrated into the driver’s HMI is the HUD (Heads Up Display). HUD displays are augmented reality extending and placing digitized information into the real world. The use of the HUD is particularly useful in the context of relaying navigation and safety elements to the driver. With more augmented reality entering into UX design, designers will have to accommodate this integration without overlapping with other navigational possibilities. Designers will also be challenged to find solutions and options for how and where driver’s (or passengers) control HUD displays.

HUD displays in vehicles can to project digital information into reality to help inform better driver decisions. (Source: https://bit.ly/3gyojC3)

Physical Control Displays

So in the rapidly changing space, where many aspects of the in-car HMI experience are becoming more digital, what of physical controls? While designers continue to advance the possibilities for digitized HMI drivers and passengers still value the use of physical controls. A recent study on car HMI input devices found that rotary controllers are second only to touchscreens as the preferred input devices within a vehicle. How automotive UX designers and engineers work together to fuse the physical will be crucial in the success of the overall user experience and . Options might include physical controls embedded or surrounded by the digital interface where the physical components are made as part of the the UI. Designers might also utilize skeuomorphic design and emerging technologies to replicate the look and feel of physical controls and combined with haptic or gesture control that may augment the users experience and similar experience to physical controls.

Combination Displays

Until relatively recently, many of the in-car interfaces have remained as disparate screens/devices interfaces with separated borders. However, automotive designers have begun exploring new options and screen sizes and shapes that offer drivers and passenger new ways to interact with their vehicle. For example, the cluster and the central display may be contiguous or the cluster, central display and passenger display may be all one touchscreen as well. This provides new and exciting challenges for the HMI automotive designer as they will be working with non-standardized grids and screen sizes all while still providing accessible and usable features that minimize distraction and maximize safety.

The touchscreen display screen for the Byton M-Byte runs the length of the dashboard. (Source: https://bit.ly/3ovfPhV)

Status Control App

Status control apps are powerful way to designers to create an in-car experience even after the driver leaves the car The idea is that the driver never leaves the cockpit (even when leaving the car) and those companies that can create apps that can offer dynamic and seamless experiences and features in the context of the the car status/control apps can gain an advantage. The status control/app can have a variety of features that allow remote control and access to the vehicle from climate and media to doors and lighting. Charging status and results for electric cars is also hugely important for apps and with autonomous driving capabilities quickly advancing drivers will have control over their cars from afar and this opens a world of possibility and future challenges for automotive UX and HMI designers. Status control apps also offer an excellent opportunity for granular stats and environmental impact for electric vehicles.

A status control app for Aether electric cars. (Source: www.johnstonayala.com)

Conclusion

These are some of the main interfaces and displays with regard to automotive HMI and UX and there are quite of few options for designers to consider during their process. In part two, we will be discussing input types. Stay tuned!

--

--