Michael Gaffney
3 min readSep 17, 2018

The Opportunity for Better User Interfaces and Mixed Reality

While using a dinky Roku remote control and trying to connect an Xbox One S controller wirelessly to a Smart TV, it is clear that user interfaces and how people interact with technology are in need of vast improvements. New immersive hardware combined with mixed reality experiences will contribute to the proliferation of new user interfaces.

With VR past its emerging stage and new apps being built, it is certain this area will change drastically. One example being worked out is the virtual experience of Windows Mixed Reality machines. After seeing a few demos and videos on the Windows UI there are some kinks to work out but this is very impressive to start. Mouse pointing and browsing in “mixed reality” appears a bit odd.

The controls are not quite there yet reminiscent of early 3D video game engines. However the use of Intel RealSense cameras (remember Microsoft Kinect) and other aids will make using a computer mouse and keyboard look way outdated.

The practicality of new user interfaces tied into mass adoption will enable growth of great new software products.

Apple Watch is pushing into fitness tracking and general health with a recent announcement enabling real-time heart ECG measurement. This is one way user interfaces are changing making people more aware of their actions and “steps”.

Voice controlled search and virtual home assistants are changing how individuals and groups get work done and play.

Services should not get in the way and create disconnected experiences. This is inevitable however due to competition amongst businesses for customer subscriptions (see DC Universe and Disney upcoming streaming services). Expect premium content and exclusive features to follow along with improved user interfaces. Customers are forced to choose sides as loyalists to brands and specific content as well as on the go games, movies, shows, and access. Hopefully how customers connect will be considered and improved by the tools and hardware providing these services. The combination of using a mouse, keyboard, dongles, tv buttons, remote controls and cords needs to go.

How user interfaces change will be fun to see and what will be the future is almost here!