Why Iron Man is the Future of User Experience
“Genius, billionaire, playboy, philanthropist” Tony Stark created the iconic Iron Man suit of armour to escape imprisonment and now protects the Marvel world with his brains, technology and bravado. Like many works of science fiction, the Iron Man films are a great indicator of what to expect in the near future; from AI intelligence to augmented reality.
Intelligent Assistance
J.A.R.V.I.S. (Just a Rather Very Intelligent System) is Tony Stark’s personal artificial intelligence system, virtual butler, secretary and engineer.
The idea of an AI interface is a concept that has existed in science fiction for a long time; from KITT (Knight Industries Three Thousand) in Knight Rider to HAL (Heuristically programmed Algorithmic Computer) in 2001: A Space Odyssey. Though still in their infancy Siri, Cortana, Google Now and Facebook ‘M’ give a good indication of services that ‘sit’ above our traditional interface and apps, pulling various strings of data together to create amazing results. In future, we could see our virtual assistants replacing interface altogether with apps and services plugging into our AI services enhancing them with their functionality, networks and data.
“That’s Jarvis. He runs the house.”
One of the problems currently encountered with intelligent systems like Siri is a sense of “what can I ask for”? Due to limited functionality these services require a pre-knowledge of what commands you can ask for — it feels like the verbal equivalent of an MS DOS boot page. True intelligent systems should be able to respond to any request with an undetrstanding of the question, reference or context -something even JARVIS struggles with at times:
Tony Stark: …I am really kicking ass out here.
Jarvis: I don’t understand this ‘ass kicking’ reference, sir.
Tony Stark: Jarvis, remind me to develop a personality for you later.
Virtual assistants are something we will likely see more of as machine learning algorithms track and learn patterns of speech. In time they will not only understand how human beings speak, but how you individually speak — able to understand your individual idiolect, interests and sense of humour. In the future interacting with a virtual assistant won’t be a case of stating set commands for set results but asking a question or stating a problem and having a computer work out the answer or best solution.
J.A.R.V.I.S. is also multi-platform, able to function in Tony’s workshop or inside the Iron Man suit itself. Future AI services will also be able to access multiple devices and platforms at once. Having the same AI able to access your phone, bio-metrics or car will allow for a greater insight of data and user behaviour. Intelligent services will be able to connect the dots in a way that appears almost pre-cognitive. For example, our virtual assistant would learn our routines and when we leave for work each day. Accessing a weather feed would mean on cold mornings when we got to our car the seats would be warmed and the windows de-iced. If we didn’t leave the house on time, the assistant could look at our biometrics to see if we’re unwell and accordingly provide health advise or automatically book a doctor’s appointment and send our health data instantly to our G.P.
Augmented Reality
One of the most iconic elements of the ‘Iron Man’ series is the impressive heads-up display of the Iron Man suit and the augmented reality of Tony Stark’s workshop.
A mix of ‘Terminator vision’, military graphics and Tatiana Plakhova installation, Iron Man has a unique and rich visual UI that he’s able to understand, interact with and manipulate. Tony Stark’s workshop is a truly immersive experience that evolves digital interaction away from a series of screens into something engaging, involving and tactile.
“It was clear from the beginning that production didn’t want to just load the HUD with gorgeous visual clutter that didn’t mean anything. Janek Sirrs (VFX Supervisor) and Joss Whedon (Director) liked to know why everything was on screen and what its function was.” — Jayse Hansen, fictional graphic user interface designer extraordinaire
Google Glass made big waves when it launched its discovery phase in 2013. Though there have been heads-up displays in the past, Google Glass allowed users a truly augmented reality experience for the first time. It also showed the first signs of what a digitally enhanced world could look like away from a smartphone screen. Now in development, Google Glass is likely to re-launch with a business focus helping customers in the workplace and on-site.
The Microsoft Illumi Room project experimented with mapping a room and using projectors to bring a form of augmented reality away from goggles or visers. The projectors could enhance video-game play with additional data and maps, make the room shake when you take a hit or ‘expand’ the playable screen size to create a more immersive experience. The Illumi Room project could also be used for more than just gaming though :
“Imagine watching a sporting event (e.g., football game) where the ‘focus’ video is tightly held on the players capturing their actions, while the ‘surround’ video is immersing the viewer with live panoramic views of the stands and the fans at the game.” — IllumiRoom: Peripheral Projected Illusions for Interactive Experiences
The virtual reality market is set to boom in 2016 with the eventual launch of Oculus Rift, HTC Vive and Samsung Gear VR. Advances in technology have created a truly immersive experience in an artificial world, but it’s the work being done by Microsoft to create a digitally enhanced “mixed reality” that comes closet to Iron Man.
The Microsoft HoloLens project has recently pioneered augmented reality — showcasing a holographic world of mixed media screens and virtual pets. Combing high resolution cameras and sensors to ‘see’ a room, HoloLens is able to display a world of ‘holograms’ that a user is able to move, interact with and manipulate.
Holograms mixed with your real world will unlock all-new ways to create, communicate, work, and play.
Just like Tony Stark designing parts for the Iron Man suit, HoloLens also allows users to build objects in a three dimensional space before producing them on a 3D printer. Advances in 3D printers allow for a range of innovations creating products in plastic, gold, glass and even chocolate. There is currently a 3D printer onboard the International Space Station allowing the astronauts to create specific tools for the precise jobs they need to do.
XBox Kinect first introduced the concept of a computer understanding and interpreting a user’s hand movements or gestures, however the recently developed Hands Moni glove go one step further allowing the user to feel and touch a virtual object by inflating small ‘bladders’ of air that press against the user’s skin. A truly reactive haptic experience would give designers and engineers a true sense of a product’s ergonomic shape.
With synchronised Hololens headsets, haptic gloves and 3D printers our lives will become a digitally enhanced world of mixed media and virtual holograms. We’ll be able to visualise, design and prototype in real time making our home and work more productive, collaborative and involved.
Exoskeletons and Biometrics
The Iron Man suit is an advanced exoskeleton able to lift huge amounts of weight, fire missiles and fly — everything a superhero needs.
Technological advances in exoskeleton research have lead to impressive inventions designed to help soldiers in the field. Lockheed Martin’s HULC (Human Universal Load Carrier) gives the wearer the ability to carry loads of up to 90.7 kg for up to 12.4 miles on a single battery charge over all manner of terrain.
“The HULC is a completely un-tethered, hydraulic-powered anthropomorphic exoskeleton that provides users with the ability to carry loads of up to 200 pounds for extended periods of time and over all terrains. Its flexible design allows for deep squats, crawls and upper-body lifting.”
However, it’s not just strength that exoskeletons can provide but accuracy too. Dan Baechle, a mechanical engineer at the US Army Research Laboratory (ARL), is developing the MAXFAS exoskeleton to reduce movement when holding heavy weaponry.
“The arm is attached to the wearer using carbon composite braces that are equipped with sensors that detect a tremor when taking aim and then signals the motors to adjust the cables and correct it, but does not affect voluntary movements.” — MAXFAS exoskeleton improves soldiers’ aim
These impressive developments can also be used to help the disabled move again. 3D Systems, in collaboration with Ekso Bionics, have recently developed an exoskeleton that has allowed a woman paralyzed from the waist down to walk again.
Tony Stark uses an arc reactor built into his chest to keep small fragments of shrapnel from entering his heart. His Iron Man suit is able to monitor his health stats and even restart his heart.
One of the main selling points for wearables are the biometric insights they provide - from the FitBit steps-per-day to the AppleWatch and Health app. Users have access to all new levels of insight into their own biometrics and are able to better understand their diet, exercise regime and day-to-day health.
Employers too are taking advantage of the health benefits that wearables provide:
“BP has been giving US employees Fitbits for a couple of years to measure their steps. Walking two million steps a year saves staff £800 in lower health-related fees.” — They monitor hearts, count calories … but are health apps any good for you?
In Iron Man 2 we learn that the palladium from the arc reactor in Tony’s chest is slowly poisoning him, meaning he has to constantly monitor his blood toxicity.
Around 10% of the American population are currently diagnosed with diabetes. The ability to monitor blood sugar level is just the start of what synchronised technology can provide. Dexcom G5TM Mobile Continuous Glucose Monitoring (CGM) System is an app that syncs to an embedded blood sugar monitor under the skin. The monitor chip is then able to communicate with the user’s smartwatch or wearable to give them an instant insight into their blood sugar levels and when they need to medicate.
Giovanni de Micheli and Sandro Carrara of École Polytechnique Fédérale de Lausanne (EPFL) have created a tiny implant able and detect several different blood molecules. The implant can be used for monitoring general health as well as helping diabetics, chemotherapy patients or those with a history of heart disease.
“The chip has already been used to accurately test for a whole series of molecules, such as lactate and glucose, with results deemed as reliable as traditional methods — the difference is they are instantaneous, delivering data to a doctor as incremental changes occur in the body.” — Tiny implantable blood test chip could personalise medicine
Wearables, implants and connected databases will allow an unprecented level of insight and control of our own health. Advances in insulin releasing pellets and implants could also provide those with medical conditions a system that completely automates the need for regular injections. Unfortunately, embedded shrapnel in the heart may still require you to create an arc reactor in your basement.
Beyond Iron Man
The Marvel Cinematic Universe incarnation of Iron Man showcases a world where virtual assistants and holographic displays could be a part of everyday life.
As intelligent systems like Siri and Google Now connect to more devices and bigger data they will be able to automate our lives like never before. Google Glass and HoloLens will be able to provide a digitally enhanced world where we are able to create in a 3D environment and print our creations in minutes. Biometrics, implants and exoskeletons will personalise our understanding of our own health and medical status. Automatically medicating, monitoring and assisting where required.
Now all we need is a genius, billionaire, playboy, philanthropist to bring it all together…
