AI Pin: visual perception of information, UI&UX
A Humane device called AI Pin is about to go on sale: a piece of smart clothing, a completely autonomous device, and not an accessory for a smartphone. The idea is this: the phone distracts and forces you to constantly look at it, AI Pin will not distract.
The AI Pin is a small square without a display that attaches to clothing using a magnet that acts as a battery.
The device is equipped with a Qualcomm Snapdragon processor, uses a camera, depth and motion sensors to track and record the environment, a speaker and a microphone.
How do you use this? What kind of interface is this?
The device uses a laser projector that projects information onto the user’s hand. There is voice and gesture control. It will also be possible to bring objects closer to the camera to identify them.
Hand projection is an unusual way of interaction between the device and the user. Like other devices, the transfer of information from the AI Pin has its own features, limitations of use and readability.
I haven’t seen the device live yet, but there are already some assumptions.
Limitations and features of visual perception of information:
◕ The user’s hand and its position (How is information displayed on an open palm and a half-open one, when there are many folds of skin and refractions? Does skin color affect contrast? Is angle important?)
◕ Use in bad weather (Rain, snow, gloved or mitten hands, etc.)
◕ Lighting (Is the text as readable in active sunlight or artificial lighting as in the dark?)
◕ Security of the environment (Is the user ready to read information in public places where other people, security cameras can also see it)
◕ Character size and tracking (Small text is almost unreadable. You need to make an effort to read. Tilts, squinting, bringing your hand close to your eyes make use less convenient. The boundaries of the characters when projected (blurred) are not as clear as on displays. This impairs readability and requires larger character sizes and tracking)
◕ Backgrounds under the text (Blue text on a blue background in projection mode is very difficult to read)
◕ Distance device — projector — eyes (Probably, to read small text, the user will try to move his hand closer to his eyes. But how dynamic is the projector? Is it ready to follow the movement of the hand?)
Let’s discuss! Do you have ideas about other limitations in perception? Watch a short video about using the device and describe your ideas in the comments.
