Object Interactions & Gestures

How the user interacts with the objects in the scene

Jeremiah Alexander
wiarframe
3 min readMar 24, 2020

--

Each object in your scene can have multiple interactions that control how the user can interact with that object and the effect it has.

In wiarframe, you add interactions in the form of user stories, for example:

  • when the user looks towards the Spaceman, the Spaceman should Spin
  • or when the user taps on the Signboard, Open the URL …

Interactions are thus broadly broken into three parts, the object, the gesture and the effect. The effect can then either be a global effect such as Opening a URL or an object-specific action, such as Spinning. In the latter case, the target object can be different from the source object; for example, Tapping on the Signboard might make the Spaceman Spin.

Check out Object Gestures, Effects and Actions next.

Gestures

The following gestures can be used to trigger interactions in wiarframe. You can read the theory behind these gestures in the The Essential Guide to Mobile AR Gestures.

Tap

A tap on the screen that overlaps the object’s position.

Gaze (visual field)

Visual gestures that relate to the general direction of the user’s gaze.

Glimpse

The object enters the user’s peripheral view from offscreen.

Look Toward

The object enters the user’s central view — represented by the central third of the device screen. Multiple objects can be looked towards at once.

Look Away

The object exits the central view and enters the peripheral.

Cease Look

The object exits the screen.

Gaze (intent)

Visual gestures that relate to the intent of the user’s gaze.

Focus

The object is at the screen center for 1 second. Only the closest object is focussed on.

Stare

The object stays in focus (at the screen center) for 3 seconds.

Cease Focus

The object moves away from the screen center after being in focus.

Proximity

Gestures that relate to the user’s position in relation to an object.

Approach

The object enters social distance of the user (3m).

Reach

The object enters arm’s reach distance of the user (1m).

Embrace

The object enters intimate distance of the user (30cm).

Leaves Embrace

The object exits intimate distance of the user (30cm).

Leave Reach

The object exits arm’s reach distance of the user (1m).

Retreats

The object exits social distance of the user (3m).

--

--

Jeremiah Alexander
wiarframe

Founder @wiARframe — the design and prototyping platform for Augmented Reality.