4.26 Interaction Details

Major Interaction Components

Capture a memory

1.Tap button on glasses to record a 10-second scene

[System: Sound/red dot indicates start of memory]

[System: Sound/red dot indicates end of memory after 10s]

[System: memory parsed into categorized data then saved to cloud]

View a memory in context

[System: searching all context-matching memories and display the oldest memory bubble/balloon to you attached to relevant non-person objects at a reasonable distance/size]

[System: bone-conductive sound indicates there is a memory appeared nearby]

1.Spot a memory in a bubble/balloon form

[System: countdown bar/number indicates 3-second time length]

2(1). Gaze for 3 seconds to open memory

[System: memory expands from the bubble/balloon into a large curvy screen with soft edges]

2(2). Look away within 3 seconds

[System: reappear in another similar context]

3(1). Watch the memory and turn around while playing

[System: memory pauses and resumes when turn back to face screen, screen remains unfolded]

3(2). Watch the memory and leave before memory ends

[System: reappear when similar context is detected again, start from the beginning]

3(3). Watch the memory till memory ends

[System: save option displays]

4(1). Swipe the glasses button backwards to save the memory to personal memory library

4(2). Ignore the saving option and leave

[System: memory deleted from personal play list;if last member then delete from cloud, gone forever]

View a memory from personal memory library

1.Swipe the glasses button forward to open the library at any time

[System: randomly selects a reasonable amount (depending on context) of stored memories and displays them around user, with the oldest memories closer to the user]

2.Move/turn around to see all displayed memories

[System: renders memories in the virtual space according to user’s current field of vision]

3.Gaze to select and opens a memory

[System: displays memory in field of vision]

Memory Display Specification

Bubble/balloon Mode

• Color: person-based

The user can choose a color that differentiate himself from other family member

• Texture: time-based

The transparency of the bubble/balloon will be higher for older memories.

• Form: single vs batch

1 bubble/balloon means a 10-second recording, if multiple 10-seconds are recorded consecutively within a short time, they will be stored by the system as one memory and be displayed as a batch of balloons/group of bubbles indicating multiple episodes

Interaction scenario: user leaves before the memory ends; spots and reopens the memory in another location

[System: start playing from the beginning of the unfinished episode instead of the very beginning]

*the finished episode from last time watching can only be revisited in personal library if saved

*save option will not appear until the entire memory is played; user can only save the entire batch/group as one memory, instead of any single 10-second recording

Screen Mode

• Form

A curvy screen that covers 114 degree of binocular field of view in plan, and 50 degree up/70 degree down for field of view in section.

*the edge will be faded into the environment

Immersive Environment Mode

Special Scenarios

• In dangerous situations such as driving/memory is down the cliff…
• Watching non-real content such as movie/book cover/online videos…

System detects context (wheel/windshield in front of user) and will not display memory notification

• memory saved in the same location but in different times

System will display the older one first, once it is consumed, the newer one will be displayed

System Contextual Recognition Mechanism

1.Memory get parsed into categorical data such as:

• Voice
• Center of vision
• time (time of the day, season…)
• physical environment (Indoor/outdoor, sea…)
• facial recongnition
• objects
• Location (GPS)

2.Stored memory’s context is constantly being compared with real-time context based on categorical data, if most categories are matched, then they will be put into an object sequence

3.System will retrive the oldest memory in the sequence to user in a balloon/bubble form