1. Developing ideas

Tangible interaction design

Jisoo Shon
HyperSense_ Fall 2020
7 min readSep 18, 2020

--

Prompt

Design an interaction that engages the body physically; create installations in space controlled by human actions or wearable pieces that augment the sensory experience.

Deliverables

An installation that materializes a human presence in a remote space, a remotes collaboration work tool, a wearable piece that enhances a certain human sense and/or alters the perception of a specific environment.

🔎 09.10 Class

My initial idea was the experience of creating own timepiece that operates based on an individual's sense of time. From the last class, I thought the concept of temporality(create traces, show the concept of time) was impressive and extended from this concept, I conceived the interaction that shows the idea of a relative sense of time that different people have.

Some people say, time goes really fast but others say time goes really slow depend on their situation such as age… this kind of relativity was quite interesting to me.

Basically, the idea is the person will asked to press button when they think it’s becoming 60secs counting from the start.Then, they will press button before or after the exact 60secs moment, which will create their own clock based on their sense of time.. For example, the clock that operates on a 50seconds basis can be created from the experience.

🧐 Feedback

Think about how can I engage more body movements and interactions. The idea of capturing a sense of time is something interesting to dig in.

Idea #1 Clock wall

🔎 09.17 Class

Stared from the idea of “using body parts as a component to represent something” Project Patient and “making a corresponding relationship with ordinary objects”

I came up with second idea; Loopstation that enables accumulating different sounds in the settled duration and creates music. Then I thought about a device that uses an image of body movement instead of sound and creates an interesting visual output(graphic) instead of music. So this idea explores a way to use the body as an instrument but creates an image.

Idea #2 Body instrument

Let’s move to the next idea. Apple’s Animoji also gave me the idea of “translate or convert”. so the human act is represented in a different format. From this example, I had this question “ if things have a voice, how it will sound like?”

So, in the personify context, we assume the situation that animal or object act like a human. they can walk and talk, My idea is something contrary to personify. I wished to imagine the voice of objects and things (Like characters from Beauty and the beast) when you act like something or mimic the shape of it, the mouth piece will create the sound of the object.

Idea #3 Be an object

🧐 Feedback

Thecla Schiphorst’s work might be helpful to understand the aesthetics of interaction and movement knowledge representation.

How can I engage people as a part of playing? Think about participation as part of the project. Capturing and exploring how the body actually moves and works. More interaction and body involvement will be interesting.

🔎 09.17 Class

From the last ideation, I wanted to keep the concept “create an aural and visual expression from body movement”. And I shift my idea more into the movement side and creation of sound. Therefore this “body as an instrument” came out. Although, it can be a little stale since there are many similar projects around body and music (google experiments: semiconductor). So I’m thinking how can I differentiate it in a more intriguing way. Right now, I’m considering creating a score by using a visual of the body as a note.

Google experiment: Semi-Conductor

📋 Additional References

Heartbeat -pattern visualization

Finger piano

Arduino air drums

Distance piano

🔎 10.1 Class

This week, I’m more leaning toward the idea of “How it feels/senses like navigating ambiguity?” Because while thinking about some inherent meaning of sound and creating sound, it feels like I’m talking about intangible feelings and how can I bring it more concretely to people.

Then I brought this question:

What if we could feel a new sense that we haven’t detectable in natural status through the medium of interventions and own body movements?

Input: induced body movement through ready-made artifacts like a wand, fan, bouquet, baton, balloon, bat, etc

Output: translate the existing environment into something…

Stick-type artifacts
Explore ideas

🔎 10.6 Class

Start making a prototype ( could be chipboard, paper, fabric. Small scale or just one module/part or detailed sketches)

collabo Playtronica X Issey miyake

Ref: Playtron is a studio dedicated to creating interactive musical experiences — objects are turning into sounds by simple act of human touch. And Synesthesia is an unusual experience in which the perception of reality causes other sensations.

Through the iterative ideation process, I landed on the idea; the object that induced a person to move/act in a certain way that creates certain perceptions and expectations about the situation. Then, I thought about a scenario that utilizing some objects like a ball or fan, the user finds meaning from the empty space.

🔎 10.8 Class

I started with the concept “Body as an instrument” and thought about what our body movement entails. Also how an object intervenes and induces a person to move in a certain way. During the discussion, the object Fan was quite interesting, in my culture, there is a traditional dance that using a fan. I thought dancers’ movement actually feels abstract, but at the same time, it feels like they’re telling a story to the audience.

Korean traditional fan dance

Again, I refine my research question as “How a dancer becomes the main character of the story and also enjoys dancing more actively?”. Then I developed my idea of Storytelling through dance.

Basically, the idea is when a person dances and starts fanning, different shapes/sizes of a cloud with sound is generated by the dancer’s different movement, and in the end, the background painting (which is a story in this case) is completed with different shape of clouds. Because I thought different shapes and patterns of cloud and the dynamic act of fanning actually closely related to each other.

For now, I just started to learn how to use P5.js and Processing to understand generative visual interaction. But also thinking of using Arduino, some sensors like accelerometer and proximity that can be attached to a fan.

🔎 10.13 Class

[Develop a prototype, we need to see the scale, dimensions of your designed piece, rough 3D model, or cardboard probe. This is a second or third iteration of your concept.]

  • Plan (Scale and method)
  • Moodboard
mood board- Korean monochrome
  • Prototyping — references

🧐 Feedback

  • Consider additional layers such as sound(tone) and light (LED strip) not only a visual representation
  • Accelerometer sensor+ Processing
  • Search for 3D projection methods (using the whole room as a canvas)

https://www.youtube.com/watch?v=-FvBQcirsUk&featue=emb_title

  • Arduino nano might be appropriate in this scale

🔎 10.22 Mid-Presentation

Research Question — Storytelling with dancing

How a Dancer becomes the storyteller and also enjoys dancing more actively?

There is a background created by projection mapping and whenever the dancer swings their fan, it creates some pattern on it and also creates sounds. I expect to create an atmosphere that seems close to the “Korean monochrome” style — coexist of a modern and traditional impression.

This is a diagram for my interaction: the location and speed of the fan will be detected from the Arduino sensors like Gyroscope and accelerometer and webcam so that input is going to processing / p5.js software and image result (graphic pattern) is projected by projector also make the output of sound. Therefore that dancer can play within the stage.

🧐 Feedback

  • Construct the picture of the stage and its interaction
  • Think about how certain actions translated into broader and thinner lines depending on the scale of the movement.
  • Connect body and motion
  • Consider leaving movement traces permanent (e.g. Neworleans artist — charcoal performance art)
  • Think it as a combination of multiple layers

--

--