Spatial AR with projection mapping

Our eyes see the reality that dominates our mind that helps our brain to believe what is true and what is not. Me and Alan are working together this week and we want to challenge if the manipulated information can make the sensory receptors detect stimuli differently and thus form another reality? Sometimes, the reality is just what we choose it to be. Is our reality real, or is it an illusion?

In order to make a projection mapping that creates an illusion in the physical world. We juxtapose a piece of space by projecting an image onto the door, and create a visual effect while interacting with it.

Here’s how we make it.

Step 1: take a picture of the space behind the door

Step 2: apply the water ripple effect to the image of the space in After Effects, and then export the video

step 3: project the exported video onto the closed door using Isadora

step 4: time the water ripple visual effect and fake the interaction

There are a few improvements that can be done. First, we should use a video instead of a still image to project on the door. Second, we should pay more attention to map the position of the projected image and the real scene behind the door. Third, the brightness and contrast of the projector are low, it affects the projection less convincing. The audiences are easy to notice this is being projected. Last, we could achieve the real interaction with a technique like this: “https://www.hackster.io/bareconductiveteam/projection-mapping-with-a-pi-cap-f1a134".