Control camera position with FaceAPI

and Topia Experience

Themis García
Real Time Social Spaces
2 min readFeb 20, 2021

--

Virtual field with a grass floor and 4 cubes. a face s in the middle of the field.

Description

My goal for this week was to use face position to change the camera position, changing how someone is able to interact with the project. I used FaceApi from Ml5 to control camera position as a way to control your point of view.

Like last week, I started my exercise from Aidan Nelson’s template, which allows connecting multiple users in the same virtual space with audio and video sharing.

After some discussion in class and looking for the three.js resources of ground creations, I was able to create a plane with a texture of grass. Also, incorporate a cone over my bubble-face to have visibility of the direction that I am moving.

Github

Virtual field with a grass floor and 4 cubes. a face s in the middle of the field

Challenges

  • I still have a lot of problems uploading models. Looks like not all types of models are readable for Three.js even when there are recognizable formats and referencing the lib.
    I even tried to see them in the three.js editor and it was not visible. Not sure how to approach this problem in the future.
  • I had problems creating a grid of spheres, not sure if I had to approach it differently from the grid of cubes (which I was able to do).
  • I also tried to run it on an iPad but the camera and keyboard controls didn’t work.

Questions

I am trying to create a hiding game similar to peek-a-boo. For this, I am using the body to move and hide in a “natural way”.
I wonder if I should move the bubble with the camera or remove the bubble-face completely.

Topia

Screen Shot of Topia App. A Drawing black and white of a camp in a forest and and two people standing in front of the camp.

This week I tried also Topia I app that actually can explore and talk with friends. I just did the basic exploration of getting a friend to look around. I enjoyed how visually pleasing it is and how really you feel like walking around. I loved the ambient sound. It really transports you to the environment.

--

--

Themis García
Real Time Social Spaces

Product UX Designer, Accessibility Researcher, Artist | PR-born & raised | She, Her, Ella| themisgarcia.com