Creating a real-time synced multi-device AR app in 24 hours
By: Team Sudo World
Team members: Arjun Achatz, Daniel Tran, Justin Jones, Lionheart Xiong, Nate Udren, Paige Sun, and Umesh Dhurvas
A few weeks ago, TribalScale hosted an incredible hackathon with a goal of creating solutions to make day-to-day life at the office more efficient and effective. Teams from our offices in Toronto and the OC participated, the events were live-streamed, and the teams built amazing products making use of emerging tech. This blog post was compiled by the winning team, Sudo World, and outlines their technology and experience with our “Hack-the-Tribe” hackathon.
Taking AR to the Next Level
Sudo World built an AR app that reaches a new level complexity and fills a major gap in the AR tech space. Basically, Sudo World’s pioneering technology makes AR more collaborative and interactive with it’s multi-device and real-time syncing and storing capabilities.
So far, there is very limited AR technology that allows multiple users to engage and interact in real-time with the same experience. There isn’t any AR technology that lets users build on their virtual world. For example, if I plant a tree, it won’t necessarily be stored and in the space of another user. If anything, existing solutions involve complex setups with printed markers, or trackers attached to the user’s body. There are also expensive controllers or specialized (and maybe even rare) rooms with multiple cameras that provide a shared AR experience.
Sudo World built the technology that bridges this gap. No extra equipment is needed, all you need to do is a quick calibration and then you can start your shared AR session. Calibration itself is easy, both users can simply point their phones at the same physical location and then they’re synced. From there on, all users’ virtual worlds will update accordingly in real time; if an object is modified or created (a tree is planted) then it will be stored and in the other users’ world in real-time. Our tech also allows for life-sized models. The users don’t need to print markers, and the AR technology can be used anywhere. Sudo World’s AR technology was initially built for the iPhone, but can be implemented on Android as well.
At last: accessible, collaborative, interactive AR technology. Plus, there are so many use-cases for Sudo World’s technology!
1. Multi-person learning
Multiple phones can view the same object in the same physical spot, i.e.: users can share the same virtual world and augment the very same physical world. Imagine a professor lecturing the next generation of medical physicians, the professor can control a 3D model of the human body — scaling, rotating, and highlighting important features. Each student will have their own 3D model calibrated to their desk, facing them and mirroring the professor’s. Whatever aspect the professor is highlighting will be right in front of each student. The students can also explore their own model and look at it from different angles. This interactive learning will likely result in higher student engagement and will make it so much easier to follow along, especially compared to when your textbook is always flipping itself to the right page!
2. Product or auto demo-ing
Automobile sellers can demo both the inside and outside of a car to a group of customers, while at the same time are able to synchronously control their experience and where they are looking in real time. This scenario could apply to any other product.
3. Architecture modeling and co-viewing
Large household decisions, like deciding which family car to buy or how to remodel the kitchen, involve different views, priorities, and interests. Our technology makes this easier. A couple can use the tech to discuss which car to buy while looking at a virtual car together in their driveway. They can then edit model colors, choose different accessories for the car, and have it all visually displayed. Or imagine sitting in your living room and designing a new house: You can instantly and collaboratively modify the number and size of rooms, layouts, materials, and furniture. You could view a small model of the house, or even virtually walk through a life-sized virtual house.
4. Shared virtual world
A creative safari travel company can set up many booths in malls across the country. Imagine the booths are lined with artificial grass and trees; when a user looks at their phone, they can see a tiger at their feet, a monkey swinging from tree to tree, flowers that open when you are near. Lighting, wind, and surround-sound can even be synced to give the user a more immersive experience. This virtual safari extends well-beyond the space of the booth in the mall, and as long as each booth is set up in the same way, each user can have the exact same shared experience.
5. Shared drawing
The app would also allow people to have a 3D whiteboard. With it, multiple users can view and/or modify 3D models, like buildings, interior design, or cars. This can also apply to a virtual world, where users can collaboratively build and create a shared space.
6. Multi-player gaming
The app would also enhance multi-player gaming and multiplayer geocaching.
Fun Fact: Work began at 9am on Friday and demos ended at 10pm on Saturday. Two of the engineers were up for 39 hours straight, with only an hour or two of sleep.
Join our fast growing team and connect with us on Twitter, LinkedIn & Facebook! Learn more about us on our website.
