Crafting the Future: Designium’s Latest AR Innovations for Apple Vision Pro

Advanced Prototyping in Gaming, Virtual Environments, and Avatar Interaction

Designium
Designium StoryHub
6 min readOct 7, 2024

--

Content

Designium Inc., an innovative XR development studio, proudly announces the groundbreaking results of its Apple Vision Pro research and development. Designium leverages its extensive experience in AR development to create groundbreaking prototypes for Apple Vision Pro. From immersive mini-games and virtual tools to advanced avatar interactions, Designium’s innovations seamlessly blend real-world elements with digital enhancements. By applying years of AR research and development, Designium is pushing the boundaries of what’s possible with Apple Vision Pro, delivering rich, interactive experiences that captivate and engage users in entirely new ways.

Advances in Mini Game

We’re excited to introduce several engaging mini games that showcase the fusion of real-world elements with digital enhancements. With Vision Pro, users can select, scroll, zoom, rotate, and move objects using hand gestures and eye movements. In terms of mini game design for Appl Vision Pro, we are more focused than usual on:

  • Intuitive operation design through gestures.
  • AR game design takes advantage of the full dimensions of the physical environment.

[ Ninja Game ]

Ninja Game immerses players in an exciting AR experience where they can unleash their inner Ninja by using intuitive hand gestures to shoot shurikens into a dynamic game scene. By flipping their left hand, players generate a shuriken, and with a swift sliding motion of their right hand, they can launch the shuriken into the AR portal. This seamless two-handed interaction offers a highly engaging and immersive gameplay experience.

[ Pet Feeding Game ]

The interactive Pet Feeding Game brings a touch of whimsy to the AR landscape. Users can witness soot sprites autonomously roam through the scene, their AI-driven behavior adding a layer of realism to the virtual world. With just a double-click gesture, users can dispense candy feedings, prompting the pets to search for their sweet treats.

[ Playing Fetch ]

Designium’s Playing Fetch is an XR demo featuring a virtual dog, showcasing the seamless integration of Apple Vision Pro. This game allows users to engage in interactive activities like throwing a ball for a virtual dog, programmed to mirror real-life recognition and behavior. Leveraging hand input interactions, players can control the ball’s trajectory with intuitive gestures, enhancing the overall gameplay experience.

[ AR Checkers ]

The AR Checkers game is an experimental project utilizing Photon Fusion technology on Apple Vision Pro, offering two unique modes for gameplay. In the online mode, players can engage in the game from different locations by sharing a website link and using Zoom for video calls during gameplay. The face-to-face mode allows players to sit together in the same space, where image tracking and Photon Fusion on Apple Vision Pro synchronize the position of game elements, creating a seamless multiplayer experience. This experiment showcases the potential for both remote and in-person interaction in augmented reality gaming.

[ Volleyball Training ]

The Volleyball Training game allows users to practice their serve receive skills with a virtual volleyball serving machine in an immersive AR environment. This game explores the potential of using VR headsets in the sports market, providing an innovative way to experience a variety of athletic skills. Through this AR experience, users can analyze their volleyball techniques in a dynamic, realistic environment, blending the physical and virtual worlds for enhanced sports training.

🔼 Back to the Top

XR Toy Technology

The Magic Wand is an XR Toy integrated with Bluetooth technology, allows users to unleash their creativity by casting magic spells through gesture-based interactions. With in-device machine learning, users can wave the magic wand to perform specific gestures, which trigger corresponding AR effects in real-time. This innovative input method enhances the immersive experience on Apple Vision Pro, offering users a more engaging and interactive way to explore augmented reality through magical, gesture-controlled actions.

🔼 Back to the Top

Travel Adventure

Designium’s efforts in digital heritage preservation is exemplified by the Tokyo Time Machine, a groundbreaking immersive augmented reality project that reconstructs historical site in vivid detail, bridging the gap between past and present.

  • Bringing History Back to Life

Our goal is to virtually transform the surfaces of buildings and environments, visually transporting users back in time. We’ve now taken this vision to the next level by exporting these visual effects and creative technologies to the Vision Pro, enhancing the immersive quality and fidelity of the experience.

  • Restoring Digital Heritage with XR

One of the demos involves the restoration of a destroyed building in Nezu, Tokyo. Using photogrammetry scans provided by @kazugoru , we’ve reconstructed the building in its original location in an AR environment. Through the Apple Vision Pro, users can explore this digital heritage and experience what the building once looked like before it was lost to time.

  • Hybrid Historical AR

It’s a fascinating way to explore historical AR, where we combine 3D models and historical photos to restore a scene from the past. In one demo, we recreated a historic image of tattooed individuals at Odaki Falls in Nanushinotaki Park. The original photograph, taken 70 years ago, comes from the book “The Tattoo Writer”. Using Tripo AI photo-to-3D tool, we generated a 3D model of the landscape and placed the photograph at its original location.

🔼 Back to the Top

Virtual Assistant Tool

Designium’s lineup of innovations for Apple Vision Pro includes a trio of virtual assistant tools: AI Cooking Assistant, AR City Maps, and Music Visualizer. Together, these tools help complete everyday tasks, allowing users to explore and experience their daily lives in ways never imagined before with Apple Vision Pro.

  • AI Cooking Assistant

A practical tool to enhance your cooking experience with Apple Vision Pro. Users can get hands-free assistance in the kitchen through artificial intelligence (AI). It revolutionizes the kitchen experience by providing interactive guidance throughout the meal preparation process, making cooking more intuitive and enjoyable.

  • AR City Maps

Users can explore a whole new dimension of the city navigation, utilizing Google 3D map tiles to enhance spatial awareness and travel planning in immersive AR environments.

  • Music Visualizer

Immerse yourself in captivating synchronization with the Music Visualizer, enhanced by the innovative sound detection function that adapts even while on the move.

🔼 Back to the Top

Avatar Creation

Designium’s XR prototyping for Apple Vision Pro significantly enhances user input and interaction design and introduces a variety of applications for AR avatar control and representation. The integration of Sony Mocopi motion capture was crucial in this development, as it accurately senses user behavior and accurately translates it into the virtual realm, ensuring the avatar reflects the user’s movements. This feature allows users to interact and control their avatar (whether a custom 2D character, 3D model, or Ready Player Me avatar) in a more intuitive and immersive way, delivering real-world action on Apple Vision Pro seamless integration with virtual responses.

🔼 Back to the Top

Stay Up-to-Date On Designium’s AR Developments

Designiums groundbreaking AR technology advancements showcase our commitment to innovation and the endless possibilities AR holds for engaging and enriching user experiences. Learn more about what our augmented reality developers are working on now!

Designium Inc.

Designium is a forward-thinking XR studio that renowned for its innovative approach to AR and immersive technology development. They have been pioneers in harnessing diverse VPS services for research and development, pushing boundaries in XR creations. Since 2023, Designium has employed generative AI technology to enhance its projects, emphasizing its ability to seamlessly integrate real-world elements with digital environments, making significant progress in creating advanced prototypes for Apple Vision Pro in 2024.

CONTACT FORM

FOLLOW US

LinkedIn / Twitter / Youtube / Instagram / Snapchat / 8th Wall / Facebook

Copyrights © Designium, All Rights Reserved

--

--

Designium
Designium StoryHub

Award-winning XR Studio specializes in developing VPS experiences. 日本東京科技x設計公司。 基於「讓人們感到開心」的理念,開發結合新科技的數位內容體驗。包含「結合地方文化」、「提供技術服務」、「協助有趣的創作」等。 如需合作相談,請隨時與我們聯繫。