WWDC-2024: Discover VisionOS 2

Krupanshu Sharma
Simform Engineering
4 min readJun 11, 2024

Exploring the future of AR with VisionOS 2

VisionOS 2 is a significant update that enhances the Apple Vision Pro experience, introducing the ability to transform favourite photos into breathtaking spatial images, intuitive new hand gestures, and brand-new features in popular apps.

Let’s break down the most significant updates individually.

Create and Relive Stunning Spatial Memories

Create and Relive Stunning Spatial Memories in All‑New Ways.
  • Incredible Depth and Realism: Spatial photos on Apple Vision Pro enhance favorite moments with family and friends.
  • visionOS 2: Allows users to create spatial photos directly from their library in the Photos app.
  • Advanced Machine Learning: Transforms 2D images into beautiful spatial photos that come to life on Vision Pro.
  • Sharing Spatial Photos: Users can share their spatial photos with loved ones to view on Vision Pro.
  • SharePlay in Photos App: Use SharePlay with spatial Persona to enjoy panoramas, spatial videos, and more, feeling like everyone is in the same physical space.
  • Capturing Spatial Videos: Available on Apple Vision Pro and iPhone 15 Pro to bring special moments to life and relive them as though back in the moment.
  • Canon Spatial Lens: Later this year, Canon will offer a new spatial lens for the EOS R7 digital camera to capture spatial video in challenging lighting.
  • Final Cut Pro Update: Creators will be able to edit spatial videos on their Mac, adding immersive titles and effects.
  • Vimeo App for Vision Pro: Users can upload and share spatial videos for others to discover and enjoy.

New Hand Gestures and Productivity Feature in VisionOS 2.

visionOS introduced a revolutionary spatial interface that users control with just their eyes, hands, and voice.

New Hand Gestures and Productivity Feature in VisionOS 2.
  • VisionOS 2 streamlines navigation on Apple Vision Pro, enabling faster and easier access to key functions with new hand gestures.
  • Users can quickly reach frequently used features like Home View and Control Center, view important information at a glance, such as the current time and battery level, and perform actions like adjusting the volume with simple gestures.

Build Innovative New Experiences

Developers have created incredible app experiences for Apple Vision Pro, leveraging the unique capabilities of spatial computing across a diverse range of categories.

TableTopKit: This new framework simplifies the development of collaborative table-centered experiences by managing the manipulation of cards and pieces, establishing placement and layout, and defining game boards.

It enables developers to more easily create shared app experiences across a variety of categories, including games
  • According to Apple, there are more than 2,000 Apple Vision Pro applications. VisionOS 2 Updates will make it grow more.
  • Canon has offered a new lens for its EOS7 camera for creating spatial images. This gives the Photos app the ability to convert 2D images into spatial ones.
The New lens allows the Photos app to convert 2D images into spatial ones.

Apple also announced plans to launch Vision Pro in eight additional countries:

  • China
  • Japan
  • Singapore
  • Australia
  • Canada
  • France
  • Germany
  • UK

Additional features in visionOS 2 include:

  • In Safari, users can watch videos on sites like YouTube, Netflix, and Amazon in an immersive environment, with Siri reading webpage content while multitasking.
  • The Apple TV app supports multiview on Apple Vision Pro, allowing fans to watch up to five simultaneous sports streams.
  • Systemwide Live Captions enable all users, including those who are deaf or hard of hearing, to follow spoken dialogue in live conversations and app audio.
  • Users can stream content to their Vision Pro via AirPlay from their iPhone, iPad, or Mac.

Conclusion

In conclusion, visionOS 2 is set to revolutionize the Apple Vision Pro experience with its advanced features and intuitive controls.

From creating stunning spatial photos and videos to seamless navigation with new hand gestures, visionOS 2 makes it easier and more enjoyable to interact with your device.

Whether you’re watching immersive videos, multitasking with Siri, or enjoying a calm focus with the Mindfulness app, visionOS 2 brings a new level of functionality and innovation.

For more updates on the latest tools and technologies, follow the Simform Engineering Blog.

Follow us: Twitter | LinkedIn

--

--