Waltz of the Wizard — MR Sandbox Quick Guide
Introduction
Over the past year, we’ve delved into the realm of mixed reality, and with the release of Quest 3, we are excided to share more about our experimental MR sandbox mode in Waltz of the Wizard. Available now on Meta Quest 3 and Meta Quest Pro, part of the Meta Quest 3 launch line-up!
Integrating hands and voice, alongside MR, marks a significant leap towards natural interfaces for spatial computing. Hand tracking provides intuitive engagements through natural gestures, while voice interaction enables responsive commands. MR seamlessly fuses the physical and virtual realms, ushering in spatially-aware experiences that enrich these meaningful interactions. We are thrilled to continue the journey as VR and AR converge.
This step-by-step guide aims to show the possibilities in Waltz of the Wizard MR Sandbox but feel free to jump into any sections to explore the possibilities!
1) Begin by completing your room setup located in Quest Settings → Physical Space → Space Setup, try to add with as much detail as possible.
2) Open Waltz of the Wizard and select the Mixed Reality Sandbox from the in-game menu by pressing the left controller menu button or make a pinching gesture while your palm is facing up with your left hand.
3) Look for the Tower Spells poster placed somewhere on your wall or window. On the poster you will find the 12 tower spells, to activate each spell use the prefix “Give me” and the name of your spell. Best spells to begin with:
“Give me air drawing”
Make a pointing gesture and draw in the air
“Give me fireball”
Clench your fist and throw a fireball!
“Clear magic”
Clear your current spell
4) Next, let’s move on to creating some objects. You can generate a variety of objects using the prefix “Create” followed by the name of the object. A list of spawnable items can be found in the appendix below:
“Create ten butterflies”
“Create a ball”
“Create five random objects”
-
5) Back to the Tower Spells, try some of these on your newly spawned objects:
“Give me puppeteer”
Animate an object by holding or pinching it for a while and letting go.
“Give me supersize”
Poke an object an watch it get bigger each time.
“Give me polymorph”
Poke something and turn it into a frog!
6) Physics of objects can be modified — point at an object and use the prefix “Make that” followed by the modifier you wish to apply. A list of available modifiers in the appendix below.
“Make that super bouncy” + “Make that jump”
“Make that float”
“Glue these together”
-
7) If things get too messy, remember that you can always use “Destroy everything” or “Clean my room” to start from scratch. You can also make any object disapear by just pointing at it and saying “Destroy that”.
“Destroy everything”
“Clean my room”
-
8) For some even more instant abilities, you can customize special hand gestures with voice commands using “When I” + do this + make something happen. Currently works for finger snapping and hand clapping gestures and any other voice command you can think of. Here are two ideas:
“When I clap my hands, create a target”
“When I snap my fingers, create a dart”
-
9) If you need to blow off some steam, consider dropping in an enemy for some in-house action! Full list of enemies in the appendix below.
“Create an enemy”
“Create a drone”
“Create a tiny blaster”
-
10) You can create fun mini experiences by combining different abilities, objects and magic spells. Here is one example of a bare bones air hockey game: Make sure you’ve mapped a table as furniture in the Space Setup in your Quest. Start by spawning feather pen by saying “Create a feather pen”, now draw a goal on the table. Next “Create a coin” and “Give me puppeteer” then use the puppeteer spell to animate the coin in the goal, when you’re done say “Clear magic”. Now take a seat at the other side of a table and say: “Create 5 coins” and “Make the coins super slippery”. Now try sliding the coins in the goal on the other side!
See you in mixed reality!
We are taking the first steps with MR and we’re excited to explore all possibilities opening up. Currently the MR sandbox mode in Waltz of the Wizard is in experimental phase and we will evaluate future releases based on results from experiments and user feedback. The steps listed in this guide are just to give users ideas and we hope this current release offers an enjoyable sampler plate of what is currently possible in MR.
Voice Commands Appendix
Spawnables
- Box 📦
- Frog 🐸
- Chair 🪑
- Barrel 🛢
- Butterfly 🦋
- Hoop 🗑
- Dart 💘
- Ball 🏀
- Coin 🪙
- Table ⎍
- Target 🎯
- Dummy 🦾
- Lantern 🏮
- Grenade 💣
- Crossbow 🏹
- Golf Club ⛳️
- Puppet 🎎
- Sword 🗡
- Gnome 🪆
- Feather Pen 🖋
- Shield 🛡
- Hat 🎩
- Helmet 🪖
Enemies
- Enemy
- Blaster 🔫
- Golem / Automaton ♟
- Demolisher ♝
- Elite ♛
- Vessel ♚
- Larwasp / Drone 🦟
- Larvops 👁
- Grenadier 🧨
- Giant 🗿
Modifiers
Bounciness ☝️
- “Make this bouncy”
- “Make that super bouncy”
- “Make it not bouncy”
Friction 🛼
- “Make this super slippery”
- “Make that slippery”
- “Make the emerald less slippery”
Glue 🧪
- “Glue this together”
- “Glue those”
- “Make these not glued”
Gravity ⚖️
- “Make gravity stronger”
- “Make gravity faster”
- “Make the gravity of this weightless”
Mass 🏋️
- “Make this heavier”
- “Make him super heavy”
- “Make that less heavy”
Strength 💪
- “Make me stronger”
- “Make him weaker”
- “Make me really strong”
Pin 📌
- “Pin this”
- “Unpin it”
- “Make the coins pinned”
Pitch 🔊
- “Make this higher pitch”
- “Make this pitch up”
- “Make this pitch down”
Size 🎡
- “Make me huge”
- “Make the barrel bigger”
- “Make that small”
Speed 💨
- “Make me faster”
- “Make him slower”
- “Reset my speed”
