TLDR
Imagine listening to your favorite song in 360 ° audio. I am pleased to present Inside Music YouTube Edition, a web application that uses Artificial Intelligence to separate instruments and place them in a virtual room for an immersive experience. Try it in modern browsers with headphones, or in Virtual Reality devices. Link: https://3dyt.hcilab.ml/ Credits: Experiments with Google.
INSIDE MUSIC — YOUTUBE EDITION
What if you could step inside a song? This is a simple experiment that explores that idea. See and hear the individual layers of music all around you to get a closer look at how music is made.
It’s built with WebVR and spatial audio. Thanks to Song Exploder and Google Creative Lab for open-sourcing their code we could adapt it to allow you to explore your own music in VR. Learn more on the original GitHub project and the YouTube edition code. And check out more WebVR Experiments here. Please send us any feedback to demos@hcilab.ml.
BIG THANKS TO ALL THE FREE AND OPEN SOURCE COMPONENTS OF THIS SOLUTION
This web app was developed by using AFrame, Tone.js, and Three.js among other open-source libraries. The backend automation was possible thanks to free platforms and libraries…
