Make any person dance with just 1 image! (Artificial Intelligence)
What if I told you, with just one picture of any person, you can make them dance as you like? Yeah, sounds crazy! But now its possible with the latest advancements in Generative Adversarial Networks.
Liquid warping GAN is a unified framework for human motion imitation, appearance transfer and novel view synthesis. It uses a 3D body mesh recovery module to disentangle the pose and shape, which can not only model the joint location and rotation but also characterize the personalized body shape, thereby using it to understand and imitate human body motion and transfer this motion to another human in an image.
So, what are the inputs needed? Well, just 1 picture of the person who will dance, and a reference video of the dance by another person or robot (basically anyone with a well-defined body shape). That’s all!
Here is a combination of all 3 — input image, reference video and the output:
Crazy right?! Well here’s a brief explanation of how you can create your own, along with a link to the google colab notebook.
Colab Link:
Follow the link and open the colab notebook.
Clone the iPerCore repo, install all the requirements, setup iPerCore and download all the assets. If you want to try it out with the sample photo and videos, download the samples and test any of the three types of motion translation — First one requires only 1 full frontal image of the person, Second one requires both the frontal and backside images of the person, and the third requires both along with the image of the background.
Now, to try it on your own photo and video, just upload them into the assets folder and link the photo and video in the 2nd last cell for custom input. Follow the link naming conventions mentioned in the notebook.
That's it! Just run the cell and sit back and relax. For your custom video, it will be saved inside the results folder and you can download it to your pc to view it.
