OpenPose with Spout Input and Osc Output

Koki Ibukuro
1 min readJun 14, 2020

--

OpenPose is one of the famous skeleton detection library using Machine Learning. On GitHub, That has a pre-build demo binary for Windows and it enables us to run without any setup.

the Following IOs are in the Demo app,

Input: Image File, Video File, Web Camera, IPCamera,

Output: Image File, JSON, YAML, UDP Stream (not implemented)

It is enough, works well, for programmers. but it was a little short for creative coders like using openFrameworks, Unity, TouchDesigner, etc. That’s why I added Spout inputs and OSC outputs to make it easier for creative coders to use. You can find it on the osc-spout branch on my fork.

TouchDesigner -> Spout -> OpenPose -> OSC -> Unity

We used this program to create a large digital signage in Shibuya, Tokyo that interacts with human movement. (Note: Need paying for OpenPose commercial use)

--

--