A Simple Approach to Teaching Marvin New Tricks

Using Open Source Remote Services to Give a NAO Robot New Cognitive Skills

Patrick Titzler
Mar 13 · 3 min read
Marvin, a NAO Robot, playing Rock-paper-scissors
Diagram showing how microservices will be implemented via HTTP requests. Back to school, without the fuzz.
  • sends an HTTP request with the appropriate payload to a local or cloud hosted service that implements the skill using deep learning models, and
  • interprets the response and execute the appropriate action.
View of a basic behavior definition in Choregraphe that leverages a vision-based skill.
  • A Select Camera box, choosing the desired input for image capture or video recording.
  • A Take Picture, Record Audio, or Record Video box, capturing the desired input.
  • A Python script box, processing the captured input using the local or cloud service.

Can you see me now?

Let’s take as an example an object detection-based interaction.

Marvin’s view of my workspace.
"predictions": [
{
"label_id": "n03782006",
"label": "monitor",
"probability": 0.3031136095523834
},
{
"label_id": "n03180011",
"label": "desktop_computer",
"probability": 0.26051175594329834
},
{
"label_id": "n03179701",
"label": "desk",
"probability": 0.17006246745586395
}
]

IBM CODAIT

Things we made with data at IBM’s Center for Open Source Data and AI Technologies.

Patrick Titzler

Written by

Developer Advocate at Center for Open-Source Data & AI Technologies

IBM CODAIT

Things we made with data at IBM’s Center for Open Source Data and AI Technologies.