Visual Recognition for Anki Cozmo with TensorFlow

The Anki Cozmo robot can recognize faces and objects with markers like Cozmo’s Power Cubes. Ansgar Schmidt and I have developed some sample code to allow Cozmo to recognize other types of objects via TensorFlow.

Watch the video and check out the slides to see how Cozmo can recognize three different toys:

Get the source code from GitHub.

The training is done via TensorFlow and a retrained MobileNet model on Kubernetes.

architecture-1

The classification is done via Tensorflow running in an OpenWhisk function.

architecture-2

Ansgar and I have blogged about this project in more detail.

Cozmo finding the deer:

cozmo-deer

Enjoy !