NAO humanoid robot plays Jingle Bells on the Glockenspiel (2012 version)

Our NAO humanoid plays Jingle Bells for Christmas on a glockenspiel / xylophone (again). The robot can read a single-track song derived from MIDI and plays it on the instrument. Compared to last year's version, the motions are smoother now and NAO keeps the beat accurately.

Merry Christmas from the Humanoid Robots Lab at the University of Freiburg!
http://hrl.informatik.uni-freiburg.de/

• Category

  Science & Technology

[Gauss Lee]

How does it realize the positions of each key? By visual systems or calibrated working space based on IK?

[HumanoidsFreiburg]

In the video, the robot knows the positions of the keys beforehand and we assume that the the robot's pose does not change. We are currently working on visual recognition of the keys and self-positioning of the robot. The hitting motion will then be adapted via IK.

[Gauss Lee]

Thank you for your reply. Nice work. It should be more challenging to work with visual system.

[HumanoidsFreiburg]

Yes, it definitely will be. Hopefully, we will get it running before next Christmas :)

[Christie Nel]

I like it. The motions are nice and smooth. Are you sharing the behaviour?

[HumanoidsFreiburg]

This is no Choregraphe behavior but custom Python code. It imports a MIDI file, which is then used to generate the motion.

[rami ran]

oppssss, it seems like they don't wanna talk about it......

[Christie Nel]

That is pretty clever. I love how automatic it is.