Aibo plays the 2-armed bandit

A demonstration of an Aibo playing a game of chance on a laptop. The Aibo can choose between pressing keys on the left half of the keyboard or the right half. One side may be more likely to give a "reward" than the other, but it will want to maximize its winnings while it determines which that may be. So there's a trade off between exploration and exploitation involved.

Tekkotsu Homepage: http://www.tekkotsu.org

You can see the code for this particular behavior at http://cvs.tekkotsu.org/viewvc/Tekkotsu/Behaviors/Demos/BanditMachine.cc?view...
Since this was made, we have added a state machine shorthand http://www.cs.cmu.edu/~dst/Tekkotsu/Tutorial/state_shorthand.shtml which would make that code considerably shorter.

Category:

Howto & Style

Tags:

• Tekkotsu
• robot
• aibo
• 2-armed
• bandit
• machine
• learning

[Chazzysgurl]

What software was this under?

[TekkotsuRobotics]

@Chazzysgurl This was written using the Tekkotsu framework, see tekkotsu.org

You can see the code for this particular behavior at Behaviors/Demos/BanditMachine.­cc (try the CVS browser link from the tekkotsu site, YouTube won't let me post direct links, I'll try adding them to the video description)

I'll add that since this was made, we have added a state machine shorthand which would make that code considerably shorter.

[rissehx3]

Wow, the Aibo really is smart.

[peacecb3]

cute:3

we will pray for japan!!

[Chazzysgurl]

@TekkotsuRobotics

excellent! Very impressive work, just started getting into Aibos and getting myself into a little bit of programming c:

Thanks for the code and link, you guys up the good work.

[heliojadem]

Great



[AndrewRiot]

OMGGG DO WANT

[Zircemerald]

@rissehx3 and that isn't even the newest version!

[janniamm]

cool

[SeanAibo7m3]

that is a great way to test out aibos knowledge