Autonomous spider learns to walk forward by reinforcement learning
Loading...
Link to this comment:
Uploader Comments (micheltokic)
All Comments (19)
-
so beautiful watching it take it's first baby steps *sniff* i think i'm gonna cry :')
-
Computer science is beautiful.
1 year ago 2
-
OMG! awesome! ufff! love to see the last part when it perfectly learns to walk!
-
LOL I was thinking, this is kind of less efficient than Animal walking because we're born with some instincts to walk and then i realized that this ROBOT leaned to walk with no prior knowledge in just 4 minutes.
-
Really cool. I hope I would be able to implement this too for Robocup :-) Thanks for sharing and the link too :-)
-
Thanks for the reply ! So I guess what you're trying to say is that, its a hell of a extended code, were C isn't as good as C++, I get it. Its still fun how the robot figures it out and remembers each sequence. I wonder if you made it possible for a biped robot, maybe climb high objects, or sensing edges. Anyway, thanks !
- 1:35Evolution of a Neural Networkby DrRhinehart11,246 views
- 1:01An A.I. (Artificial Intelligence) Robot Develop...by SSCexpert122,148 views
- 1:07RX-64 Quad Robotby AlterRobotics10,088 views
- 0:51Robot Spider Walk and Turnby didibach121,545 views
- 0:20Spider robot - walkcycle testby kifkroker1291,760 views
- 2:14Genetic Algorithms: Evolving a human faceby ldbrandy27,339 views
- 3:08Autonomous Robot With Neurologically-Based Cont...by spectrummag467,904 views
- 4:58A brief introduction to reinforcement learningby galamaz3,303 views
- 1:55GA Crawler (learning how to walk)by teknowledgeable4,807 views
- 2:52Robot Learning with a Biologically-Inspired Bra...by BrandonRohrer4,461 views
- 1:41Robot learning a forward walking policyby micheltokic2,105 views
- 1:07NXT Q-learning snail (exp3)by mentulatus8,070 views
- 3:58QLearning Javaby davifoueira1,609 views
- 0:25Eight Legs Robot Spider - Roboterspinne Acht Beineby quadraturencoder202,976 views
- 2:16Humanoid Robot Learning to Walk with GAby saeedmokaram954 views
- 0:162 Legged RunBot breaking recordsby groonk55,072 views
- 0:58Autonomous walking robot - Dynamic Programmingby micheltokic3,211 views
- 2:49Learning robot from University of Vermontby joshbongard1,328 views
- 0:38A walking robot learns to climb over an obstacleby micheltokic1,871 views
Is this robot programmed with the included software, or is it done in another language like C?
I've been thinking about getting the bioloid starter kit to experiment a little on my own time with neural network algorithms, but the major drawback for bioloids is that they don't seem as well supported by standard programming languages, where as others like NXT and VEX can sync with RobotC out of the box.
Aoitetsugakusha 2 years ago
Dear Aoitetsugakusha,
the robot is programmed in C on the little PC-Board on top of the robot on which we run Linux. We use a very small (USB) serial-to-bioloid board for sending positioning commands to the bioloid actuators. So you see we are very flexible in the choice of our programming language :-)
Cheers Michel
micheltokic 2 years ago
How can I get this code in C, I wanna use it with the mindstorm NXT, thanks ! Cool robot !
Ryuuken24 2 years ago
We used the Dyna-Q algorithm as proposed by: Sutton, R. (1990). Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming. In Proceedings of the Seventh International Conference on Machine Learning, 216-224.
micheltokic 2 years ago
Nice. I'm actually surprised that the learning was so fast. Usually Q learning requires a huge amount of trials.
csotanyag75 3 years ago 2
The speed is due to a very simplified state space with only three states for each dimension (a bioloid actuator).
micheltokic 2 years ago