Robotic Roommates Shopping for and Preparing Bavarian Breakfast

In the first part of the video below, you can see TUM-James, a PR2 Beta Programm robot, and TUM-Rosie cooperatively preparing the traditional Bavarian Weisswurst Frühstück (Bavarian Sausage Breakfast). TUM-Rosie is collecting the sausages, putting them into the pot with boiling water, waiting for them to be cooked and, finally, finding and getting them out of the pot into the serving bowl. TUM-James is meanwhile slicing the french baguette using a regular electric bread slicer and in the end serving the sausages and the bread to the class of highly regarded roboticists.
In the second part of the video, TUM-James is shown simulating the shopping task, bringing the groceries home and placing them to the places they are meant to be stored in.
It uses 3D perception algorithms from PCL in order to detect object candidates in the storage rack and ODUfinder system to recognize them. Grasping and manipulation
of the shopping basket is done using James's haptic capabilities. Finally, to infer where do the objects belong to, TUM-James queries KnowRob system and computes the maximum WUP similarity (aka relatedness) to the other objects in the kitchen's ontology.

By Intelligent Autonomous Systems Group at Technische Universität München
http://www.ias.cs.tum.edu

See the long and annotated versions of the video here:
Breakfast-part: http://www.youtube.com/watch?v=_SIUCrmE8J0
Shopping-part: http://www.youtube.com/watch?v=JS2zycc4AUE

Song:
"Marbert Rocel: Cornflake Boy (Solomun Vocal Remix)
(P) & © 2008, Compost Records
Musik/ Text: Panthera Krause/ Marcel Aue/ Antje Seifarth
Verwendung mit freundlicher Genehmigung der Universal Music Publishing Germany und Compost Medien GmbH & Co. KG

Video and editing: Michael Karg ( http://www.michikarg.de )

Category:

Science & Technology

Tags:

• robotics
• artificial intelligence
• TUM
• München
• IAS
• künstliche Intelligenz
• Robotik
• CoTeSys
• PR2

[iasTUMUNICH]

@rhynobots: there is only one reason for the robot to be "slow" - because we wanted it to be so. We needed a time to explain to the audience how does the demo work. There is absolutely no impediments to make the robots work at the faster pace.

D.

[iasTUMUNICH]

Hi ereignisfelder,

above video displays only the highlights from an obviously much longer demonstration of skills of our robots. The demo was thus two-fold, one part featured the robots preparing a breakfast and the second part featured PR2 robot simulating the shopping task (milk+cereal) and inferring and putting the objects where they belong to in our testbed kitchen.

See also the longer version of the latter part in a video titled TUM James Goes Shopping.

D.

[Hackzoid]

so skynet can cook now , brilliant

[NewAgeDirector]

Great video keep up the good work.

[brooklyninja]

@UDKoder hahah



[UDKoder]

EXTERMINATE! EXTERMINATE!

[chabi3000]

Hahahaha through our intelligence and creativity we men won´t need women no more . We will have cookbots for making our meals , a cleanbot for cleaning our rooms and even a fembot for sexual pleasure :D hahhahaha . Women fucking women .

[goodgoodgoodful]

If Bruno Mars' "The Lazy Song" is to be remixed, these robots really fit in the music video :-)

[rivlean8]

@gregorstuhlbein now did it ever occur to you ever learning that you dont get paid for sitting your ass at home doing nothing?

[gregorstuhlbein]

@rivlean8

Did it ever occur to people that not having a job might be a good thing, at least

when most work is done by robots for them?

[rivlean8]

@TheSlackerboy and in 20 years we humans gona have no more job

probably in 40 years they gona have robots to fuck our womens for hours instead of us doing it lol

[captainferr]

Was the robot able to recognize that it dropped a sausage?

[foxyd3]

It is nice to see they are using Ubuntu Linux.