Tele-operation using two KUKA Lightweight Robots and MS Surface

Watch video in HD for best experience!
Two KUKA Lightweight Robots are remote controlled (tele-operated) by a Microsoft surface application utilizing mult-touch and tangible interaction. The operator cannot see the robots directly, he can just use three types of feedback that are provided: the picture taken by a camera mounted on the right robot, a 3D visualization of the robot poses and the force values measured by the robots at their end effectors. These force values are displayed inside the 3D visualization.
The application is powered by a robot control architecture developed in the research project SoftRobot. The architecture includes a real-time robot control core supporting the Realtime Primitives Interface (RPI) and the Java-based Robotics API for high level robot application modeling.

Category:

Science & Technology

Tags:

• Robot
• Lightweight Robot
• Surface
• tele-operation
• SoftRobot
• Robotics API

[jamen1993]

Really good work, don't know, what it's good for, but amazing work and amazing interface as well!

[ISSELabs]

@jamen1993 Thank you! This might be useful for scenarios where a robot system is operated in hazardous environments, so that the operator cannot have direct visual contact to the system. In this case, intuitive control and feedback mechanisms are very important.

[KUKAyouBot]

Good work!