Using the Iphone as a human-robot interface for teaching new visually grounded words to a robot

In this video, we present a system allowing non-expert users to teach new words to their robot. In opposition to most of existing works in this area which focus on the associated visual perception and machine learning challenges, we choose to focus on the HRI challenges with the aim to show that it may improve the learning quality. We argue that by using mediator objects and in particular a handheld device like the Iphone, we can develop a human-robot interface which is not only intuitive and entertaining but will also "help" the user to provide "good" learning examples to the robot and thus will improve the efficiency of the whole learning system. The perceptual and machine learning parts of this system rely on an incremental version of visual bag-of-words. We also propose a system called ASMAT (active simultaneous modelling and tracking) that makes it
possible for the robot to incrementally build a model of a novel unknown object by simultaneously modelling and tracking it.

More details in:
Rouanet, P., Oudeyer, P-Y. and Filliat, D. (2009) An integrated system for teaching new visually grounded words to a robot for non-expert users using a mobile device, in the Proceedings of IEEE-RAS International Conference on Humanoid Robots.

More info on: http://flowers.inria.fr

Keywords: Human-robot interaction, interfaces, HRI, HCI, robot, intuitive, computer vision, language acquisition, teaching, joint attention, pointing, Nao, Iphone, Wiimote, Laser, inria, flowers.

Category:

Science & Technology

Tags:

• INRIA
• Human-robot interaction
• interfaces
• HRI
• HCI
• robot
• intuitive
• computer vision
• language acquisition
• teaching
• joint attention
• pointing
• Nao
• Iphone
• Wiimote
• Laser
• inria
• flowers.