WorkPartner robot Spatial Information Interface tests, part 2/2

Helsinki University of Technology's (TKK) WorkPartner robot and Spatial Information Interface test. User asks where object is located and the robot replies using speech, turning the head, virtual environment model and robot's camera image.

The ball is recognized using OpenCV ellipse fitting. The speech commands are recognized using CMU sphinx-2 speech recognition system. The virtual environment model uses Open Dynamics Engine (ODE) based SimPartner software. The speech responses are generated using Festival speech synthesis system.

The scenario steps are basically:

1. User gives speech request: "Where is ITEM?". ITEMs used here are ball, box and hammer.

2. Robot responds either: a) ITEM is in LOCATION. b) I don't know where is ITEM? c) I did not understand, can you repeat?

3. Robot points the ITEM from camera image and from virtual environment model.

4. Robot turns head towards the ITEM

More info:
http://automation.tkk.fi/SpacePartner

Category:

Science & Technology

Tags:

• WorkPartner
• HRI
• Spatial information
• speech recognition
• robot

[harrikuk]

Yebbey, robottien kuningas.