Guiding robot planes with hand gestures
Sign in to YouTube
Sign in to YouTube
Sign in to YouTube
Published on Mar 13, 2012
MIT News - March 14, 2012
Aircraft-carrier crew use a set of standard hand gestures to guide planes on the carrier deck. But as robot planes are increasingly used for routine air missions, researchers at MIT are working on a system that would enable them to follow the same types of gestures.
The problem of interpreting hand signals has two distinct parts. The first is simply inferring the body pose of the signaler from a digital image: Are the hands up or down, the elbows in or out? The second is determining which specific gesture is depicted in a series of images. The MIT researchers are chiefly concerned with the second problem; they present their solution in the March issue of the journal ACM Transactions on Interactive Intelligent Systems. But to test their approach, they also had to address the first problem, which they did in work presented at last year's IEEE International Conference on Automatic Face and Gesture Recognition.
Yale Song, a PhD student in MIT's Department of Electrical Engineering and Computer Science, his advisor, computer science professor Randall Davis, and David Demirdjian, a research scientist at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL), recorded a series of videos in which several different people performed a set of 24 gestures commonly used by aircraft-carrier deck personnel. In order to test their gesture-identification system, they first had to determine the body pose of each subject in each frame of video. "These days you can just easily use off-the-shelf Kinect or many other drivers," Song says, referring to the popular Microsoft Xbox device that allows players to control video games using gestures. But that wasn't true when the MIT researchers began their project; to make things even more complicated, their algorithms had to infer not only body position but also the shapes of the subjects' hands.
Read more at MIT News: http://web.mit.edu/newsoffice/2012/ro...
Video: Melanie Gonick
Simulations courtesy of Yale Song
Standard YouTube License
- 10:04 Luthier Tips du Jour - Hand Planesby OBrienGuitars Featured 11,639
- 5:04 Ramp Marshal Hand Signalsby Jim Clark98,935 views
- 4:59 IKE Shooter Gangnam Styleby gryspr85,931 views
- 10:46 Inside Adam Savage's Cave: Awesome Robot Spider!by Tested87,183 views
- 40:18 How Robots Will Change the World - BBC Documentaryby supecx macol1,177,995 views
- 7:41 USS Enterprise Flight Operations - Very Cool!!!!by US Military269,997 views
- 7:20 USS Enterprise Flight Deck Operationsby US Military87,836 views
- 1:01:26 For the Love of Physics (May 16, 2011)by MIT813,831 views
- 6:30 CARRIER | Flight Deck Danger | PBSby PBS103,388 views
- 10:24 ITALIAN IN 10 MINUTES - BEST COMPLETE GESTURE'S LESSON - by CARLO AURUCCI .wmvby caurucci464,033 views
- 6:00 What is Graphene?by VegaScienceTrust475,132 views
- 14:28 How Google's Self-Driving Car Worksby IEEE Spectrum482,675 views
- 2:01 Shooter Gives His Perspective on Flight Deck of USS Enterpriseby U.S. Navy12,807 views
- 4:20 U S aircraft carrier fighter jets taking off and landing with ground crewby Jinku Lin3,804 views
- 4:56 NASA and GM Take a Giant Leap Forward in Roboticsby jbibby2007111,752 views
- 1:38 Flight Deck Operations USS Nimitz (CVN 68)by AIRBOYD23,294 views
- 2:53 Man Controls Robotic Hand with Mindby Discovery1,106,673 views
- 1:05 Chinese Jet Launch Inspires Gangnam Style Crazeby NTDTV19,139 views
- 2:15 TechSolutions: Connecting the Warfighter with the Scientist (short version)by usnavyresearch2,724 views
- 9:50 Body Language: The Meanings of Hand Gesturesby Simona Rich370,355 views
- Loading more suggestions...