Virtopsy - Potential use of gesture control in medicine using the Microsoft Kinect camera

[jhk2022]

We have own solution for Gesture Recognition Interface with Stereo Camera.

We don't use prime sense solution as laser sensor.

Our New solution doesn't have Calibration step and Skeleton that mean it is easy to apply any general purpose usage.

Get in my place!!

[ikemkrueger]

The only unprofessional I see here, is the *plop* sound. So that's a pretty good work.

[gallantmon8]

Now I wonder what the Achievements would be? lol

E.G.: Achievement Unlocked: This Is Just Like Trauma Center!(Preformed your first successful surgery; 50 Gamerscore)

[Acer81996]

So you're performing brain surgery, and the apparatus RROD'ed on you. Now what?

[mikerebel]

@Acer81996 the RROD gives honor to his name

[Acer81996]

So you're performing brain surgery, and the apparatus RROD'ed on you.

[finalstagemetal]

Huh, look at that. I guess Microsoft and Apple ARE compatible after all....

Seriously though, so f'n cool.

[1996bonny]

GAYYYY

[YxBthemaster989YxB]

Hello Cracked.com

[misterawesomeo]

lol u have a microsoft kinect system but ur using an apple pc

[flako179]

absolutely amazing! the capabilities of using a natural user interface are just beginning to show, and kinect is gonna be a major cornerstone in this evolution by putting this technology in the hands of the underfunded genius. fuck the naysayers and keep it up :)

[snakepit000]

Kinect seems to be good for everything, except gaming.

[randeDANDE]

You don't see Playstation Move saving lives.

[Baby4Ghost]

This is really nice, sinds the first previews of Kinect(milo etc) I already saw the potentials. I'm really glad this is used in this way, to help save peoples live. The tech in Kinect could be used for so many things..

And people should stop bashing about limitations now, of course there are limitations now, Kinect is still in babyfeets, look beyond and see the potentials people..

[vinnieuitgeldrop]

BORING!



[bbpearl8120]

Very nice work.. Like you said, this was a proof of concept and I think it's a very impressive prototype. My only question is, how often do you think surgeons review CT scans and such during the procedure?  I have never seen that done before in my experience and to be honest, the good surgeon does this homework before gowning up. Regardless, I like what you guys have done. Always appreciate collaboration between medicine and technology.

[BloodyIron]

All this equipment and you guys can't afford a decent microphone? I can barely hear you guys.

[VirtopsyProject]

@BloodyIron : Sorry for that - all the equipments fans plus a crappy camera microphone is a bad combination.

[delcypheruni]

This is quite nice. There needs to be a voice command to fix/unfix the current view configuration as a user will probably want to move their hands after picking a view.

No one wants to have to hold their hands in a particular position for an extended period of time.

[VirtopsyProject]

@delcypheruni : That is absolutely right. Its is one of the next developments and would significantly increase the usability.

[cheergirl99999994]

i think you should whistle instead of making that popping sound, maybe a quick double whistle.

[drbartsimpson]

Brilliant!



[juan22021971]

This was done already in 2006, published in Jamia in 2008

See the "Gestix" system

[nameofsam]

@juan22021971 This is open source and available now

[VirtopsyProject]

@juan22021971 : Hi.

Yes, we are not the first ones to try gesture control. Even before the Gestix system, people were using pointing devices for touch-free computer input (StealthStation i.e.). Modern surgical navigation systems (such as the Brainlab systems) use pointer movement for limited user input.

[VirtopsyProject]

@juan22021971: The advantages of the kinect solution are that it is very cheap, easy to implement (especially with the official Microsoft driver), does not need any calibration, works independent of the user and has a lot of unknown potential if we think about finger or gesture detection.

In comparison to the Gestix system, we can alter the images in a way the surgeon is used to - browsing, windowing and moving is exactly the same as on the PACS workstation.

[TheBestNameEverMade]

Great Stuff!

[ngecenk]

to be honest thats not user friendly at all, its not even comfortable and im pretty sure thats not accurate. latest tech should not implemented to everywhere.

[VirtopsyProject]

@ngecenk :

Hi.

We are aware of the current limitations. These limitations however could be overcome by using more sophisticated methods of gesture and voice recognition.

For a surgery (and this is what it is meant for), it is certainly more confortable than sterile sheets for the computer or constant changing of gloves.

The system already performs well enough for a prototype. We are aware that it could be better, but this is only first step - a proof of concept.

[AuraAurora]

YAY! :O)