Cynergy Labs: Project Maestro

[GeekingForJesus]

So... did this lead to Kinect? Or did this project just get screwed? (Obviously this is better with finger gestures, but Microsoft is obviously going to spend billions to make sure Kinect is the future of gesture/motion technology for the home.

[Legokink1]

IS THAT A WIIMOTE ON TOP OFF THE TV!?!?

[Editutes]

watch?v=2kt7nd_XelU

[DavidHernandez2013]

you dont need to have gloves with kinect finger traking hack xD

[FlipThatPC]

Wow people say just like Minority Report or Minority Report is finally here lol I guess you guys didnt know that what they did in Minority remote with the controlling the screens like he did, they ACTUALLY did so, I dont remember the guys name, hes a professor proposed the idea and basically used the excuse of the movie to fund his research and in effect create the environment that Tom Cruise worked in on the movie. So in reality it was reality. Sure not all was real.

[MrDamienYoung]

I recently found a video on youtube just like this one. The guy had custom coded the software so the IR glove can fully control Windows. Do you know the guy (Link)? Or can we download the software that you used?

[retepvosnul]

Silvershyte -1

[zatalan]

minority report becomes reality !

[Sinjinator]

If only Silverlight didn't suck so much...

And do you have to say Micro$oft in front of everything??

[grimlock047]

just add VR goggles and it becomes johnny mnemonic instead of minority report

[raxidian]

this is so wrong on so many levels, pretty much random company shows wii-mote capabilities with a concept already explored by microsoft ?

so much for a project, this would be an excellent garage proof of concept or do-it yourself hack, at best.

[armendstarmend]

plus the fact that the idea and the glove styling is from a film anyway. pretty unoriginal overall.

[AmericaTheNewEmpire]

8 days? Impressive.

[JackassBG]

its amazing what the wii-mote can do. GREAT WORK GUYS!!!!

[wikigrinder]

Cool :)

[tylerszabo]

Great job guys, looks really cool!

[2ndtoJohn]

awesome stuff man, now only if you could see crimes before they happened lol

[Frosmad]

Nice, powerglove 2.0!

[AKAMustang]

Any chance you can give a closer look or better explanation of the gloves.

You said they emit IR.

But are they just reflecting from an IR source e.g. next to the TV?

Or do they have IR LED's and a battery back?

Thanks

[thingies4U]

Nice, but you need to code it to be way less elastic. For example, your dragging a piece of a photo: When a drag is initiated it should instantly follow the cursor with no friction. Your programmer forgot to turn off friction during that drag!

[KanameTousen]

anyway I bet you guys got paid every time you mentioned another company's product

[KanameTousen]

Nintendo can buy that if they wanted since it was made using their system

[mesto17]

cool concept but needs more work. good luck though.

the part about the microsoft guys was a bit boring

[Vmota123]

i can see how people can hate on this, but why cant it you just look and see how its just plain cool. of course it wont have much functionality now but think of how cool stuff can develope from it.

[Morag0]

very nice ^^

[h3llbring3r]

Nice work, you completed this in 8 days? Are you serious?

[yellasriharsha]

nice video.....

[Duracelpupu]

cool.

[muffinator2002]

The kid in the background is obviously crying because he wants his Wii Back lol

[coresnake]

nice professional video work there, the screaming baby really ads to the suaveness of the presentation... *cough*

[NoncentsProductions]

Imagine more intricate programs like MAYA--these novelty approaches would burn out just like VOICE recognition software. It just isn't practical.

[babylonian]

This isn't necessarily intended for those programs. It's not a universal control method, it's an idea intended only for application to specific uses.

[NoncentsProductions]

I'm sorry, but the more and more I see these multitouch screens/knock-offs and their supposed uses I laugh to myself. It is great that people are trying to create new technologies, but the truth is there is no functionality to these or real applications until we get virtual reality down. Imagine using your hands to control pictures and cursors; can you say completely exhausting and frustrating.

[jowie74]

All this wonderful technology and no decent microphone ;)

[florianvandillen]

Awesome!

[teunome]

did you use GlovePie in any part of the project?

[AlligatorExpert]

eso que hay encima de la Tv es un wiimote? :|

[memeovore]

Si. ;)

[pixelcowboy]

There's a new blog post from Rick Barraza at cynergysystems dot com that explains how he did a lot of this. Good stuff.

[kevinbrendenjeremy]

fake

[NuVanDibe]

do research before calling "fake"

[cyberprunes]

lol, it's not fake. If you know how the wiimote works its quite simple. think before you open your mouth.

[umilmi81]

very creative

[irishflipp]

Rick Rocks...but I don't care for the Michael Jackson look with the gloves! :) You might want to consult your fashionista wife to redesign the look...NR

[danetska]

jiopnonio

[Zybergod]

Nice idea, invest in a mic.

[ZeldaDD]

I'm pretty sure (to the naysayers) that this falls into the realm of 'tech demo'. Still, a pretty neat techdemo. :)

[1benA2]

kinda cool. Looks like a nintendo wii but with gloves.

[ZeldaDD]

It uses a Wiimote...you did hear that, right?

[jimjamkillsnerds]

Lol yeah thats like watching a video of halo on pc and saying "hey that looks like xbox on computer" .

[FilCanJay]

Neat. But in no way in its current form will it replace a keyboard or mouse. Multouch in general is only great for smaller devices like a phone or laptop. The Minority Report interface in the movie is just that, a dream. Its not useful for anything other than being another way to play games. Plus it looks tiresome.

[irishflipp]

Who cares, its awsome. Its not neccesarily tiresome. If your to lazy to lift arms up then maybe you shouldn't be using these gloves.

[FilCanJay]

Ok sure you can get a great workout (you can add that to your list). I admit its kind of neat. But in know way in its current form is it practical or useful for todays business market, aside from possibly, gaming? Even Microsoft is still trying to figure out what the Surface table is really good for other than drawing smiley faces. This device is still a pipe dream at best.

[cerupcat]

I agree that this will not replace a keyboard or a mouse, since there is no direct manipulation like devices like Jeff Han and other multitouch screen. But, multitouch is LIMITED by small devices like a phone or laptop, not GREAT for them. Larger devices are what make use of multitouch applications, not smaller one.

[FilCanJay]

I disagree. Simply because if you compare both the Surface table and the iPhone; by design and for practical purposes,

the iPhone serves a greater share of the market and its a lot smaller and more useful than its MS counterpart. God love MS! but they haven't a clue on what the Surface table is actually good for yet. As for the iPhone, it already is the prototype (for the evolution) of future touch devices, from small to big.

[cerupcat]

Look at nuigroup com or my page to see how applications with multitouch can be practical. I've built my own multitouch table and am developing music based software for it. The iphone is only 2 touch and therefore you are very limited by the amount of touches as well as screen real estate. The iPhone is only the beginning. Small devices are not that answer. No, it will probably not replace a keyboard, but for many applications it will make things easier and MORE practical/intuitive.

[cerupcat]

MS surface is not out yet. The reason it appears they dont know what to AIM for is because they're trying to appeal to the whole market right now since it's still in develop and needs a lot of work before it's released. They're not trying to replace desktops right now as you can tell from their demos.

[Eegee0]

You really should use a lamp and a microphone to make your video items

[ElmarVisser]

This has potential!

[sylewis]

Laggy as sin and your arms would ache something chronic after 5 minutes!

[irishflipp]

It wasn't laggy maybe you should get your eyes checked. If you think its so tiresome, then i assume you hate the wii. Its the same idea... this ones just way more awsome.

[herbertherberthoover]

does anybody else hear a screaming baby in the background?

[pazimzadeh]

yes

[markymarkcirca]

VERY COOL

[ToppyToo]

This could be great for those with certain disabilities that prevent them from using a mouse or keyboard.

[sisopipo]

i think one hand was sufficient but the inventor want to pretend to make this device by 2 hands like using 2 pc mouses to just tell us he is like a magician ...so one hand is better

[vdogg89]

this technology is definetly eye candy for a few minutes, but in terms of actual use, this is useless

[nukepuppy]

well to you but it really isnt useless in any way what so ever.

[FSK1138]

cool but to - slow -

[poppacookster]

Why the hell would you want this. Who wants to put on gloves to look at their jumbled up pictures.

[nukepuppy]

its called a proof of concept.. if you dont know how things get made in the world.. then dont comment when new things are invented and put to use.

[gambitrocks]

New technology needs to become mainstream faster.

[celinocaliente2002]

Silverlight is to Flash what Zune is to the iPod.

MS missed the boat again

[djcombo187]

combine this idea with jonny changs glasses and u have yourself an awesome new nintendo console!

[FvckUp]

FAKE watch this hand and watch screen, see no same act.

[LCSEF]

This is only a copy of Johnny Chung Lee's tech demo from months ago.

btw: useless photo app, please think about more usefull scenarios!

Youtube Video id: 0awjPUkBXOU

[LCSEF]

"third party community libraries"

Which one?^^ The WiiMote Libraries? LoL :D

[166beads]

this wud be so cool on the wii

[magnum9er]

minority report!!!

[KingSiddhartha]

the Wii is Jesus!

[scarecrow2k6]

r u guys for real? this stuff has been done by the Genius Johnny Chung Lee. This guy is a wannabe. If he admits later in the video then my bad (i am not gonna watch this).

[MrDeathSandy]

kool

[toyotaboyhatman]

now all you need is a transparent display

[manit77]

nice blend of technology, this could be very useful in many different applications. I would like see a developer's platform with this type of technology.

[brettf]

kinda lame..

[CheriLifesaver]

omfg you hot!

lets sex

[francisco1563]

Is this sh*t for real??

[fajitameatpete]

..your hips, your thighs..you got me hypnotized!!!

ayo!!!, freekin sweet!!!

[nobtube]

Well, this tech is nice but do you think people will keep their arms up for so long to view and edit pics? I really don't think so. Microsoft Surface is much more practical and easier for extended use.

BUT, this can have an awesome use for games. Imagine you punching an enemy or casting a "hadouken" in a game like Street Fighter. Adapt your device for games and a lot of people will be eager to buy one.

You could use for rpgs too, so a lot of people could exercise and kill mobs or pvp.

[desiredusername]

Developing with...Microsoft software?

lolasthough

[thepdw]

It definitely has potential. Nice job, guys! Next time, the video would look a bit more professional if you lit the guys face a little better :-)

[turbo2ltr]

Yeah and how long can you hold your arms up like that? And can it be any less responsive? .NET is a bloatware.

[ShaneVTR]

Very nice, im sure cost isnt going to be an issue in the future if this kind of technology takes off. If people want it they will pay the price.

Congratulations on a very nice project :)

[mick6885]

I look forward to the day that the mouse becomes as redundant as a CD.

...Also, If this method of input takes off, I think it will, the next evolution will be using possibly heat signatures to track fingertips, therefore discarding the need for minority report gloves.

Awesome work for 8 days of coding!

[ThatguyDusty]

Ok so...why is this superior to a simple mouse?

[cprcomics]

guys from microsoft owns a wii? omg! get bill we have a traitor

[naturalui]

"Its just like microsoft surface without the surface"...

yea and without any tactile feedback.. direct manipulation... and you have to wear gloves...

[AlexGreenberg1]

Hmmm..... Lets see this is free. Microsoft surface around 10,000$ and not even out yet. And when it dose come out its not going to be in a house for a while anyways. it will be used in places like resturants ect.

[cerupcat]

It's visually nice, but not as intuitive as actually touching a surface. I don't think this is the direction the technology is heading. Nice work, but air manipulation isn't as efficient as direct manipulation like a multitouch screen.

[racheloagibson]

bliss

[limaq]

kewl sh!t.

[dsjfh09kjmsd3kjh]

neat, but way to imprecise to be usefull

[haotian1976]

I think this needs to be combined with Johnny Chung's 3d head tracking via the Wiimote. To hell with "touch screen". I want "touch3d"!

[wjuk]

Nice. Not quite Minority Report as the Digg post suggests, but it's getting there.

[frozenwalkway]

lol microsoft surface to microsoft "air"

[Enthropomorphia]

Hahahha! :)

[Clamps87]

So wait, the three finger touch is stronger than the two finger touch? X)

[JacobDyerMedia]

So. Damn. Amazing.

[bendster]

Anyone else hear that baby crying at 1:14?

[namwob0]

lol, its crying almost the whole time :P

[Enthropomorphia]

I HEARD IT!!! It was amazing! :D

[ctunit1]

ITS A LION!!

[Enthropomorphia]

Haha..wth! So the guy who says its a lion gets 2 thumbs up...pfft! :p

[blankogotsacked]

Excellent mash-up. Great work.

It's interesting to note that it's the gaming industry that seems to be leading this pack. And more recently with the iphone. But we've really only scratched the surface (pun overload) of limitless interactive possibilities.

Standardization is great for business - but it has stunted interaction/experience design. We've had a single input device for 30 years. It's time to open the flood gates.

[Lucanos]

Did anyone else notice that around 1:30, when he pushes the Mona Lisa off the screen to the left, that his movement and the response were out of sync? (He moves his left hand only _after_ the picture has already disappeared from the screen.

Looks pretty authentic, but was just funny.

[ramsinks]

Hm, I can do this on my Touch.

Nice though man.!

[fergidude]

...no you can't. Did you watch the video?

[ramsinks]

lol, thanks.

Comical to be told otherwise.

;)

.. Did you just come over and watch me?

[gannondork]

i hate Tom Cruise

[perfectionbox]

Sweet... but let me know when the blood no longer reaches your hands after holding them up like that all day.

[indiekiduk]

And lack of tactile feedback will make it really frustrating to use. I saw him trying to pinch the same piece and kept missing.

[UnlimitedHopeWorks]

Also, it seemed that he couldn't cross his hands, and the mouse feedback wasn't as high-res... I mean, you saw a bit of lag/slingshot when moving the mouse, yes?

[UnlimitedHopeWorks]

Append: It's rather unique, though, using the Wiimote as a sensor rather than effector.

There should be 5-finger capability instead of pinch/grab 3fingers, in the case that one needs to type, highlight, specialized functions, et cetera.

Thought: The Wiimote's always rolling, even if you're drinking coffee at the workspace. (accidental pinch!)

Thought: Counter-Strike/TF2/etc. 'Nuff said.

[Leadeath]

he said this was done in just 8 days... thats not impressive enough for you? give it some time and they can work out all the small bugs

[HereIAmTheState]

Oh for sure, give them a couple months and it could be a lot tighter and much more useful. But still pretty cool

[Kedyn808]

but it is only a short hop to adding a 'vibrate' function to the gloves so that like the wii-mote itself, rolling over 'objects' causes the glove to 'bump' giving some tactile feeback.

[naturalui]

man.. i didn't know interface could be so ghey...

[mikefoz]

I wish these damn people demonstrating these interface ideas could show something other than looking at pictures. Are they designing COMPUTER interfaces or £5,000 photo frames?

Show us how those gloves can type an email/paint in photoshop/edit a vlog/error check my PHP/throw a lightning bolt like William Shatner.

Why has every piece of technology suddenly turned into a camera/photo lab?

[tendonut]

Because most people can't comprehend using a computer for anything but that. They also can't comprehend that a computer from 2001 can do basic Window XP native photo editing just as well as a brand new top of the line machine can now.

[alienkid]

Because it would take a long time and a lot of money to have a playable demo of a game that worked with the controls for this prototype thing

[clipshooter]

The babies will live, you weenies. Two and a half minutes won't kill them. grow some balls.

[flatassben]

You hear that baby in the background? Go take care of your baby instead of nerding off.

[face523]

Uhm, what about the screaming children in the background? Did you not feed your children for those 8 days? Come on! Take care of your kids. Theyre a tad bit more important that making a frigging youtube video. You can pause and retake you know.

[pogue666]

I didnt hear the children crying in the background. Maybe they are yours !

[irishflipp]

Wow your retarded i know him and he has a wife you idiot. This is his job. He's a great dad... unlike you.

[irishflipp]

I meant to make that a response to face523

[mobileperry]

very cool, thanks for sharing. how difficult was it to create the IR gloves?

[MrZippa]

It's a shame that holding your arms up all day is impractical outside of a movie...

[memeovore]

Actually, the only reason I used WPF was to access the WiiMote DLL. So its the same restriction as I would have had in Flash through the browser. All the code was Silverlight 2.0/C# (alpha) compliant. Also, make sure to check out Johnny Chung Lee's great work with the Wii that inspired this project and Brian Peek's managed library DLL that made it possible. - Rick Barraza

[discorax]

This is impressive work. It's important to note that this isn't Silverlight, it's WPF. It's important to make that distinction because WPF has WAY more functionality than Silverlight. Don't want people to think you can build something this cool in Silverlight, at least at this point.

Impressive work. Keep it coming!

[wctschumy]

Rick, Dave, and Cynergy in general - this kicks ass! It's really amazing. Looking forward to seeing what other amazing things you'll come up with in 2008!

Will Tschumy

User Experience Evangelist

Microsoft

[2dominate]

That is the only way I want to interact with the computer soon!. Keep up the great work.

[haggulator]

wow - thats awesome!! When do you get your pre-crime badge?!

[miuprint]

My friend is blind, how is he going to use this?

[PsychoMatt01]

how is he going to use the surface either?

Research wireless video trasmition and see where its at for eyes actually being capped with a recorder and the feed sent back to the brain, apparently its possible to already cure blindness, cancer, all known colds :D

but they cant have us doing that our SELVES :O

[clipshooter]

...is this any different from a current computer interface, as far as handicap functionality goes?

[mikefoz]

Would be nice to track all fingers on each hand, and their relative positions to help type or IM with signing. Can't really think of any others right now.

[Mossyblog]

I have warm and fuzzy feelings right now..

-

Scott Barnes

RIA Evangelist

Microsoft.

[doctorKJ2000]

Awesome use of WPF and IR technology. Amazing that this just scratches the surface of what you can do with next gen UI technologies.