Added: 4 years ago
From: spelunkerucd
Views: 344,520
Sort by time | Sort by thread (beta)

Link to this comment:

Share to:
see all

All Comments (450)

Sign In or Sign Up now to post a comment!
  • How about one wee mote towards the user as a head tracker... should become a sweet first person star wars game...

  • that is awesome dude. I wish I could have come up with something like this I would be a millioniar. However you spell that. Just bought a wii bundle. Pretty cool game console I had the original Nintendo so this is really new to me.

    

  • The Vii Controller?

  • These kind of things are used in motion capture.

  • lololololol at first, I thought it was sarcasticgamer

    ...so about those thumbs...

  • Blender?

  • To have the wii remote get the exact turns, you will need an extra dll file and a wiimote dock. The dll program that you will have to write should include everything that the original file has but including an extra program that you can write for calibration. The dock needs to be exactly flat and in the center of the IR beams (the accelorometer should read 0,0,0,0). Then you can write a program telling the computer to wait a few seconds while the controller is still and have the cgu match real 1

  • @BensTopics What television screen? I didn't see a television screen!

  • 2:02 lol Panda, Its Finnish, ever been to Finland?

  • @wrathchild16 They export that stuff to California. It's great!

  • At around 3:30 where you demonstrate "full position tracking" could the Wii controller effectively be replaced by an iPhone utilizing its onboard accelerometers and camera as the sensor inputs and then render what is currently shown on your monitor on the iPhone's screen with the test program running on the iPhone?

  • @jeffgrant167 Yes, I guess you could do that.

  • Freaking SWEET!

  • i didnt understand anything!!!

  • oh.. just the kind of video i was looking for :D i would only buy a wii for a game where u can control a lightsaber like that...(4:22) also a katana would be cool xD

  • have you tried using strobing LEDs. you could set multiple LEDs all over a room and strobe them at different frequencies. that way you could have only 4 'on' at a time, but at least 4 always visible due to the strobing sequencing. I hope that description made sense.

  • @ScottBarrett No, haven't tried that. The problem is that the Wiimote doesn't indicate when exactly its camera takes pictures, so you'd have to strobe at a rather low frequency to ensure that the camera gets it. As a result, tracking would be quite slow in response, slower than it already is (you can see the lag between motion and response in the video). If there were an indicator, or a way to trigger the camera externally, strobing would be a viable approach.

  • Dude i didn't understand a shit of what you sayd!! toooo smarty!!!

  • Dude i didn't understand a shit of what you sayd!! to smarty!!!

  • bla bla bla bla bla bla

    that what i hear lloll

    BLA BLA BLA BLA

  • wait wait, if this can be used 1 to 1, then why the hell do we need wii motion plus for? do you know wat wii motion plus adds to the "accuracy" of it? if any?

  • @megamanxu This tracking relies on an "IR beacon" that is more complex than the Wii's "sensor bar," and it only works if the beacon is inside the camera's view, which is narrow. The motion plus would allow tracking to work even if the Wii briefly loses view of the IR beacon. The emphasis is on "briefly;" even with a motion plus, tracking would still require a beacon that is almost always in view. The motion plus is not accurate enough to sustain tracking by itself.

  • by tracking each controller in 3D space, couldn't you basically create simple motion capture data with this system if you had multiple controllers?

  • @TheFXGuy Yes, I think someone has done that already. But I don't recall right now where I saw it.

  • @spelunkerucd i found a video with that shortly after watching this

  • Zbrush! :D

  • Whats the program called for the computer???

  • you should do this all over again not that the Motion plus is available.

  • Now I have absolutely no engineering knowledge, but I think you might be able to fix the tracking problem, or help it anyway, by attaching some more LEDs to the side of the TV and tilted inward at about a 45 degree angle. That way, instead of the receiving LEDs being limited by a single point, they'll have more information to draw on when the Wiimote gets too close to the TV.

  • @TimeGlitchCentral

    In theory you are correct, but in practice it's complicated. The Wiimote camera can only track four LEDs at a time, so if there are more than four, it will (randomly?) decide which four to track. This would make it very hard to come up with a unique and consistent tracking solution.

    But this is simply a limitation of the Wiimote. Other optical tracking systems use your idea to cover large areas successfully.

  • Windows???

  • @Hilsong3 No, even better. Linux

  • instead of the sensor bar u cud just use candles.

  • @YouEssEssArr

    no, the wii mote detects infared led lights, normal lights wont work, thats why when using the sensor bar u cant see no light from the sides, but look at it with any type of camera, and you should see 2 lights coming from it, this is because infared lights are visible to cameras ( like the wii mote ) and not the naked eye

  • @BOS6940

    You are right, but YouEssEssArr is right as well: candles would work because they emit most of their energy in the (thermal) infrared band. After all, candles are hotter than they are bright. Way back when, some people actually used candles to stand in for the official "sensor bar."

  • @spelunkerucd

    hmm, ok? anyways i found out that they do work a coupple of minuets after posting my reply to YouEssEssArr ( << the username wtf? )... i thought the wiimote was designed to only detect infared LED's, not heat also

  • Tony Stark  built this in a cave!! With a bunch of scraps!!

    Why can't Nintendo do this?!

  • fuck you lost me dude

  • Comment removed

  • what

  • This is so cool. Looking forward to seeing the support for this in GNU/Linux in near future. Congratulations for your success ;)

  • I'll be bak! hahaha

  • wii motion plus + this stuff would be PERFECT! 100% real time playing with real 3D space... a dream of mine for nintendo

  • thsi is all i heard balbalbalbalbalbalbalbal wii controla balbalbalbalbak led blablabla linux balbalbabalbalbabalbalbalba controla balbalbalabaal comutar balbalbalbalbalabal linght saberbbalbalbnalablbakba

  • @talhagx

    That's because you're a total idiot.

  • @BlockisticStudios no becanuse your mum is total idiot

  • @talhagx

    That was the only thing you could come up with?

    lol, what does my mom have to do with this

    that joke is seriously old by now

  • Hmm, Linux? Look like Fedora OS :D

  • Fedora 8, to be precise.

  • @spelunkerucd

    thx :) my brother have a Fedora 9 too

  • photoshop liquifiy in a 3d space sweet.

  • Huh. If you have to keep leds in the camera view anyway, why not use a camera alone?

    It's position and orientation can be calculated from the leds positions. Also with something like ARToolKit you can use a regular web camera and an image instead of the led array.

  • @Rpahut1 Wiimote talks to the computer wirelessly, can comfortably be held in one hand, and has plenty of buttons you can press to trigger actions in the software. Those seem like pretty good reasons to me. :)

  • now the orientation is possible, its called WII Motion Plus, right?

  • one day someone will cross that with virtual reaity so an artists will beable to sculpt something in a 3d reality with devices like the wii remote/ pen

  • you know whats crazy? the actuall professionals who work at nintendo who were given the task of making the nintendo wii and were given all the time and money and resources to do so--did not come up with anything half as awesome or advanced as the things people have done like this!

  • have they tried this with wii motion + ?

  • but the motion+(plus) makes the same!

    or not?

  • I changed my mind about the motion plus. Initial reports said it had two rate gyros, which wouldn't have been enough. Turns out it actually has three, which is sufficient for instantaneous 6-DOF tracking, akin to what's shown in the video.

    You'll still need some kind of LED array, since instantaneous tracking will lose accuracy very quickly. The LEDs are then used to correct for this drift.

    In short, the motion plus would make the software shown here work better.

  • I'm not sure about the 3rd gyro. can it sense any rotational acceleration around the vertical axis when the wiimote is layed down on its right or left side?

  • According to the tech specs and the bluetooth protocol, yes. The motion plus contains one two-gyro integrated device, and a separate third gyro.

    Therefore it should be able to detect rotation around any axis, no matter how it's oriented. But I don't own one, so I can't test it.

  • @spelunkerucd

    I've yet to use the Wii motion plus, perhaps if you ever get the urge to continue this line of tinkering I think more than a few people would enjoy a video integrating the plus to see if it indeed would yield some finer tracking. Is it such a pipe dream that technology like this might one day make it into true VR gaming like making use of the Virtuasphere? I hope not.

  • Comment removed

  • Aaand.. Thats my learning for the year.

  • gief that for windows

  • That was very interesting. Thanks!

    Have you tried developing these tests further with the motion plus to get greater accuracy?

    Any lightsaber games yet? :)

  • @KiltedRic Dude Watch Red Steel 2 trailer :D

  • omg so many words i cant understand

  • fedora :D

  • u sound german...

    but dont worry, me too^^

  • very nice...

  • Yes! Physics, maths, linux and lightsabers!!!

  • faster

  • Somebody was bored lol

  • hmmm. infrared LED's all around you?

  • shut the fuk up u chinese beener

  • great controll!

  • Wii Motion Plus is better than PS3 motion.

  • i know lol its 1 : 1

  • You havent even seen the PS3 controller yet. Why dont you wait until it comes out, then try it, then state your opinion about it? Otherwise, you just sound like a biased Nintendo fanboy, which you probably are.

  • It doesn't have enough buttons, and is a blatant rip off of the wii's technology in reverse. Nintendo could tell users to mount the wiimote on screen and release their own glowing ping pong ball on a stick, only in infrared, achieving the EXACT SAME EFFECT. Look at wii remote head tracking, It's the exact same thing.

  • @stinkomalinko

    Yeah, I prefer the Wii Motion Plus, second Wii Controller only, and the third PS3.

  • @stinkomalinko And really so much better :)... sony only knows how to copy.. and nintendo always improve theyr creations... nintendo is always one step in front of sony ;)

  • @stinkomalinko Nintendo - Innovates, focuses on fun, gets money for it. Sony - Jumps on the bandwagon, focuses on having something that does everything, sadly gets money for it.

    Don't give those "it's business" speeches. It's bullshit.

  • Comment removed

  • Comment removed

  • Comment removed

  • @stinkomalinko No it isn't, I'm no fanboy or anything but I can easily tell you it's not.

  • dude, i think ps3 is 5x better than wii, but the motion control owns

  • It's about 3 times more powerful, and has a hard drive nearly 150 times as large, but that's besides the point. Gaming consoles are for GAMING, and the wii gets that done just as well. However, the PS3's power can help the graphics. Graphics aren't important, but they can be a nice feature, and the power can also help physics and AI, more very nice features. The wii is more innovative, and if the motion controls are done right, the game can be very fresh and play better than on other consoles.

  • lol , it isnt even out

  • Nice demo. Have you considered though, that if you switch the Wiimote to 'full' IR mode, and make use of the fact that the standard sensor bar is actually 2 clusters of 5 led's each, you can in fact, use the standard sensor bar to determine yaw, roll, and the distance from the screen?

    That would leave just the pitch, which can be determined from the accelerometers...

    This is possible because in 'full' mode, the IR data gives the center point and bounding rectangle of each LED cluster...

  • Considered, yes, but works, no. Yaw and distance from screen are not independent. If the sensor bar width is D, and the observed distance between the two clusters on the IR camera is d, then z -- the distance to the screen -- is proportional to D/d. At the same time, if yaw angle is a, then d ~ D*cos(a). So you have two unknowns, z and a, and only one equation. Since you can't measure yaw independently using the accelerometers, it doesn't work that way.

  • ur german and great it cool

  • Pretty smooth motion.

    It totally shakes around for me.

  • I am using a simple low-pass filter to smooth out the original, rather jerky motion. In the video you can tell by the delay between a motion and the computer's response to it.

  • 1:58 pause there. i thought it was domo... xD

  • put that with johnny lee's project of fingure tracking and you got an awesome thing going.

  • why does him talking remind me of a long info-mercial?

  • donkey man mcguiness wii is gay buy something usefull

  • lunux FTW!!!

  • u are a germen right?

  • nice vid! :)

  • hehe, i love this german accent - sis is great, mous, Kybord, i love it ^^

  • ur awesome. I love tech, physics, and chem, ur molecule thing combines them. U should write one that lets you rip apart atoms for nuclear explosions

  • I know what a tetrahedron is from chemistry

  • Stinking awesome.

  • this freaks me out

  • Did u run the program off a computer and use the becon as a infra red to track down the location of the wiimote?

  • what?

  • this makes perfect sense. how does this not make sense?

  • Can you make another vid using the Wii plus? that will improve things.

  • Das hört man raus das du Deutscher bist :D

  • Argh, all that I hear is a bunch of technical Jargon that I can sort of understand.

  • Whining about ignorance isn't generally a well-tolerated thing. What do you want him to say, "this thing move good"?

  • Sure

  • Comment removed

  • I'm way into science and i understand what this guy says and i'm only 10 lol!

  • wow

  • i have no idea wut he just said he talks smart

  • how did u get the clay thing

  • just like with the ps3 pretty much with the tilt function where you can control in game objects by simply moving your controller it does seem better with the wii remote though lol

  • na wenn das mal kein deutscher kommentator ist ;)

  • Hört man richtig

  • thats cripled,it'll be awesome if they had

    games using this kind of realistic feature.

  • this is also where wii motionplus comes in

  • i guess glovepie code? as an initial coding program. then using some other crap later.

  • Is there any drivers to install wiimote on a pc?

  • Well, since this entire video is about how to connect a Wiimote to a PC, I would say yes.

  • yes all you need is bluetooth on your pc and a program called glovepie

  • no. it's too difficult to program such sophisticated drivers on Windows because it's not open-source. It's much easier to program for Linux.

    Also, Windows is too slow and bulky to run this. Linux is much more lightweight and much faster. This application also looks like it's more intended for developers, rather than end-users, and the application is open-source, so most other developers interested in it would probably be using Linux.

  • You have no idea what you're talking about.

  • How do I have no idea what I'm talking about? I've used Windows and Linux, programmed for both operating systems, and learned a lot about each. I've also spent a lot of time learning about open-source software and its benefits to the technological industry. It's clear that I know what I'm talking about. If I didn't know what I was talking about, then I wouldn't have been able to write all of that.

    Take a look at what pab2000k said. He understands this because he knows about this technology.

  • are the programs shown freeware? ;)

  • Yes, but not all of them are released. Check the web page for more details.

  • microsoft sam D:

  • lol you sound like mikrosoft sam computer default voice ^^

  • lol

  • you know your stuff. too bad you didn't hop on that motionplus train. <_<

  • lol 6:03 xD

  • really awesome, really impressive video. your explanations are clear and detailed and your demos showcase your work very well. you even have a link to more information, instructions and source code. wow. more developers should aspire to be like you!

  • I thought guys like you were only in sci fi movies :P

    this was actually interesting to me.

  • wow this is awesome

  • wow, not until now do i understand how smart those Nintendo guys realy are...

  • Yeah, but the wii only uses 2 infrared sensors, and to get the lightsabur this guy built a 4 infrared sensor block... Why Nintendo didn't do this I don't know... Which is in fact a question I would like answering if you know the answer Spelunkerucd?

  • "Sensors" is not quite right because the sensor bar contains infrared emitters and the Wiimote has the sensor, but that's besides the point.

    I'm guessing Nintendo went with a 2-LED design because it is enough to get mouse and light gun emulation, and because it is more robust. You can see the tracking hiccups in the video, and for a game system, robustness is more important than bleeding-edge features.

    Or the Nintendo guys are not that smart after all. ;)

  • That's a good point, Nintendo are the best when it comes to innovative gaming, but they are also the best when it comes to robust systems too. So they probably did balance innovation with robustness as you say. Hopefully they will give us the option to upgrade the wii by introducing a 4 LED beacon like yours. A "proper" lightsabur game is needed :p

    Thanks for replying so quickly!

  • I didnt get a word you said........ toooooo smart for your own good!

  • And the most stupid fanboy comment yet , it not even a video about the Wii, which is a great console btw douche.

  • This is actually somehing more likely to be useful for the PS3 since the ps3 has the greatest console linux support and built in bluetooth.

  • And yet he choose to use the Wii interface with its full motions sensor interface, says it all. Hell Wii FTW.

  • Well, I don't even own a Wii, and chose to do this using the Wii controller because:

    - it has a built-in camera

    - it is light and can be held comfortably

    - it talks to the computer via standard bluetooth

    - it is cheap

  • you should buy a wii, its the smartest decision you will ever make.

  • what is the clay sculpting thingy

  • Just a small volume editing program I wrote. It represents an object as a volumetric density field (gridded in x, y, z), and renders the object's surface by updating an isosurface defining its boundary in real time. The editing tools work by manipulating density values in the volume grid, and affect the surface indirectly.

  • hi,

    bist du ein Deutscher ??? klingt nähmlich so :D

  • englis por favor

  • it's german, idiot you're not funny

  • lol...XD

  • interestin .

  • they are making an add on for the wii remote thats gonna be packed for wii sports resort that tracks the position of wii remote.

  • You are referring to the Wii MotionPlus; if you look back in the comments here, there is a detailed discussion of why I think it won't quite work.

  • r u asian? just asking

  • Great way to present the information. Care to post the name of test program you used? I wanted to know how many Infrared LEDs the controller needed to see. Do more LEDs means more accuracy and more range?

  • There's a link to a web page with more details in the info box to the right. :)

    In general, more LEDs mean more accuracy and more range, but the Wiimote's built-in camera can track at most four.

  • Ok thanks. I was assuming it could track an infinite number because the Wii sensor bar has 10 (2 clusters of 5).

  • The clusters are just to increase light output; the camera sees each cluster as a single spot.

    I found that the Wiimote camera can't see a single LED from farther than a few feet away.

  • wow i had no idea the controller was so complicated. its amazing all the applications it can be used for