"Just throwing science at the wall to see what happens," but what if you used a transparent amoled display - you could see items behind the television. That might make things interesting - what d'ya'll think? Of course it comes with obvious disadvantages. -Quote from Cave Johnson, Portal 2
has anyone managed to get this running? I've downloaded the files, installed sensorkinect drivers, openni & nite. the samples with those installs run fine, but on running this in xcode, i get complaints about glut32.lib and lisbOsc.a
If you could apply this to work like TrackIR does so it could be used for head tracking in games like flight sims that'd be awesome. Lost my damn trackir and i'm going nuts without head tracking.
@msdarkfh For this demo the Psi pose is needed, that is correct. Ideally, it will not be needed and OpenCV can be used to do head tracking without calibration.
Do to popular demand, I'll be releasing the source and an executable for this very soon. Right now it's pretty messy, so I'd like to clean it up and document it before releasing. Also, I really appreciate all the support!
@mobilerengler THANK YOU!!! when your app releases, i will show my friends what the kinect can do and prove that you don't need to buy games !! question.. will it also be usable with mac users or just pc? i have both but my pc is really slow ..thanks again!!!
@mobilerengler Having a source would be great! Are you aware of any resources that explain (theory/maths behind this) how to achieve this effect? I understand how it's done in general, but having more info would be really helpful.
Are you zooming your camera when filming? That's the only way I can understand you being able to get as close to the television as you are and the Kinect not freaking out.
@Nightenstaff No zooming. I was surprised how close I could get, too. There are a couple points where the kinect loses me and freaks out a bit, but OpenNI is pretty good about keeping stable. I also implemented some very simplistic filtering to account for loss of data and jitters.
@mobilerengler On second watching, I notice it shake a bit when you get really close. Still, that's pretty incredible. How much reliable tracking space to you have (how far forward, back, left, right, up, and down in say, inches, can the camera pick you up)? With that knowledge, you could build a small environment. Maybe a room with a table and lamp you could move through. I know not being able to turn would be limiting, but it would be interesting to see done. Or do you have plans of your own?
@Nightenstaff The kinect has a pretty wide range, I don't have exact figures but I think it's something like 60 degrees outwards in the left right, and somewhat less for up-down. Still discovering the potential here. Ambient light input and interaction are the two features I'd like to work next. Not 100% sure where it's going yet, but I'll be sure to keep adding videos as the ideas flow in.
@KinectHacks I'll find out from my employer if I'm allowed to make this open source. But, to break it down, I'm using OpenNI and NITE to get my skeleton, and then using the position of my head to set the OpenGL perspective matrix. The blocks in the scene were rendered in 3D Studio Max, and the Mutual Mobile logo is rendered using GLSL to simulate dynamic diffuse and specular lighting.
do u think this can be used to make 3d video chat?
m0h1tD33pak 23 hours ago
This + stereoscopic 3D = virtual window / real 3d
markymark2036 4 weeks ago
Awesome 3D Collection - Red Blue ( Cyan ) mixed with this would be killer
openthemind2012 1 month ago
DO WITH A FLAT SCREEN TV!!!! IT WOULD MAKE A FUNNY ILLUSION!
chaquator 2 months ago
I got a problem with compiling, every time i compile i get te error with glut32.lib and lisbOsc.a. Can you fix this or update sources?
sjoebo 3 months ago
now if only someone could make this on windows desktop using a webcam
Snotrocket1000 4 months ago
hey. have you released the source and executable yet? its been quite a while since you last updated.
mjeffdema 6 months ago
Amazing job. Any chance to compile it as an excuteable file so we can enjoy it on our screen ?
TomiTom1234 8 months ago
"Just throwing science at the wall to see what happens," but what if you used a transparent amoled display - you could see items behind the television. That might make things interesting - what d'ya'll think? Of course it comes with obvious disadvantages. -Quote from Cave Johnson, Portal 2
pascbjumper2 9 months ago 2
has anyone managed to get this running? I've downloaded the files, installed sensorkinect drivers, openni & nite. the samples with those installs run fine, but on running this in xcode, i get complaints about glut32.lib and lisbOsc.a
hints anyone?
Cheers!
zedz 9 months ago
man u r a genius
USConnexion 10 months ago
Please I need a mac tutorial from the start, please my english is not very good. Im from spain. Please I Love this.
riversay 10 months ago
DRUNK TANK
NarrowsCrossFit 10 months ago
what is your website?
shadowheart43 10 months ago
Can anyone else just imagine that Minority Report screen thing being done with this sorta idea?
KrimsonWolf 11 months ago
If you could apply this to work like TrackIR does so it could be used for head tracking in games like flight sims that'd be awesome. Lost my damn trackir and i'm going nuts without head tracking.
vandinroth 11 months ago
Mind=Blown. know i truly know how it feels.
silvershadowfang 11 months ago
How did you do that? :/
danfelbm 11 months ago
excellent work any idea of when the codes gonna be released?
stivheys 11 months ago
@stivheys Within the week, I hope. Probably this weekend.
mobilerengler 11 months ago
amazing. you should definitely contact microsoft about a job
jigsaw0002 11 months ago
this was done 3,5 years ago with the wii remote but this looks nice and evolved too
watch?v=Jd3-eiid-Uw <---- wii headtracking
lightstorm66 11 months ago
@lightstorm66 i think thats where he got the idea?
shadowheart43 11 months ago
the Psi pose is needed to do that or you can do without calibrate the user???
msdarkfh 11 months ago
@msdarkfh For this demo the Psi pose is needed, that is correct. Ideally, it will not be needed and OpenCV can be used to do head tracking without calibration.
mobilerengler 11 months ago
Do to popular demand, I'll be releasing the source and an executable for this very soon. Right now it's pretty messy, so I'd like to clean it up and document it before releasing. Also, I really appreciate all the support!
mobilerengler 11 months ago 10
@mobilerengler THANK YOU!!! when your app releases, i will show my friends what the kinect can do and prove that you don't need to buy games !! question.. will it also be usable with mac users or just pc? i have both but my pc is really slow ..thanks again!!!
shadowheart43 11 months ago
@mobilerengler Great to hear. I was just about to ask haha. Could you reply to this when you upload it to let me know?
Thanks,
Frankie
0xParse 11 months ago
@mobilerengler That would be awesome! Thank you very much for this announcement!
I know a lot of people will like this.
steffensensa 11 months ago
@mobilerengler Having a source would be great! Are you aware of any resources that explain (theory/maths behind this) how to achieve this effect? I understand how it's done in general, but having more info would be really helpful.
Dzipi 11 months ago
That is fucking amazing!!!!I was like...what?....what????
inthemidstof 11 months ago
Is there any noticeable latency between moving your head & the image on screen moving?
cuplaxi 11 months ago
@cuplaxi There is a little bit, it will also jump a bit on occasion, but overall it's pretty smooth.
mobilerengler 11 months ago
This in kinect games would be awesome!
Great work dude.
IRWBRW964 11 months ago
Is that just a 2d tv image? Thoroughly impressive!
TheSupremeGunman 11 months ago
@TheSupremeGunman Yep, just a normal TV.
mobilerengler 11 months ago
whats the name of the music?
spacelord3000 11 months ago
as has been mentioned, great job and would love to see source or executable for this.
patloonytoon 11 months ago
is the 1st song by Helios? i know i've heard it before and its killing me to know what it is....
xxJBATxx 11 months ago
@xxJBATxx It's actually just one song, Try to Remember by Pretty Lights
mobilerengler 11 months ago
Cool. Well I look forward to seeing more cool things from you anyhow.
Mezatronic 11 months ago
solid demo
wickedceltics 11 months ago
very neat
mrdotbryce 11 months ago
Are you zooming your camera when filming? That's the only way I can understand you being able to get as close to the television as you are and the Kinect not freaking out.
Nightenstaff 11 months ago
@Nightenstaff No zooming. I was surprised how close I could get, too. There are a couple points where the kinect loses me and freaks out a bit, but OpenNI is pretty good about keeping stable. I also implemented some very simplistic filtering to account for loss of data and jitters.
mobilerengler 11 months ago
@mobilerengler On second watching, I notice it shake a bit when you get really close. Still, that's pretty incredible. How much reliable tracking space to you have (how far forward, back, left, right, up, and down in say, inches, can the camera pick you up)? With that knowledge, you could build a small environment. Maybe a room with a table and lamp you could move through. I know not being able to turn would be limiting, but it would be interesting to see done. Or do you have plans of your own?
Nightenstaff 11 months ago
@Nightenstaff The kinect has a pretty wide range, I don't have exact figures but I think it's something like 60 degrees outwards in the left right, and somewhat less for up-down. Still discovering the potential here. Ambient light input and interaction are the two features I'd like to work next. Not 100% sure where it's going yet, but I'll be sure to keep adding videos as the ideas flow in.
mobilerengler 11 months ago
This looks really smooth, amazing job.
Are you using OpenNi? Would be great to see source!
Mezatronic 11 months ago
@Mezatronic I am using OpenNI. Still have to find out if I'm allowed to release the source for this.
mobilerengler 11 months ago
@mobilerengler You should be able to many others have.
Jon88938 11 months ago
Open Source?
KinectHacks 11 months ago
@KinectHacks I'll find out from my employer if I'm allowed to make this open source. But, to break it down, I'm using OpenNI and NITE to get my skeleton, and then using the position of my head to set the OpenGL perspective matrix. The blocks in the scene were rendered in 3D Studio Max, and the Mutual Mobile logo is rendered using GLSL to simulate dynamic diffuse and specular lighting.
mobilerengler 11 months ago
Great work! I want to see this being introduced to the mainstream soon. Keep it up.
asher345 11 months ago