I watched your videos and I am very impressed! I thought you were very well spoken and the video was very well paced. Feel like you are doing an awesome job in that regard!
I was wondering though what tech you were using. More specifically how you are viewing the models in real space. I get the idea of the future you are making (which is awesome) just wondering how close you've gotten with today's tech.
@AlterSoul Thx for the compliments. Sorry to disappoint, but everything in these videos are post-production video editing - special effects. I made it pretty clear in the first video that these are design sketches, _not_ prototypes or anything real like that.
I am currently in the process of making a third video. I'll make sure to clarify in that one that these are all post-production effects.
I always try to save money on all the things I buy. I do it in various ways including on the internet. This video shows a system that was totally new to me.
Hey, just curious, have you seen an anime called Dennō Coil? Plot is a little bit eh, but it is probably one of the best examples of what you are talking about with your spatial computing videos. Check it out
So Cool.. So scary.. Someday my grandchildren will be asking me what it was like before augmented reality. Im going to have to go with the flow on this one.. Im a freelance 3D modeler.. Apparently we are going to be in high demand. Hey, Someone has to build the new world..
Heh, yeah, one of my dreams, honestly, is to become a relic. I want my grandkids to think of the dawn of the 21st century the same way I imagine a world without - ya kno - things like phone lines or electricity.
Keep modelling, cuz you're right, we'll be needing you...
Funny thing is that I saw your video a week ago. Next thing I know I was contacted to produce a 3D model for a very high profile AR advertisement. I'm reasonably certain that AR in some form will become wide spread. The developers I am working with at the moment seem to think its a fad but I dont think they are looking past the application at hand.
One thing I'm not so certain about is the goggles. I haven't done much research but there seems to be a problem with the idea that you can put a transparent display so close to an eye and make things appear as if they are out in a room. There seems to be a problem with focus. The focus problem goes away when you stream a video feed to they eyes (Vusix AR920) but then you end up with a long list of other problems. I wonder how these problems will be addressed.
Great job; great editing. Nice practical illustration. As much as I, and I'm sure most, detest advertising, AR will only come into fruition with commercial backing. I agree that it will be the companies that conduct themselves in a manner akin to google that will flourish. I'm sure that there will also be something analogous to the the ad blocking extensions of today's web browsers. We shouldn't fret too much. Anyways, very exciting times... the world is about to be altered immensely.
I think right now everybody is worried too much about commercial backing and not enough about cultural relevance.
Think back to VR & VRML: first approached academically, then commercially. Money trying to change culture doesn't work.
Instead, think of Quake - a juvenile 3d engine that changed history. Most people believe that all the money in AR is in advertising, but my gut instinct says it'll be made in the hardware that can drive the next gen quake engine.
I teach physics and engineering design at a rural high school in western Maine. I am really interested in applying augmented reality to the physics and design experiences of my students.
I'd like to be teaching, learning and creating in 3D environments with my students within the next 5 years.
I deployed 20 wiimote kits this Fall for the cost on one "smart"board but we are still in the paper paradigm. How do we start experimenting with spacial computing? Any software, platforms or hardware that you could suggest to purchase so my students and I could start building a prototype system?
To be perfectly honest, I don't really know what the first practical steps might be.
I guess in terms of low cost solutions (and taking advantage of your stash of wii-motes), you might want to check out Johnny Chung Lee's wii projects, specifically the head tracking one. I feel like there's a project waiting to happen if someone can figure out how to integrate some of the design choices from this video (the pointing gesture) with his system...
Have you seen "dennou coil", it's an anime that deal heavily with augmented reality, using 'glasses'. Anyway, excellent video, your post-editing skills are top notch.
Admittedly I did not like the last segment as I am heavily anti-advertising and the idea of being forced into a 3D mobile phone ad 'in my living room' is not a pleasant prospect.
I do feel the need to address the advertising thing. Being a citizen of New York City, I totally share your resentment towards advertising. I actually used to be an avid reader of the anti-advertising agency. And the thought of an unwanted ad in my personal space? Yeah - that makes me very upset as well. (continued)...
That said, on the other hand, when I am actively seeking info about a product, I'll freely admit that I do enjoy being treated nicely - whether it's in a brick and mortar store, at a website, or in a pamphlet. The idea I was trying to present (and probably not as successfully as I had hoped) was that sometimes a little fanfare can make shopping a more enjoyable experience. (continued)...
When AR eventually becomes mainstream, will it be accompanied with advertising? What technological media hasn't come packaged with commercial interests? In time, though, the losers will be the people who invent the 'pop up ad' of spatial computing, and the winners will be the people who come up with the "Google Ad Words" of spatial computing.
I hope by the time AR goes mainstream that culture will have evolved to the point where our rights as consumers are at the top of the food chain, and advertising becomes a strictly voluntary activity. I'm probably dreaming there though.
I suppose the pioneers/developers of this technology will largely be responsible for how accessible and ultimately vulnerable it may be to abuse. Let's hope we learned our lesson with SMTP and javascript :)
i love the "bring it home" step and how things get all small when you throw them in the shopping cart. i'd kill for that take me anywhere keyboard. watch out apple!
All this can be implemented with enough effort, but the thing that boggles me still is how the projections are made? Some central projection device? Does you standing in its way make shadows? Could u really project a keyboard usefully? Let me know if there's something i am not seeing clearly!
I dont think its possible to overestimate the impact AR will have. This video highlights a handfull of use-case's very well, but there must be millions more out there.
I just hope some decent investment gets put into hmd development. This "hold your phone up" style of AR at the moment is hardly any good for use-case's like these.
you always amaze me with your creativity! i saw these couple of videos and also thought of your previous videos related to technology and perfomance, i immediately thought of a scenario where you can have real actors on stage in a virtual world (audience with special gogles). actors could interact with virtual world with gloves OR audience can interact with the performance with gloves. crazy! :-)
You said alot about bringing/comparing digital 3d objects into your home, but it would/could/might be interesting to look at it the other way around, aka putting yourself into digital space (for example an architect showing a client how the inside of a 3d home would look).
Yeah, I've definitely had that desire before. Sometimes I look at digital environments, like Halo maps, and think to myself, "wow... I wanna go there someday..."
One idea I kicked around for this vid involved environmental rendering - instead of loading a model of the coffee table in your living room, the idea was loading a model of your living room around the showroom @ say Ikea.
I couldn't reasonably wrap that idea up in this video in any way that was either elegant or succinct.
Brilliant video ! Bring us a good example of what near future will be !
You definitely want a stereoscopic display to visualise you content with actual perception of depth and distance. I've been working on realtime stereoscopy engine, give me a shout if you need any tips :)
I'm actually thinking about publishing my next spatial computing project in 3d. I mean, I'm already doing all the blender renders in 3d.
Yeah, work you peops have done w/ the stereoscopic wall is pretty sweet.
Do you think you could create the beam of light that extends from your hand? I guess you'd need to do some pretty decent mocap on the subject's eyes as well as the on the finger or wand.
Stereoscopic render sounds great ! It has to be realtime to work properly, but Blender sounds like a good option !
You can't have stereovisuals coming to close to the subject (that would be painful to watch) but there are ways around.. You won't need to track the eyes, but only the head (in 3D) to get the vanishing point.
What do you think would be an intelligent solution to easily toggle the motion detection (in order to avoid accidental clicks/commands during routine activity)? The solution should be easily accessible so that toggling quickly and frequently isn't a chore, and maybe shouldn't be a gesture (or at least shouldn't be a gesture we might accidentally perform).
By the way, hey Albert, this is Ronnie Hong, haha.
Yeah, that's a big concern that I had when designing the gestures that you saw in the video.
To be a little more explicit, the solution that I envision is that the gloves have contact sensors on relevant spots, like in the tips of each finger, or on the 'thumb-side' of the middle finger. The point-selection gesture should only occur when the last three fingers are curled in AND the thumb and middle finger contact sensors fire @ the same time...
Pinching only happens when the thumb & index fire @ the same time.
Pointing isn't a big deal - it never actually changes the environment except by creating a hover state. So I don't really mind if this fires all the time.
Oops *** I just reread what you said and understand it now. I think that's a smart idea. Say, for example, I want to reach over and pick up my Coke; I don't want to accidentally activate anything. Haven't really considered this... good food for thought tho, so thanks
With the new and improved use of bar codes for locating products online etc. Would it be possible to try using personalized bar codes that hold relevant information or can be located on a credit card? Possibly simplifying the visual input step.
Can't believe I'm only seeing this video now, dude. Super cool. Sharing this!
dmaranan 2 months ago
Hey Phedhex!
I watched your videos and I am very impressed! I thought you were very well spoken and the video was very well paced. Feel like you are doing an awesome job in that regard!
I was wondering though what tech you were using. More specifically how you are viewing the models in real space. I get the idea of the future you are making (which is awesome) just wondering how close you've gotten with today's tech.
Good luck, keep fighting the good fight!
AlterSoul 4 months ago
@AlterSoul Thx for the compliments. Sorry to disappoint, but everything in these videos are post-production video editing - special effects. I made it pretty clear in the first video that these are design sketches, _not_ prototypes or anything real like that.
I am currently in the process of making a third video. I'll make sure to clarify in that one that these are all post-production effects.
phedhex 4 months ago
I always try to save money on all the things I buy. I do it in various ways including on the internet. This video shows a system that was totally new to me.
MrBidwin 5 months ago
Your video editing skills are epic! How long did it take you to do those? I want to learn.
worldmodelcoach 10 months ago
Awesome :)
yumyumsesame 1 year ago
Great work, if i had cash i'd back you!
nodnodwinkwinkV 1 year ago
Hey, just curious, have you seen an anime called Dennō Coil? Plot is a little bit eh, but it is probably one of the best examples of what you are talking about with your spatial computing videos. Check it out
Aelphais 1 year ago
SKATEBOARD
buzfortuna 1 year ago
Yeah, rrrright... you call this "spatial computing" ?
And what was Augmented Reality again ?
The idea is completely unoriginal, next time think harder.
fedemenoyo 1 year ago
Fantastic explanation. Hope we can use this soon.
SirWilly9999 1 year ago
extremely well made. Thanks!
SpunkMaster3000 1 year ago
GREAT!!!!!!!
Gabryhunter 1 year ago
awesome vid! can't wait to see what you come up with next :)
houdoken 2 years ago
is it just a model of application interface made not in real time?
alexneskin 2 years ago
Haha... Stupid easy.
hexcenteric 2 years ago
: D
phedhex 2 years ago
So Cool.. So scary.. Someday my grandchildren will be asking me what it was like before augmented reality. Im going to have to go with the flow on this one.. Im a freelance 3D modeler.. Apparently we are going to be in high demand. Hey, Someone has to build the new world..
Routb 2 years ago
Heh, yeah, one of my dreams, honestly, is to become a relic. I want my grandkids to think of the dawn of the 21st century the same way I imagine a world without - ya kno - things like phone lines or electricity.
Keep modelling, cuz you're right, we'll be needing you...
phedhex 2 years ago
Funny thing is that I saw your video a week ago. Next thing I know I was contacted to produce a 3D model for a very high profile AR advertisement. I'm reasonably certain that AR in some form will become wide spread. The developers I am working with at the moment seem to think its a fad but I dont think they are looking past the application at hand.
Routb 2 years ago
One thing I'm not so certain about is the goggles. I haven't done much research but there seems to be a problem with the idea that you can put a transparent display so close to an eye and make things appear as if they are out in a room. There seems to be a problem with focus. The focus problem goes away when you stream a video feed to they eyes (Vusix AR920) but then you end up with a long list of other problems. I wonder how these problems will be addressed.
Routb 2 years ago
Great job; great editing. Nice practical illustration. As much as I, and I'm sure most, detest advertising, AR will only come into fruition with commercial backing. I agree that it will be the companies that conduct themselves in a manner akin to google that will flourish. I'm sure that there will also be something analogous to the the ad blocking extensions of today's web browsers. We shouldn't fret too much. Anyways, very exciting times... the world is about to be altered immensely.
chesterleethompson 2 years ago
Thanks Chester -
I think right now everybody is worried too much about commercial backing and not enough about cultural relevance.
Think back to VR & VRML: first approached academically, then commercially. Money trying to change culture doesn't work.
Instead, think of Quake - a juvenile 3d engine that changed history. Most people believe that all the money in AR is in advertising, but my gut instinct says it'll be made in the hardware that can drive the next gen quake engine.
phedhex 2 years ago
these concepts blew my mind. keep these videos coming!
outsidenow 2 years ago
Good ideas.
inspiring
wongalan2002 2 years ago
Excellent work. It is inspiring.
I teach physics and engineering design at a rural high school in western Maine. I am really interested in applying augmented reality to the physics and design experiences of my students.
I'd like to be teaching, learning and creating in 3D environments with my students within the next 5 years.
(continued)...
mrbogar 2 years ago
I deployed 20 wiimote kits this Fall for the cost on one "smart"board but we are still in the paper paradigm. How do we start experimenting with spacial computing? Any software, platforms or hardware that you could suggest to purchase so my students and I could start building a prototype system?
mrbogar 2 years ago
Hi Mr. Bogar -
To be perfectly honest, I don't really know what the first practical steps might be.
I guess in terms of low cost solutions (and taking advantage of your stash of wii-motes), you might want to check out Johnny Chung Lee's wii projects, specifically the head tracking one. I feel like there's a project waiting to happen if someone can figure out how to integrate some of the design choices from this video (the pointing gesture) with his system...
(Somebody PLEASE do this).
phedhex 2 years ago
Have you seen "dennou coil", it's an anime that deal heavily with augmented reality, using 'glasses'. Anyway, excellent video, your post-editing skills are top notch.
Admittedly I did not like the last segment as I am heavily anti-advertising and the idea of being forced into a 3D mobile phone ad 'in my living room' is not a pleasant prospect.
neotoy 2 years ago
Hey Neo - Thanks for the compliments!
I do feel the need to address the advertising thing. Being a citizen of New York City, I totally share your resentment towards advertising. I actually used to be an avid reader of the anti-advertising agency. And the thought of an unwanted ad in my personal space? Yeah - that makes me very upset as well. (continued)...
phedhex 2 years ago
That said, on the other hand, when I am actively seeking info about a product, I'll freely admit that I do enjoy being treated nicely - whether it's in a brick and mortar store, at a website, or in a pamphlet. The idea I was trying to present (and probably not as successfully as I had hoped) was that sometimes a little fanfare can make shopping a more enjoyable experience. (continued)...
phedhex 2 years ago
When AR eventually becomes mainstream, will it be accompanied with advertising? What technological media hasn't come packaged with commercial interests? In time, though, the losers will be the people who invent the 'pop up ad' of spatial computing, and the winners will be the people who come up with the "Google Ad Words" of spatial computing.
phedhex 2 years ago
I hope by the time AR goes mainstream that culture will have evolved to the point where our rights as consumers are at the top of the food chain, and advertising becomes a strictly voluntary activity. I'm probably dreaming there though.
I suppose the pioneers/developers of this technology will largely be responsible for how accessible and ultimately vulnerable it may be to abuse. Let's hope we learned our lesson with SMTP and javascript :)
neotoy 2 years ago
there are so many awesome ideas in here!
i love the "bring it home" step and how things get all small when you throw them in the shopping cart. i'd kill for that take me anywhere keyboard. watch out apple!
lvrgrlvideo 2 years ago
All this can be implemented with enough effort, but the thing that boggles me still is how the projections are made? Some central projection device? Does you standing in its way make shadows? Could u really project a keyboard usefully? Let me know if there's something i am not seeing clearly!
triggerme2ice 2 years ago
Hey Trigger -
All of this stuff is not using projections, but instead using a head mounted display. Those concepts are discussed more in depth in the first video.
Doesn't solve ALL the problems... like occlusion, but I'll get more into those details in later videos.
-Albert
phedhex 2 years ago
Ok thanks.
I see these concepts of being very crude, clearly due being early concepts, but i must say I can see these concepts going places!
triggerme2ice 2 years ago
Absolutely brilliant and I'd love to see more.
eirepreneur 2 years ago
Very well made and great explanations. I would love to see this technology implemented ^_^
xXprojectt2501Xx 2 years ago
Very well explained.
I dont think its possible to overestimate the impact AR will have. This video highlights a handfull of use-case's very well, but there must be millions more out there.
I just hope some decent investment gets put into hmd development. This "hold your phone up" style of AR at the moment is hardly any good for use-case's like these.
twdarkflame 2 years ago
Excellent stuff! Very inventive. It doesn't seem like it's that far off.
atarom 2 years ago
you always amaze me with your creativity! i saw these couple of videos and also thought of your previous videos related to technology and perfomance, i immediately thought of a scenario where you can have real actors on stage in a virtual world (audience with special gogles). actors could interact with virtual world with gloves OR audience can interact with the performance with gloves. crazy! :-)
paulinobrener 2 years ago
You said alot about bringing/comparing digital 3d objects into your home, but it would/could/might be interesting to look at it the other way around, aka putting yourself into digital space (for example an architect showing a client how the inside of a 3d home would look).
DCKern 2 years ago
Yeah, I've definitely had that desire before. Sometimes I look at digital environments, like Halo maps, and think to myself, "wow... I wanna go there someday..."
One idea I kicked around for this vid involved environmental rendering - instead of loading a model of the coffee table in your living room, the idea was loading a model of your living room around the showroom @ say Ikea.
I couldn't reasonably wrap that idea up in this video in any way that was either elegant or succinct.
phedhex 2 years ago
Comment removed
crustea 2 years ago
Brilliant video ! Bring us a good example of what near future will be !
You definitely want a stereoscopic display to visualise you content with actual perception of depth and distance. I've been working on realtime stereoscopy engine, give me a shout if you need any tips :)
joanie
crustea 2 years ago
Hi Joanie -
Thanks for the compliments!
I'm actually thinking about publishing my next spatial computing project in 3d. I mean, I'm already doing all the blender renders in 3d.
Yeah, work you peops have done w/ the stereoscopic wall is pretty sweet.
Do you think you could create the beam of light that extends from your hand? I guess you'd need to do some pretty decent mocap on the subject's eyes as well as the on the finger or wand.
phedhex 2 years ago
Stereoscopic render sounds great ! It has to be realtime to work properly, but Blender sounds like a good option !
You can't have stereovisuals coming to close to the subject (that would be painful to watch) but there are ways around.. You won't need to track the eyes, but only the head (in 3D) to get the vanishing point.
Can't wait to see your next experiments !!
crustea 2 years ago
What do you think would be an intelligent solution to easily toggle the motion detection (in order to avoid accidental clicks/commands during routine activity)? The solution should be easily accessible so that toggling quickly and frequently isn't a chore, and maybe shouldn't be a gesture (or at least shouldn't be a gesture we might accidentally perform).
By the way, hey Albert, this is Ronnie Hong, haha.
flushentitypacket 2 years ago
Hey Ronnie! Nice to hear from ya!
Yeah, that's a big concern that I had when designing the gestures that you saw in the video.
To be a little more explicit, the solution that I envision is that the gloves have contact sensors on relevant spots, like in the tips of each finger, or on the 'thumb-side' of the middle finger. The point-selection gesture should only occur when the last three fingers are curled in AND the thumb and middle finger contact sensors fire @ the same time...
phedhex 2 years ago
Pinching only happens when the thumb & index fire @ the same time.
Pointing isn't a big deal - it never actually changes the environment except by creating a hover state. So I don't really mind if this fires all the time.
Oops *** I just reread what you said and understand it now. I think that's a smart idea. Say, for example, I want to reach over and pick up my Coke; I don't want to accidentally activate anything. Haven't really considered this... good food for thought tho, so thanks
phedhex 2 years ago
With the new and improved use of bar codes for locating products online etc. Would it be possible to try using personalized bar codes that hold relevant information or can be located on a credit card? Possibly simplifying the visual input step.
yourbuddiebob 2 years ago
Sure thing - I don't see why not!
Altho, one thing to note is that OCR (optical character recognition) is getting better and better every year.
phedhex 2 years ago
Thanks!
phedhex 2 years ago
simply amazing, really clever!
i'd like to help you make your vision come true, i think this could be comercially available in just a couple of years.
jukimv1986 2 years ago