Skyrim in Virtual Reality using HMZ-T1, TrackIR & Kinect

Skyrim played through a simulated Virtual Reality environment using a head mounted display, head tracking, motion sensing and speech recognition.

I've also written up a walkthrough on how you can do it yourself too:
http://zookal.com/blog/2012/03/how-to...

This is what was used for the demo:
- Skyrim - A first person action role-playing game for the PC.
- Sony HMZ-T1 - High definition head mounted display with Stereoscopic 3D.
- Microsoft Kinect - Track movement and gestures.
- TrackIR 5 - Head tracking.
- TrackClip Pro - Used with the TrackIR 5 for more accurate head tracking.
- Shoot - Speech recognition software.
- FAAST 0.9 - Software used to map Kinect gestures to the keyboard


I've setup the Sony HMZ-T1 head mounted display to use Stereoscopic 3D as well as attached the TrackClip Pro on it for head tracking. I had to place the TrackIR 5 on a wire hanging from the ceiling as it needed to be around head level to track my head movements properly.

The Kinect was setup on the PC using PrimeSense's OpenNI drivers. I used FAAST 0.9 with a custom script to map certain gestures with the keyboard, such as walking on the spot to move in the game, leaning left, leaning right, jumping and moving my right arm forward to use the sword.

Shoot was used to map several speech commands with actions in the game as well, such as saying 'Open Menu' and 'Close Menu' to trigger the in-game menu, as well as using commands to navigate through the menu.

All the devices to do this cost less than $1,500, although it is still not smooth and responsive enough yet for a decent gaming session. Hopefully in the near future this concept of gaming will be more refined.

Also don't forget to check out the outtakes at the end!

• Category

  Gaming

[chriswww]

LOL the walking on the spot looks silly.

[Jimmy Hopkins]

Dragon he will never kill

[vintasalo]

Go outside and play damnit, lol...  Geez

[Lucas Hau]

KKKK.... The real likes minecraft miner

[dogeymon83]

I would consider one of those HMZ thingies if they weren't such an unbelievable ripoff

[Ninjo335]

This is awesome but i cant help but imagine having to fight giant spiders in this D:

[JohanssonJ92]

Just buy an oculus rift and you wont have to.

[m0lk0b0y]

all the movement with hand u should use something like PS move :O

[enriqueGoPro]

Very cool except the Kinect!

[Евгений Лыков]

you could spot teamfortress player by muscled legs.

[shane neyome]

Sorry for saying this was fake after seeing a friend do something similar I realized I was wrong and a am sorry. But it is bull shit that you have to buy the head tracking separately

[nextgenhacker01]

How hard it was when he's playing skyrim but in DI RT these guy dont wait. that's y i comment with the words their. 0_o