Skyrim Kinect

Skyrim Kinect is my latest PC game adapted to work with the Kinect. It allows for full character control using both gestures and voice.

Update: I've been reading your comments, and you guys have been very positive! There's always going to be debate over motion controls, so keep the discussion going. It sounds like you guys have really enjoyed the voice controls. Lucky for you, a new video is in the works, which includes Fus Ro Dah, and the ability to perform any shout you know, on the fly. Also, the new voice commands now include drinking potions and more spells. Video coming soon, so please subscribe! Cheers.

The gestures are simple and intuitive, yet allow for gameplay depth never before seen with the Kinect. Simply swing your right arm forward, up, left, or right, and your character will hack with his sword. Or, if you have a spell in your right arm, simply raise your hand or push it forward to cast. Use your left arm to control your character's view; if you have something equipped like a spell or shield, your left arm will control that as well.

Movement is also easy. Put your right foot just inches forward to run, and even further forward to sprint. Your left foot forward switches to a slow walk, while leaning left, right, or back moves your character in that direction.

Reach down with your left arm to draw or sheath your weapon, reach down with your right arm to activate objects. Crouch to sneak, and raise your right foot to jump.

This established gesture-based control scheme has worked well in my previous videos, but what is new in Skyrim Kinect is the use of voice controls:

Yes, this means Dragon Shouts!

Voice control also allows for much easier access to the menus and the 8 hotkeys. Each hotkey item has its own word or phrase, and the word 'double' before most hotkeys will equip it to both hands. Voice controls really do help create a seamless Kinect experience that would otherwise be burdened by accessing menu's using gestures.


Some features that are implemented, but not used in this video include:
- saying "Left hand" or "Right hand" to equip an item to a particular hand when in menu
- saying "Hello" to activate a conversation with a store owner or NPC
- saying "Journal" to access the journal
- saying "Skills" to access the skill trees
- saying "Switch View" to change between 1st and 3rd person perspectives.



So what kind of technology is behind the Skyrim Kinect video?

Well, gesture control is handled by the Kinect using a program called FAAST. FAAST, a middleware that operates using the OpenNI framework, converts user movements into keystrokes. Unfortunately, the openNI framework does not support voice control for the Kinect.

As a way around this, voice control in the Skyrim Kinect video is handled by a program called VAC (Voice Activated Commands). VAC allows you to pair spoken words with keystrokes.

Trying to avoid any type of controller, wires, or anything that might impede movement, I have used a RazorFish bluetooth headset to send voice commands to VAC. This device was relatively inexpensive, and probably accounts for some of the gameplay moments where a command is unrecognized.

I hope that you enjoy this Skyrim Kinect video. I look forward to suggestions about which PC games you feel should be Kinected in future videos.

FAAST: http://projects.ict.usc.edu/mxr/faast/
VAC: http://www.dwvac.com/
Music clips: Kevin MacLeod

Category:

Gaming

Tags:

• Skyrim Kinect
• Skyrim
• Kinect
• Kinected
• PC
• Games
• Jabroni
• Elder Scrolls
• Shout
• Dragon
• Control
• controlled
• Gestures
• FAAST
• VAC
• Voice
• KinectFAAST
• mic
• thu'um
• mod
• nao
• arrow to the knee
• gameplay
• commentary
• arrow
• hack
• controller
• knee
• adventurer
• character
• commands
• Fus
• Ro
• Dah
• Fus Ro Dah

[hdgamevideos1]

Dead Space 2 with Kinect would be fun!

[crazicow16]

assassins creed revelation ? or halo reach

[xbluefire101]

Bet your mate is playing with the controller on the other side of the room ;)

[xECHOxASSASSINSx]

it looks cool but i dont think its real you see he says long bow and pulls out a glass bow thats all i have to say

[TheftSAs]

Show us some hand-to-hand!

[kylerxy3]

i don't see how this could be real, because when you say fast heal, how does i know which hand you're talking about?

[MustangMassacre89]

Guys u need to stop fighting and just play skyrim its a fact that I needed to state

[JUICYTABACCO659]

That Guy in the top corner looks like a retarded fool

[kgoo867]

@Raven1024

I'm not arguing opinions. Right now, I'm stating a fact. Props cannot give you physical feedback unless they are mock controllers (in which case, there is no benefit over using an actual controller) or you're playing with another person (in which case, go the fuck outside).

So no. Neither your nor my opinion is relevant right now. Until you care to explain how props can give physical feedback, I suggest you stop talking.

tl;dr respond or STFU

[MiningMines]

Fake

[TheClumsyFilms]

@DePakiable When I read this I forgot what it meant!

[Raven1024]

@kgoo867 Lmao, I'm not ranting at all, I'm pointing out you were whining like a little kid about me not respecting your opinion, while at the same time doing the very thing you were whining about.

My opinion is just as relevant as anyone elses.

If you don't know what physical feedback is that's not my problem. I don't need to explain to you the hundreds of ways to do it in a youtube comment if you can't be open enough to think about it.