Kinect Win7 control with fast text input method

This is the demo of our Kinect Win7 control program which provides full support of mouse and keyboard operations. This demo simulates the 8Pen Android input application and shows the advantages and potential applications of using novel text input methods for natural interface against traditional ones, such as an on-screen keyboard. This program uses OpenNI framework.

Category:

Science & Technology

Tags:

• Kinect
• OpenKinect
• OpenNI

[xd201112]

Hi, In current stage the code is still under development, some new features are going to be added soon. I'd like to release the code as soon as we wrap it properly.

[FedorAnimus]

@xd201112 Sounds great! You'll have a great community to expand it.

By "Full Support", does that include multitouch?

[xd201112]

@FedorAnimus Since currently we are mainly focusing on providing convenient mouse and keyboard input, the code doesn't support a lot multitouch operations. But it is intrinsically supported and can be expanded in future. For example, in our program if you put two hands in front of the torso you can resize and move the "shadow" around in the screen.

[FedorAnimus]

@xd201112 Yeah, I saw that. It's a great option. I'm very interested in these developments, as well as with FAAST. Which drivers are you using?

[xd201112]

@FedorAnimus I'm using avin2-SensorKinect driver.

[paveljetensky]

Hello, Dan and Yun, your work is great.

Do you have some statistics about how fast is typing with your 8-pen like keyboard? I was measuring that typing hello kinect took 0.92 s per letter and hello world was about 1 s per letter. It is amazingly fast, have you trained to type these particular words as fast as possible or was it just casual writing? Do you have any statistics for some longer texts?

Thanks and good luck with your next work (I have seen your newest KinVi video-cool)

Cheers

Jetz

[nathanthekiller]

@FedorAnimus Sounds pretty pathetic but i do too xD

[FedorAnimus]

@xd201112 I check back here every day, waiting for a release, I'm pretty excited about this!

[jordanmc50]

Hello, Any news on when you have a release or open source for download? Thanks!

[jordanmc50]

@xd201112 Hello, Any news on when you have a release or open source for download? Thanks!

[nathanthekiller]

Still looking forward to this release!

[FedorAnimus]

@xd201112 Okay, thank you. Same as I. I'm attempting to do what you accomplished here, as well as combine it with gesture input options, and full multitouch. Great work!

[SanchoTheKidTV]

i am BLOWN AWAY at the way he hacked and used Kinect...

[yunlincs]

@bricemathieu Actually we tried to use the second hand for mouse clicks. It doesn't out perform the one-hand version in our test. Usually it may need more effort to coordinate the movement of two hands and to ensure one hand's movement doesn't disturb the other one. In addition, it's also easy to get tired with two hands.

-Yun Lin

[bricemathieu]

this is amazing and you re sticking it to evoluce for releasing the code !

your input panel is great but would you consider using the second hand for mouse clicks as it does not seem effective or at least it seems to compromise accurate pointing ?