Autonomously Playing Guitar Hero using Simulated PS2 Controller+OpenCV

[madmace125]

what recorder did u use like what video capture for the game

[VVawaVVooom]

nice idea. and now upgrade the software to autoplay-through zelda:ocarina of time :D

[EpicPremonitionUK]

@VVawaVVooom LOL

[dadudeondacouch]

I've tried to do this using his files and all goes well until I get to the actually sending commands part, teensy is dim but wont go bright when I press any keys. it's been giving me the shits anyone else tried to do this?

[Utharas]

It's been 3 years since your last video, feels bad man =(

Glad to see you have posted something new though. Hope it persists =)

[silntdoogood]

Nicely done.

Subscribed.

[TheSer1010]

Your PC rocks!!!

[HunterInEurope]

Johhny! It has been too long... Glad to see you on youtube again! Will you be at CES, I would be honored to meet you!

[dandab]

i was wondering what this was doing in my subscriptions section. :p welcome back johnny!

[Zalo10]

That's bad ass. Way better than what I wanted to do for Audiosurf.

[crazzel]

welcome back! nice "little" hack you made there. will you share future real-time projects? I hope you come up with a cool enough thing for that :)

[djderekcollins]

simply awesome, how did you un warp the live feed image of the fret board for the program to read it better? did you get it to identify certain colors as they came down the fret board then calculate there eta to the "score mark" so the controller could input an input stroke on time? once again ... awesome

[XXXdiffXXX]

Sweet.......!!!!

[lordsathien]

Didn't look like it can handle held notes like the last one.

[heibertelf]

a kind of hardware cheating, ya? ;-)

looking forward to see your feature experiments

[ferociousfrankie]

This guy invented 3D TVs.

[Shyguy419]

wtf that is awesome

[joelmartinez]

You sir, are a beast ... well done

[TheFXGuy]

One word:

Epic

One other word:

HAXXXX!!!

[rude19]

It's fuckin' Johnny Lee!

Respect.

[595o]

What's specifically "real-time" about this?

[crazzel]

@595o process the frame (filter and calculations) and send info to controller before the next frame is sent to the pc via the usb dongle

[Messinaroundinytown]

Your character looks like antoine dodson.

[JhnnyBy]

@suit1337 JINXERR!!!

[DDRsensation]

GH1 is so hard because of the damned to hell broken HOPOs, but it looks like it doesn't matter to you. .-.

You should upload all of FIRE.

[fabiotnt]

YOU ROCK!

Awesome project!

[suit1337]

Zero dislikes, i'm impressed :)

[snapf00]

Well that's a very nerdy way to cheat. But awesome. :P

[cench]

this will get lots of views.

[popinmad]

finally a new video! your awesome!

[CoolJimy84]

the end note is a holding note, does that not get passed through ? (seemed be be a short press)

[MeMoshRocks]

Yay, so glad I was still subscribed

[Pay919]

Glad you're back!

[cozmo195productions]

we missed you lol

[dgcompany54]

NIce work

[thegoodhen]

It's been a long time.

[schmidtbag]

very cool, good job. i'd like to see more

[kyoopihd]

Very awesome. Who needs a TAS when you can just teach the computer how to completely optimize game play on its own?

[kyoopihd]

So essentially, you're able to "teach" a computer how to play video games. The next thing to teach it is, "Hey, when the note has a line behind it like the last note in Bark at the Moon, hold down the corresponding button," to cover sustained notes.

[1000Errors]

well that sort of takes the fun out of it doesnt it? ;)

[Saur]

Fantastic stuff man, very clever.

To all the "I don't get it" idiots;

This is a demonstration of a game being played autonomously via software. A PS2 console is running Guitar Hero, the display is hooked up to a computer via a video capture card. The software uses the captured video to track the notes and activate the correct PS2 joypad button input at the correct time, I'm assuming the colour of the note is what is used to dictate which button is activated.

[Perfhex]

Its about time you uploaded something!

When are we going to see more videos from you?

[AnUntitledStory]

For this song you don't really need that. I could probably 100% this without that.

[AnUntitledStory]

@AnUntitledStory Wait, I think I'm confused. What just happend?

[TheJ0026]

i dont get it....

[Zaziuma]

i dont get it.

[chessmastor]

Great job. Hope you're still doing your thing at Microsoft.

[kvacken1]

Yaaaay a new movie!