The "AutoBand" software using OpenCV and some heuristics to detect notes along the racetrack in a RockBand 2 video. The color boxes designate matches to the keys. Video of gameplay borrowed from other YouTube video, the computer is not actually playing (yet). However, the keystroke indicators are added in by the OpenCV layer and matched to the keys scrolling on the racetrack.
There is also a planned hardware interface which uses a series of FETs to "press" the guitar buttons. Stay tuned.
This reminds me of SlashBot: The Guitar Hero Robot. They had a similar approach.
kimmo99 2 years ago