Augmented Reality for the Blind using Google Android

This video clip shows The vOICe for Android (beta) running on an old T-Mobile G1 (ADP1) camera phone. More information and the software is available at http://www.seeingwithsound.com/android.htm (also on Android Market). Video snapshots are converted into sound using pitch for height, time for horizontal position, and loudness for brightness. Thus, a rising bright line gives a tone with rising pitch, and a bright square sounds like a noise burst. Any live camera view can be turned into sound, although the response is here still a bit sluggish for lack of a JIT compiler for Google Android. Apart from the ability to sound any camera view as demonstrated in this clip, The vOICe for Android also includes a talking compass (you may hear it say "South", "South-East" during the clip), a GPS-based talking locator that speaks nearby street names, and a talking color identifier. The color identifier speaks color names of items at the center of the camera view, and the color filters can for instance be used to only hear exposed skin.

Category:

Education

Tags:

• yt:fmt=18
• sensory substitution
• seeingwithsound
• blind
• vision

[giantcandy]

why no explination, this thing would help the blind if they knew what the freak the noises meant...

[IgWannA2]

those sounds are freakin scary