Mogees - Gesture recognition with contact-microphones

[tmarsh462]

+1 above. I can see some clever musicians program the algorithms and interpretive engine according to the sounds they want (metal drums, drums, theramin, bass, electric drums - possibilities are endless) and have it sitting next to a synth or mixer on stage

Awesome.

[Mynameisnumber5]

Me want this right now.!

[vanhoveseb]

Magnifique ! Est-il déjà disponible pour la vente ?

[BwHorH]

I WANT TO BELIEVE

[smilzo87]

orgoglioso che tu sia italiano! bravo bruno!

[souljahzunited]

read all the comments but whateves- i;ll take 2 please

[lyfeportrait]

this made my day :D

[kofimazu]

wow! this is a boon for the Foley industry!!

[tiktunez]

Put it on a computer screen :3

[TheMickiPacific]

Are you using MaxMSP ?

[TheGuldruk]

There's an app on the iphone, "tabledrum", that does the same kind of stuf. It's mostly based on drums, and basically you associate sounds you make by tapping on stuff to drum samples. It's pretty cool actually if you got the rhythm

[mrcowmeat]

acoustic dubstep :D

[lightotw]

Here is a real version of what contact microphones produce in sound. Not a fake: watch?v=iBu5HkKr1fI&feature=re­lated Notice how the tensions of vibrations correspond to the sound, unlike in the example of the "Mogees" which are completely random in this relationship.

[LittleBrightLED]

How much would one of these cost?

I'm guessing $4.99

[simonjohnroberts]

Pretty sweet. Wheres the codebase? All I see is more bumf on your site. This is going to be open source right?

Good project.

[jimvandamme]

"Any sufficiently advanced technology looks like magic..." or something like that. Half the people posting here haven't a clue what's going on. Very cool, but lots more development necessary before you have an expressive musical instrument.

[heatseeker010176]

On voit très bien les possibilités offertes à tout type de musicien, pas seulement de musique expérimentale. Génial

[ChalkboardDream]

Can you tell me what contact mic is used in this video? thank you.

[bohitomi]

@ChalkboardDream im also intrseted in

[bub101bub]

its sound trigger you can use mouse to play music or keyboard anything you can plug in to pc how this so new like for me i would use my korg 707 it old but it not toy if like make music with mouse or keyboard try electronic piano its freeware it fun search for electronic piano 2.6 freeware

[WalangMagawaProd]

excellent! I want one, hahahaha!

[Domonesium]

If this is real, I'd really like to see someone control a computer with it, eg, typing directly on a desk.

[s995511]

man thats sick lol I love it

[lightotw]

This is a fake, and I'll even say why... The sounds do not correspond to the surface tension change from a ballon (low tension) to something like glass (high tension). Also, consider the final ballon case. It sounds like a heavy gong on one side and then a tin can on the other side - the sounds were made roughly same distance from the mic and in the same way. All of these mic sounds should be just like hitting a mic stand with your foot - a bump sound only.

[8KY8]

I consider myself an excellent hand drummer and am looking forward to playing with one.

[gearhead9122]

I don't fucking get it, next video please.

[NarcissistsDie]

So why is it 'gesture' recognition? What are you talking about? This can be done on the skin of a drum or any electronic pad triggering a synth. Explain why it is gesture recognition. This is not about the surfaces you are using it's about the method of recording and the way that the signal is carried and the synthesis you are employing to interpret that signal. In principle it is no different to vocoder technology from the late 70's and beyond.

[brunozamborlin]

@NarcissistsDie once again, the software recognises different types of touch and each one is associated with a different sound synthesis engine. that's why finger tapping sounds like a bass while rubbing nails sounds like a glass... sorry if it is not clear enough in the video

[NarcissistsDie]

@brunozamborlin It seems what you're saying is that the software interprets abrupt tapping as bass type sounds and sustained scraping or rubbing as glass or metallic sounds. Again, how is this gesture recognition? Tapping a table isn't making a gesture unless you're calling a cat over or something. To make a gesture is a non verbal form of communication? So which is it? So yes, it's not clear enough in the video. It looks and sounds cool though. That's it.

[IamJamespro]

@brunozamborlin where can i buy one

[cybersoul25]

It's really a novel approach. Bruno is right, he associated some sounds generated by specific gestures (e.g. strikings, scratches etc) to a specific sound used as a seed for the synthesis engine using various synthesis algorithms to generate the final output. It's anyway a novel approach. But similar results may be achieved, with a little software tricks, using the same Schaller Oyster 723 piezo pickup used in the clip, along with an Open Source softsynth (e.g. ZynAddSubFx). .

[serenitykittie]

asome i want one

[tardz13]

Looks real, but ah, could you send me one just to make sure? xD Seriously though that looks awesome I want one.

[BluePumaMusic]

Maybe a trigger but this is not recording the sounds of the items it is attached to. Nice fun video though.

[cybersoul25]

Nice idea, but with a little software tricks one may obtain similar results using a Schaller Oyster 723 piezo pickup (used also in the clip :) ) and a softsynth that allows various sound synthesis algorithms (e.g. ZynaddSubFX). Congratulations anyway, the approach is quite new, even in a world full of more or less new music controller:Akai EWI, Novation LaunchPad, Yourock MIDI guitar, new microphone MIDI controller by Sennheiser etc

I wish you all the best and succes,

[DJXXXAVIER1]

Not fake, maybe interesting for live use on stage, but one should explain which sound is controlled by which software.

[nellie2581]

Is this even possible?

[thejerrymobile]

I have that microphone! I've never gotten a chance to use it though :P Very cool application :)

[Axol]

look/sounds impressive, to me. I hardly understand it though:P

[Stheens]

If you place it on Oprahs ass, you'll hear how pure fat sounds

[filipiliescu]

You can see is fake, from 1:52 when he taps the baloon with fingers, next 1:55 the same baloon, same distance from the mic, SOUNDS LIKE BELLS? at 2:03 sound like cristals? THIS SHIT IS TROLING

[brunozamborlin]

@filipiliescu the three different types of touch are recognised and associated with three different types of synthesiser... it is audio-based recognition. it is not fake i swear, it works :-)

[filipiliescu]

@brunozamborlin you say that this some sounds are recepted by A COMPUTER and transformed in some kind of "loops", according to a algoritm imposed by the computer. Thouse are not purely sounds recepted by "any kind of microphone"

[jimmanni]

GENIOUSSSSSSSSSSSSSSSSSSSSSSSS­SSSSSSSSSSSSSSS



[LiberalDerppppp]

SHUT UP AND TAKE MY MONEY!!!!!

[displayelevenstore]

-_O] impressed !

[sniperspywalker]

Omg. Want it so hard :P

[kevinsmellls]

Props to Cristina Picchi who filmed and edited this video. Not a lot of people really think about that when watching a tech demo but I think the film maker really has a pretty integral part in making whatever the inventor etc is doing look cool.

[Setherian]

Can anyone sugest a good contact mic? 

[NevtiqvamErro]

who'd have thought this would all happen in peckham?

[brunozamborlin]

@NevtiqvamErro :-)

[malablu]

I guess I should say Steve Angello sent me here? :D well, he did :D

[dimau5]

So Amon Tobin... 

[rafik6747]

Rak tatmanyak bina ,lkhit hadak rak montih f tramtak wala win

[gleutgleut]

how buy it?

[OfficialAxiro]

Steve Angello send me here :D

[PsychotronicWar]

It is the new perspective of transforming any kind of surface into a way of information interaction (either this is acoustic like here or digital in the near future). It could also be an indirect answer to the criticism against Blade Runner where the absence of Cyberspace was obvious; Internet (Cyberspace) was everywhere around Deckard - clothes, furniture, mirrors, walls, etc.

[hughtub]

I'd be impressed if it seemed you could play controlled notes with it. As a sound effect generator, it's neat, but it would be REALLY neat if it had fine tuned note creation, as an ultra minimal keyboard. It would be the ultimate portable instrument if it were wireless too, and I assume if it can detect differences enough from location, it could double as a typing keyboard. User might first have to create a reference by typing asdf jkl; then can start typing.

[EastStandManc]

I'd like to see what Trent Reznor, Depeche Mode or Burial could do with this.

Excellent work.

[tarpanism]

lol hahaha its not real

[vethelenpa]

Now we just need someone with rythm for the next video, also it seems that it doesn't take the frecuency and adjust it to a certain sound specific from that surface and frecuency, it sounds similar in different surfaces, also some sounds seems to be pre-recorded for example when it sounds like a DJ sracth and beatbox in the video.

[epalmotion]

nice! now, where is the download for the app?

[MegaNewt0n]

Tested sent me.

[elpagna]

does it work on human skin?

[heatrock11]

amazing !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!­!!!!!!!!!



[juancholongo2]

yeah right! LOL

[2346danny]

i want one :)

[cristobalallendes]

CTM quiero mil ahora!

[liln4444]

fakee

[Vitisaurio]

@liln4444 It's not fake. it's really not impossible to do this, on PD or Max MSP with Fiddle~ object and some filters to detect the freqs (high or low) and process it. What it's really interesting is the sounds, how its processed!!!

[TylerJamesAdams]

Now we wait for an insane amount of uploads of crazy music that most of us will never be able to preform.

[alampallam1]

Heard of the musical pillars of Meenakshi temple at Madurai in Tamil Nadu?

[123arskas]

Awesome man!!!!!!

[1cipheradam]

DOMO !

[MRMASTERBEANS]

I was hoping he would pop the balloon!

[uberCOUGHmedicine]

Now we can communicate with the TRANSFORMERS. Optimus Prime out.

[ciho69]

this is how the machinarium OST was made xD

[aboardable93]

This is incredible.

[BIPICY]

1:00 Yup, keyboard typing sorta gave it away.

[intermender]

Use more than one mic at same time: you can localise the sound, make any rigid surface into a keyboard/mouse/custom input device?

[PatsyMe]

Where can I buy it and what does it cost?

[juanfdo82465]

do you realize what have you done?

this could have so many uses

basically you turn any surface into a touch screen

that have being my dream: make a new thing that could change the world

i hope you success and don't become a rich douchebag

good luck

[mgungora]

looks like the gestures are coming after the sound.

[busteryoutubr]

i want it

[felipejustin]

now play a music.

[thewakz]

Not hard to do. It just coverts voltage signal from audio and depending on the shape of waveform incoming will trigger a different sound in it's bank. You can choose any bank for any surface, it's just coincidence that he chose a wood sound on wood. Unless proven otherwise, that is what I am going with.

[beachlgm]

pop the balloon!

[slashroar]

@beachlgm Not hard to do, but imaginating it is awesome :)

[dreamlandsessions]

COOL!



[12308madman]

Is this real?

[rowrowrow10]

ehh.

[ssanandk1]

Doesnt seems to be real

[brunozamborlin]

@ssanandk1 I swear it is :-)

[danlwarren]

Gimme gimme gimme gimmme

[xXxOlivier911xXx]

He sure likes to scratch a lot

[batosato]

I gotta have this....

[Cacabambolade]

2 death people are hating

[walkerzapper]

I want one!

[MrRickjames567]

how much

[TheDiabolicGnome]

WANT



[mwsource]

I want to hear a pin drop on that balloon.

[smathywerp]

Why does the second balloon sound at 1:54 start before his finger touches the surface? Clever hoax?

[rsswd]

@smathywerp you're a clever hoax

[smathywerp]

@rsswd heh :) It's true.

[nikkitto]

wowzee. is it possible to record?

[rsswd]

@nikkitto ummm..yeah...that's how you were able to hear it.

[deanpogni]

FINGERS OF FURY!

[inohunter]

If you used 2 mic's could you use triangulation to get locations out?

[postdan28]

Is it possible to transform this in to "talking" device for mute people?

[atipul666]

@postdan28 exactly my thoughts. I wonder if gestures could be attached to speech and work as a translation mechanism?

[Zer0Blizzard]

If you can get this to figure out distance from the sensor (intensity? reverb? have the microphone produce a tone and do distance calculations based on sonar-like echoes?) and number of fingers (probably number of sounds produced at the same time), you will get multitouch.

[b3fiend]

What is the sound source? a commercial synth?

[DixieFatline]

practical use?

[jon780]

@DixieFatline possibly turn any surface into a computer with this and a projector?

[DixieFatline]

@jon780 wouldnt you obscure the light emitting from the projector then?

[CriX098]

@DixieFatline Instead of the interactions triggering sound effects they could trigger certain things to happen, like closing a program or navigating a tablet. ? Thinking outloud...

[xycadium]

@CriX098 Thinking outcloud?

[DixieFatline]

@CriX098 just dont see it. its a nice gimick but when would you need such a device?

[animaulet]

Have you tried sticking it to your belly when you're hungry? Not kidding, just curious xD

[silvenshadow]

Source code?

[MrEndogen]

@silvenshadow SOURCE CODE!!

[baal19801980]

This is awesome.