 All right. Hi everyone. I actually just renamed it Interactivity. I like the Interactivity also but it depends on the context. Who are you talking to? And today I'm going to talk a bit more about the hardware side of my interaction with artists. I'm not an artist myself but I like playing with them and helping them if I can. The way I'm going to talk about it is kind of geographic as I was saying. I grew up in France, traveled a little bit in different parts of the world. So quickly I go through Europe, South America, the US, and Asia. Normally I would give a quick background about myself but basically I've been playing with music for a while. I gave up school for that. Then I went back and I kind of learned a lot of cool things to do with sound and technology. And obviously there's a lot of equivalence in other media like videos. So I start with Europe. My final degree was a remotely controlled segue. So it's not very artistic if you think about it but it gives a point of view of how technical I was trying to get at the time. Kind of taking another path maybe now. So just to show you because it's funny. Very quickly. I'm sorry. So you can remotely control the thing and just enjoy it. So you can see she's not very confident. It's the first time she's taking it and it kind of works. Well I just keep quickly. Well that's a remote. Whatever. Just to show a little bit of some of the tech. Then in my same degree I was also honoured to make a little scholar project that was in partnership with the museum. There's this artist who makes this real-size rhinoceros. The idea was to give some interactivity for the visitor in the museum because this rhinoceros can actually open its furniture. It has a table and everything you could store things. And basically in the museum you could not really feel how powerful how all the cool things you could do with it. So I offered that project and it was accepted. The technique is using a kinect. You can see up there. And when you get in the middle it shows you different points of view. When you get in the side it shows you other points of view. And finally on the right side also. And if you try to touch it then that's actually the sound of a rhinoceros. When they are attacking another one they do this word sound. The idea was that at this era of digital everything when you want to touch things we have other ways of helping people in their curiosity. And I thought that would be a cool way of playing with kinect. That was a few years ago. So in general this talk is about showing what I did and if any of you is interested in doing something similar or using some of this I'll have everything on github. I'm happy to share. I'm happy to explain it. Another project I did after I graduated was a musical controller. So you carry this thing very beautiful on your body and it's actually four pads. So you can see this is one and so on. And you can hit them. So they are the size of your chest and by hitting them you trigger samples remotely. There's like the kind of Arduino called TINSI, a wireless module and that's the receiver. We're here. And it behaves as a midi instrument. That's amazingly simple to use. If ever one of you wants to play with music that's pretty cool. So little demo. So that was just showing one pad. So he's kind of bit boxing but with his body. So body boxing or bit body, I don't know how you call it. We called it body ar drum but the sound, the acronym was bad. So we called it tap me. It's bad. Another project using the energy of the visitor or the user. This one is a cycle kind of augmented reality bicycle on which you pedal and generate energy to video project whatever you want. And so we use a motor from a washing machine and basically the energy that you generate is enough to power a video projector computer for variable speed video. And that's a very simple first test also. So the video projector is inside of a track. The thing was totally mobile and autonomous electrically. So we video project by the background and on the side you have people bicycling and it shows them another point of view of where you could be and the faster you go the faster the video goes. So you feel like you are actually traveling in that. As you can see an amazing videographer. So then I went to Columbia. Got to work with interesting artist. She's a photographer and she weaves pictures. So it's not that obvious but if you take twice the same picture and you cut it vertically for one and cut it horizontally for the other then you weave them. You get this interesting shape that I was frustrated because I didn't really understand it. So I suggested to make it physical like mobile and I found that this analogy of the hologram was interesting. So basically if you if you move with there's a sensor that detects your position and if you get closer you have a bit like in this old school hologram. The points of view or the piece of art itself changes a bit like if you were a VIP visiting the artist while he's doing it. So this is the the actual picture moving physically. It's not a photoshop thing or video and so you can see the vertical stripes are moving vertically. So this is a sonar sensor, an Arduino and a simple motor with a servo. Then I got to play with a group friends called Systema Solar. They do a lot of amazing shows in Colombia and they travel a little bit and there was this kind of frustration on the DJ. To me there was not enough visualization of what he was doing. You hear it, it's amazing but you don't really understand what he's doing. So I played with a vinyl kind of virtual scratch system it's called Serato. The vinyl has a timecode. You can listen to it with an Arduino and analyze the signal. Basically you amplify it you saturate it actually and you measure how many ticks you get to control either an LED strip or any video you want. So you can see the this thing is just eight LEDs that are rotating at the speed of the vinyl. So just a proof of concept once again. If the vinyl goes backward you can see it on the on the LED and if it goes slowly you can also see. Just a way of visualizing things. Then I went to San Francisco, worked for this company called SIFTO. They make these touch screen based cubes that can detect each other and they also have an accelerometer. With my musical background I had this first idea of controlling music with it. Sadly I lost the video I have it there in San Francisco but not here. But basically each of the cube can for example control a track. It can control an effect, it can control the volume and it can also enable for example the recording mode depending on what software you play with. I got to play with another kind of interactive system. These cubes they can emit sound. They talk to a bass that has a speaker and there was this frustration again that you cannot communicate with the phone. So I worked with this application that can detect DTMF. It's the old school tonal system that you would have when you call someone like this. And you're going to hear it. So you see I had ABC in the cubes and here you can see ABC was transmitted just by the sound. So very simple proof of concept again. And if you have CAB, it just does CAB. Simple, stupid. Then I worked with guys I made in the hacker space called Noisebridge in San Francisco on this project called Pulse of the City. This artist there was frustrated again. Everything is about frustration and how to solve that. She was frustrated by these coin machines on which you pay. It's the park meter. You put coins and you can pay for your car and it's kind of ugly and it's everywhere. He wanted to give it some love on some more aesthetical part and bring some smile. So we put a Raspberry Pi, an Arduino, the usual suspect, battery, 3G module, USB or whatever. And the idea was to allow people who walk by, just to pass by, hold the handles and make music at the speed of their heartbeat. So the video is actually not really obvious. So that was in Boston, but there was also one in San Francisco. That's the mayor, as you can see. Very serious. And the artist. Once again, if you want to play with variable speed, sound or music or video or whatever, this is pretty simple. I have that on GitHub. I can show you. Then I went to this festival called Burning Man with the Noisebridge gang. There's a lot of amazing art installations. It's the biggest art gallery in the world. It's uncurrated. You can go put your thing. Everyone sees it. There's like 68,000 in the last time when I went. I think it's even bigger every year. So this was a set of installations, a couple of mushrooms that throw flames to that are interacting with lights. So that's probably the most impressive. But basically the one I was working on was this mushroom that makes sounds. When you get closer, it's breathing with a kind of stressful way. The closer you get, the faster it's breathing. And if you want to calm in down, you just hug it. There's a little pressure sensor that I made with a fabric that has carbon inside. And if you put that in sandwich with conductive fabric, you can measure the pressure. So infrared sensors to measure the distance of people around and pressure sensors that were made with fabric. You could buy something already made, but it would not be big enough. So we made our own. Pretty simple. Then I came to this hacker trip to China with this guy called Mitch Altman. If you know him, you can recognize the haircut. We got to visit a few interesting places. There's this Tsinghua University that was organizing a visit from different hackers from all over the world. If you're interested, they are actually organizing the next occurrence for October. It's open. Anyone can go. You just go on this website. I'll give you the link if you're interested. And you get your ticket paid, your food, your accommodation. And that's like a two week period in Tsinghua, Beijing, and two week in Tsinghua, Shenzhen. That's how we were invited. And then they show us around factories and we get to see all the tricks that they have and get to present our projects. You can recognize the hat. But yeah, I'll talk about hardware a little more in depth if you're interested afterwards. But yeah, that's a really interesting thing to get to. Not only see how factories are, but a lot of really cool hackers facing in China and how people see that over there. It's quite different. Then I lost something here that was written grow well. So I arrived in Singapore and I got to spend some time in this place called grow well. That actually just shut down. Maybe not shut down, but ends the pop-up last Saturday. But they play with growing things and go to experiment like some of these sensors to see how you could have an automatic watering system or how you could monitor mice to try to understand how they behave in face of your traps that usually don't work. If you're interested by that, it's really a not project how to catch mice. Then I got to meet Jacqueline at the end and George actually met him in Hong Kong and then he came here and understood that this place is actually where it's happening. So we will see how this collaboration go, but maybe we'll get to do an interesting project that involves fire and dancing. She might be the dancer, we'll see. And now I'm working on this wireless motion sensor that I call TWIS for tangible wireless IMUs. IMU meaning inertial measurement unit. The idea is to measure either object motion or your own motion or your cat or your mice motion. But it's the sensor itself that is moving to measure its own motion. I feel like there's something interesting if you want to play with motion of things. But to explain how we came up to this idea that I'm going to show a little afterward, this is basically what my startup in France does. We make these big multi-touch screens that also can be used to control music, but not only. In this case we have objects that are recognized by the table and they have all a unique identifier and they all can control a different filter, effect, volume or just on-off for a track by rotating them because we also measure the orientation of it. So you might be familiar with the reactable. This is an open source equivalent. So that's my lab in Paris. This guy is the guy who invented that open source. He developed that open source version and we just kidnapped him to have that thing with us. So we have that in Python now, but it's originally in C sharp I think. So we've got this frustration of the two-dimensional aspect of the table. You cannot interact when you take the object outside. So we thought let's just play with the common thing that you would use like an Arduino motion sensor and a wireless module. The problem is that the antenna is not really happy with metal in front of it. The magnetic sensor doesn't like metal also. So we had these interferences problem and it was too big and we made a smaller one. So I actually have it in my pocket if you want to maybe pass it. So I can do a quick demo with my phone and show you in video also. I have a problem with the Bluetooth in my computer right now, but I have a Python app that does the same in the computer normally, but it actually crashes in my computer right now. This is still a prototype. All of it is open source, the hardware, the firmware and the software. So if you are interested in measuring the orientation of things or how it's moving, it's actually sending the accelerometer data for the three-dimension of it and the orientation of the object itself. So you have the north and south but you can also rotate and the idea is to forward it using the protocol called OSC. So you can control visualization, motors, sound, flames. That's what I want to do, my little fantasy and maybe parent something. So that's a little demo we did with one of our big tables. So it's just controlling a 3D model of a clock, of a watch. So just the rotation, how you tilt it. And I went to this hackathon in San Francisco with friends from CIFTO. We did a little musical controller just as a proof of concept in 24 hours. The idea is that there's this analogy between sound and color, hot sound, hot color that can be used to maybe teach kids the simplest way of understanding music. So we have this kind of musical writing system. So each color is virtually a sound and you have a feedback on the object itself. So inside of the object, you have inside of the egg, you have this sensor that I was showing you and that's what happens. Simple and stupid, we didn't sleep much but that was really good. So we won the hackathon and we'll see what's the next step. So thank you for listening. If you're interested in any of the project I made and want to play with it, you go on my www.honet.eu, my website. The slides are here. It's good. We can put it online. Let's do it.