 Okay, sorry to be late. It's a new computer that Tried to make Work in these last days and it took me a bit of time exactly yesterday I will talk about Actually some Work I've do I've done this last 10 years That involved Blender game engine and blender in general for quite a lot So It's such a present to me a bit my my name is Olivier Monnier I'm also known on the internet by the nickname of Olme I am a new media artist. It means also called our numeric in the French part of the world and Which means that I actually I mix a lot of different Media and a lot of different hard techniques through digital mediums computers, but also microcontrollers and source video projection video feed sound Wi-Fi links and Networks in general and I mix a lot of all these techniques together in a lot of different Projects each time it's different. There is a Lot of excitement in that field because in that way exactly each project has a lot of New Fiddling to do so I Can be also seen and so some sort of artist hacker and With us others we have founded the Association in Belgium, which is called flat for free liberal art and technology and Where we talk about we we made some workshop we develop we Made some education about the techniques we use and the project we make we Help other artists to do their works also And It's in the name. We use it. We do it only with a free Libre or with a big Mind to word free Libre software and culture Why I will talk about it a bit later So here are the project we will talk about today. So the first is 10 years a bit more than 10 years ago and It's a path where we will come come to the The last project I'm presenting today and you will see there is a Link between all these these works So and I tell our world it's actually the first Big project I had Founded by public funds it It involved actually the idea of having the control of an avatar in the world in a virtual world But in a space with a projection like in a cave that you use in in the laboratory for VR research and car presentations, but in a public space and having Control touchless and without any interface to take cover by the public So you could have a pass on a pass or buy coming into the virtual space and controlling the The avatar without having to take any controller in hand or something like that I use at the time Part of my system use pure data for the video tracking that I use Use a technique with an eye air infrared camera and video infrared video detection and I use in real tournaments for 3d as a 3d engine the problem I had at the time and that actually led to the Abandon of the project or its Partisite was that in the in the in real tournament at the time I could not reroute easily the control for the character and have the The smooths movement I want to to do Also, it was really hard to modify the game File of philosophy or the the the game really Purpose and even for some stupid things like Giving away the harms the virtual arms of the character that you will have in this game engine It was pretty hard to do For simple projects. So and also as it was appropriate a Software it has its own kind of Files and it reveals not to be really easy to port for the future and part to new engine and new possibilities so Comes after yeah, I can have a Small video of it here I'm really sorry for the bet The bad quality of it you but you understand a bit the idea of having the control of the avatar through the The position actually of the the person in front of the of the screen. I will not Have too much time on this Maybe talk about what afterward I did With the blender and Bender game engine So after these problems I had with this product I decided to really look at what was possible with the free software only It was quite a hard time for me because at that time a lot of these Tools were really hard to take over and only actually the blender game engine was Quite easy to to take for a small team and Also super open to to do whatever you want on top of the the basic Functions of it. So the the the next project was a dome projection with 360 degree video interactive video done in 2006 was commissioned by photon records, which was a recording Company for electronic music those so videos and stuff in Brussels was filmed is a Quite big Lady gray ladybug Camera that was combining six cameras in for for this We implemented actually the poor work method to make a dome Which was basically after that Reimplemented by that I into the game engine for a dome projection and the dome projection you have now for the the 3d the 360 Rendering And actually at that time we used the development found we had for the project to find a developer to Integrate the video texture into the game engine It we have to mention also that was specialized with the credit for Nick with an interactive System only with the get the the blender game engine through that was enough to to drive for An area for speakers and specialized Specialized sound Installations so This was me into the dome which is an inflatable dome with a mirror And the projector and I can show you a video of it also a bit sorry about the the quality of that it's for having an idea Was filmed at the time is a bad bad camera, but Was a one-week experiment in an art center It was quite fun also to do this because we had to to hack into a building to get into the Work elevator This was a building in complete renovation. So we took the The side elevator the workers use to to mount to on top of the building and we filmed the Up and down movement of it. So afterward the the users could With a gamepad turn away the view the public had in the space The sound I have on this video is created really bad, but as I don't have much time So after that Went to the Project I do I made with another Organization in in Brussels named ok no the idea was to film Some video cameras on time-lapse matter in different spaces and to and bring them together into into Virtual space where actually the time could be deconstructed So it gives Some kind of a cave a cheap one with three projectors and You can visit a summer a Really interesting place like that with Just your position and into the the space Which is a bit better in that case so That time actually the problem for me was really to pass my complete work Tools in a free software manner Because I had also a different work with the commercial clients and and stuff and I used other tools that I won't name at the time that permitted to make 3d models and Scenes and salaries on the internet and From one day to the other the companies at the time decided that these modules that everybody had on this computer could not be Published any more used or by and they closed the the forums about of the developers that use these tools and they closed Basically complete market of Some interesting things that were happening in the internet at that time and I was actually using it for clients to make like interactive visualizations and I also was kind of pissed off by this and decided really not to use any proprietary software anymore because in this in a really Different ways it's completely blocking me for the future and having this kind of Contract on me is not possible because it would means that I could put myself out of the game for a long time after having worked on the technology for So this one this System this presentation or in solution was filming camera video camera on remote places Stitches together in the video texture actually was part of the of the development was contributing to the Blender code and put in in the Blender trunk by the novel Z that was paid by the the project and We use also pure data to Make the the video capture of the movement of the people These are the images of The project that looks like at the time Here is another project that is not so Interactive or actually it's less visible that you interact with it, but it's a it's a video mapping of a Small hut That looks like have been made in a garden of people re reusing Planks and pieces of Houses to make their garden the idea was to have an installation about permaculture and the new way we could rethink about the Landscape and the reuse of objects and the the relation to hurt and to to the agriculture It was made as an immersive display of different Places all the different part of the image are also video time-lapse taking from different Garden of permaculture and are actually Interactive for some of them the one on the on the hut is interactive because there is a Kinect camera that tracked the position of the viewer on top of And that gives the impression of some kind of transparency of reflection into the in the windows of The of this hut And inside of it you have also some video of the ground living and not as a Dead ground like in the big fields we have today where the The landscape is dead because of too much chemicals the idea is that the hurt is a living place and So everything is done with a blender Game engine actually is one computer with her which has three video outputs on the big projector on the space and Which is mapping in real time the the whole space With two two instance of blender and That are everything is also Was a bit tricky to set up because the computers was supposed to start up with the electricity on the morning and shut down by the electricity at the evening and so for the one year this computer was just started and and stopped like that like a light and But everything worked at the end Was unattended for more than a year and work perfectly Where I was okay, so Yes, it was done this little bit of the the the facts behind that down on the boom twos the light and Bono about say I don't know if he's here. It's there That helped to fix the parrots view on the viewport We use us Coletan and pie OSC Also with art and Bunkers key that I fell into Mario may we work together on the Artist a blender artist forum to fix that the Oh, I see this is so the this Protocol of communication between application that you can use it's a normally used for sound But it's really interesting and it's used by By pure data and here we fixed it for for For a blender to to control the Kinect and lunch is It's a small the Python software too, which is served as a watchdog for Like orchestrating all your application together and be sure that when something is starting the other one has started to and not the reverse And it was also filmed with free software actually we use Webcams attached on at that time a Big good board So it's like the Raspberry Pi, but a few years back That we placed in the gardens and that's filmed automatically for you for days Here's the the great acknowledgments and then now The Last part where I can explain a bit the system I came out about From this to the VR World so you have seen this Installation with a big screen where you are in the front of it and basically I was thinking about just taking these installation and put it them into VR Headset and it appears that really it works super well, and it's reduced motion sickness compared to for example With a joystick or with other kind of Root navigation system it has It happens to leave you some kind of freedom of moon of movement like a room-sized movement but interestingly also is giving you always the the invite to the envy to go just straight ahead and not turning around and not Make you were making you entangled by your cables What you see often It's also very natural way to to manage your your movement in your into a virtual world. I can I have made demonstrations and people just like in a few seconds really Understand the system are and are happy with it even with kids actually It's also probably simple to implement with any possible system to see I Have implemented it in blender in a very simple way because I'm I'm more an artist and or and the hackers who I combine things well together But I'm not really Developer that go deep into the code and that can really debug things Really deep. So I just used to blender game engine Which is kind of simple also to to work with that has this Python implementation and That permit to have me all things together So I've developed it with the blender game engine, but it's probably possible and we will do it with order systems like web VR and I don't know So here it is the simple system actually is that you take your position in the space in in income in Like in a part from a reference point that you take it in the beginning and then from that the idea is simply that if you go forward you you will make your your world going forward like you are on the on the platform that will move with you and Turning your head will make your platform turning slightly less fast than you To work this position and basically what is going to do is to Make you feel like you have some kind of a body Into the space which is a bit more slow than yourself, but It's not a problem. It's something that you are accommoding really fast And what is permitting is that basically it makes the virtual world where you have a movement and the real world here Where basically you don't have a movement. You are just in front of your computer You can't you don't want to bump on to onto it or in the wall so you make big between the two physics also and the body I've made some research also look at the papers and Research into the university before and basically you you find that the body is also I Can do that when you go to you know in a boat when you go in a train There is also this system that permits you not to be sick into this places so video That's the paper so a fast three recaps of these and then Small demonstration with me in front of the In front of the stream where you see what I'm I'm seeing and Aside you can see video a reference camera that is linked to the space like it is in the reality So that there I'm just Recording the reference place and then now I can play so it's basically a really simple system here that is that has no like weights or Like tweenings in Any of the direction or forces applied? It's really it's really direct and Linear, but there's a lot of things you can add on top of that having like jumping is for adding actions so you can have Acceleration and you can have also some way to Enable or disable the the movement In a software way and stuff like that, but it's just a basic system And here is the application into two new project that I'm working on one which is in with an artist Sound artists working both by doing electronic music and digging but also working a lot for theaters and with That would have been cool with sound but The video will be published on the web. It's not so much a problem because this is really an infancy the idea is to have a Synesthetic world where the world is reacting to the music but also Creating part of the music by the physics and the reaction of the Object and your action into it so you can visit it into VR But the idea is also that it's a concert so we can do it in live with Ourself in a room playing the parameters sending Audio streams and playing with an audience, which is this dispersed and Also, we can use the same The same session to make dome projection with the public and have so a live session with the public and a VR audience at a distance So here this is a busy a basic Test we made with sound which is driving the animation of some object which are itself also Subjective physics and so it's make them quite alive And I'm visiting the space here. So just using my position in the place And here it's another project. I have with a friend, which is a painter a really good painter And where I'm Building some kind of a weird A weird place or where the apartment where a house Where his paintings are presented into Different ways that I not possible in a reality So this is a really more classical walkthrough Situation Where the paintings are put in scene so this is also something that I presented into Gallery where the the painting were presented into into the same place And so visitors of the of the gallery were invited to try and to visit this extension to the real gallery and They were quite Quite amazed by it. I think and they were Also quite at ease with the system and some people that were Also that I invited because I knew they know about this kind of VR Movement we see now and the technology They have tried a lot and they came and tried this and said it was really Appealing as a way to to visit some places so Yeah, that's the ending credits And so this is a system I think is possible to use by a lot of people I am Actually releasing of the paper explaining the the system Probably today or tomorrow. I just didn't have the time And Probably a demo also for Blender I would like also to Is if it's possible to present you with the demo a bit upstairs one of these time just after I have to say again that Free software could be a bit more spread and that these video drivers Could be I'd be more easy to To work with because I love a lot a lot of time With that and Yes, I hope you can you can see it today, but thank you and If there is any question What was used to actually track the person and the square? Okay, so we can discuss What is used actually is the tracker from the Oculus? Basically, that's the interest of it is that any Helmet that has a position tracker can use this This system so it's the Infrared camera that put that get the position of them of the headset it can work so so actually you a try Before the DK2 was out I use the the DK1 with a Kinect to Associate the position of the skeleton where the hat should be in the in the game and it works pretty well Actually, it was a bit aware because the the Kinect is working at 200 milliseconds. So Delay is what a bit wobbly in but it worked But yes I'm hoping the I'm developing also with the OS VR SDK So the open source VR Headset, but there is still no Working, I think there is probably some some bits were missing but The tracking for the camera is still not working correctly in Linux, but it's still it works from Windows and should be usable to Probably adaptable with any for the Vive for the Even Yeah the Sony one any anyone which has a position tracker can or even using any Professional tracking system or or the Kinect or they can combine Okay, any more question no Thank you very much