 Hello, thank you Yeah, nice that you're here for my talk. I shouldn't shout so loud. Huh? It's too loud Nice that you're here for my talk for mapping life open-air operas My name is Clemens Rudolph a car a care on trilope. I do 3d art. I do videos I do mapping animation Interactive art all this stuff. We are a are all stuff you can do with blender and with your computer I'm located in rings book. It's a city in the southeast of Germany And a freelancer and out to deduct. I'm a blender user since I think 2.3 I checked to find it out. I checked all the splash screens and like I think This I remember And I'm a blender supporter since elephants dream, so I supported all open movies I have a small rocket from the blender sprint. I think it was called I'm a blender cloud supporter and blender development fund member Yeah, I wanted to talk about mapping Mapping like in general you can say you have a projector and you put it somewhere and a facade on a Building on an object on a car everywhere This is a slide of one of my projects These are stills they're part of animations They normally take from five to eight minutes ten minutes Some are shown just for one night some are shown for three for four weeks every night. It always changed Why do I do I do like mapping? The one thing is I like audience like if you Make a video and just do it for a screen people watch it at home Perhaps in the cinema. Yeah, but you don't get the reaction from the audience I like to have the emotions the reaction from the audience and this I have what's going on Something went wrong with the presentation It's back so Sometimes I like to watch the people watching my my shows to get the emotions the reactions. I really like it The second thing is public space. I like to work in public space. I think We have the public space is much It's too much used for advertisement and stuff like this and traffic and so we need more art in public space So I that's the reason why I like it The other thing is I used to be a street performer 20 years ago I did juggling shows fire show stuff like this I was touring through Germany and France and That also audience and public space. I stopped juggling, but I kept this and I still like it The third point is I like big screens It's really nice if you produce something and you see it very big somewhere in the city It has some disadvantages You have to be very careful with speed like moving things appear totally different on a small screen than if you have 30 40 meters and Rehearsaling or testing is very complicated because projectors are still very expensive to rent and so normally I have one day in advance to test my stuff and I Produce the stuff on the screen and then I see it a day before I run the show on a big building and sometimes It can appear different In 2019 I had the chance Ah, normally it should come up to do my first opera Yeah, it was Tosca. Does anybody know Tosca? Have everyone seen Tosca one person. So no not many opera fans here I wasn't also it was like the second opera I saw or I yeah Haven't seen many opera. So it was totally new to me It's by Jaco Mo Puccini and it's kind of a romantic thriller. So you have love you have bad guy you have police you have murderer and The whole show is about two hours We played it just once in front of three thousand people Two years later. I get the second chance. That's Reingold. It's from Richard Wagner, it's a German guy and it's more like a fantasy story. So you have gods and you have Giants you have magic you have dwarfs and of course you have gold because you have dwarfs The normal duration is about two and a half hours, but we played a version just one and a half hours We played it once it was planned a second show But it was cancelled because of a thunderstorm warning. The thing was the thunderstorm never came But it was too late to do it The audience was a little bit smaller or half because of COVID restrictions So we had to keep distance between the people So it was just half of the audience It was produced by the theater Regensburg. It's a Theater of the city of Regensburg. So it's paid by the city. They do orchestras They do ballet they do a theater and of course operas Normally they play in venues like this But for the operas it was something like this or it was this it's the start Lagerhaus It's a storage room storage house It's not so glamorous, but it's big it's 70 meters long and For the four meters high. So I had my big screen and I was happy What you can't really see here is that it's located in a port So on the left side you have the audience and then on the right side building and in the middle you have the water The distance between the audience and the house is about 80 meters and This makes things not very easy To get a better overview also in pink you have the audience area Which is about 90 200 meters wide in the bright green you have the Audio and video technician tent where I was located also in The bottom you have with the green the orchestra tent because we had a live Symphony orchestra playing and they don't want to play outside because of the instruments They were expensive and the blue one is a stage that stage. It's a little bit overrated It looked like this. So you have train tracks you have gravel you have grass you have uneven surface Opera singers don't like it very much to play in these conditions Especially if it's in the night and you have light and you are blinded Could be a little bit dangerous Well in the first year this are the first show with Tosca. They decided to just play on this platform In the second year, they were a little bit more Let more courage they Also have this big inflated sofa, which was also not very easy to walk on And in the right corner you see a camera guy Because if you're eight is 80 meters away from the audience, you can't really see what the singers are doing So we had two cameras on the stage side and one big camera on the audience side And here you see the small guy in the sofa but Reprojected on the big house so people could see what happens We had four projectors each 30,000 30,000 37,000 Anzi Lumen And two projectors were put in a stack so two projectors produce the same pixel picture This is done to double the Brightness of the picture so two projectors for the left side of the building two projectors on the right side of the building It overlaps about 15% But this there's a soft edge so you it looked like a whole picture So here you have an impression how it looked like on the left and right you see an actor filmed this live camera On the whole building some 3d content and on the bottom some stage light and For a mapping artist, it's not very ideal because you normally you want it very dark and just your projection very bright and This is stage light it reflects to the building so you can't really see The live camera picture covers your picture So you have to deal I had to deal with the sweat situations that I'm not the most important thing on the wall And this was new for me and then you have the cranes in the foreground which also cover parts of the building Here's a picture of the technician 10 so we had two audio technicians one light technician in the bottom right corner as my desk On the right side for me. There's a video camera operator So he gives Instruction to the camera guys what to film and how and what was my job now? Like on-site I was playing the videos in my Mapping software so I had one guy sitting next to me reading the score from the opera that I know where we are in the opera because I'm not I can't read notes musical notes And I to on Q side to press button to play it. I instructed the live camera Operator what character do we need next and how he should film it or his camera guys? And I mixed the live camera content with my content all together to one picture The biggest thing was before like the planning creating of all visual content So I did the concept the ideas and I produced it so it was video recording editing color grading modeling Texturing lightning simulating all the stuff And where's blender now? I Used it in several stages of this production One stage is I had a 3d scan of the building and I did the overall planning and measuring with the 3d scan I Re-projected my image. I created on a low-poly model of the building So I get a better impression how it will look like I even exported it in VR or later on with Reingold I used VR scene inspector and blender to even get a better impression how it will look like I Used it for the planning. This is a video sequence editor of blender. So all color blocks Representate Different content. So you have 3d content. You have live footage live, yeah live video footage pre-produced footage And all these stuff like so I could see are there gaps there I need more like I did the planning with the video editor and blender and Of course, I created the 3d content and blender Here you have an From Reingold. It's a second egg not the first. It's a mistake They live on a mountain top and in my version. They don't live in a mountain top the gods They live in kind of containers from the harbor with trees on and Like tiny houses the house the trees were done with a groove blender add-on. It's a really nice add-on I don't know if he's here the crater. No It's a really nice one Now I give you an impression how it looked like a small video from Tosca The video quality was not so good But it's also not very easy to film projection if it's very bright like with the stage light Photos mostly look better from video mapping if the surroundings a little bit too bright So I had different categories of content because you have to imagine I had to fill up one and a half hours From the opera. It's a one-man show. I had to about 10 to 12 weeks time And so I had to decide where to do what I Decided to have some scenes where more like a background like a normal stage design In Tosca the acts are placed in very dynastic Places like you have a church you have a palazzo and you have the rooftop of a building so this This place is I could design And I also have kind of stage design with the containers you saw they're floating around So I have a little bit of movement, but it's very fast to do and to fill up time And then I've stuff like I call foreground. It's where my animation or my videos are Real in the foreground in the face like you this is the main thing happens on the on the building and this was much more complicated to do And needed much more work the foreground was a mixture between 3d animation and Pre-produced video content and then there was a live camera content on top of all these Here is an example of the church I designed for Tosca It's a static scene, but the light changes so I could easily fill up some time in the first part of the opera the light changes on the things what is getting on in the opera like your fellow scene or romantic scene when the light is more warm and and Yellow and then you have the bad guy come coming then the light is more cool and blue And so several light changes during this part of the opera Yeah foreground what why and when I Told you I'm not an opera expert and opera is a very Special thing they have their own language. They have their own. It's a kind of all a bubble And for me it was not clear in the beginning when do they need support or pictures from me When do they need the singers pictures of the singers? When What what is happening because if you hear an opera you don't understand first you don't understand anything So what's the story and this was a took some while to understand Where to fill stuff and like and then Tosca thinks this area The theater said she should be visible But if always the singers are visible in the interesting parts of the opera I just got the boring stuff or just stage design and this is not so much fun for me so I also wanted some parts of the opera which are the interesting parts and Get an imprint like an Tell in my visual language Thinks what happened in the opera so in this example you see a torture scene and this guy is tortured and it was For me it was really visible and feeling of a tortured guy, but I can show you just still picture Atistic challenges. Yeah, the length of the opera. I told you already The keeps you have same quality above the whole length of one and a half hours I couldn't work like just on one part very Intense and the rest I forget because it's visible if you have one perfect part and the rest is crap You can't do it. I have to compete with the live camera picture And I have to Think in the planning phase already where is the live camera picture and what we're not I have to compete with the stage light. I've compete with the blocking stuff or I have to think about it and Here comes the spread of the audience in I have to take an account because if you sit on the very left and Sing in front of the building gives a different visual shadow if you have Sitting on the far right. So it blocks for different people. So I couldn't put important parts where Visual was blocked And they couldn't tell me before where the cranes are standing exact. So it was a little bit Blind flight and then temple variations Had a version recorded version of the operas, but the conductor doing his own speed every show So I couldn't have one block of video and just press play Sometimes I had during one piece of three four minutes I had four or five cues because it has to be exact on the note that coming this effect And this was not so easy and of course budget is mostly a problem It was here also Just fast some technical challenges projectors came late then there was rain after rehearsals I couldn't check my pictures after the rehearsal next day kind of same happened support was still in operations Or during the rehearsal a train come we had to unplug all the cables. That's the train through plug it again And This Reingold we had no orchestra. It was just a piano version because it was a positive cover test in orchestra Yeah, life stuff can happen always So I want to show you a short video from Reingold and then I'm finished Yeah, thank you for listening if you have any questions. I'm here till day after tomorrow Thank you