 Thank you Welcome So is the volume okay. Am I shouting too much nice perfect? So coming on the stage. I was really stressed I'm used to talking in front of crowds, but this is a completely different set of target audience for me. I'm usually Presenting shows for jugglers, and they're usually very drunk. So whatever you say, it's very okay. All right So I have a tactic for you, you know like the recommendation They tell you if you're gonna talk in front of a crowd and you're like stressed You have to imagine the audience being naked But for the blender community, we can make me fix it like this imagine the audience using Maya Okay, then you will be okay. You will have no stress. So but Why are we here? We are here for this thing which I changed the name of in the last minute Don't do it, please like if you're here the for the automation and AR and geometry notes. This is the right place welcome again We will be talking about this but Specifically in my company. We use blender in our pipeline at every point like here here here here here But Especially I will focus on this part, which I beautifully like depicted on here But the product is basically we take photos and design files of footwear models and turn them into Immersive AR experiences to increase conversion rates blah blah blah make money be happy But before diving into this thing which is kind of technical and geometry notes, you know procedural things I would like to tell you a bit about myself My name is gem which in Turkish actually means group of people coming together So I'm in the right place like the blender. I was born to be a member of the blender community. I know this My educational background goes like I was a mechanical engineer for two years Then I say no way and I step into industrial design And my professional background is like gaming industry for two years Then some product management in the same company because I was harassing the developers too much So the boss has said of it Okay, if you're gonna like keep harassing the developers at least lead the games, you know, I was a product manager Oh, and then now I'm the creative director In this tech startup which will come up Are you hearing the same thing? Okay, somebody's trying to Wow, I turned it. I think this is also okay But can I ask for some technical help? Like this Yeah, is it on Really Wow Okay Then something can go wrong. It will go wrong. You can trust this is the microphone on really Wow Okay, I go back. I don't know why it's like, okay. Thank you. This was the presentation We can all go back home So, where was I? Yeah, I'm blah blah blah. I'm jam blah blah blah before I go into the talk Yeah, my blender history will come up like I've been working with blender for three years now And it's been a blast and I hope you're enjoying the conference so far because I met some crazy people with crazy ideas It's going great for me So some really quick Turkish culture lessons for you We have the saying called the monkey's appetite in Turkish which is used for people who are Indecisive in their enthusiasm pleasure decision often quickly changing like either you or someone You know fits this profile like a kid they go around and play with everything they can I mean, I'm sure you had the same experience when you first started blender like you open it up You do some tutorials then you see something interesting and you go into sculpting you try geometry notes now Or you can be like a 2d guy like the deduce But in Turkey, this is seen as a bad thing like having a monkey's appetite is bad because Turkish people and the Turkish culture Doesn't like change too much. So I was always criticized for having this So the story goes like this This is me thanks to my sister for the drawings by the way I've been like a rock climber for like years Then I still have a workshop in my house doing woodworking projects metalworking. I am a circus monkey also I you might have seen me juggling somewhere around and I did a lot of things and the story usually goes like this And I'm the monkey. Yeah all the time Next one So usually I'm minding my own business maybe like trying to hold my skills in a specific field and then I Feel this a creeping feeling like something is approaching me from the back and I get stressed It's coming and I will give a little Suzanne 3d print as a gift if someone can guess the next slide coming up. What do you think is creeping up behind me? Not Blender think of the monkey's appetite and the new things Nobody nobody was It's a new hobby Every every time I almost swore. Okay Now it's some quick self Shameless self-promotion time. I checked the time. We're good quick shameless self-promotion time You might be asking like why this guy has been telling us his life story Like there is not enough Ted talks already on the internet Well, first I had to feel 20 minutes of a talk which I definitely didn't leave for the last minute Okay, I'm a very organized person and secondly all of these things that I do with my life like Climbing music every little playful thing I find and play with They actually helped me become who I am. This is a tad tall part and they really Add to my being and using blender and how I use blender why I use blender why I am on the stage here today Talking to you, which is a pleasure So let me take you through my journey with blender really quick And then we will dive into the geometry node project for the nerds. I'm also an earth So I started with modeling Like many of you probably I did not do the donut tutorial yet, which is kind of surprising I will do it one day. I like promise Andrew. Sorry and then In the gaming industry, I had to go through a lot of like animation things and I said why not Play damn it. Okay. I like learned my first fk ik things with For unity and stuff like that and some shader work I used to like experiment on blenders shader structure and import them Like transpose them in unity's shader graphs stuff like that So this is to prove a point like I have no idea what I'm doing, but I love doing it and Somehow luckily I landed a job as an animator in this title, which is on steam. You can play it It's like a crazy game Where do I point like you're a dragon and Nazis in major cave. So you go to kill them and Yeah, I know I had a crazy professor who got bored during covid and made this by himself And I just helped him with the animations But all of the animations were made and blender. I learned a lot of nice tools to like work procedurally and Like use animation layers ik's like noise modifiers and stuff like that Which is really fun and lately I have been wait. I have to drink some water night, it's so nice here like intermission break This is the important parts and Lately I've been like fiddling with geometry notes. This was my first geometry notes project like Somebody's gonna ever need a cactus generator But I will be rich if one day we wake up and every cactus 3d model is disappeared from the internet And I will sell my generator and I will be rich and This one was a surprise like last month. I was in a juggling festival that we organize in Turkey. You're all welcome I think the communities should meet There was one guy doing like a commercial for like a t-shirt brand which I shouldn't say the name Yeah, definitely, but he was using some other software not blender and in the middle of the festival I was like curious to see How long would it take to try to do a similar scene with blender and this whole thing which was like the same duration of the guy Maybe took around like two to three hours from like Start to finish with the render and everything. This is easy by the way Okay, now that you know me a little better. I can maybe Now we can move on with the main subject of the talk so art labs is the company I'm the creator directive creative director of We build a lot of AR experiences for e-commerce. We call it AR commerce But we will specifically be talking about our product virtual try-on You yeah, I will wait if you want to take pictures because there are some business people and my business people Would have wanted me to wait So, yeah The the product virtual try-on is basically the thing you see here And we had like two million users in the last quarter. So business is good and AR commerce is being adopted really fast So virtual try-on is basically like taking it to the image in real time. It runs on a 3js Environment it's web-based and we put like place Footwear models on the 2d image so that I don't know vans or Nike or they can sell more shoes to us Conversion rates are important, but there is always a but in technology, right? The challenge is Like if you directly put a shoe like that Wow, okay Put a shoe onto a 2d image. It looks like this which is not believable. It's not realistic So somehow you have to mask the render out each frame and we have something called an occluder for this So what is this occluder? Like it's like a They're basically socks. Okay. We need to put a sock in each 3d Shoe model so we can use this as a shader mask in the 3js structure. So This is the beautiful occluder that it consists of two parts There is the shoe top occluder and the heel occluder the details are not important and but the important part is the shoe top and the heel occluder work together to mask out the render in a way that it renders more realistically and We deal with Hundreds of shoes in a week because like when we make a deal with some retailer They send all of the shoe models at once and we have to like Finish this occluder project and the whole thing whole pipeline, you know, like you need to work really hard and Manually doing this Making the occluder before geometry knows as you can imagine was a pain in the butt Maybe you can guess the next light coming up Not new hobby like try to guess Try to guess like a small Turkish startup with a task like this 250 shoes in a week. What do they do? Come on. Yeah If we keep really quiet, we can hear our AI lead engineers crying while they're sculpting the sphere neatly into place So it fits the shoe perfectly. Of course, this is a joke like not the crying part They we were using our AI engineers like the brain team of the company for this task And it took them around like 10 to 15 minutes because They wanted it to be perfect and I know manual workflow manual workflows, right? so I kind of I was newly hired creative director in the company and they expect me to do like a Social media content some videos animations Showcasing the technology but nothing like geometry notes and stuff like that So I convinced the team to let's like give it a try with geometry notes Maybe we can automate the process blah blah blah They say yes and I jump into the project with the monkey's appetite if you remember like I was like Yeah, I need to play with this. Why not risk it all risk your career with like a yeah But I jumped into it and then I started to get stressed because I had no idea where to start with geometry notes I made a cactus generator up until this point remember and it's not even textured So remember the monkey's appetite. I'm completely lost with the project I know some of the nodes and what they do but I'm nowhere near the technical expertise needed for a project like this So remember the monkey's appetite all those like 5 a.m. YouTube sessions watching manufacturing videos Actually paid off because I was this guy like during my university years I was spending my nights until the morning watching videos like this which seemed like a loss of time at that moment but What do you know like you can actually recreate this blow molding technique With the raycast note and I love the raycast note if the developer who made it possible is here I love you too and the monkey is also in love with this node So let's dive right into the technical stuff I won't show a lot of node structures and stuff But if you're interested in the technical Challenges you can find me later and we can nerd it out together So we need to first Define the opening of the shoe so it's procedural and it works with every kind of shoe right because we get boots We get high heels everything a lot of different shoes exist people So you get the bounding box and like draw a line on the top surface with some dot product Calculation you separate the top surface and make a line that goes right through the middle and then With another raycast operation you just array some rays and then Calculate where might be like a such a big change in the mathematical length difference Okay They're called derivatives guys okay the first and the second derivatives give us like the two red lines Which precisely enough like approximate the opening of the shoe then the rest of it is like a child's play So these are the two points where we think the opening of the shoe might live in Then we will use these two points as our starting point for the okay. I will have to come here Because I forgot to add one slide, but there is a laser so we use these two points and place a cylinder going from the middle point of the two points and the heat position of the Index of the ray that we calculated from we place a cylinder and with another raycast operation Using the surface normals of the cylinder you just blow into the cylinder really fast and it stops where it hits Kind of like you carry the vertices to their hit relative heat positions And while I like you have the blow molding inside blender, which works perfectly for every shoe This is a lie by the way But because this is still work in progress like I started Preparing the presentation the occluder now looks completely different. It's much better Covers a much more variety of shoe models like different category of shoes. This is just another useless gift Yeah, and the shoe top occluder is like even easier after that You just get the two points and extrude some lines lines into planes planes into boxes And the beautiful subdivision modifier in the subdivision nodes in the geometry nodes makes it like a not very hard corner So the mask is smoother And while we have the occluder fully automated and we have the whole thing scripted with Python so right now like we are We are in the middle of a new deal for like 300 choose the guys are probably working still on a Saturday and Let's see some comparison of before and after we integrated geometry like geometry nodes in the pipeline So these stats speak for themselves however, I would like to point out the last item on both lists like This used to this task used to take like 10 to 15 minutes of an AI engineer You know like salary ranges, right? You're quite familiar like think of it five or six AI engineers spending 10 to 15 minutes on each shoe versus No human resource is used. No humans are harmed and it takes three seconds with the import and export included So if you're from a startup you own the company or you work in a company I think just stop whatever you're doing and Ask can this be automated with blender or can the pipeline be like improved using blender or other software? I don't think so like you blender should be enough But just stop what you're doing and ask yourself like if you're getting bored while while working. It's there is probably more fun way to do it. Yeah, and This is my info if you're interested in any of the things not only the occluder project Juggling climbing music. I don't know anything. Just reach me up. Reach me out or up Reach out to me. Yes. Thank you Yeah, and this was it but I want to thank my Loyal companion mr. Tangerine because he helps me with every talk I do and Thanks for the conference for all the healthy fruits and the teas because I was kind of like getting The flu, but I'm I'm like strong as a metal. Thanks everyone for joining me in the talk