 You don't have to bear with me for a sec and it takes a couple of things Before we can begin So this live stream See if I can hear okay That's still working. Yeah, sorry my OBS at all a mixed up. Yeah, I can hear myself. That's a good sign just going to Live stream Check myself through here for a sec Betrayed is lower than recommended but why this thing? Shit, I don't know why it's coming up. Yeah, the chat is working. Okay, so I'm Obviously locked in fine. Oh, what's up with that? Yeah, it's a new OBS It doesn't work well, well not for me at least let's see what's what serve that so we back on by chaos side we had that tool From prior need a few improvements one for example if the If this file was already selected, we don't need to regenerate. So we could do that a We by the way was And nothing works as expected. They changed quite a lot of Interface and everything Just doing this Tool for the report my computer as well. Yeah, we're doing this be it right, of course could not capture the camera because OBS is hogging onto it. I Suspect yeah, I need my mobile to check The last stream is well So I didn't know what's coming coming out It's actually no screen why? Okay, this might be a beginning of a very bad stream There's about what five six seven nine ten Delay there's some long delay So I apologize if I'm not responding straight away Not work because the camera is getting hooked Hooked up. We have two cameras connected. Could not Care capture But do yes, it is number two Yeah, we have this funny Avatar over here Yes Let's take the pop in the other share Out of there. Oh, this is actually working through Python itself. So I would not be able to do any other Development just not would cause That's what we are here for Let's see. Yes, this video capture. Let's taking my Features from my face and translating it into that the into this avatar. So It's working Okay. Yeah, the eyes are weird. I did ask to add a hands fingers A lower lip is missing It's cool. I think it's called lip a outer Outer is missing. Yeah, let's do it. Let's do one more iteration on it and we move on Generate the whole code for me. There's some sort of era Meaning oh, yes, just give me a sec. Hey, we can place And It's called screen. What is it called capture pipe one name it later? Yeah face lin mark share Okay, we can pop it Yeah, we can pop it in there as well and right Put this Green capture top. Yeah, this is okay I Was out for now and the other thing is oh ideal way. Yeah, that's when we started having trouble with OBS barely gt4 a increased Dead Number of prompts you can be sending within a certain period of time Even a certain time window, so we can test it out See when the dead times out cases of it actually a Working pretty well copy of it Because it's now making another one for us. It looks way too short currently we Up to 85 lines of code. Yeah, way too short dial-like representation To run the code copy it into a Python file and execute it in an environment where media pipe is installed And you have access to a webcam Right, it will have to be The second camera let's try it out and fortunately I have to get rid of that Again, but that doesn't have Right as the hands Has a mesh The avatar is missing Where is the avatar? The avatar boy, are you suggesting this could be the avatar? It's not a bad avatar It's hands giant hands. Well, they just close it to the camera and see what says the avatar Representation requires additional work to draw the simplified facial features and hands on to the avatar frame Here is a revised version of the code that includes drawing basic shapes for the eyes eyebrows nose and mouth as well as the hand landmarks I just leave this one for now Yeah, they have a problem with this And it's running in my Python so I wouldn't be able to run anything else The avatar representation requires additional work to draw the simplified facial features and hands on to the avatar frame Here is a revised version of the code that includes drawing basic shapes for the eyes eyebrows nose and mouth as well as the hand landmarks Yeah, it's missing all these things This script only outlines where and how to draw the facial features and hands You would need to add the specific logic for extracting the landmarks and drawing the features like eyes, mouth, nose and eyebrows using methods like cv2 Circle for eyes and cv2, polylines for mouth and eyebrows The code to do this is non-trivial and requires a good understanding of the facial landmark indices Um Okay, should we keep the rest? To keep this example concise the code for drawing each facial feature is not included You will need to reference the media pipe face mesh landmark map to find the correct indices for each facial feature And add the drawing logic accordingly It keeps saying that I'll need to reference the Landmark map, but I'm pretty sure it has it to you have access to Pretty sure it does because it's giving me correct. It was giving me correct Landmarks thickness circles It's to have access What I don't have access to the internet didn't they just Yeah, that's not right. Is that uh Didn't Sam outman just did this big Press release I don't have access to the internet or external databases directly including the media pipe face mesh landmark map However, I can guide you on how to find it. It's not good enough first. I'm pretty sure you already have it So I'm not sure why I say you don't have it a second vol should Be able to connect to the internet So I don't know why you're saying you can't connect to the internet Or whatever it is you are saying The landmark map might be available as a diagram image or as a part of the documentation that outlines the indices of each facial landmark It might give it the rest for now Now just one last prompt how to change It's actually right with um co-pilot Plane is good button screen users Yeah, open libraries Initializing media pipe displayed avatar to Change colors thinking To change the color of the hand landmark to green you can modify Cert into the new file. This just inserts it in head cursor This inserting into a new file. So I actually need to And be in the right location Well, I have two of them Out of frame and That's face. This is hand Insert it over there We have actually colors for the A Project that's not running yet. There's a have to rerun the face mesh To green. I guess it's that bit over there still every time We run it green detector Okay Yeah, ideally we just learned how to use a get up co-pilot So we don't have to use change of t4 at all landmark connection Let's see. We had a Alice for the project Up to i2 that and hashtag that's only work in CSS It's just taking h SLA is this rgb It's an rgba It's rgba You can use splite because of the background use To us Stop check action drawing And to be that yellow one of the uh off top that for a sec There's a little crap, but Okay Every need to run it in a separate the How to this We need python 3. Yep. Stop it here in a terminal Close it there That's running What's up with the finger? Can't actually bend my finger that way, but Okay All this is good because now we can actually do something Else Close that So we have those couple of apps that way I still need to get one of them is this Spectrogram eG It's using the same Using the same file Just called Spectrogram It just has that index html Start and in for text It's actually in labio To get rid of labio Yes, we have this description And this index html can go Okay, we have this in ball Do we need to keep that maybe Maybe not And can get rid of it for now Yeah, we won't have the play button And right, let's keep the description to minimum And what else do we need to do? Well, first the ball we could just take Not this one What's the last working app from the noise Yeah, we can copy This one We have the data We need the data Play it's app Close all for sec Find the info text Okay, so instead of this And let's run this quickly just to see That it's running okay Yes, that's what we have in development And essentially what we want to do Is replace the frequency spectrum Spectrogram Frequency spectrum The frequency spectrogram That's right, we have this HHR script and html And the actual Python application Yes, we want to replace We should be doing it It was actually called frequency spectrum That's the second shot Let's see It's called some sort of container The second container Type here anymore Can I replace frequency spectrum with a frequency spectrogram? Might have an option for it But in the Python code More stuff already have SciPy signal, don't we? It creates spectrogram It's not an audio file It is not specific to app Provides close range to the flat complicated tool Yeah, that's the correct file It's not an audio file So we want a function here Using the same file And this is the one Had a function to display g-spectrogram Okay, now it's more specific Do I need to plot show? No, I don't need to show anything in here And show it in the html It's have to be an image It has to be an image To display the spectrum in the web page It's simply converted into the image Yeah, how about blotly? I already didn't use blotly Not sure if copart is actually a reading the files It's giving me some sort of generic stuff So I missed that message actually Missed a lot of messages because I didn't have the OBS My hover screen Ah, now it's actually working Because before I had trouble maximizing it On to my second display Now I can do it It's still not great But so what I want to do is have an option Or to turn this spectrum into a spectrogram Which is a whole different piece I could do a blog about it Try to use githubcook while at for it We have a mixed success show In this spectrogram in this html Instead of the spectrum Yeah, now it's using blotly Spectrogram plot controls All the container Yeah, I can pop it in Yeah, spectrogram plot Plotswrapper Chouser code to generate and display the spectrogram Will depend on the specifics of your github I might need to change the Python First, I don't want it to write JSON file So, yeah, now it's getting more of the context So, actually, I had to tell it to explain the files before it started giving something more relevant Let's go to see if you have a function Get the cheap dial, I'm pretty sure we have it No, we have a function called getDial And just read the code We have access Open dial How it works Sometimes Okay, how do I share it? How do I share? Oh, open Yeah, that's the view I want to finish with me by copying and pasting Into a conversation So, how's it different from just using changeupd then? Don't get it The point of copy pasting Pasting Oops Oh, sorry Yeah, I should be just able to do stuff in here Get data A function Write Aspects Aspects Thinking There's two options Should be Get Was returning 400 Just in case of error We're already doing this And it's not being accessed Yeah, I can just set it in here So it's returned Do we want to replace it or return both of them? I think we ran out of time We'll continue in a bit See you soon