 Definitely better than it's been the last few days. Although we are dropping a video tomorrow on Price Watch. So that's our monthly video where we talk about like we track the prices of the four different largest retailers in the country. And then we take a look at certain CPU and GPU models. But before we get into that, let me just do the ad real quick. So waka na ba sa un-activated windows mo? Well, lucky you! Pinakabago mo la sa cilicyoffice.com. Windows 10 and Windows 11 activation codes. Legit, safe, and pinakamura. Madalilo mo order. Hanapin ang windows version mo gusto mo. Piliin ang preferred pay pen friend mo. Wala pang 5 minutes na ciligit na na para sa windows mo. Maraming na kaming na tulungan. Date? 7th Deport ako? But now, I'm from a log of my life. Date? Igmresan walang purchase ang life ko. But now, I'm a world-class Zuba instructor. So web developer ako and content creator for a YouTube channel. And ngayon, ganun pa rin ako pero activated na yung windows ko. Kaya ako naghanap ka ng legit, mura, at original software. Check out cdkoffer.com. Check out cdkoffer.com. Check out cdkoffer.com. Alright, unfortunately, just as the ad was ending, made dumating na payment confirmation, so let me just confirm the payment of the B550 AORUS PRO AX Wi-Fi. Alright. What's up, Erbu? I already don't know how to pronounce this. I won't see your name but it's like Erubu Sparkay. Although in my mind, parang I just short cut it to Erubu. So hello. So as the title of the, so parang background. Saan ba tong galing tong stream na to? Well, una kasi may utang pa tayo isa pang stream for our sponsor. And here at Hardware Sugar where they're a customer of the shop or a customer of the YouTube channel in the sense that you pay us for content we always deliver. So we're always very conscious about the deliverables we have for our primary sponsor. We do still owe them one more livestream. And in the background of this particular stream, I've been playing around with AI running locally on my computer. So it doesn't run, so if you've used chat GPT which is the prevailing or yung parang pinakasikat na AI model currently that runs through the internet. So the questions or the kind of chat that you're having with it is being processed on their back end, their server end. So they have like thousands of GPUs or something. But I've started playing around with AI on my running on my computer locally. So it's my GPU that runs through the large language model. And I've been doing it for a video. So I've been researching for a video. But unfortunately, the video would not. So I've shot a little bit of the video yung parang goal ko doon. I'm a big adventure games fan. So we're talking about like Monkey Island, Dream Fandango. They have the tentacle loom. Like if you're super old school loom. They have the tentacle, maniac mansion. So basically the Lucas arts games. Sam and Max hit the road. So it's kind of very irreverent. But di na sila uso ngayon. Like the Secret of Monkey Island games where you have to figure out puzzles. Like there are several items and then you need to interact with the items and the environment in a certain way. South Clark from Facebook. So I grew up playing those kind of games, but they're not so uso anymore. But those are the gooey. So those are the games, the adventure games with the graphic interface. But if you go back a generation behind that, they're the text based adventure games like Zork, the very famous Zork na the opening line is you're standing in an open field and you need to type in like what you want to do. But obviously the interface back then was very primitive and the processing power was very primitive. So the game couldn't really understand you when you did a lot of things like oh jump up and down in front of a window, run through the field. I mean sublimated lang yung mga cues na, maintindihan ng game. So I approached AI thinking that well apparently you can download AI now and it can react to you. So it can be like a text based adventure game where the computer quote-unquote understands what you want to do. So when you're saying that I pull out a gun and shoot the first guy even though that's kind of a not even though that's kind of like an unexpected option magagits ng computer because it is running AI. It is running a large language model. And then well words are just text and depending on the language model that you download it can be NSFW or it can be not safe for work which well to be honest I kind of put that there as clickbait but also to be honest I did run it for research purposes. So the video will be like my difficulties getting it set up because it wasn't easy this isn't ready yet for prime time. It's not like you download it from Epic Games or Steam tapos good to go na siya. I've talked about before how gamers now have it a lot easier than gamers before. You know gamers before if you remember back in the DOS days niya to edit auto-exec bat, edit config.sys why don't I have sound even though my sound blaster ko. We don't appreciate now like having windows and direct X and everything just kind of works together. I mean yes there are still problems but a lot less compared to what it was like back in the day. Anyway so I've been doing research for this video. We were actually supposed to come out with it at the end of the yes Elgin Trouser for research purposes. Syempre gusto mo comprehensive yung experience ko sa AI di ba so may adventure game and may different kind of adventure game. Shout out Nookturnal. I like the pun on that instead of Nookturnal, Nookturnal. So the video actually was supposed to come out this month but marami na kami content like the one that dropped yesterday so the updated top five building mistakes videos Pinoy PC building mistakes for 2023. And so my video on running AI locally on my computer got pushed back but even so but I've shot some of it already and done the research for it like I played around with the language models I want to download them but because the nature of the video parang nasisira yung momentum ng video if I go into detail too much like technically but to be honest like there's a lot of head scratching and hair pulling involved. Hindi siya ganun ka dali to get the AI running. So I thought for this live stream regardless if you want to use it NSFW stuff or just text-based adventure stuff I'll be running through the steps that I took to get a large language model to get AI running on my own computer locally and like how you guys can get into it if you want to experiment a little bit. Soap KC Bolios So it's AI kasi you know we're running the large language models like chat GPT so it's supposed to understand when you chat with it and then some people have tweaked it so that there are characters or adventures involved whether it's like a cyberpunk hacking adventure game or you know the kind of like more mainstream like you enter a brothel and the girls there are trained to service or you know to engage with the needs of the clientele to put a safer work description on it but I mean like damning mga characters like obviously there you can get from anime you can get from games so many people have come up with characters already so I mean for me aside from the not safe of course the not safer work aspect gets everybody's attention but aside from that I'm just really like super interested in the creativity of people to come up with these kind of text based to come up with these adventure games and they tweak the language model to kind of funnel the character you the player along on a particular journey on a particular theme Soap Mark Lester Navarro So yeah I was explaining so it's um I've been experimenting running AI specifically the large language models locally on the computer on my local computer and you can use it for safer work games like text based adventure games but you can also use it for NSFW not safer work games where the characters you can't take the characters you don't need to but you can't take the characters involved on a you know an explicit kind of romp although for me like part of my research was kind of just try to if you could break the model so you have one character who is prostituting herself but she basically doesn't get value for money so para siya just charge her clients basically should take any money that the clients offer her so one of my first opening gambits in the chat was like you know you're doing it all wrong charge higher based on the act that the customer wants you to do and then she was like oh okay yes that's that makes sense so I'm like hmm is this going to be like a pimp simulator have I suddenly just diverted the model away from like this character that is very naive into someone who's like okay let's make this a business simulator where the business just happens to be you know massage plus I don't know for lack of a better description so part of my research is just trying to break the model a little bit because there are characters already involved and I wanted to see like can I break the character can I kind of push them nudge them away from the past that they've already been or the past that they're supposed to take based on the adventure laid out already na sub archie sub itx adic ah yes and I do agree with the Emmanuel I do agree with the quote from avenue q the internet is more porn sub geyser liya magaye so yes there is a not say firmer component but I was just really interested in so you can try out chat gpt it's free it's actually supposed to be quite amazing but I wanted to see like you know the creativity I mean that's always the way computer works right you have like a centralized thing where only a limited number of people have access to it but it's really when it becomes democratized that anybody can access it that suddenly like oh that's when things become interesting just like with an app store you know the first apple the first iphone steve jobs was like hell no are we going to open up the apple store it was only supposed to be for apple created applications or programs but they needed to get people interested in the ecosystem that's when they opened it up and that's really when apple got the ball rolling with these apps when they opened the app store to anybody well anybody within reason right so actually that was my interest in trying out running llm's large language models ai that's the type of ai that's also now on my computer and I thought you know I have a 3080 siguro kaya naman but I'll get into the technicals a little bit but long story short medyo hirap yung 3080 ko to be honest and yeah I mean it's kind of like a silly I mean the internet is for porn but you'd be surprised like how a lot of technology pushed a little bit or is advanced a little bit because of our basic human desires and you know I mean we're all adults hopefully on the stream so I don't feel the need to apologize for not safer work desires I mean that is part of life guys especially if you're on the internet and especially if you're into tech I mean there's always been a wide intersection of those two things so I'm gonna have like I think my voice is a little better not the best but it's still kind of gravely but I did shoot a price watch episode which you're gonna it'll drop tomorrow although it's already available for members that one my voice is even worse and then if you heard my podcast for the one that dropped yesterday on YouTube but actually recorded that last week yung talaga grave voices ko not so bad naman Mark Lester kaya nang 3080 ko actually it's not even using the GPU that efficiently it's like only a 38% usage pero sobrang task ng power usage and like my entire system things bog down when it's trying to process like how it should answer my chat so just typing things in word it slows down YouTube videos kind of stutter a little bit it's really taking up a lot of resources even though I think it's inefficient because the GPU usage is only around 38% so I think it's like Jedi survivor na it's not really optimized sup moniker I know right 3pm I can't because sometimes I would stream late at night but like now with my daughter with my two young children my daughter and my son I'm just so tired now so like call it a day I can't watch TV shows I can't even play properly anymore but yes so we did owe we did owe di siya CPU kasi sobrang baba no CPU usage I feel ko na it's just super inefficient because these are all basically cobbled together also by by amateurs or by like people are just also interested so everything I talk about here is just ko na cobbled together from from different developers who aren't really might not be that proficient there's a lot of Python involved though so just so that if anybody who is interested and actually that's my primary purpose for this stream if anybody's interested you won't be able to kasi it to see in my video that will drop probably next week like how actually installed everything so this is the purpose of the stream and so we're at 16 16 minutes 38 seconds just note that down so I can pin it later alright so I'm gonna so this is these are the basic steps that I took first you need a large language model probably download that but I'll start out with you need something that will run the large language model so this is what I started with so I'll start with that either you download uubabuga and again I must emphasize the very the very it's still very early days for the community so like a lot of yeah that's the same at the hell whatever right but one of the more popular ways to run an LLM is to run uubabuga so you can download that you run it you install it but caveat I just couldn't get it to work on my computer I followed a video on the internet which recommended uubabuga and I thought well since nerecommendaman o video nato that unfortunately the video wasn't clear and you can even tell where he jumps from installing like he's talking about one program that suddenly he transferred he jumps the next screenshot is tavern so hindi talaga siya ganun ka ganda as an installation guide but I did download uubabuga but I couldn't get it to work and dami mga errors like literally I spent hours on reddit on editing scripts it's like a python script and everything but I just couldn't get a darn thing to work so I researched another way to run LLMs is cobald AI cobald AI download it you run you execute installer it was the same thing at first with ubabuga I couldn't get it to work like it will install but it wouldn't load the LLM properly but after a while after again troubleshooting I was able to get it to work so that's now how I run the AI so download cobald AI would be my recommendation and then you go to huggingface.co where you actually download the LLMs and you need to take note that there are a lot of different large language models available and they're suited to different things basically what sets the different models apart are the language sets that they were trained on what they learned it's a little bit like what schools they went to so if you want not safer work a sikat na and again you'll have different results you can have the same characters but depending on the AI that powers the experience that's actually the LLM that you're running the experience can be different so if you don't need not safer work you can download different LLMs specifically suited for the different kind of adventures that you want to go on if you don't want to get too complicated you can actually just have one model so you can have, if you want to also dabble with the not safer work once you can use the not safer work LLM also in your other adventure games di naman sa necessarily magiging not safer work kagal and that's what I did because to be honest I didn't want to download another LLM anymore so for not safer work actually they recommend Pygmalion I think it's at version 13 something now but the one I'm running is 6B Pygmalion 6B so that's I downloaded Kobold AI and I downloaded Pygmalion 6B I finally got Kobold AI to run the Pygmalion 6B first I was having problems with Kobold AI I had to edit some stuff it was a little scary for first time user so again this is more for advanced users that don't mind thinkering I don't know what it is with my computer I just wouldn't run Ubabuga and then and then I had to wait I had to fix it for Ubabuga I just couldn't fix it then I had to fix it for Kobold I finally got it to run but the last problem I had with Kobold was my fault you specified the folder where the large language model is this is where I put Pygmalion look I told Kobold AI look in this folder then it's going to ask you how many GPU cores to run or something because ako may abang ako inisip ko actually it's not how many GPU cores but like how many gigabytes of memory you want to use and so I was like I have a 38th okay so you can just take like so I thought it was more like a cache thing you want to tell it to take up 3 fourths of the GPU memory since I'm not running anything parallel with it I'm not running a game alongside of it or anything yung problema it can only go up to 12 and again I don't know it took me so long to figure out basically just accept the default settings so long story short for where we are now download Kobold AI if you want through huggingface.co if you want not-safe for work I do recommend Pygmalion it knows things yeah it'll scratch that itch if you're looking for not-safe for work download the latest version of Pygmalion ah sorry shout out to the guys who understand why it's called Pygmalion because I was a former professor I just can't help myself Pygmalion comes from the old mythology of the guy who constructed a doll for himself and he fell in love with it so it's kinda witty because you're running not-safe for work adventures and you're chatting with an AI girl or boy wherever your fancy takes you so there is that Pygmalion aspect where in a way you're creating the kind of partner that you want to take along with you and Pygmalion was also famously the basis for a very popular musical My Fair Lady which was also made into a movie with a very lovely Audrey Hepburn way back when and the latest sort of reincarnation of Pygmalion is the short-lived show it only ran for one season I think 10 years ago or so Selfie updated it for modern times it's like a modern My Fair Lady with with the Asian guy in the remake of the Netflix live reaction remake of Cowboy Bebop he played the primary character what did they call him? Roy? No, not Roy but kinda anyway Harold and Harold and Kumar so that Asian guy Sulu in the Star Trek remakes and then the girl was the very lovely Karen Gillian Doctor Who and of course now of Marvel's Guardians of the Galaxy fame so anyway there's a long history behind the name Pygmalion and if you're looking for a not-safer work LLM I can vouch for the not-safer work aspect of Pygmalion so long story short yes download Kobold AI download Pygmalion point Kobold AI in the direction wherever whichever folder you installed your LLM in now you have it running but you need to load the characters and I think you can run some limited characters in Kobold AI so that there's another program that also runs through the browser that people prefer and that's Tavern AI so once you have those three things doing basically three things we're only at step three download Kobold AI make sure it runs on your computer download LLM download a large language model and then run Kobold AI and then point it at your LLM now download Tavern AI and once you download Tavern AI you point it to the IP address of basically Kobold AI is running as a server and then Tavern AI will connect to that server and then once there actually it's super easy to find characters or adventures either you go to buru.plus or chop.ai so there are lots of characters there even just going there is not safer work already recommend especially buru.plus well even the chop.ai it's already pretty much not safer work so don't do that don't do that at work you can go there and actually the cool what I really found interesting was so people have come up with custom characters and custom adventures you can download them from these two sites that I mentioned and basically they're just PNG files or SVF or basically they're just image files and then sorry my voice is just not 100% yet so parang it's like I can't it's like I get a little tickle in the throat if I keep talking for a long time but already embedded in those image files are the metadata that you need to run the adventure or the character so sobrang galing the LLM is a little large I mean not like warzone large but it's a large language model it is large so I didn't want to download another one after Pygmalion because I'm like oh it's like more space pa parang ganyan wait lang John Chu thanks Erobu yeah so the everything that you need to run the adventure or the character it's already embedded in that image file and it's like 300kb or something so yeah that for me that was pretty exciting like wow okay that's all I need so tavern at first wasn't loading the characters again I had some trouble but finally I found the proper kind of file format that it needed and then you load it in tavern, you just straight forward the user interface you just load the character and then you start interacting with it or the scenario through the through the AI through the chat window of tavern AI so I did a I did a star trek adventure basically I've done a cyberpunk kind of cyberpunk kind of hacking kind of adventure and I had two not safer work characters one was yun nga parang yung go to like a brosel type and the ladies there are supposed to be professionals in meeting whatever needs you have and the other one was actually a Ray Ayanami character so Ray from Evangelion and it's the typical Ray that you know from the show na she's very quiet and she's very passive and things like that although as you run the adventure or as you run the character parang you can draw her out so I mean that was kind of interesting just from at a certain point I was like computer learning from me like I spend more time with it so parang the model becomes less shy because she's supposed to be shy at first but then yun nga as you go on parang she interacts with you more and I don't know and that's kind of like the freaky thing about AI right I mean it's not sentient it's not aware it doesn't understand but at the same time sometimes you kind of wonder like parang sobrang on point kasi na mga responses before I share a little bit like on yun nga the experience I had with the AI getting coffee getting excited not safe for work even with my 3080 medya mabagal yung response time so like I would I would type something out and it's not instantaneous so definitely for the not safe for work kind of peeps this is very delayed delayed gratification it's a very much a long burn kind of thing plus this is all text so you gotta use your mind guys it's all in your imagination a little bit yun nga the technology is not there but I can imagine if it just becomes a little bit more efficient within 30 seconds man lang yung reply sa yun and then you connect stable diffusion to it stable diffusion is another AI thing where you can describe to it a scenario and then it will come up with an image or a video so I was just thinking about like the possibilities na right now the technology is slow if you're running it locally slow to respond to you sometimes it won't understand you sometimes kasi yun nga I was I like to read a lot I'm a former literature teacher so yun nga some of my responses sometimes are very descriptive and so magigive up na lang yung AI sa akin para it's like it returns a null response kasi what's interesting is you can actually see the both cobalt AI and tavern AI run in text so it's running in a windowed yung para command line structure but you still interact with it through the GUI of the web browser but you can see it running in the windowed the the CMD interface and then you can actually refer to the CMD interface for like longer descriptions para what the model was thinking about no now the hiccups so oh man wait sorry I have the hiccups alright we're just gonna have to power through because actually I do have sure far away I'm getting rid of hiccups but it takes a little time alright well right back is everybody at the shop now? I think I still have the hiccups oh yes definitely usually my thing works but I need more time to usually I have a sure far technique to get rid of hiccups but it takes more time so I was saying right now the technology is not yet ready for prime time super difficult to install time to run but I can just imagine 2-3 years down the line like you have these the actual adventure thing actually works quite well it can really kind of react to what you want like it can really react to how you like what kind of adventure you want to have so if they kind of streamline that technology and then you add stable diffusion run which can run which can create images or videos based on a prompt man that would be that would be something you want alright so actually I would go on longer but I don't think my hiccups will permit me anymore I think that's my voice my voice is way of saying take a rest but people have brought up Westworld in the chat I mean that's really it right at what we made them to be our playthings but then they become sentient and I'm kind of sad now that series ended because they didn't really get to finish it medyo bitinyo ending although after season 1 I felt like they were kind of not sure where they wanted to go anymore but season 1 definitely what a ride I don't have energy for game night anymore sa bitoy turuan kita pa na mo gano not safer work AI it's kind of creepy so long story short I mean it is very you'll be hitting your head for people who like to tinker and who like to try to figure out why the heck is this thing not running when you do get it to run sometimes the results are subpar but sometimes so there was a security camera in the cyber pang adventure I was talking about I was like there was a security cam there and I don't think I was supposed to hack it I thought I was supposed to just walk out but I was trying to break the model I was like I hacked the security camera and then the adventure proceeded it's like okay you hacked the security camera this is what happened although I mentioned earlier I'm kind of wordy so much so sometimes the AI doesn't know what to do with me parang dami-dami ko sinasabi sa kanya and afterwards it just returns another response which I can see in the command line interface it's like I don't know what to do with you reset na lang tayo you may tell me something else because when I tried to get too wordy and at like one time in another same in the cyber pang adventure like a man suddenly stepped out of the shadows and he's threatening me and my assistant and my assistant has a gun and then the man in the shadow shot at us he missed and in my text description I said my assistant shot the man but purposely only like to hit his gun so my thing was like to try to disable him so that we could question him later on but the AI took that and made my assistant's character just shoot the hell out of that guy so there is kind of like still a mismatch between like how you try to interact with the adventure versus how it actually plays out with how the AI understands you but yeah there are some moments where you're like okay this is unexpected but cool unexpected I mentioned like one of the not-safer work characters basically she was getting paid but she wasn't she wasn't maximizing her potential properly so me as me the character typed out that you know you're doing it wrong you should charge more depending on the service that you provide and then she's like oh yeah it became like a business simulation or in one of the other not-safer work characters ito talaga specifically there were some pure interest involved but I was generally like why are all the staff now like all my staff are tuning in now to the livestream where I talk about like how to run not-safer work stuff when they're all at work so one not-safer work character that I experienced yes and there's some pure interest involved but I also wanted to see so this particular character now is that you're at a brothel and then you're specifically just talking to one of the ladies there but then I typed in so do you like three sums and I really thought that would break the model because now the character the computer not only has to make up dialogue for the primary lady that I was talking to but if you introduce a three sum another character but then the computer was like hell yes I like a three sum and I'm like well then let's go right who doesn't like a three sum and so the computer introduced another character another lady and it was able to juggle the the conversations like distinct sila so like the new lady would be like so I hear my friend my friend asked for backup parang ganyan so it was just kind of interesting to see the AI like how far how far you could push the the AI in the scenarios that it wanted to run versus the kind of scenario that you had in your mind so that is pretty much it yeah this is something I couldn't I thought it would be too long if I mentioned it in the video proper but just from a technical standpoint super fascinating that you can actually run locally now these large language models which are basically fueling the AI renaissance like everybody wants to jump on the AI bandwagon now the technology is not yet ready for prime time pero it is interesting to play around with I saw one comment earlier na but what's the practical value of all of this non at the moment but if you get in on it early and you kind of understand actually for me I wish I stay around stuff without any hope of practical value that's how I got into computers mostly to play games not like oh I need to know this to earn a living or something I'm just naturally curious and like the GPUs that run AI now because the kind of processing that AI need very apt for the kind of processing that GPUs do and GPUs are born out of people who just want it to play games so you never know where this kind of experimentation will take you right now what's the practical considerate like practical benefits of doing this not much but I think even now you could probably customize an AI to be like a sort of personal assistant but tailor to your needs admittedly that's like a long-term project like you would want maybe a faster server more tailored to your personality like it understands what you want but I can totally see that happening and you never know where this kind of experimentation will take you Jeff Suga generally for GPUs MSI is okay no problems with the 36 TTI model in particular we have a video where we talk about like we bought 300 plus GPUs from this brand and ilang beses kinelangan APA RMA the MSI brand came out quite good so for GPUs so no worries on that front so that is my last livestream for this month please do check out our video which dropped yesterday the top pinoy building mistakes PC building mistakes at 2023 updated by our staff lots of good scenes there so well worth checking out tomorrow will be price watch our episode of price watch drops Monday Tuesday we have shorts coming out and on Wednesday we have a video from Rocky my brother Friday will be pwede magtanong because it's the first Friday and then on Saturday we will have our ASUS 4070 review and maybe on Monday next next Monday we'll have the video where I talk about AI and where I tried it out and things like that yes pwede magtanong on June 2 which is Friday yun so sorry for I actually took out some screenshots but maybe I will post them nalang I'll just use them in the video yun so thanks so much for joining me this mid weekend stream do check out the video we released yesterday very very good video thanks for watching guys stay safe I'm going to heal up some more I think I need more water practical value depression cured I will say the responses were pretty interesting but also it tickled my fancy in lots of different ways the technical aspect the kind of naughty nature of the NSFW content and yun nga I'm a super big fan of adventure games so ask your viewers like how the technology would go for that thanks so much guys stay safe have a good weekend oh yes and don't forget to check out also our podcast is super interesting actually our first news bit which we tackled in yesterday's podcast was an e-sports empire built on alleged tax fraud not yet on youtube it'll be up on youtube next friday pa but it's already up on spotify apple podcast and google podcast thanks for watching guys