 Go live. I think that's instant when I do that. It is. It worked first click I was using stream yard for a little while which I like but stream yard is a Not as easy as this is to switch and I like this switching better. It just feels easier to Go between different screens on things and jump back and forth So, uh, yeah, I'm back to using this but I'm gonna go back to using stream yard sometimes too matter of fact, I should use stream yard combined with this and then I can actually do both at the same time Uh, more setup work, but more things I can do. So welcome to vlog. There's a number 250 we're gonna talk today about some zen orchestra updates and I realized I really uh, I'm catching up and saying no to some of the hardware reviews. I've been asked to do Uh, matter of fact, I just got an email from super micro. They really liked my last review And it's fun, but hardware takes a lot lot longer to review than some of my tutorials. So before I say yes to any more hardware reviews I'm definitely saying yes to more tutorials, which everyone's like, tom When are you going to get to those tutorials about pf sense and way regard and I'm like, yes, I will be getting to those Um, I'm starting that project. I also am delivering some projects for clients other projects. I'm working on So I had to get all those out of the way get that delivered neck. It's delivered, um Tuesday So hey if you're watching client. See you Tuesday. Uh, we'll be out there doing a delivery and setting up all the racks and the servers and things like that I also recorded several videos on Some new, you know, how to build a rack how to do some networking I did those onsite and I really want to take the time to edit them to make them very concise So the filming was already two weeks ago And I'm catching up with the editing side of that And kind of related is I'm also going to be building a new studio soon We decided that it is time that I build a new dedicated studio And we're building it at my house because I have so much extra space. I'm not using it at my house I have a 2000 square foot basement. Well like 20,000 or 2200 square foot basement that has 9 foot ceilings and so we're dedicating a section at to be my studio So I can just do live streams whenever and I want to be able to do live streams um, so I I don't have to like Go home at the end of the day type thing. I'll be home So I can do late night live streams and maybe a few other extra things I want to be able to do uh, because it's kind of a hobby for me jumping on and doing podcasts and Everything else, but also it'll free up my editing time. So I'll have a dedicated area where I just spend that time Creating those longer form narratives and tutorials that are so much harder to do um Everything else I do is so much like broke it up in between to really get it right I need to kind of focus and that's kind of where I'm going with all that But yeah, definitely gonna be fun. I'm watching the people ramp up here I always like to Talk through a few things that are going on before the numbers ramp up for all the people on here because everyone says What I miss and because YouTube's notification system is less than wonderful about telling people even though I tweeted even though I It's posted in my forums. I've done everything I can to notify people But it always takes like 10 minutes in before I see all the numbers go. Hey, look, there's Tom and he's live But nonetheless lots of fun. I see all the people in there So we got kody from mac telecom networks in here. I got lots of other people So let's see. Good afternoon. We got jake. We got will we have All kinds of names I can pronounce stinkle Bullenov. I think I'm saying that right. We got a mic Jake Billy Oliver Lambert There's a guy I like to see we got to do me and Oliver if you don't know Oliver is the head of the xcpng project Over there at vates. They are awesome. They're the ones who bring us the xcpng project. So I'm excited to see um Oliver in here because that is awesome and I think Oliver seen because me and me and uh Wendell from level one techs been conversing a little bit back and forth about xcpng and he is He's like me. He he started with it and he goes this has a lot of features Boy, this has a lot of this thing. This does a lot and so we've been kind of excited About it. I want to do now that we're all the way in eight I realized my last getting started tutorial is an orchestra was all the way back in version uh It would have been in version seven So I need to do an entire version eight tutorial. They've added some really awesome stuff in here The small quality of life improvements when I look back on that old video going wow There's a lot of little things in here that's uh been updated and improved And yeah, I just really like all these features. It's just pretty cool. So I'm really excited to really jump into uh getting into all those different things and how all of that works As a matter of fact, I'm curious now So I have a couple of them here. We got this, uh Del lab Looking at the network settings on it All right, that's eth1 The one in I haven't tried this in version eight is uh, some of the matching when you join pools But they they've just done so much in here, but I guess where should we start with this the new backup system the backups are Much much improved from where they used to be. There was a lot of performance issues people would kind of bring up about some of the um As an oliver can't miss a blog with xcp and g in the title. Actually, I should move myself somewhere else Let me get that So i'm not covering up the chat. There we go. Put myself down here, but uh, yeah, no the um The xcp and g stuff, man. I'm I'm excited to dive back in and really make some tutorials So that's that's where that's why i'm not talking about it. So hey time and chat from marini switcherlin Switcherlin's awesome cool Oh, yes, you'll see all kinds of videos on this new studio build You know, I'll share a picture of the space I have. I don't even know if I don't have a recent one or not It looks different now. He's just more empty. I have a picture when we first moved in the house uh Where did that picture go? So this I here's the space where the studio is going. This is when this is when we first moved in So this picture Is an idea of what my basement looks like right now, but there's less stuff in it This was uh some of the construction stuff from it still being finished You can see there's ladders and a power washer. That's all been cleared out. So But yeah, that's where the studio space is getting up to is a pretty big basement as you can tell My wife standing over there in the background um So yes, definitely be talking about that exciting stuff for sure So that's yeah once I do the whole new studio Oh, let's see Yeah, once we get that whole new studio, it's pretty excited. It's just I I even you know, like I said I'm excited to build it all and start doing all that fun stuff back over to xcp ng the A lot of little changes actually I started dragging over all the zen blog stuff I'll drag that over here too. We'll talk about the changes and actually show some of them, but uh in some of the latest ones here And just for halloween. Thank you, Oliver Lambert and team over at vates for giving us a fun update just in time for halloween and A few of you and I have not done a video on net box But they have net box compatibility. I've actually talked to we helped some of the storage solution But they love the net box integration with their xcp ng Uh, if you're not here with net box, it's a way to manage all your ip's and everything else And they've taken the time to do that level of integration on here, which is just really slick that you can do that Um, this is something That's up and coming. Uh, this is the xo light. We're still making some progress on xo light This is kind of a interesting, uh, I really like the approach you're taking to us. It's very early stages here So this is like I guess you might want to call it someone alpha But a lot of people said well, tom the thing I don't like about xcp ng is that you have to load zen orchestra On a vm into itself. Of course, that does take up some memory There's some advantages to doing it that way. I'll cover momentarily, but xo light is going to be a way you can, uh Actually connect to the system and uh Oops, is there a way I can do it here Which system has I think the dell might have it in there Let me see So this is 192 It's not on this server Let me figure out what server it's on real quick. I actually have a demo of this This is really a cool thing that they're working on. It's on this server 2 dot 10 I think oops If only I could type today, there we go There we go They're working on the ability to have Of Some functionality with xo light So it's going to be able to be a lightweight version So you can connect it to your zen servers without having to load zen orchestra So it's kind of like zen orchestra light xo light and this is going to be for some basic administration The reason you have like with zen orchestra all the other features and everything else is especially like the backup Which I'm going to talk about is was then orchestra you get so many features It kind of has to be its separate standalone product for it to orchestrate all the different things that it can do But the xo light is going to be for people that want to get started and just have some control over vms And not have to worry about any of the other things in between and it's pretty cool It's coming along. It's it's going to take a little bit before they get there But I like the I like the direction or going with it see uh I love xo experiment sc targets and yeah One thing i'm asking and maybe i'll ever so listen on this one here I'm excited about the s3 targets and let me show you what those are when you go over here to settings you go to remotes And remotes are what they refer to as the backup targets So currently this is a backup target, but one of the other options is an amazon s3 target in here uh the challenge is and I don't think there's I Think one of the problems I ran into when I was setting up an s3 target Is it does check for a valid certificate? um I think that's one problem right now, but eventually That would be a handy feature now if you're just backing up to s3 you're going to have a valid cert And that's irrelevant, but for demo stuff. I actually like there's a tool you can use called min i o That emulates an s3 bucket and matter of fact, this is a feature if you i'm going to pull up my um Uh 213 In my true nas system This is a feature that you have within true nas Go here here here And we're going to go over to services And right there's s3. So you can actually create your s3 targets in here and when I was trying it before this was one of the problems I ran into was uh the It kept giving me a certificate error. So I couldn't get it to use this as a storage target. Like I said, it's not necessarily um Something that's as big a deal in production, but then again, some people may run they because they have something that's s3 compatible But they don't want to take the time to put the certificates on there So, you know, eventually hoping they add the feature to be able to use a self-signed certificate on there. Uh Oh, okay right here Ultra fast will be available in november release and working on self signed. That is awesome. So Thank you. This is this is what's awesome when you get the developers joined in here. So It's gonna be very cool You know, this is a fair point too, you don't have to install XO xcp and g uh, if you don't want to it does work on virtual box This is one of the things about the way xcp and g works and let's say let's pull up some Let's do a drawing real quick here. So the way xcp and g works and uh, let's pull up a server We'll let's do a That's ugly. That's empty rack. There we go server tower So, uh, drag these around a little bit Actually, let's do this draw.io for those of you wondering how I'm drawing things so fast Zen orcishio So these are two hosts or three hosts Or maybe this is a pool of them over here And if we do a pool then we can always draw this around right here And I'm gonna I'm gonna do some more graphics like this to do a kind of a demo for how the system itself works Uh, where you go? It was put a rectangle around it to back so This would be A pool of multiple servers. These are some standalone ones and zen orchestra And that's set. Let's like this cool rounded green Make these a little fatter I don't really want arrows on the end of it. There we go We draw fast. There we go. And then we set Set as default style. There we go There it looks prettier So zen orchestra is a one-to-many relationship. You can have a zen orchestra server talking to Each one of these different xcpng hosts or a pool of them where you take all the resources together Now when you're doing like ha, let's say you have an ha pool or some high availability cluster you built right here Zen orchestra can talk to all of these. By the way, these don't have to be local either So these can be remote and we've have clients like this where they're managing a zen orchestra instance that manages All the different instances now. Here's one challenge and this is how they solved it Let's say and we'll duplicate this one here And we'll just call this guy remote So if we have uh one of these Come on Oops, I'm dragging them wrong. This goes over here two back Actually, let me do this too so I can pop the chat out over here so I can still read the chat There Catch up with all this stuff here. Uh, what was the other thing we missed here? We were doing Progressing to see targets. I like to keep up with all this stuff here Uh, let's see XOS works with Raspberry Pi. Yes That's actually a fun fact too for those you didn't know you can load this on a raspberry pi If you want to manage it that way So there's kind of a neat neat feature there Uh, what else we have? Ooh, that's exciting if sources will be in 15 days. That's really cool. All right. So zen orchestra let's see all of these ones over here are Local systems, but this one over here is remote This is where they have kind of a neat feature for being able to handle this And so zen orchestra handles not just the management of multiple servers at once It can also handle the backups of them But in the case of remote backups, this is where they have the ability to have We'll duplicate this but make it mini oops Delete delete It's fun drawing all this stuff in real time, right? Um, you can actually talk to remote servers, but then to handle the backups They can actually have proxy backups that handle locally different backup Functionality and everything else that's in there So it's kind of a neat way that this is why zen orchestra from a scalability standpoint because I've talked to some people that have like Hundreds of hosts hundreds of hosts xcp and machines Scattered around in different places maybe even in their own data center You only need one zen orchestra instance So from a home user standpoint that's saying well, I don't want to have to load zen orchestra on my xcp and ghost directly I get it But then when you talk about scalability of product and larger enterprise usage This is an interesting aspect of it. The other thing that's really novel about zen orchestra is without any interference You can do this You can actually have servers talking to another instance of zen orchestra This works perfectly fine without conflict zen orchestra is reading The configuration and writing the configuration to each host and not storing it on its own Therefore whenever you're making these changes the other instances of zen orchestra are connected Simultaneously to it all get to see the changes at the same time So you can actually have some local administrators or maybe you're a remote administrator and be able to handle all of these things Like this it's a really slick system once you kind of wrap your head around The fact that it's a one to many Relationship in both ways from host to zen orchestra or zen orchestra host And like oliver said if you want to do something like run it on a raspberry pi You can have a raspberry pi that then controls as many different xcp and ghosts as you spin up and then as you start pooling and managing those resources together It can handle it downside of a raspberry pi will immediately be felt when you try to do some of the backup stuff Because the backups. Yeah, that's going to be That's going to slow you down a little bit if you got to do the backups on there because they do pass through Here because when we set the backups up and we'll put another server in here real quick We have a picture of a storage server SQL these look like storage st or a g e We'll put a tape storage. You don't don't use tape by the way Um, they're not really designed for tape, but when you set up the backups The remote says they're referred to and this can be s3 so matter of fact s3. I'm pretty sure there's probably something s3 in my shapes Hey, look at that. There's an s3 shape Zen orchestra can handle all of your, um Why didn't that connect? There we go. Eh, whatever I was trying to make it look prettier. Let's move that one up bothered me that they weren't separated, right? Zen orchestra is better than v-center. So Oh Here's a good point too on the topic of people with a lot of remote sites dcs. We also provide a kind of reverse proxy for Only open entry point to an external xo. Yeah definitely There's a lot Oh reverse proxies based on the backup proxies. That's actually really cool I didn't know you did that that's something else off the diet dive into Zen orchestra seems better than v-center. This is something me and wendell I want to maybe mean if I can talk about doing a video with it His window is way more versed in v-center than me Which that's what's got me excited that wendell from level one text likes the Zen orchestra so much because he's like this is really impressive and he's a guy who's done some very large-scale v-center stuff. So It's you know one of those things like that the big changes from there But whatever your backup targets are the one of the other things I like about the ways that an orchestra works Is even though these hosts may not know each other One of the things that orchestra can do so they're not pooled together. They're individual hosts. As a matter of fact That's exactly how we have this setup here um Actually, let me switch something. I got too many things. So I need oh, yeah I don't need this anymore. Don't save all right Crap everywhere on there. Nothing's anyways um Go back over to here here in our settings. You go to settings Servers, I've got three they're on the same network so they can talk to each other But having these three servers here means I can actually take the vms that are within here As a matter of fact, let's change this to So you can see the vms, uh This one, what's this one at This one's living on the chunas mini right now If I wanted to migrate this I can actually migrate this easily copy it Fast clone if I just want to make a quick duplicate. Um, so we go back there Here's a clone of it or I can take and say Migrate this and I can move it to the other hosts that are in the list So each one of these is a completely different host. They're all independent of each other But because zen orchestra can talk to them I can shuffle things around between all the different zen orchestra All the xcp and ghosts through one instance of zen orchestra This like I said just makes it really really handy for Doing this type of things now. Let's talk a little bit about the backup stuff um What else to be here, uh Is there automated backup verification so you can restore backup and make sure it's sort of responsive ping um This would be a whole different issue because This is a completely different function um You can do that with a few different beam. I has it the enable software has it It's a little bit different though spinning something up again somewhere to verify it Making sure it can do something without interfering with the existing VM. I mean it's It's not something I don't think that really becomes a part of zen orchestra It's cool, but I don't know if that's something they would actually do is do the entire Spin up a VM to verify the backup is good. It's It's neat, but I I don't I don't really foresee that in the short term being in any I should see in a near future I mean, it's a cool feature. I know Oliver's listening on this, but I it's not something I would actually say on there so it's um Definitely a pretty cool thing Um, is xcp and g an x away recommended for a home lab. Absolutely. I say yes. I definitely would use xcp and g I use it for my lab. I've used I've know a lot of people that use it for home lab It's actually really slick for all of that matter of fact one things We can talk about for doing like a home lab on here. So Let's look at this particular server is this one on Let's migrate this to another server. So let's migrate We'll put this on my Dell lab For this lab May see what networks are available on this lab. So let's see. I want to match the networks So they were talking about this and this is where you talk about the network pull downs I keep mine shorter right here That's something I someone had mentioned this right here and one of the things I do Let me show you what we go to like one of the pools and many stuff the networking on here I change all of them because the default is kind of a longer name. So any of the systems I have Like the right here, what's the network names on this one? Yeah, I change the word I put the words not in use not in use on all of them. That's I keep everything really short when I do it. So right here's the management network studio This has a something called ponage on it, which is this vlan 1337 So that's definitely the one I want that network on and go here We'll just migrate it back over here Select migration network perfect local storage that works hit okay It's going to migrate that right on over there to the other system Yeah, the yeah, I mean ES6i is obviously the really It's Oh, I like this. So my dev answer is in fact He's in fact building the S3 backup with min IO. That's actually cool That's actually cool. They're actually using it which is perfect because I know if it's The thing and if you just want to keep repeating a certain a business, I'll just put you I'll remove you so I Yeah, this is not the place to advertise your business Room message so Anyways, but yeah that you're building it with min IO that's definitely pretty cool Because that's what I'll be doing my testing in my lab stuff with because well I like true nas and true nas well matter of fact, I've done a video itself just on min IO because it's a really cool S3 type of Emulator for It's got some more than just S3 millers. It's got some ways it can build storage redundancy It's it's just a cool service all together min IO is actually that really neat service More on zen orchestra. All right, we're doing a migration says it's going to take seven minutes Unfortunately, the storage is slower than I thought so we'll have to wait on that one to get finished My well we can do other things while it migrates, but let's talk about something fun like this right here So let me unlock this system in effect. Let's do this I got to take over this system and I'm log into it Takes a second for this to get going and we'll I'll drag it over there using my remote control app for this Gotta put the password in I don't feel like typing a password. It's too long But you can see what I'm this is just a way to remotely control this system And I did shut it down improperly because I was goofing off That happens sometimes. All right, let's pull up our task manager and uh Actually does this one might be kind of big to back up. We'll back up another one when it's done copying Or we'll just fire this one up What is this one running on? Oh no hosts available. Um What is this on rate? Oh, there's not enough room available. So you should probably shut down the windows one So that won't start on here Any oh, this is a pretty good question here Any problems running xcpa g on that matter of fact, let's go over here to hosts This is running on a rise in uh, specifically this is It's a processor in this one amd rise in 5600 g rate on graphics So yes, this is a uh The you can run it on rise in that it it absolutely does work This is almost done copying these files so we can fire up something else. We're going to shut down this lab servers It's taken up too much memory So we'll go ahead and stop that one So that's why I wouldn't start the other service because well, there's not enough memory to start this one at the same time I don't have a lot of RAM in my uh rise in server. Let's put this on I believe it on this network Now it should start there we go What disc is this not? It's on the chunas mini right now You can get an ipmi interface with a uh with systems Yeah, oh, this is true too. I would go epic if you're going to go for a full one But yeah rise in like for the lab we we this is part of the demo I'm going to do because I know I want to target it so people can use it on Hardware that's more accessible. Don't get me wrong. The epic is awesome, but The epic system is going to be a little bit more expensive great for production and uh, I matter of fact the demo I did it will go over here and If you look up the super microserver I did grant I know it's an intel one but I did this video with xcp ng And here's you know using local mvme zfs this whole video. I break this down running xcp ng All the performance you can get on there. Yes, I know it's an intel one But we have when you load this up on some enterprise hardware you can get some really crazy performance out of xcp ng in matter of fact, I have the Somewhere in here That's the server. Oh, I get the benchmarks or somewhere They're in the video that's for sure We talk about just how many iops you can get out of the system So i'll leave this is easy to find it's a super micro ultra server with xcp ng Giving ideas some of the performance you can do on there Threadripper is good too I will admit don't use zen server that uh or zen center I'm not a I don't know where they stand on it. I haven't used it in a long time You can do pretty much There's not much I think I don't think there's anything in zen center that you can't do in zen orchestra But zen center, I don't like it because you have to run it There's a way to get it to work in linux, but it's pretty much designed to run in windows to manage it It's the old software pretty much everything to me is zen orchestra is the better way to manage the system So a lot of people ask me the Yeah, you don't because you don't need zen center to even load zen orchestra matter of fact one of the things they have like here's the xo light, but if you go over here Here is the quick deploy Where you can actually deploy as soon as you set up and I've covered this in one of my lab videos You can do a quick deploy and get the basics loaded Right away And then I have another video for running this in your home lab if you want to build it from source But it's pretty easy to get this deployed and you don't really need any You don't need much to get that going Back over to here back over to playing with zen orchestra. This is up and running Oops, I think I only got the wrong username. Actually it's lts Now since I it's been a while I think I have a demo when they added this feature here Um Because now you can do snapshots with memory And do backups with memory and what within memory means is where let's play with this real quick snapshot with memory So it's going to grab a snapshot of this Takes a second to grab Because it's grabbing the memory status and everything so if we go over here to council I was still thinking of finishing a snapshot It does it faster on faster servers. All right, so now I've done this and we can even do things like Reboot the server So we'll reboot it Which is this is on a reasonably fast system. So it should boot relatively fast She has our tasks doing two minutes left and we'll have this one done That's the other one. We're migrating to another server So we can go here. We'll log back in and Now let's do something fun Uh sudo Spell it right rm Why not? awwe We can't remove some of the proc. I'm sure something's going to break by doing this. Well, some things won't remove I guess But some things will remove so we're going all out. We'll just let this run for a second because we'll kind of do this demo here oops Put that in the background put this in the foreground Yeah, I know I I really should just do this Yeah, so this All right, we probably removed enough. So how much is left of this? Oh Let's reboot I can't even reboot. All right. We've we've now eliminated most of the file. We can't even ls Now if you're doing cash track, there's one of the cool things about the new snapshot with memory. So if we try to actually I don't even think it's accepting. Yeah, it's not accepting commands. So we're now we're going to go Let's go ahead and uh force a reboot Grub rescue that's not where you want to be So let's go ahead back over to snapshots And uh, let's just restore this Revert your vm It's going to think for a second It wouldn't finish even reboot But here we are right back to our snapshot with htop running that fast Look file system intact. Everything's up and running. I've reverted it the rmrf didn't uh Where we can't even look at directories. It's that fast to bring it back This is really kind of the cool features. And then if we wanted to go fork this vm Let's make another vm from the snapshot. So we actually create a vm from the snapshot Shot whoops, I am have it. I'm typing at an angle and looking at the screen. So it's be it's uh Oh, I didn't hit the storage target Yes, the snapshot in femory is very huge on it. Matter of fact though, one of the things, um One of the one of the things about it that worries me was snapshot in memory And where I'm getting at next is where we can actually back this up. Actually, let's uh Go ahead and back over to the council run htop again We're going to build a backup job that does the same thing. So we're going to kill this I don't need the snapshot anymore. We're reverted back to it And we're going to build a new backup job And we want to do a backup Select vm. What was that one called? It's our demo rise in one here. Select the target turn as bad backup advanced with memory So now we're actually going to be able to take this server and Grab a snapshot of it and it's running state state as a backup job. So go back over to our backup jobs There's our blog. There's the backup job. Matter of fact, how many copies do we want to keep? I didn't say that you set that here Uh, we'll see I'm just naming it keep to keep two copies for retention. Keep it simple So I have two copies of it Go back over here to the backups Actually, did I choose the remote? Yes. Do I have the remote on here? Let's go ahead and run that backup job Now we know right now the system is actually this one here And it's running htop. So it's when we backed it up. It's actually doing something on there Oh, this is actually really cool Customers giving those vms with memory to cyber authorities to find proof of attacks That's actually really neat or even ransomware still in memory Um, yeah, that's actually really cool Yeah, these are really Very cool. Imagine the possibilities ideas IPS. Yes for sure Happy you solved your hacking problems with untangle Snapshot and then reboot. Yeah, there's We know part of our procedure because we run all of our our infrastructure here at the office in xcpng One of the things we're really big on is before we update anything We just grab a snapshot of it real quick Um, we even just run a backup of it real quick just grab it snapshot it stick it in there Have it, you know in the state we want it that way I can quickly get back to where I need to be if something goes completely wrong Uh, it's really handy to be able to do this. So the backup task is running right now It's going to be done in about five minutes And we'll be able to play with to restore that these servers are not the absolute fastest servers So that's why they're taking like five and six minutes. This would happen even faster. Um on faster servers Just a heads up on that for those of you wondering One of the other when we're playing with this something else I want to show you that's really clever on the backups speaking of You know, let's deal specifically with restoring things What if I needed a file, but I don't feel like Running backwards all the way. So right here's my debbie in 11 system And I can restore this vm. Maybe I needed this older copy from october 31st But this isn't what we want. We we we just want one file. I don't want to have to restore an entire vm to get a file that doesn't That isn't what you want to do. So what if you could go back here and restore Maybe from october 26 on this one here Go here Go here. Uh, I didn't work on this one By missing something in that one It's making a fool out of me That's not I bet this server doesn't the other server I have hold on let me pull up another one I'm missing a library to make that work. It works in my production server Let me make sure I got the right let me log into it first Here's one of my production servers and it should work fine in here. Um So if we go to restore There we go So here's my october 15th backup And what if I wanted to get a specific file That I needed on this particular system. This is where I think is really cool if they've got this in here So if I needed One, uh, we're I'm sure we're unifying stalls things. Oh, let me look and I'll answer that question But in a more concise way bar lib unify backup. All right, so we actually need to go If we go here to bar lib Here's my unify Unify backup Let's say I needed that file right there Now I'm able to get and select a single file and pull it out of a backup Without having to show the entire vm. It can look inside of there This is like to me really handy because if I needed this older unf file But I don't want to restore the whole vm But I wanted my one unify backup that was from my october 15th instance So I could do a comparison and things like that. This to me is just really such a cool feature Um, and it's all built in this is one of the things that zen orchestra is a lot different compared to like Here's your hypervisor from vmware and things like that and then oh, yeah By the way, like someone mentioned vm earlier use a separate backup server All of this functionality building built right right in at the same time is just Oh makes your life so much better to be able to just go in and grab any one of those particular files that you Need out of something in order to get that working All right, cool. We have our backup still running htop here So now we're going to go ahead and just stop it Now we can go back over to backup restore Is this the one that's right one right here Now we can restore this one here Where do I want to save it to Ah the local mvme So here's our backup. We just did we should be able to restore it exactly as it was in the state when it was When the snapshot was grabbed so let that run in the background here Smash the like button for sure Make sure you test in production. Yes, of course You can't fully so it's um you have essentially The level of permission you have to pull files is going to be God level permission because you're not using the internal permissions built into the system you're using um You know raw file access essentially to the to the uh You know the compressed of the hard drive image So you're basically like grabbing a piece of the hard drive image mounting it as a linux hard drive image and then pulling files out of it Can you do the backup says read only um Hey, well, here's the thing in the case of ransomware You just got to make sure your backup targets are not Somewhere that the ransomware threat actors would have access to so obviously if they have access to your xcp and g system Then well you kind of got a problem, but technically when you set the target, there's a worm option Um, I don't know how well that would work though as I never tried it Generally, I don't think of creating like a one-way right, but can't delete that would be very problematic on there. So I don't Yeah, the best way to do is is you create silos essentially. So you take And take your backups and like our backups go to for this system here So if your backups are going here to the pool And you have your uh, you know zen lab vm backups And then these are then these are other ones of production backups and then they're replicated to other servers here Then they're replicated to get off site. Uh, they're replicated in different places So someone would have to be able to get into all the different replicated servers Which each one has its own password if you didn't notice if you reboot this system These have this icon on them because their password Unlocked to even get to see any of the data in them Not that they can't just purge and delete your true nas server But they'd have to delete each true nas server This is replicated to and then the off-site backups that it's replicated to so it's not really something as easy as saying Read only for the backups. Um Yeah I see you push backups and then those get pulled From the replicates server they're pushed. It's kind of a cascade the zen orca show pushes them to a Server I have a whole video I've done on like disaster recovery planning on there. Then they go to Once around the true nas server, then they're replicated to another true nas server And then I have a script I run every week that copies them to an encrypted physical Drive that's locked in a safe that I do a rotation with So I have physical drives locked in safes that are unplugged is where their final extra resting places. So It just makes it easier this Yeah, I don't think I don't think worm would work well in that case You know there's there's a way and I haven't really tested it one of the features in Here if we go over here to sharing I haven't tested this but there are SMB worm option Um becomes read only after five minutes. The problem is how do you ever get rid of your backups? So it would make sense like I send the backup there five minutes later. It's static and can't be deleted Okay, but you probably want to run the backup again. Do you want to keep do you have infinite storage to keep an infinite number of backups? Or did you want to write your own process that has to purge those out? So read only doesn't really Uh, it becomes very problematic because I mean if you have several petabytes of storage Even that will eventually run out if you keep every single backup for all time So that's why it's kind of doing it read only it's not going to be something that makes the most sense Yeah, worm works well once tape library, um Offsite you can actually take and just create something offline You can create something that you only put online once a week. That's another option Generally speaking once you have it off site the the Ray the ransomware operators act Operate is gaining access to the infrastructure and then frequently for convenience and especially when you're doing with larger enterprises Everyone just uses the same federated logon. So they'll they'll tie it to their An oauth login to their You know microsoft or google login and then they'll have everything login the same as opposed to using separate passwords for everything This just becomes very problematic And if you do that, that's what allows them to jump through all the access, you know, I can't remember it was one of the um One of the it firms that got that got popped One of the ways they were able to get into everything is they found their spreadsheet That had all the they had different passwords But they put them all in one spreadsheet that was easy to find with all the passwords to all the different things they had So they were able to go through and log into all the different things and uh do that So what you do is as this replicates the different things you also Have each system have its own Siloed credentials for each place it lands. So they'd have to find the different credentials to each one of the machines That's kind of how you layer things better And of course doing something that you put online for backups and take offline That makes a lot more sense Yeah, I want to do a video soon on some 2fa for some of the um ssh systems Oh, yes Spreadsheets are still more secure than a pinned comment and slack. Isn't that the truth twitter? That's that's the twitter case in a nutshell there. All right Where are Restore or did I put that storage? Success That's the backup. Did the restore success? Something didn't success. Oh, I restored it as a template. Oops My bad That's not good. All right different different problem today Why is it showing as a template? That's just weird I screwed something up Nothing like doing it live and somehow accidentally checking a box to turn something into a template. Well, I guess we can probably destroy that template Storage Hold on. Let's narrow this down to singular server here Just because it makes it easier to look I could filter for but I'm not filtering crap Go mouse go So here's this how did I end up with? Yeah, we'll destroy it. I don't understand what this template's for So that definitely now you get to watch things go wrong in real time, right? Yeah Ubiqui yes We actually have and I'll show you here We've been doing a lot of testing with the new ubiquis and we like them. I just been slow to um I was oh, there's this is true. I think Oliver's probably right here Maybe your exo's from sources outdated. I remember a bug that slipped by master storing template instead of a vm Good possibility and uh, I won't argue with that. I Definitely have uh, maybe goof things up a bit like what version am I on? Let's look here Let's just 5e3. I think that's the latest but back to the ubiqui. These are definitely um I plan to do some updated videos me and j both bought a handful these we just haven't gotten around Because I've been so busy with other projects to do some videos on these that a lot of places we can use this Uh, we got these configured for using with bit warden. Uh, we got these configured for using with Some of the online tools we have so I got the hiccups a little bit Um, some of the online tools we have we have these configured. So yeah, these are definitely the ubiquis are great Excuse me. I don't know what gave me the hiccups I plan to do some videos and some explainers on these I just been kind of busy with other projects, especially this is one reason to build my own studio So I could just kind of continuously work and record as needed. So I actually probably put more content out once the new studio is built So Looks like them on the right version of zen orchestra Uh You uh, yeah, I mean you could set up however you want I'm using like I said true nas and with true nas you have so you can use uh snapshots And that's one in fact one of the things we do here if you look at We snapshot lots and lots of things So we've got auto snapshotting going back for weeks On all this and when you if you're not familiar with the way zfs replication works It doesn't just replicate the now data. It replicates all these snapshot data as well um So all these snapshots are completely replicated along with All the real data. So this is just some way we do all the replication on here So yeah, definitely and of course you set all the retention policies on this as well So let's try and restore that again because I'm curious what happened. So let's restore it Put it in local mvme So kick off the restore process again. See where it goes this time Let's actually let's do this too. Let's log in here This is the actual server running it The zen architecture server So you can see it's chugging away Doing its thing restoring that backup Three minutes remaining. I want to see where it goes this time I don't know if I screwed up or I just have a bad copy of something here I should rename this to When you start having a bunch of servers to say local storage But make sure you go that way when you're in here servers and reconnect these other ones Local storage, but I know you can see what it's on. This one's on my dell lab. So we'll actually put that on there. This is on By the way, if you didn't know this about the way it works in xcpng I really like the fact that you could just rename things because everything's assigned by uuid You can use plain text normal naming schemes that are easy for humans to read and name them and it doesn't affect anything So by renaming anything on here, it does not directly affect the other Functions of it. So it doesn't like if I read right right now This is on a network that says storage and this is one eth 110 gig. So that's eth 110 gig. All right, cool If I want to go into the pool look at the Dell lab network And I wanted to rename this no problem. It's not going to break anything if I changed it to eth 110 gig. All right, we changed it. So it's got a capital e but Naming is arbitrary Hey, look has a capital e here Um, this is a really you can build networks without shutting down the vms or anything like that Swap the networks and hit the pull down and swap where they're at Not a good idea while they're actually running a backup task because I guarantee that'll break my backup task And this is the zenark show we're using but changing ease on the fly Not a big deal even like right now the vm is not running. So we'll go ahead and fire it up Let it boot up all the way. Oh, you can also change a template in a vm in cli. Ah, okay That's cool right there. I did not I didn't know that Get pulling in and do the master build that's always good advice, but I like this advice here That's really cool. I didn't know you could just flip a template back and forth like that That's actually really slick And to answer uh Ernesto's question right here. This is what I drew Yes, zen orchestra can manage simultaneously Many hosts. It's a one to many relationship. So you can use one zen orchestra to manage individual hosts or Uh clusters of them or pools depending pools the proper term I say cluster because a lot of people may be coming from other hypervisors might call it that but uh when you Group together a series of xcp and g hosts. They become a pool And the resource pool that is managed you then just manage the pool and it manages all the ones in in uh inside of there as well Oh, you know, I didn't talk about this much, but in case you didn't notice Uh The facelift that was given to this the diagrams.net you can switch themes now between This look or you know a different more modern look. It's kind of cool the way they've changed all of this they Done it a little bit different and use these little floating menus and shapes and format But you can go back to the old one if you prefer in the preferences They've got a theming here right now. It's on the minimal, but I can actually switch to like the default theme or Whichever it they're doing some cool updates I need to do a new video on diagrams.net because I really like the way they've updated this. It's it's really slick Anyways back to something I was talking about switching a network So right now if we go here and we type in LTS And you have to type the password right which I did wrong all right So here's the ip address of 172 16 69 78 We're going to be here to the network by the way. You can see this and this was a big quality of life improvement copied a clipboard. Oh man being able to see Put that in and a clipboard is uh very handy. Anyways, let's switch this to The ponage network so this switches here it switches the ponage this takes not long this updates within about 30 seconds But immediately because it's on a different network Here it's on the 10 dot 113 37 dot 122. There's this new ip address if I were to create another vlan So I go over here to the pool And this was on the Ryzen if I go into the network add network And I were to create another vlan uh We'll just call this Vlog 200 just because uh, well, she's vlog 250 250 So there that vlan 200 is actually a real vlan in my network. Well, there's well, there's nothing on it So it's going to give an error. So we'll just type in 250 and we'll delete it afterwards So we just created another uh vlan if we go back over to that You can on the fly. All right, we created it and uh Oops There we go. We can switch to it But there's nothing at 250. So it's not going to work. Um, you don't have to restart the vm You don't have to restart services. You can do these on the fly So this is one of the reasons I would like it. So if I'm when I'm building my lab stuff out I can very quickly and rapidly start building different network interfaces tying them all together and it's almost just an arbitrary thing to do To do it now. You can't delete a network While it's attached to one you get an error message on there, but then we're going to go back over here to home pools Then we go back over to here network And we'll just go ahead and delete the vlog 250 network And it's gone. There's no vms attached to where I would have got an error By the way, and if you didn't notice this this is not I've not dove a lot into this I know people have used it a lot and this is really cool Um, they have the ability now to create different rules From to Range and you can start creating rules around the vm. So you kind of lock them in to very specific, uh Firewall rules it's it's kind of slick that it's got this ability. It's kind of an interesting way to assign that Select ip's you can create ip pools in here So they're Only allowed to be this ip that way if you had someone else who remotes into the vm They can't log into the vm swap the ip address try to safely assign something they weren't allowed to do Um, this is actually a really cool feature on there to be able to do that to Allow that to have this more advanced like I need to lock this person down. I want to be able to Let people into this but they're going to have root access and they have the ability to possibly change it I don't want them to interfere with something else. I have Um that may be attached to the same land. So that's where it gets in you know, even if it's not security It's just if they set the ip to something else on a network. They're going to cause conflicts and cause problems Is that orchestra on the platform in january free for use more like vmware? Uh, it's all open source. Yeah, I've had no problems with 10 gig and some of the demos I did were on 25 gig So I would say zen orchestra has doesn't have a problem working with 25 gig. There are some Limitations because of the processors in there. So if you're doing like a z z standard compression It does seem um Well, that's cool. I'll get to this a second If you have uh A processor fast enough it'll start saturating Uh The bandwidth but if you don't there's some processor threading limitations that you may have to overcome So just popping a 25 gig card or faster in a system doesn't necessarily mean you'll get the full speed out of something Like zen orchestra doing a backup you also have to have enough processing power to handle the Uh moving of all that data. I think i'm saying that right and I think it's just a limitation I mean z standard is fast, but it does seem to Uh have some processor limitations when it's doing that All right, did that install again as a template? Whoops, let's go back over to storage Hmm. Yep still installed as a template. So that's weird That I'll look I'll just recompile that I won't do it during the live stream here But yes, we'll just recompile this and uh sort sort that problem out Because that's weird that it's restoring that way. Well, here's something here. Let's do this And go back over to our backups destroy the backup now So get rid of that backup Overview let's go the only thing different we really did was um What we call that backup job blog and we go here Let's just try this Normal set of a memory backup. We'll just grab a normal backup of this As a matter of fact, we'll make it a delta backup just for convenience Save by the way, something else I'm going to mention. It's interesting. So if you look here at the backup And we edit it this backup says it's backing up a bunch of server on rise it. All right, no problem What if we want to rename this where we'll just recall this blog Thursday demo As a matter of fact, we can even Call it here So if we go back over to the backup and edit it Hey, look, it knows it's different name that once again because everything's tied to uuid You can kind of flip around and change all the different things you want. It doesn't really break anything Um, we can just go ahead and do that and let's go ahead and run this backup now I didn't do the memory thing in this version of the backup. This is just going to be a more normal backup So report on if you look at advanced settings, just do things normally Don't do that and we'll see how that backup runs and restore it and see I'm curious if the bug is only if I have it with memory turned on because I've been using this to back up and I thought back up and restore things a few times and I don't remember having any problems with it. So weird But hey, if not recompile it Uh, let's see XO backup it won't be fast enough yet to saturate 10 g. We're also working on improving this but for xcvm's you can easily saturate Yeah for the vm's no problems. Uh, when you're connecting these and I demoed this with uh, a couple different systems If you have these systems connected to each other at 25 gigs You can move the data You at 25 gigs you'll start running into limitations of the different Rated arrays you may have but if you have something like an mvme or Uh ray, yeah, you can start moving the data back and forth at that speed or I have a um I did a video with the synology And the synology connected to xcp and g with a 25 gig connection. So using the synology as a storage target Crazy amount of speed. I was getting out of that. Um, that's in my recent videos as well s y And oh lo g. I am having a really hard time spelling things today I probably got to look at my youtube channel directly for this Find it Something for the model number There we go So I did these benchmarks in this Um, and they're all done with uh xcp and g connected to it. So at 25 gig it gave some real impressive performance numbers so using xcp and g and I have this I broke all this down in a video but You can get some really good performance out of here really good iops all over 25 gigs So from a not from an x o backup standpoint but from a performance standpoint. Yes, you can use 25 gig cards Yes, you can saturate them provides you have a system fast enough to do so That's almost done there Yeah, oh this too. Yes the uh vm network speed. That's true too. All right, so we'll go ahead and stop this one backup Restore here's our blog. There's a demo We'll put it back over here Let's see what it happens How fast will it restore? Will it cause that problem again? Will it turn it into a template or will it restore? That's weird I haven't I just the first time I've ever seen this problem And I know I've played with restore on this a few times because this is our this is our usual lab server for playing with stuff all the time Which is why it doesn't have like a full url at the top Lots of good chat going on here One minute remaining All these connections here are only over um 10 gig so They're they're reasonably fast to backup and restore VMs When I do my actual video tutorials, I always speed all this up So you don't have to actually see how long each one of these took to back up and restore One minute 40 seconds remaining I'm still excited about the upcoming s3 storage targets Actually, let's go look over here Yeah, this is how this is the this is us doing those backups and restores Seven seconds remaining and then we get to figure out where it goes. Where is this going to land? There we go Hey, look it works. So apparently if I do snapshot with memory um It goes not where I want it to go But if I do it this way it does so this one works So there we go. I it seems to boot up fine So works there Let's go ahead and try that. Let's go ahead and modify the backup to say with memory next time This this booted right up. No problem. Let's go ahead and remove Destroy that one Actually, let's get rid of this one. I don't need it anymore I do some housekeeping All right, let's look at the backup. Let's edit the backup and uh Let's just see if we can modify the backup to say With memory Too many windows open only narrow these down a bit All right, so it's modified with memory It's currently off. So that's not much there. So let's go ahead and turn it back on So and have it doing something And we'll have it do a snapshot with memory and see if uh, I get that same result again Is there a way to transfer from vmware es excited docker? vmware to es excited docker is not a thing because that's you're talking about different technologies um Docker is a containerization system not a virtualization system uh, if you want to convert from A vmware es excited convert the format over to something else that's possible um, if you right here's two if you Uh, move your vms an ova format import to your favorite open source hypervisor So yes, that's a way to do it and I've also, uh Done a video on how to this is a really fun clever way and this works. We've done this with vmware To get things migrated over virtual machine to physical machine, but really it can be I cover this in this video. It's a really simple video. Um I mean it's 15 minutes long, but I cover moving things from even virtual box or you can be insert hypervisor of choice Where you want the source to be but the destination can be xcp and g So using tools like clone zilla make it really easy really I mean there's more than just clone zilla whatever cloning software you want But this is a way when people go. Okay. I i'm having trouble getting out some of these Formats I just want to clone it and if you fire up clone zilla on one fired up on the other and you can do it Now if you're trying to reload the same server that becomes a slightly Extras intermediary step in between but something completely that you can do Because you could actually take clone zilla and tell it to export out to a file But you can actually do system to system transfers and clone it and we have done that if you're doing a windows server There are tools in windows p2v How to convert physical servers using virtual disk to vhd. This is for doing windows systems Um, this is a tool. It's actually made to get you in a hyper v turns out you can get yourself into xcp and g as well So, uh, this will work as well I've got to be is how to convert physical service or virtual servers using disk to vhd With xcp and zed architecture. There's a couple different ways you can handle it depending on the types of servers You're trying to migrate, but absolutely. Yes So, all right, we're doing a snapshot with memory. I just want it running something so I can see And uh, that was 10 minutes ago. So we'll go ahead and just run this back up again It should run to one a job with memory now No, uh post post in xcp and g forums if you want to talk really specifically about xcp and g forums, um That's the place to go I'll drop a link Do you recommend using the built-in backup system for i'm assuming you're talking about xcp and g? I always use the built-in backup system for xcp and g. I don't have a reason not to use it Uh, can you export from proxmox xcp and g? There's ways to convert it because proxmox uses a different format There's some conversion methods you can google. Um, but the clone zilla method I mentioned works fine, too So using clone zilla is a easy way to make that happen All right backup successful. So we have the backup snapshot delta Let's stop this actually make sure so it was running this we're going to stop it and now we can run a restore We got two deltas We want the second delta that was run at 524 and uh start I guess Let's see what happens See if see if we can repeat the bug. Can we make this happen again? If if I can Then offline i'm going to recompile this So it's pulling in the suspend image and now it's pulling in this so let's Watch the chat Yeah Nested is good for testing, but don't don't use nested in production if you can avoid it That's the uh queue cow to ovf is very easy. I've seen instructions how to do it I've not used proxmox actually test it, but it's it is something you can do to do the conversion on there All right, we got two minutes remaining before this gets copied over I think this is a good question too that someone has here for oliver Um, is there just a donation option to donate to the project? Um, I've said people asked that before I don't think that I don't maybe i'm wrong and I don't see anything on there but yeah, if there if there was a um Some way people could just donate to the project because there's a lot of people that just you know a lot of home users They maybe can't afford the full license, but we still would like to help out and contribute So, um, that'd be kind of cool if there's an option for that Jay just did a bunch of videos because jay is um Jay does the proxmox stuff. He's did a bunch of videos on it, but jay really does like xcp and g So, um, he's a fan of both. He's used xcp and g in my office He's played around with it some himself. He definitely likes it, but He's got a lot of stuff in proxmox and he's like well He doesn't mind doing the proxmox because it's a good system too And a lot of people like it What's his name? He likes proxmox as well craft computing. He's got a lot of proxmox servers as well Nine seconds remaining Does it build it into a template? That's the big question we have here Nope, it didn't weird Okay, I got no reason. I did that the first time. I got nothing. Oh, it booted it though So that's interesting it booted it It didn't even though it had a memory Version of it. It didn't do it. So let's stop it and advance remove Go back over to restore again And maybe we don't I usually don't use I played with I've not really played much with the backups with memory I think it's cool. It has it I've mostly done snapshots of memory not backups. Let's go to backups restore We're going to restore the memory snapshot one, which is this one here I'm not going to tell it to start. So I think Because it has a memory snapshot. It should Already be in that position. Oh, by the way, the latest version has this hide short tasks Yes, that's a nice little feature for those you didn't know That's a some of the short tasks that may occur It'll do it. So let's um five more minutes Actually, I'm going to wind this down an x half hour by the way To give an idea the cost of running xcp and gxo is roughly two million dollars a year growing. So yes Yeah, that's one thing about it is um The as these companies grow it's it it's a bigger project And I think a lot of people realize I've seen some stuff, man I we've talked and consulted with and obviously we you know We know people that buy a lot of the enterprise support and we've helped them with things This will buy like a true nas setup from us. Um, there's some big companies that run xcp and g and that's We we actually um, we're help we helped a bigger company convert A lot of systems there they got off of hyper v and they're not small They're building a pretty large Their data center for their internal stuff It's a private data center private cloud if you want to call it that but it's a pretty big facility Oh, they're building on it's all xcp and g now. We've been doing a lot of consulting work for them to get them um Set up on new storage and things like that because they are not as familiar with the true nas world But they fell in love with the xcp and g. So um, yeah, I'm excited to see that the Project's gotten so much bigger Could be hot sauce. Yeah Yeah, two charts is an awesome project when I get around to doing My next series on because it's going to be in really it's in release candidate now for um The true nas scale. So I'm going to be getting back to some true nas scale stuff as well There's so many things I want to play with and so little time to play with them all that's That's always where the big task is All right, so now I'm actually missing something Because it does do this But there's no resume. So I did a snapshot with memory But it doesn't leave it in a running state. So when I turn it on it just does an normal boot up But it doesn't make it as a template. So that's interesting I'll recompile this and play with it some more. I'll get it more concise when I do my video on it But if hopefully if this showed you anything it's really really easy to Migrate VMs back them up restore them destroy them do fun things with them migrate them to other servers and um Convert them to template clone them start on recovery start With this hey, you know what since there's a way to undo this is actually not definitive Go ahead and just purge it or we can revert back to Copy the template. Can we just so it does do this if I revert the snapshot? Let's go ahead and try that real quick See if it reverts it with the memory This is even better. I don't even have to go file a bug report Yeah, I guess if you do a live stream you mention xcp ng with a lot of people talking about it And you demo your thing and olver lambard happens to be there They'll take a look at it Yeah, it can revert the snapshot back, but when I'm restoring it Um, it doesn't start it in a running state. So it seems to it does the memory restore But I don't know where it's it's not restoring it to a running state or when it did choose running state for the restore It didn't uh do that. So the final Question might be and let's go ahead and purge the snapshot Go back over to the backup Let's do this. Let me get rid of these because I don't want any of the old VMs You got to do this housekeeping because I'll have no I'll be doing this and I'll be like, what are all these VMs everywhere that I got backed up This is all our lab server, but still there's sometimes a lot. Let's go back to a standard backup With memory so Vance proxy failure Uh Z standard I don't think there's anything special here. I have to do so. This is your normal backup with memory save execute the backup Try it one more time after this backup by six o'clock. I'm gonna wind this down because I got my son messes me He wants pizza All right, it's backing up everything right now Um If you're wondering here. Yeah, let's talk about this Zen Uh terraform you can work with someone said infrastructure is code. There are terraform Uh setups that you can use with zen arkasha. So I maybe that's what you're trying to get at with that question Ooh an ansible coming soon one thing that's you can't be overlooked is the um api on x the api interface is really cool because uh, you can do a lot with it the Things you can do from the command line things you can write batch scripts for Or any type of control and the whole api interface they have really gives you a lot not to mention Inside of zen orchestra. You can do all kinds of weird custom things I say weird because it's like you can just kind of dream up things and uh build different, um Here's all the commands There's probably more acl host attach host restart You can set like jobs up and things like that too It's really cool that they've got like if you have this one-off thing that you need to do you can Run this tell what you'd run the user as or you can go to scheduling and create schedules for it Uh, I've never really used this much, but I just kind of marvel that it's there That it gives you a lot of extra features you may not realize you needed so to speak You're like I didn't know I needed this feature and this is uh kind of handy to have Come on back up. I want to do the restore soon so you can figure out this works How many people are on the live stream take a second here 120 people 69 likes click some more like buttons over here Three minutes remaining I need to switch everything to 25 gigs. Look at this. It's just I need more speed I'll let's see what else we have in here. Oh, it's gonna make me sneeze now All right Oh, all right, let's go to restore now Actually first, let's shut down this vm Go back back up restore One full backup with the memory snapshot there I will I guess say start vm is restore. Let's try it first to start See what happens Four days that'll fix real quick five minutes Six eh It'll restore in less than that. I think it's been taking like four minutes to restore each one two minutes See what it does Need the jeopardy noise there's never enough speed no matter what I do Yeah Something too fast for networking It's well you get a faster network then you gotta get faster hard drives and you get faster hardware Then you say all right now the network's the bottleneck you kind of roll through all your bottlenecks And it's just a continuous and perpetual upgrade for everything Three minutes Three minutes remaining. What else can we do while we're waiting for that? What else is in here anything? I don't even have anything interesting here. Look at all the backup logs here I gotta I gotta look and figure out what I'm missing too I'll solve that when I recompile this Because the file restore is not working on this Only files of delta backup which are not on SMB can restart. Okay I'm missing some module for this to work properly. Yeah I'll sort that out. It's working on my production server. So I solved it there Go go back to my notes No such VM Huh, well, there's the error logs I have Command mount options loop RO size limit equals blah blah blah blah interesting so it's not Able to do it no such VM So it has it only as a template. So if we go back over here to storage And uh, here it is as a template again. Okay So it's unable to reassemble this Interesting But where is that limitation at? So what if we went over here to Back up restore And uh There's a vlog. There's the one. What if we restored it somewhere else? So here's my Let's throw it to here True nasty. No, not that one Trinity lab NFS. So let's try to restore it here and see if I get that same error I wonder if it doesn't like the local storage And if it's different if I restore it to a remote storage target, okay, that's yes When you compiling yourself is definitely, um Where you're going to make more mistakes? Uh, this is why I encourage people using this in a business environment You buy the commercial support package because then you don't worry about what you missed and what you goofed up When you were compiling things I like the learning factor of everything else, but There's there's certainly the mistake factor that comes with it And that's where you need a team of professionals to help you avoid forgetting libraries and uh Add-ons that you forgot to put in there. I'm not likely to do any next cloud docker image stuff Uh, I don't even know it does next cloud have an official docker image that they support The one of the my aggravations with people on the internet Just pull it from docker. Just copy and paste this random code And in case you didn't see it today and we'll pull this up real quick because I want to rant about it while we're waiting um This is a real problem right here supply chain attacks Come on made the window too big going from a 4k screen to a 1080s Bring it down. Um there's a constant hijacking of different things And supply chain attacks. So when you start talking about popular docker repositories that are run by Some unknown person as opposed to an official package maintainer. This is a real challenge. This is not docker This is mpm, but the concept is still the same. It's still supply chain attack And what better way and I you know, I've talked about this before you can research like, you know, uh docker images containing bad packages and security problems I don't I thought that anything wrong with docker It's understanding the supply chain and how it's coming to you from docker and where you're pulling that docker commit from And uh, so this is something just a really um Yeah, who needs commercial support when you can join blog thursday, but this is something that you can really think about when you're doing these Is like, yeah, make sure that you, uh, know where you're getting these docker images from All right, it's still not running. Well, let's go over here to storage Yep, did the same thing. So it's not the storage target that caused the problem strange It's full backups causing the problem weirdly delta does work, but delta doesn't do the memory restore Cool either way. I still like that. I can Restore snapshots from memory, but uh, I had to look at that little bug there on that Interesting nonetheless What else are we talking about here? Ah I've never tried running, um xo a over zero tier. So Okay, next cloud does have an official docker image. That's cool Good to know that they have one Uh, any thoughts on an decade end of sale? I mean Everything has a life and then they stop they have the end of sale is not the same as end of support. So yeah um So yeah, I don't really have any thoughts on it's just you know, whatever Still no interest in learning ipv6 because it's cool networking I just don't care about ipv6. There's a joke. Um, that's been running for a number of years That is that one of the local linux. We're not linux. It's more of a computer users group. Um This guy's been doing the same talk every january for like 15 years called the year of ipv6. So It's it. I mean cool. It's but it's not the year of ipv6. Uh, everyone tells me it is but The the internet powers that be in the group think that is the internet tells me It's gonna be a long time before ipv6 becomes a thing Oh, yeah, I see you deployed me have issues getting him. I don't think Well, we're just slowly bumping. Um We're gonna we've been bumping people up. We do have a ton of them out in the field. Uh, so yeah, that's Yeah, the 6100 we've been we've been deploying more 6100s on the pf sent side lately. So This a lot of people like it because people are getting into 10 gig. It's got the 10 gig. It's got sfp Uh, so definitely a nice nice way to do it. Um, oh, here's here's something. I don't know the answer to yet Uh, and while we have all over here, this is a solid question Because the arbitrary rule that windows 11 needs a tpm system Will we be seeing tpm support? Uh, or is there already there and i'm just not sure how to enable it we'll we'll be able to like tag of tpm as part of a vm in order to get like windows 11 working with its full tpm support in there we We gave a tpm error and we didn't dig into it But that's actually what this is for is we noticed that there was some problems with the um Windows 11 test and the uh tpm not being recognized in there So I don't know if it's a system we have it doesn't pass it through properly I've not really investigated it much one of my staff looked at it, but we didn't dig deep into it I guess that's the questions are going to be more support in the future for zen server and tpm Uh, so, you know to make windows 11 arbitrarily happy for those people that want to run it Which windows 11 is full of issues and I don't really see the need to run it anytime soon. Um, yes Okay, there there will be named vtpm virtual tpm to come in xcp and g but it's not there yet We like to work with citrix. Perfect. Absolutely solid answer on that Got people gone. So last couple minutes here. What else we got? I'll go all the way till six rapid fire questions It can be about xcp and g. Um, I'm gonna do more tutorials on it. That's uh Definitely coming I'll be playing around with some of these, uh, new things. We'll probably look for a patch update Oliver Lambert's going to dive into this problem that I have with restoring it But hey, why not learn things all together on here? I I have not played with it but window did tell me xo sand even though it's in beta right now. Um Is a Something he played with that's supposed to be pretty good the zen The xo sand system. I have not touched it yet myself I do plan to play with it at some point as they are coming along with it So that's definitely uh on my to-do list to do some xo sand testing What pizza's on the menu today? I don't know yet. Oh, okay xo sand replacement will be xo store and collab with Lynn bit. Oh cool. All right That's awesome. That's there's some exciting news as well For those of you that want to be playing with that so Was there a word about synology? You know, I wanted to get to that um Because i'm running the latest synology over here Here we can combine our synology along with our Combine the two together. So this is my synology and we'll go over here to control panel um We are running the latest dsm 701 here Let's go back over to I got to meet the reducing number of things that are open. Uh, yeah, I don't think I have this in here So new Storage We'll attach this to the rise in the system. This is going to be my uh, Synology We'll do an ice cozy target One thing I learned about the way ice because he works inside of uh, Synology, it's way faster than nfs and synology. Synology is not optimized with nfs Um, that is that is a certainty that I ran into Um when doing some of the testing here It does support nfs. It's just It's not as it's a synology problem not a xcp and g problem at all matter of fact. I have nfs versus ice cozy and when you use your synology you get a lot more speed when you're using chunas It's a little bit of a mixed bag But yeah, I'm running the latest version here. Um, and we have and we should pull up the storage manager Let's just say a manager. Where's the storage one? storage manager, um, we are now using the latest Uh built-in pair of mvmes along with four ssds and yeah, I want to do some testing and speed testing with it With the new version to see how it works out. I also have the, uh rs model one of the rack station ones all flash and I'll be doing some updated videos that they both just got it I just did today a synology ha video as well And I did that with the latest version of dsm 7.01. So um so far. I haven't run into any problems with it Seems to be a good solid update. So um, I'm happy to report on that Only uh downer is ice cozy is not shareable ice cozy is shareable um When you you can use ice cozy as a shared storage target between two servers uh, the live streams are on wednesday for the homelab show and Neither me nor j compile androids. So don't expect any videos on compiling android So that's um the update on that So Well, I may do a video. I don't know if there's enough to do a video about it. So I don't know if there's enough about the whole style g701 update. It's nice. I like the look of it I like the way it gives you the um Look of each of the drives each of the systems on there But like I said, you can use if you have hosted a pool uh, this ice cozy will work as a Multiple machines can talk to it, but not if they're all individual pools. They will not talk to it that way You can't mount more than one technically you can't in nfs either But what with nfs each server that connects to the nfs it creates another uid So there's a series of folders in nfs for all the connections Uh, let's Live migrate. Let's just do that Synology nas, there we go. Does live migrated over That's you know, handy stuff. We don't have to restart the vm or anything like that We can attach a new storage Migrate it over to that storage and it's going to take about two minutes to copy it over We'll go back over here Pull up our resource speeder Because we pull up the network speed What are we at so far? Taking a second to copy. Let's see Two minutes remaining about 287 megs It'll catch up in a second How much cpu utilization are there though? Oh, not bad It's not overrunning the cpu on this 287 megs a second copying Not too bad. There we go Memory utilization volume. Okay It's copying Yeah, this is an important part is that um If you want to do a tpm if you're trying to emulate a trusted platform module As oliver's alluding to you want to have it to be actually trusted So there's a lot of engineering that i'm positive they will be putting into it to make it a true Trusted platform module not just a tpm Because just emulating one is one thing emulating one in a secure manner so people can't Wedge themselves in between it is It's a little bit harder of a task There we go we get Yeah, we're still not using up too much processor on this. That's not bad It's transferring So about three minutes remaining not bad for a live transfer Overall though, I gotta admit i'm pretty happy with the technology and asked the that's why I did that video on ha on it. They've I've had no problems running plex. Uh those of you who have pointed out a few times and tagged me I did a video on tail scale tail scales officially in Here it's a it's a third-party package, but it is without having to load the manually load the package You can run this in style gdsm now um That's pretty cool. These are the contributor ones tail scale is pretty slick I think they've added more of these tools in here and of course you got the docker So if you want to pull some docker images and run the run containers inside of here I don't think I have any in here right now 58 percent There we go. It's thinking Yeah, the sounds these are nice little boxes if you're setting up at home The extra features you get on here and I don't think I've done any dedicated videos on how to set up nfs or ice cozy with Uh as a storage target, but it's really easy to set these up It doesn't take long at all to to build an ice cozy target attach it to something like xcp and g and use it Um pretty straightforward and then for your backups you can always go to your remotes So if you go to your settings remotes, you can also choose like I've got this chosen right here the Uh true nash tourney lab, but you can just as easy choose anything else on there you want If you want to set up like a uh SMB share so all your vms can be backed up xcp and g and sonology play really nice together There's really no downside to using them The only problems you may run into is someone will always point out But sonology doesn't have really super fast uh systems. I'm like yeah, they're not Sonology always goes for the tried and true stable, but they're not a beast when it comes to hardware But they've done a lot of efficiencies So you can still get good performance out of sonology despite it not having an incredibly fast processor in it Who comes every vlog jersey watches like 90 of the stream and then drop a dislike lots of people do There's always haters I've just that's youtube you should read the comments That's that's where things get even more fun One minute remaining For the migration Then I'll see what kind of speed we get out of it. What kind of iops can we get out of this thing? Do I have something on there I can test with? So what actually let's go here Yep, I got this so I can run some fio tests So this is on transferring 27 seconds remaining Counting down. It's almost there. All right, cool. It's on the other system now See if this chokes the sonology out 32 000 iops 37 000 not bad To go backward to the disc That's gonna it's thinking Not super fast But I'll do some testing and tuning and all that fun stuff disc throughput I can play with this all day, but eventually I do have to go so anyways See What do we have in here? Yes, you see 3200 is good in the enterprise environment um Jay has a I think jay has a video on cloud and it The the challenges with cloud and it are often cloud and it challenges. So I'll throw that out there It's not necessarily something with um uh Debbie in itself One of the things that jay pointed out and he's gonna jay's been working on writing up some documentation jay from warlinx tv He realized when he was doing some cloud and it testing that there's just some gaps in the documentation. So He found people complaining, but the complaints are mostly from Uh, missing documentation for certain things I haven't tested it myself. Uh cloud and it's maybe on Uh, at some point, maybe I'll do some testing on it so I can figure out where the gaps are and do a tutorial Me and jay have talked about it a couple times A lightweight application and place the next cloud. I don't know. I don't use next cloud. So I'm not really sure Not the same thing I know, but I use sync thing to synchronize my documents and files that I need Uh, you know, for example If I wanted to save this document, uh, I'd save it and it would be synced immediately between all my systems Simultaneously, I'm fine with that as a solution. Um, this is how we handle a lot of the documents here at the office that are Local documents. Um, that's I work on them at home or work on them here. They're saved and are synced I don't really use I usually use applications like this. I don't really use next cloud Ooh, I'm excited about a november release on it Um, I will mention this because I mentioned it earlier the I have forums. Yes, but if you want to talk directly about xcp and g Here's a link to their forums xcp-ng.org slash forum and uh, you know go read through there's a lot of good information in there I spend I do more reading than posting in there, but nonetheless if you want to get a good grasp on a lot of these things, um There's a Definite good reason to go in there You you can read through problems people have had solutions that have been posted for it Different ways people are using xcp and g definitely recommend checking out their forums over there The the team at vates looks to those forums. This is how you can interact with them So this is definitely I even suggest people when they if if you were to post in my forums about cloud in it I would just send you a link over the xcp and g forums be like hey head over there. So yes Come full circle you sync to sync all your password dot xlsx file absolutely And yes, the team the team over at xcp and g and vates are happy to get your uh The feedback on things that are working and are broken Uh, let's go two more minutes two more minutes to answer a few more questions and stuff But I uh, I gotta run. I gotta get my son a pizza Message him back. I'm gonna install from source Yes, this is This is the best answer um I really I when you want to test this at home and one of the reasons and I've said this before when I do my videos With this one of the reasons this is installed from source with no support I want to make sure people who want to learn about this have access to it I have a video on how to build from source. So I've got this covered But this is important because I want people to say everything I'm doing in this video is something completely accessible to You the homelab user that says my budget is about um, A ramen noodles and I really want to learn so I can get into it. So I have a better Uh than ramen noodle budget and so I love tools that put very strong Accessibility for those the view that are home users that want to get into it Um, but at the same time offers support So if you are and we have enterprise customers we work with that they watch me do this And go if it does this much for free, I'm willing to give these people money I'm buy a support contract as needed to support this in our enterprise environment. Um, this is you know One of the things I really like about the way the whole zen orchestra project works Compiled offer source get all the cool bells and whistles You have a massive amount of things that your fingertips and as I said, I'm doing the videos I've been doing are on the complete compiled from source version But if you then move into a business role using this, um, yeah Go ahead buy a lease buy the support contract right from them and don't have to deal with Compiling this all from source and perhaps missing a library, which I'll admit. I definitely missed I'm not sure which one I missed right now. I can figure it out But that's also part of the learning process of getting better at tech is understanding how to compile things understanding how to assemble them Um, it's just to me. It's a big part of it kind of getting your hands dirty working on this Uh, I never recommend other than for labs running true nas as a pass through So that's something not Uh, not something I recommend because it's always We're not always but it can be problematic. It's fun for tasks testing, but never good for then um Zfs boot on a bun two not something I'm likely to use I might explore butter fs on a bun two or something but honestly zfs on a bun two doesn't uh Doesn't have me all excited. It's just not not high on my list of things to do So thank you all for joining. Thank you, especially from uh for that oliver was here answering all of your questions the next cpng This was great. Uh, I definitely I it will It will definitely be one of those things we might do again sometime as long as maybe I'll coordinate it and message Oliver ahead of time and make sure he's got time But luckily he did have time so this is uh, you had time to help participate and uh do all this But at some point maybe an oliver will connect and do some videos, uh, do a video together talking about the history of the projects I like a good origin story and boy zen orchestra I mean just a couple years ago This was a Kickstarter with well the xcp and g specifically was a Kickstarter And now it's like it kicked into overdrive over the last couple years between the zen orchestra product Which has been around for a while and the xcp and g platform and the combination of these two things has been really cool Uh, it's just In we'll we'll drag wendolin if we can too because I know right now Windows definitely enthusiastic about this product as well. So there's a lot of us. They're all excited about it. That's um, yes um Bdia pxc vdi boot set up not anytime soon. I don't really use that anymore just kind of lack of need so Oh, that's even better as soon as i'm traveling in the u.s. So it'll be come by to say hi. That's cool um, I love to show you around and uh, no, I'm i'm looking forward to that too So thanks everyone to kane. Thanks everyone for joining and i'll see you next week or some videos in between