 This video was edited on TrueNAS scale 2108 beta one. That's exciting because they've come out with the betas and there's been some quirkiness with it. And thank you for all of you that do the testing out there. And I'm among you now that finally decided I'm not just testing it. I'm actually well using it for functional things like editing my videos and a bunch of my lab stuff has now moved and migrated over there. I wanted to really put some testing on it and make sure that things worked. The good news is my TrueNAS core systems have no problems ZFS replication over to TrueNAS scale. They talk back and forth perfectly fine, which is great. Now I can have some systems at scale, some systems at core and test compatibility and changes between them. I will be doing a full migration video because I want to take my TrueNAS mini and convert it with all the data intact. Cause a lot of people are gonna want to know how to get through the upgrade process. I've talked about it in my previous video but of course it's been enhanced more but that's gonna be a separate video to actually show you how to do the migration. This video is just gonna talk about what I've set up so far, how it worked and my experiences with it and well the fact that you're watching this video means they're good because it worked and I got the video uploaded after I edited and saved it all onto my TrueNAS scale which is my working server for all this. Before we dive into these details, if you'd like to learn more about me and my company head over to LawrenceSystems.com. If you'd like to hire a sharp project there's a hires button right at the top. And storage consulting, that's where you'd hires for that. If you want to support this channel in other ways there's affiliate links down below to get you deals and discounts on products and services we talk about on this channel. Now here's the official announcement right from the folks over at TrueNAS and this is their blog post, Windows ACL Editor. I wanna talk about this, we'll show you this in a little bit more depth in a minute here but yes, this is something that it needed, something that they changed. I like the way they change it which is exciting. Now I gotta create new videos on exactly how the ACLs work inside of here. I don't know if these changes will be reflected back into TrueNAS core but I think they're a little bit easier to understand and they're right. I think the whole editor and a web UI large improvement in ease of use that would be something I do not wanna overlook. It is a received a large in ease of use improvement. Yes, that's true. I think it's one of those things if you're new or you don't do this all the time and because we're editing and working with a lot of systems for clients and configuring systems it's familiar to us as in my team but it could always use a little UI enhancement and they did a good job on that. The scale out is something I wanna talk about. People are asking about this and this is gonna be its own separate deep dive video at some point where I set up a few of these and build it. So to command 2.0 provides a web UI for TrueNAS scale which enables ZFS datasets to be pulled together as a cluster volumes which span multiple nodes clustered SMB access to those clustered volumes is a previewed on TrueNAS scale 2108 via API and will be web UI configurable with the upcoming true command version update that allows scale out capacity and bandwidth as well as fault tolerance. Let's break that down a little bit. In order to refer back over to this forum post right here and is SMB share available on TrueNAS command nightly? I don't see the option to create a share. No, it has been implemented yet and true commands still work in progress. Now all this is working with Gluster on the back end and this is one of those little details that when people start talking about a scale out system it's not like there's magic where you just click some buttons and yes it's just automatically scaled out. There's still some planning and thought that has to go in there. They're trying to make it easy as possible and if you're not familiar with Gluster it's not exactly although being titled GlusterFS it's not like a traditional style file system. So you still have to build the VDVs, take the drives, build them into a VDV, build them into a pool. It's all stacked up on here and then we have our ZFS pool. Then we have the Gluster tool that sits on top of that and then we can tell Gluster to use multiple ZFS pools and then pull it together and that's where True command becomes a glue to put all this together and then ultimately how it's presented would be let's see an SMB share and then Gluster determines which one of these nodes has the resources or for fault tolerance you can design Gluster to have the ability to fail over to certain nodes or how you want that data to be done. That's gonna be probably a separate deep dive video. There's a lot of work that goes into designing it and I know a lot of you are going to town we already know this but it's some of those things that I probably need to sit down and make a whole visual on it for how this works. Maybe I'll sit down with the TrueNAS team I'll drop some visuals to an interview for someone who can explain it a little bit better than I can but it's also very beta right now so it's not like this is the easy solution you drop in but this is one of the purposes of TrueNAS scale is what they refer to as scale out as in stack a lot of servers together to create fault tolerance between physical servers. Now TrueNAS core resolves this by having fault tolerance by I've reviewed them before some of their high end machines with dual motherboards and things like that makes a really fault tolerant individual machine the concept of using Gluster is to create a series of machines and tie it across here to make them fault tolerant so your data is always available. There's some pros and cons of each of these but like I said it becomes kind of a rabbit hole there's a lot to talk about there and it's not something any of the homeland people outside of learning are likely to use on a basis it's something used in a more enterprise market where you need absolute high availability for really high volumes of storage because Gluster can tie them together for larger storage or for fault tolerance storage and different strategies that can be used but like I said it's a deep dive that we'll do in a separate video. Improved system and sharing dashboards yes they made that a lot easier enclosure management such as the TrueNAS R series supports of many M series and X series coming soon I'm excited when this gets fully implemented because this is what I'm going to be doing is migrating my TrueNAS mini over I'll migrate it before with this beta my goal is to do it and I'll do a separate video for like how to do the migration so I'm saving it for that but that's definitely important OpenZFS 2.1, 21.08 includes updated version of OpenZFS which lays a groundwork for future file system enhancements IX systems contributing code for better scaling and work a process with processor cores to make tasks such as scrubbing and re-silvering behave more reliably so there's a lot of enhancements been working there for those of you following some of the dev blogs but there's a lot going on there they also have when you go down here absolute ton of little bug fixes and things like that more than I have time to cover in this video but of course I'll be linking to all this down below another interesting thing and this is not something I use but I know a lot of people do is container storage interface the Democratic CSI is now supported improved to be all API basis will enable more robust deployments to TrueNAS storage for Kubernetes systems this and it's a way you can take your Kubernetes clusters and have a common storage cross-clustered nodes and they're integrating that into TrueNAS scale that's exciting that is for those of you that are huge into Kubernetes, not really me but it's gonna be a cool backend management for ability to do that Apple application catalog improvement third-party applications can be deployed from a single Docker container described with customizable helm charts these applications can be downloaded via TrueCharts which also provides process for users to build and customize their own catalogs now I set this up and I'll go over here to applications in here there's a lot in here and I have not, this will be its own deep dive into setting this up what you can do in here but generally because they're integrating things like Docker this is an improvement over jails not because jails have a problem as much as because finding as many developers that are participating in creating the images for jails is sometimes our problem and people have asked why things lag behind this is one downside is there's not enough people put in the time or wanting to dedicate the time to building the most up-to-date free BSD jails or sometimes even building a jail at all for something to run on the free BSD system versus well Docker is what it is it's huge, it's popular and having all that in here means you got a pretty solid list of items in here and of course the ability to add more on there even things that kind of surprised me was I seen the TP-Link OMADA controller I've covered some of the TP-Link OMADA networking hardware before on my channel and they have that, they have the Unify and it's a newer version I think that's offered before they've got own cloud, next cloud transmission lots of things in here like I said that'll be a separate video where I dive into setting these up because I really haven't set any of these up now while we're here let's talk about what I have set up and what I do have working and right here I've got in the background running this is my TrueNAS scale Trinity this is the server that it's running on it's name Trinity I'm not clever with names but they matrix names have been good tank does are Trinity it's got 30 drives in it so Trinity seemed right with three VDevs and 10 drives each but I'm doing some testing on here seeing what kind of IOPS it gets and so far, you know, 60,000 not bad for some of the IO tests I was just making sure if I loaded it up it didn't have a problem the system is extremely responsive and matter of fact it's really not sweating whatever's going on here and you can see down here we're pushing a little bit of data so let's go to reporting and you can see we're barely stressed in the CPU running all this in the background here I can't remember what I was doing here this morning I think this might have been some application tests I did but generally speaking the system is very responsive and as far as speed this is connected with a 10 gig connector I don't know if we're fully saturating it but we're pushing some data through here so it's moving pretty fast this is not a reflection of exactly the speed test what I do plan to do is before and after tests I'm gonna be taking my TrueNAS mini testing it out, getting a whole baseline of tests migrating the VM off of it upgrading it to TrueNAS scale I'm going to be doing all these VM tests with XCP and G here that one I'm using exactly the same VM same hypervisor and just changing what operating system the storage target's going to be using so it's gonna be the same setup just with TrueNAS scale so I wanna see if there's any major speed improvements that come from switching it to scale or the opposite you know does it slow down is it as fast overall so far all my testing at least works that's the first thing is functionality then we'll test all these other things I have set up here under the shares I have a Windows SMB share actually a couple of them there's my videos that this video's being added on I have a ZenLab backup over SMB it's just where I store all the backups for a bunch of my lab stuff and lab VMs then I have a NFS share where I have it tied to NFS and then we have a iSCSI share that's actually where these tests are being run right now just wanted to make sure that works so all those things are the most common use cases I have that I set up all the time for clients for things we do here in the lab and that's working perfectly fine this is on a relatively high end machine it's got a Xeon Silver 2.2 gigahertz obviously 128 gigs of RAM and someone asked about being Ram Hungry ZFS is not Ram Hungry ZFS is Ram efficient so the use of memory in ZFS and why the cache is only 62 gigs so far is because that's all it's cached that thus far it doesn't like leaving memory to do nothing I don't like leaving memory to do nothing you should be using it for something so the services that are running on here the iSCSI and a couple other things if I added Docker images that would increase all the different things running on here but right now services are about only eight gigs and with 120 gigs we should probably have caching for the rest because why not if you're gonna request the same files over and over again like the video files that I'm editing why not have them cached and that makes complete sense so ZFS will consume the memory that's free but then there are limits so it won't just keep doing it to the point of detriment to the services but if the services aren't using it why shouldn't it just be cached that's kind of the short explanation for how ZFS caching works now as far as drive layouts and things like that that's not pretty simple here in storage they have changed those I'm looking for the three dots to click on it and instead I have right here pool options status so you can see all the drives how they're set up I built three 10 drive vdevs of RAID Z2 just make it simple and so a lot of the functional layout is the same just where the buttons are is a little bit different so instead of getting a little three dots you have the little storage icon here add export disconnect status expand pool export data keys encryption works the same not a problem there ZFS replication no problem as I said I can target this as a replication from the other system as a matter of fact I was just replicating my videos back from my other core system over here no problems there credential management and permissions that's where things get a little strange here we click on this and we're going to say we want to view permissions and it then pops this up then we click this to edit it so it's actually extra step but a lot of times you just want to view so it doesn't bring you right into the edit but this right here has the option to use ACL preset so we can choose a preset ACL options or we can go and say user Tom user group and then add an item and we can add more users or if we wanted to add a different group so you could add the item choose whether or not it's a user at owner at group or maybe you want an everyone option on here do we want everyone to be able to allow modify or just say full control it's not too complicated but it does give you the granular options for the ACLs right here it's going to be something that I'll have to dive into another video but for the most part if you just need to have a user and that shared user and allow that user to have a group that is the simple options that you can do and of course make sure you check apply recursively confirm I think I may have had a problem with it not replying recursively once but then it did a second time so I got to figure out if there's any edge cases that have problems of course the other thing is I'm bringing data from another system over to here so I may have created some of my own problems by not stripping the ACLs out when I was copying data I haven't dove enough into this but functionally I did I always start with strip out of the ACLs get rid of everything that was in here before then apply them and then it seemed to work and we're functionally back at a working system and I'm editing on it so it's working quite well matter of fact it's not just editing we're still pushing data and we're still pushing this right here over scuzzy it looks like it's about done should have some results on here but so far that's been working quite well now system settings the one thing I'll say is when we go here to like the shell and you can SSH any get the same thing this is not something I like like it I don't care for the prompt you can change it it's ZSH it is customizable so you can do some shell customization I just at least like to know what directory I'm in what user I'm logged in as which pretty much is always true but I don't know you I think there's some better tuning they could probably do on this and someone commented also in the forum post on the same thing and they talk about this I'll look at what shells I want to make sure I don't break anything so I left it at default but obviously I'll do some customization to the shell because knowing what directory I'm in so I don't have to type in print working directory seems like it would at least be something to be in there that should be good now virtualization this is not something I ever used in course I didn't think it was quite as well done as it could have been but I'm excited because I'm hoping they did a better job in here in scale so this will be something once again it'll be its own deep dive video when I get to testing this but that'll be fairly exciting on there for doing it credentials this is still and I didn't step to FA yet I really should but under credentials we also have the local users, local groups that's pretty much easy I just set up two users on here that's how you set up the users first you then you go and they'll show up in the ACL manager to set them up with permissions on there pretty straightforward this actually does look a lot like TrueNAS scale so not too much of a difference there the little bit of confusion at first I guess it would be the data protection is actually where things like scrub tasks cloud sync, R-sync, smart tests, replication tasks are now the replication tasks I was doing from my core system to this and the automation part works perfectly fine so when you're building these out so on this system on a different system it has the same options for creating SSH connections and you can do it from here or there even though it says semi-automatic and let's go over to my other system you can see right here SSH netcat set up I tested it both with just SSH plus SSH netcat and it had no problem moving data from this system here and when I was setting them up the automation part where it says hey, semi-automatic TrueNAS core only technically, I mean I didn't try going from a scale to scale system but going from a core to a scale system was no problem at all even using it's kind of automated give the credentials of the other system it logs in, creates the SSH key pairs does a replication and does it with a quickness the speed on that between the servers was as fast as the drives could seem to allow and network system could allow to get it across so that worked smooth had no problems getting data over so if you're doing a migration from that point that works good of course the next thing I'll be doing is actually converting this particular system over to there and of course this I'm gonna miss the enclosures being lit up here but this is the system I'll actually do a video breakdown on for doing the migration that'll be separate because this is the system I want to upgrade but I gotta finish those before tests they get the baseline then do the after tests now granted setting this up was relatively easy the install went smooth but I've only been running it for a few days and haven't had any issues so this is not the long term on this this is me being an enthusiastic user because that's who this beta is designed for all of you who are enthusiastic are willing to roll the dice little deal with some risk and be willing to file bug reports when you run into things that don't work but setting up NFS, iSCSI, SMB the common things I use had no problems I know there's some people talking about some of the little Docker nuances and things like that that I've not dove into so maybe there's still some problems I'll run into there when I set it up but that's a full new learning experience for me because I don't really have anything that I'm running outside of from the command line for Docker I don't use any UI type management for it so when I dive in and learn that I'll see what problems I may run across now as far as the migration if you wanna load this over the top you should be able to import your pool I covered that in the previous video that should work perfectly fine but reminder that if you do the ZFS upgrade to the latest version of ZFS that makes it a one-way trip you are not going backwards because now the versions of ZFS are on a sync the TrueNAS scale can import ZFS but cannot downgrade ZFS this is one of the challenges so TrueNAS Core runs a slightly older version so if you do the ZFS upgrade of the pool in place to the latest version of ZFS your data does remain intact when you do that but going backwards you can't just go I'm just gonna boot it back up over the TrueNAS Core so buyer beware if you are trying to do that but I think it's worth it I think it's exciting I am going to keep using this I'll report if there's any issues I'm looking forward to doing the switching after I get some of the testing done so in my opinion if you're an enthusiast go ahead and load it I haven't found out what the gotcha is what doesn't work but hey this video got uploaded so I can tell you that SMB and sharing does work I've also have plans too but have not tested yet active directory integration that does work fine on TrueNAS Core and has for a long time but scale I'm gonna be kind of curious but I know it's got connectors for it so I don't know where that's at that's not something we test a lot inside of our lab but I'm thinking about adding it to my test here in the lab to dive a little bit deeper into it before we deploy this to clients as I said TrueNAS Core's long time proven track record means for the next numerous installs we have there at large scale are probably still gonna be core but the enthusiast to me is probably gonna be playing a lot more with scale because it's exciting and it's new and it's based on Debian all right links to everything I talked about below and thanks and thank you for making it to the end of this video if you enjoyed this content please give it a thumbs up if you'd like to see more content from this channel hit the subscribe button and the bell icon to hire a sure project head over to laurancesystems.com and click on the hires button right at the top to help this channel out in other ways there's a join button here for YouTube and a Patreon page where your support is greatly appreciated for deals discounts and offers check out our affiliate links and the descriptions of all of our videos including a link to our shirt store where we have a wide variety of shirts and new designs come out well randomly so check back frequently and finally our forums at laurancesystems.com is where you can have a more in-depth discussion about this video and other tech topics covered on this channel thank you again and we look forward to hearing from you in the meantime, check out some of our other videos