 Good morning everybody if you're standing in the back. There's plenty of seats here up in the middle. Just Raise your hand if you got an empty seat by it. So We're in this nice shiny new venue where folks don't have to sit in another room watching a live stream of the keynote. So So please take advantage of those seats How are you guys all liking Pasadena this year cool. I'm glad you guys are liking our new home Pasadena has been very welcoming to the scale team And one of the folks that has been doing that has been what we've been working with is Andy Wilson on the city council here And so I'd like to call him up. He's going to be introducing Introducing our session today And for Andy Wilson good morning. Good morning I'm impressed this group was up at 10 o'clock in the morning on a Saturday. I Had my coffee walked my dog. So I'm ready to roll. I'm first of all, thank you And welcome scale 14 X I wanted to tell a little story about how this happened because first of all, you know having you guys and passing is incredible And it doesn't happen by accident So I'm going to follow my notes here because my coffee hasn't fully kicked in but I remember Richard Gatson is sitting up front in Maddie came to me and said this thing scale is awesome And it needs to be in Pasadena and then they wanted my help and I said Why are you talking to me? And you're probably like why is Andy on the stage this morning? Besides being on my walking ride. I had a few things I want to say to you So I co-founded something called innovate Pasadena. Is anyone familiar with innovate Pasadena? Any people we got a few? Yes, thank you guys And that's all about creating a vibrant tech ecosystems in this part of Los Angeles. So I'm going to talk about that a little bit later In that that effort innovate Pasadena is is more around technology and engineering a little bit different than I think the Consumer media activity in Silicon Beach. So if you're really kind of nerdy like me, we're trying to make this home So that's our focus with innovate Pasadena. I also have started a series of software companies and invest in a bunch of companies And as a lawn mentioned Some people say I drew I drew the short straw I sit on the city of council of Pasadena and I'm really the advocate for innovation in technology in our city So I've been a star geek and I'd heard a scale, but I didn't know a lot about it So they were educating me and I started to learn that scale is the preeminent event for Linux users Attracting more than 3,000 people. Are we close to that number along this year? Oh more awesome So 3,000 amazing people great job And I like to say bringing together the best and the brightest so welcome And who cannot like Linux right? My nine-year-old is a coder He likes to hack Particularly a minecraft especially when it's time to do his homework and I was telling my kids about Linux and my nine-year-old Says isn't that the thing with the penguin? And you know, I don't know I think we're always gonna think it's a penguin thing and who cannot love penguins There's a book called 365 penguins that my kids made me read when they were young and ironically Penguin birthday parties were all the rage when my kids were younger. So I hate when people talk about their kids So I won't talk about my kids anymore. I Did research on penguins so I could talk to you guys with some credibility and they're pretty incredible animals apparently very social I have a feeling this group is so sure we're gonna check the box there But also what consider one of the smartest animals in the world So I think Linus was pretty pretty bright in choosing the penguin So why is the Linux scale conference a great fit for Pasadena, right? And it's great. You're using you know kind of filling this building By the way, I served on the board of the convention center when we built this beautiful building So I'm glad you're taking advantage of it but let me tell you a little bit about Pasadena and I'm gonna brag because I want you to know about Pasadena should you come back and realize what we have here Okay, we're a city of a hundred and forty thousand people. I think you used to do this on Long Beach Am I right so Lax, okay lax Okay, not that great, but Santa Monica has less there about 90,000 people So we're a little bit bigger than Santa Monica and we have a lot of great stuff in Pasadena Mars are over up the street JPL a JPL people Go JPL There was a video they did called think five minutes of terror about the landing of the rover which is incredible DNA sequencer spun up out of Caltech So if you think understanding the gen the human genome is important that came from Pasadena Seema semiconductors Caltech invention unbelievable Maybe some other things are more relevant paid search advertising invented and passing a patented Company I work for out of ID lab called overture services invented paid search We all know that is the monetization engine behind Google. I think it worked out okay for them Couple other companies hatched in Pasadena e harmony moved actually the Santa Monica won't mention that Earthlink City search and more recently Incredible companies open X. Do we have any people here from open X? Yeah, we got some open actors good Spokeo incredible company around data and people search supply frame Also here as well. So just to mention a few companies in Pasadena Caltech in ID lab people familiar with ID lab raise your hand if you know about idea So idea lab was the original incubator 140 companies can my idea lab now incubators are kind of like everyone has an incubator But the first incubator was in Caltech run by a guy named Bill Gross Caltech 30 Nobel Prizes right we got some smart people at Caltech guys. They're amazing. So a lot of incredible people We're talking tech art center College of Design. How important is designed to technology guys? Come on Art Center College of Design in Pasadena. We know if you can't get people to understand and use your technology It's not worth very much. So having people think about injustice on usability art center here is in Pasadena They do incredible work Interesting fact about art center the majority of the cars on the road today We're created by art center hand. So you think about the impact to an industry art center designers are extraordinary We attract almost two billion dollars annually in R&D funding in Pasadena That's $14,000 per capita More than any other innovation hub in the country. So lots of R&D dollars going here We're home to three of the top world's Engineering firms dare I go on and boring you so I'll stop Anyway, so the bottom line about Pasadena like me. We love smart nerdy people. You this is such a great place My kid tells me I'm a nerd and I said thank you for the compliment So a little bit about innovate Pasadena because I think It's a personal mission It's a an organization that I helped found and I want to share with you what we're doing because I think the scale mission Is very consistent with that. So three years ago I helped find a local grassroots organization focused on building our local kind of geek and tech community called innovate Pasadena And our vision and bear with me is to create a vibrant ecosystem of technology design and innovation in greater Pasadena That's a sport sustainable growth. I'm not exactly sure what that means, but it sounds impressive But I think the bottom line is we are here to help connect people right connect people with other innovators So they can strengthen the innovation community right and build more great shit I mean it says like we help people build more great shit because we know by connecting people and sharing ideas That's where innovation happens, right? And clearly Conferences like this are super important to what we're doing so connectivity is key in supporting conferences like scale plays Right into our kind of sweet spot So to wrap up I did a little research and Mark who I met briefly who's an incredible guy I was reading about in Buntu and Unity desktop and you guys probably know what that means And I found out that he was he was an early adopter and he and I were talking about this early to to space tourism Right space tourism. I know if I can see if he paid some 20 million dollars to go to space I'm thinking maybe someday. I'll go to space and with companies like SpaceX, I'm sorry Virgin Galactic SpaceX Blue Origin all of us I think we'll have some time in our lifetimes to actually experience space and hopefully not at 20 million dollars But two orders of magnitude less than that So, you know your fantasies can become reality thanks to innovation and technology and and I was reading about the the Genesis of in Buntu and it says it means I think if I get this right correctly a Humanity towards others or the belief in a universal bond of sharing that connects all humanity And I think our mission at innovate Pasadena and I think for innovators in a whole is around community building and sharing ideas and connectivity So I'm really happy to have you all here to help you facilitate your community because I think What you're doing at scale in the Linux open source movement is very consistent with what our ethos is around creating an innovation community here and in Pasadena so Thank you for coming Elon. Thank you for having a great conference Thank you for letting me bore people first thing in the morning on Saturday I wish you all a fantastic rest of your conference and I have fingers crossed that this is the first of many times We get to host first this group and in many like yours Richard wanted me to mention April 11th and 12th We are hosting the worldwide space apps challenge, which is a hackathon around the space data set Right hundred concurrent locations hacking space data around the world We've moved that kind of ground zero of that hackathon from New York to Pasadena. So I hope you'll be involved in that I'm gonna turn this over to I don't know line mark who's who's next mark a lawn Someone more impressive than me. Okay guys. Thanks very much. Have a great conference Hello Balancing out down up down where this is Is that technology, huh, I Think we're good. All right. Well, what a treat to be here loudly in Pasadena The reason I'm into this stuff is because technology changes lives and Technology changes lives in many more ways than you think, you know, we think that society evolves because People decide that they want something different But actually society evolves because it becomes possible to live differently, right? And and then we embrace what's possible, right and what's possible changes Because of technology So one of the reasons Ubuntu exists is because it struck me that there was this enormous potential For for for innovation around free software, but there was also enormous friction, right? I looked in the late 90s around the technology community and there was this huge divide between the people who had access and could easily consume this amazing free software and those who couldn't just because it was too difficult or too foreign or too to Unusable for them and Ubuntu initially kind of came into being because I thought and I was lucky enough that lots and lots of other people joined in with this vision that if we could make that free Platform easily consumable then amazing things would happen right people would build new kinds of businesses They would they would get deeper into new kinds of data and new kinds of science And so that the happiest thing that happens to me all over the world is people come up and they say Thank you very much Ubuntu changed my life It made it possible for me to do things that otherwise I wouldn't be able to do and obviously it's not Ubuntu It's that huge tale of free software, but we did something to try to we tried hard to make that consumable and easily accessible Now a land set me a challenge to talk this morning about Free software in the age of app stores And that's a super interesting topic because I think it's something we could easily forget right the nature that nature of software itself Has changed a little right if you think back to the 90s Software was scarce You know there was a price on software and that price either took the form of you know An obstre cash, which is an obstacle I grew up in a in a in a country very very far away from the epicenter of technology and I couldn't afford Software I remember saving for a year so that I could buy small talk right I was fascinated by small talk and that took a year for me to be able to get it and Then I found myself in a position to say well We could actually just make that great software the best software that people make in the world We could make that easily and instantly available So nobody has to wait a year just because they happen to live somewhere where you know currencies work against them so software used to be scarce and Free software has essentially changed that now today. We have vastly more software vastly more complex software And software that moves much faster than ever before So if I look at the sort of world of software today in this app store era in a really interesting way Six months, which used to be a really fast cadence of releases of getting the new stuff out to people six months is way too slow Right if I look at the really cutting-edge stuff that's getting done now the stuff that I would like to accelerate and help sort of robotics people making robots that can help people live better people figuring out How to introduce smart devices into the world people doing stuff on the cloud and Only about half the stuff that they need is stuff that we can curate at the speed of a distribution Right the other half of the stuff is stuff that's happening on github, right? It's happening at the speed of git right and so in a very interesting way One of the one of the things that's changed as we move into this era of app stores It's just the speed and complexity of software has kind of leveled up and that happens slowly So so like the frog in the pot of boiling water, right? You may not be aware of that change. It just kind of happens But think for yourself how much of what you do on the cloud Involves apt-get or yum or something like that where you're getting curated software from a distro Versus building the latest version of something from upstream from github or from somewhere else So this is one of the areas that that I've been thinking about a lot, right? How can we how can we understand this new sort of speed of software and how can we support that? From the perspective of a distro essentially if you think about the role of the distro It is about essentially taking on common work Integration work to make sure that two pieces of software kind of fit together and work well together You can get them on get them off Trust work looking over the code patching it to address security issues maintenance work, right? Making sure that that stuff can just become a background utility for people The fact that we move that into the background allows bright people to apply more of their intelligence to Solving the problems of society and the problems of the future But there is a trade there, right? It takes time It takes time. That's why it takes us six months to produce a rev of the distro two years between LTS So we looked at how we could potentially in the age of the app store do this differently And the heart of the problem is this in a traditional Linux or Windows or Mac OS type environment all software is the same, right? We treat every piece of software exactly the same every piece of software when it's installed effectively has root right and Not just root here, but root everywhere. So So you install a package and that's great You can app get it. You can app get remove it. You install another one. That's great You install more and because each of these packages can do anything on the system what you end up with this is a fairly complex Story, right? And it becomes difficult to know exactly what you've got, right? You know because you did it once but if there was a hundred thousand of them out there in the world It becomes difficult to reason about all of those different things And that complex interweaving of software really makes sense for a lot of the sort of deep common stuff that we all use like GCC You know the foundational stuff, but it doesn't necessarily make sense for the things that we're talking about now The stuff that moves really fast on github, right? That stuff is kind of a leaf node rather than the web in the middle So we looked at that and we said well, how can we change that? How can we change that? trade of Speed for trust integration and maintenance and so we said well, let's look at two of those things Let's look at the nature of trust on software, right and let's look at the nature of integration on software Now trust is really important because in a traditional world Those packages are gonna just can do whatever they like, right? So when you apt-get install something that package can literally do whatever it likes, right? So we have to figure out ways to trust it, but what if we could put it in a box, right? What if we could put each piece of software in a box and say like that piece of software can only go So far I can only see the stuff that I give it in its box And it can only write in places inside its box unless I explicitly let it write somewhere else And this is really interesting There's a great paper called you know machine for keeping secrets that I read and was talking about how in a sense We get it wrong today We still live in a world where we think that the software is working for us But increasingly the software actually is half working for the guy who wrote it, right? Think about that the software is half working for you. You're installing it. It's your machine But it's also kind of half working for the person who wrote it And so it becomes interesting when you see that to sort of say well What if we could create like a DMZ on the machine and we could say right in there I trust that person with the stuff that I give that software, right, but I don't trust it with anything else so that was the genesis of Something called snappy which you might have heard of right and it's a new packaging system that I think is going to match GitHub for binaries right it's going to be softer at the speed of github with the convenience of apt get right Lots of people will use it just for their own stuff and lots of people will use it to share things in the way that perhaps they use PPAs to share stuff today if you want to create a package that's shared So how does it work? Well the first thing we do is we say we segregate the system using some of the new kernel primitives for isolation and confinement and we segregate the system into blobs of software where it's absolutely clear and Unquestionable who's responsible for each blob, right? So let's take a tour of that system there's a blob there which represents the OS and That can be updated Essentially arbitrarily on any given day by the people who make the OS There's another blob that represents the kernel or the hardware effectively and that can be updated essentially arbitrarily by the people who make the kernel and again we keep all of the files from those blobs separate so In fact the code sits in a read-only blob It is literally a single file on a file system and it never gets unpacked That's really important because it lets us digitally sign it and in an era where there are some very smart people who devote their time and attention to compromising the integrity of our computing I'd like to live in a world where I can check signatures on software every day at boot time so we built that world and this is what it looks like right all of the code associated with the hardware in one blob That has some space that it can write to some read write space But you can imagine that if you just deleted the data in that read write space You'd effectively have reset that aspect of your computer, right? similarly all of the entire operating system in one blob Right with some read write space where you can store configuration or data associated with with that and then apps Go into boxes right apps become blobs single files compressed with everything that they depend on and They get the ability to write to space that is assigned to them that no one else can write to And so we're starting to just change the pattern of trust no longer when you install software Are you trusting that person who wrote that software with every bit of data on your machine? You're only trusting it for the data that you feed to it and that I think fits the modern era of app stores much better If you think of what changed in personal computing with the advent of the app store We now consume software from many more companies, right? I think that's fantastic, right? But we correspondingly have Less recourse effectively less idea of who wrote that software. What are their motivations? What are their intentions? How do I find them right so in a in a world where it's impossible to sort of to square that circle You can't have perfect knowledge about huge numbers of of of actors, right? But if you can essentially put stuff in a box then you don't have to worry about it so much more So this is the kind of Linux equivalent of saying like when I download a game onto my phone I don't want it to read my address book, right? And I don't want it to have access to the microphone now partially we did this because there's a whole new world of computing opening up and in the free software community we have a bad habit of waiting for Larger proprietary companies to invent stuff and then essentially trying to commoditize that But it means that in many cases. We've played kind of second fiddle We've come to the party long after the rules of the game got established And I think that what's really exciting is that for the first time actually maybe the second time We might be free software might be there right at the beginning of this whole new phase of computing so What does it look like and again? The things we were trying to address here. We're trying to reduce the amount of work required for somebody to publish software Essentially the work required to package software whoever's tried a package software in Debo RPM format a couple of people, right? There's a fair amount of Work to be done right there's a lot of there are a lot of rules and the reason for those rules Of course is that those rules help all of those pieces of software that can do anything Not trade on each other's toes. Well because we've put each piece of software in a box effectively There are far fewer rules. You can basically do whatever you like in that box Right, so this is what a package looks like maybe difficult to read But the summary is super clean super simple. This is a package It's basically pulling two pieces of software GPS D and NTP and putting them into a snap essentially a big blob so that they can be installed and removed together transactionally and The reason for that is I'm a bit of a clock freak and this will let me use GPS to run like really accurate clocks in in in the house and so What does that feel like in practice? this is That's that package Declaration so that's describing a snap and you may be able to see that it's composed of two parts and the reason for that There's one part essentially saying here's how you fetch and build GPS D And there's another part saying here's how you fetch and build NTP Now this is a packaging system not a build system, right? The way it works is essentially it's describing those two parts saying the one uses Skons and the other uses auto tools So essentially just Documenting in a structured format what you would do if you were surfing through GitHub and reading readme's and building stuff, right? You'd say here are some dependency packages that I want to have installed in advance I'm going to use make files or I'm going to use auto conf and then just do what you would normally do We all know those patterns. We all do it fairly sort of quickly without thinking This is essentially just a structured way to describe it the net effect of that as if I say snap craft build or snap It will go out and fetch If I still have my VPN running So when done fetch the code for GPS when I fetched the code for NTP a check that had packages up to date and Installed and now it's just going to build so this is a from source build and the reason that's important Is because the the this code that moves faster than the distro can move is source code, right? That's the great thing about the world we live in right now. It's a it's get it's coming straight from github and it's Being built from source so of course There's a different kind of trust game going on here because this code is never going to go through a distro Like if you installed one of these snaps it would be coming literally from the person who built it So we're bypassing in a very real way. We're bypassing some of the Traditional trust mechanisms. That's why we've got to put it in a box and that's why we've essentially got to create a more direct relationship between the user and and the system I'm running a VM, which is a snappy VM and If I say I can't use that get Right why because again, this is a system where there's no read read write file system, right? This is a set of snaps. So what can I do I can say? What snaps are installed here and those are those kind of base snaps that I was describing, right? Each of those is a single file if you actually look to the file system You'd see three blobs effectively that contain all of the data for the kernel or we call the gadget and the and the and the OS I Don't know if there are any updates Maybe something came in overnight. Nope and One of the advantages we get here is that updates become super fast because there's no you don't have to fetch a whole catalog of all The snaps effectively. It's just a single message up saying these are the snaps I've got installed and a single message back saying you might want to try these ones instead and I previously built that Snap and so I can install it just like that and You'll see snappy there So we've got this kind of prickly file system It feels a lot like firmware if you've ever kind of gone into a firmware world and in fact That's that's the sort of spirit that we're going for Occasionally that gets uncomfortable. So one of the things we've added now is Something called classic the classic dimension up. So a snappy system has this kind of rigid file system That's really nice For if you've got thousands of them out there because you know exactly what they're doing But it's a bit uncomfortable if that's a machine that you happen to be logged in. So what we do is again using some of the modern Primitives We create this classic dimension. So you've got the snappy system with its snappy file system And we essentially create a container a special container Which has a traditional there based file system. So now Here app get works just fine. And so you think of it as one system with two faces two dimensions, right? And if you pop into the classic dimension, you can use app to get you have all of those tools available to you It's easy to debug stuff. You can you can look at what the machine is doing. It's comfortable effectively If you flip out of the classic dimension into the snappy dimension, you're back into that very structured very manageable world Okay so The goal is to be faster because the software is moving faster The goal is to be easier because again if we make it easier for people to share things Then everybody else benefits, right? I mean, I love this about free software, right? It is there it is special to to build stuff and publish it for other people to use Right, not only does it kind of help you but just think of what it does for all those other people, right? So we want to make it faster and we make it easy and we want it to make it much more secure We also wanted to make it compatible with classic system. So what I showed you there is I was on a snappy system Which is connected to snaps in the store effectively, but I could pop into a classic dimension And it struck us that we could do the other thing as well, right? You could start with a classic system a dead base system a re-dried file system and you could install snaps as well and I can't demo that now, but it will be in 1604 this idea that in fact When people publish these github speed apps free software apps those could go to traditional Ubuntu desktop and server and VM cloud systems just because of the way snappies built right since everything is in a box We can essentially set up a box for it on a classic system just as easily and so in this way I think we're really going to help people like the kabuntu community We're talking just the other day about how to help communities like that go faster and One of the challenges for them of course is attracting people to this packaging process But the vast majority of the stuff that people are interested in every day the new versions of the new stuff is actually again the leaf nodes it's the apps at the end of the chain not the sort of libraries at the core and So this will allow those communities to package that stuff and share it much faster It also solves another problem. We've traditionally had in the Linux world where our entire software stack was interlocked Right, you've got all of the applications from 2014 and we couldn't introduce newer applications because they would introduce newer dependencies because of the system of boxes now the dependencies go in the box and We're off to the races So we should be able to bring much fast much newer software to the desktop and to the server and from a much broader base of Developers in this app store era So why am I excited about this? Well first everything that we do today gets better, right? So I PPAs are kind of amazing, but it always freaks me out that I'm giving every single PPA I subscribe to root on my system they can all change the kernel on my system just by popping a kernel with a higher version number in and D-package will very happily install that that newer kernel and I might not even notice, right? so As much as I love Google and I'm intensely grateful for the fact that Chrome is such a fantastic browser on On on a bone to I'd like to keep that code and I think Google would appreciate this too I'd like to keep that code focused on the stuff that we both trust it to be trusted for right because it's enormous It's an enormous attack vector So things like third-party software on our existing world go much faster But this is the other half of that right we're about to see an entirely new domain of computing created We've got personal computing and that's been getting more and more personal Right your phone is the most personal computer. We've all ever had right and then we've got cloud computing Which is sort of super professional right if you think of clouds their giant data centers There are lots of professionals watching them If something goes wrong there somebody notices and jumps on it really quickly But I think about the Linux that's running in that Wi-Fi access point up there that's blinking red That's kind of kind of awkward that it's blinking red Right, what does that mean? Is it broken right if it's broken and someone has to get there? Just imagine what that involves it could be more expensive to reach that box Then the box cost in the first place right and so in a sense you're yay Linux one That's running Linux in another sense yay new responsibilities Right, we have to think about building software to support this whole new class of device Drones this is a drone from DJI an amazing company Making great drones and this is the first drone that they launched with a Intended goal the specific goal was to attract software developers It's got a little Nvidia motherboard on it It's running Ubuntu and the the reason it's running Ubuntu is because all of their research showed that the developers who doing the amazing Computer vision and collision detection and avoidance type algorithms. They're all using Ubuntu, right? They're using the free software stack expressed in Ubuntu and so you know Maybe something like snappy enables us to get faster better apps on to drones If those are going to be flying up around us, I'd like to know that they can be secure, right? To fix the software on that I have to wait for the vendor of that device To publish a new version of a single monolithic blob, right to fix heart bleed on that device I have to wait for a vendor who Doesn't really have anything to do with the operating system normally Their focus is on a single application in a snappy world because those are separate blobs I can update the operating system on there as soon as there's a new blob Version of the operating system that comes from the people that I trust to deliver that blob, right? And I can update the autopilot or the whatever else it is as soon as As soon as those guys have produced a new version that fixes the issues that they're responsible for Robotics this is just if you haven't been to a robotics fest in the last year. It's just exploding. It's just amazing, right? What what is coming out of labs right now will blow your mind, right? We are genuinely at the dawn of a new era all of that running free software all of that running Linux All of that right now completely crazy, right in the sense of you know If you had all of those robots running around in your house and another heart bleed happened You wouldn't know where to turn right because it would all be compromised. It would all be vulnerable GE Essentially has said that every single appliance they make from jet engines down to kitchen appliances will become smart That means they'll be running Linux that means they'll be running our stuff free software stuff We're gonna be responsible for that in an entirely new way Smart cars cars that drive themselves. They're all built on free software and these Devices don't have that same property of being either personal in other words. Somebody looks at them every day or Centralized in other words. They're closely watch 24 hours 24 7 right there sort of just distributed So we're gonna have to figure out how to work with the software on those And here's where I think the opportunity for people is you know This is a this is a town of inventors and scientists and and and dreamers So what kinds of things might you dream? Well, there's the hardware and I think the hardware is gonna behave economically like hardware does it'll be produced very cost effectively somewhere else, right? Almost certainly But even the guy who's making that hardware is in a super competitive position In fact, most of the magic here is gonna be software and I assume that just for the core function of that software I'll have free versions of that software open-source versions of that software and proprietary versions of that software And so we need to be able to accommodate that full mix But in fact the guy who made the drone Only knows about flying that thing around so I would trust him for the autopilot Right, but think of all the things you want that thing to do right What if I attached a camera to it and now I could or a sensor now I could look at farmland effectively and and and and conduct Analysis right well think of all the sorts of things you can do if you have a moving eye in the sky traffic analysis If you run a city the city of Pal Pasadena Nutrient analysis if you're if you run a farm. I love the example of Ski resorts that have to find areas where they might be avalanche risk and then drop hand grenades on them Right. I love the idea of an abundant in a buntu-based drone. I'm gonna get that through and get that through the TSA What's that? Oh, that's a it's an automated hand grenade dropping machine Well, come on in sir. Yeah Nice clock All right, so this is what we're trying to set up right We're trying to create this framework for people to invent stuff I believe the vast majority of the fun stuff that gets invented will be built out of free software and I hope we can help people go faster So that's the one half for what I wanted to talk about other half What I want to talk about is on the other end of the spectrum, right? The other thing that's changed in software is we've entered an era of what I call big Software you've heard of big data, right? Think about big software, right when I grew up All you needed was a single machine and you could do all the fun stuff on that single machine You know, you could get your lamp stack You could get you could set up all the things that people were talking about you could be part of the cutting edge Just with one machine, right and essentially for most people who are passionate about technology having one machine somewhere like on the side Was free cheap easy consumable, right accessible The challenge we have now is that the really interesting stuff like the idea of building an AI in your basement, right? Doesn't run on one machine anymore In fact, it's not even just a few pieces of software. It's big software. This is a phase change And so again like the frog in the in the in the pot That's where the temperature is slowly rising, right? We may not be aware of that phase change So what's happened is that softwares gotten bigger and bigger and the approach that we take to that software the Tooling that we bring to it the way we think we're going to do it needs to change to match that If I say to you you've got to get a hundred tons of H2O from Pasadena to Santa Monica, right? You'd really want to know am I dealing with ice or am I dealing with steam all the tools would be different The mindset would be different the risks would be different, right? And so in the same way if I said you're gonna install some free software You'd actually want to know are you dealing with something that's going to run on one machine effectively or something that perhaps Needs an entirely different way of thinking about that software. So these are some open source projects and free software projects They're all pretty amazing. They're all big software, right open stack Hadoop TensorFlow Google just open-sourced this very cool deep learning neural network AI base sort of construct Cloud Foundry kubernetes mesos These are all things people have heard about but you'd be amazed how few people actually get to play with them because unlike the software of the 90s You can't just stick it on a laptop on the side to really understand it. You have to be able to work with it at scale. It is big software and The interesting thing here is that the scarcity Is no longer the software back in the 90s the scarce thing was the software it was a miracle That you could get a full TCP IP stack for free right set up web servers amazing What was scarce was the software back then now what scarce actually is the knowledge the operational knowledge, right By the time one person comes to understand open stack open stack has changed Twice Right and exactly the same thing is true of big data AI has big software So I've seen super competent teams crushed By big software because they charge in thinking where hey python on Linux we've done this before right and that's why we've spent so much time and effort building A new way of working with software a new way of thinking about software at scale So today's software is about topologies and scale right and the operations are really about managing the topology and changes in the topology over time at scale It's a topology that doesn't sit on two machines or four machines It sits on hundreds of machines and it's the mapping of software to machines and the gluing of all of that together That is scarce the knowledge of how to do that. So what if we could crowdsource that knowledge In the same way that we crowdsource the code itself, right When you buy sass Right, what are you really buying? If you buy elastic map reduce Hadoop is free. What are you really buying? It's the operations So what if we could open source Operations for big software right and what if we could codify all of that so that people could just reuse it in their basement The way we all started reusing Linux packages in the 90s. That's what juju is all about This is a picture. It's a logical picture of a big data deployment some software Notice you can't you know real idea at this stage how many machines that's running on right because what I'm drawing there is a logical description Of services spread across some machines and what matters in this view is just what's connected to what Each of those boxes comes from a kind of software a kind of open source software. We call it charm That's essentially a codification not of the software, but of how you operate the software How you get it on how you get it off how you connect it to other pieces of software All of the things that somebody who wants to be like a total expert in that software would need to know all the stuff You'd find in the book about that software, but instead of reading the book You can just use these charms their open source and The beauty of this is that When it gets better it gets better for everybody at the same time Now it's difficult to do this in the same way that it's difficult to create a deb right but once it's done Thousands of people can use it without having to dig into the book effectively and so again we have exactly that same Same dynamic of sharing of something that used to be scarce in a form that is easily consumable everywhere If I want I can go and have a look at what's actually mapped to which machines that's obviously super important And I can do all of this at a CLI or through a rest API but ultimately this is what it's about It's about saying here is a distilled version of a complex thing that would take you weeks to figure out and set up And then be too brittle for you to want to touch it instead of that Here is a distilled version of that that you can use on any cloud or on your laptop effectively If we can make your laptop look like a cloud and we can And the store angle on this is that ultimately that becomes a repository of goodness It's a repository of competence not a repository of software We really have repositories of software It's not a configuration management system either because inside those charms Whichever communities collaborate on those things they're using puppet, they're using chef They're doing the configuration management inside those charms I don't have to worry about it This is a modeling system and a store effectively of the knowledge of the free software community for big software So it's an app store but not for software for operations It gives you the SaaS experience with on-premise control The dark trade at the heart of SaaS is the loss of control of your data And in a sense that's just as important at scale as it is when we're thinking about software on a device And we want to put it in a box and control it So what's at the heart of that stuff? It's code And code what we've learned in the last What we've learned in the last over the last couple of years of doing this Is that the unit of collaboration here is not actually around a single piece of software It's about common aspects of operations So here's an example here are two charms talking to each other And they're actually made out of reused operational code So for example there's a chunk of operational code called a layer that would handle setting up a JVM And in fact you could reuse that in any charm that was a charm of Java software On the other side you might have a layer that was used for setting up Python code And all of the common operational practices that would go with that Similarly for key generation and so on But there's a shared layer there which is specifically around the protocol that those two pieces of software are going to talk And there's now a rapidly growing community of people contributing this operational code Largely in Python it doesn't have to be, but largely in Python effectively Okay So I want to wrap up with just one teaser trailer of something new in 1604 Which comes out in April And that is something called LexD Now if you haven't played with LexD, LexD is essentially LexC 2.0 It's a hypervisor that gives you virtual machines on your laptop that are Linux only but super super fast So they're Linux only because in fact those virtual machines are containers But there's been an enormous amount of work to make them look, feel and act just like virtual machines So you can get a CentOS one, you can get a Debian one, you can get a Ubuntu one and off you go Super fast, super light I think that is the single tool that is most going to change what people do with their Linux laptops Because it's going to allow everybody to work with big software in a very realistic way Because you can actually have 50 machines running on your laptop on an airplane Whereas today there's very few people that actually get to work with 50 machines all day long And develop code, right? The coders tend to have far fewer machines available to them than the ops guys So if you haven't looked at it, that is the single thing that I am most excited about For everyday developer usage in 1604 The nature of software is changing, the nature of our communities will change to match it But it's been a real pleasure to be here at scale because more than almost any other conference This feels like one where it's smart people coming together to figure stuff out without much of an agenda I hope this stimulates debate, thought, discussion And I hope some of what I've showed you is super useful to you all in the years ahead Thank you very much There we go So thank you very much Mark I've got George Castro in the audience here with a mic if folks have questions for Mark Just kind of raise your hand and George will come find you with a mic And while he's doing that I've also got something here for Mark So thank you for joining us today and for being a member of the team And so we'd like to offer you this jersey I can't believe it took me 14 scales to get one of these I finally made the team Thanks Hey, so I have a question about LXD You spoke about it and you described it as a hypervisor But you also said that it's an extension of LXC Is this truly a system which allows different kernels to run within it? Is it truly a hypervisor? No, so it is a hypervisor in the sense of providing sliced machines It's a container system in the sense that all of those use the same kernel The key transition that I expect to happen in the next couple of years Is when the silicon that chip the CPU guarantees the isolation of containers Which we don't yet have But all of the major silicon vendors have expressed that that's on the roadmap And so at that point you would have the same isolation guarantees You can't run windows in a container But I think you'll see the LXD API on Windows To get Windows containers on Windows So the LXD API gives you a single rest API to talk to a machine To say give me a slice of yourself with this effectively guest OS You'd have to talk to Windows to get Windows guests You'd have to talk to Linux to get Linux guests But you could get them both So Mark, I live in the AWS world And in the AWS world we use Ubuntu a lot But it's sort of a second class citizen Do you think there's any possibility of that changing? So when you say second class, do you mean relative to Amazon Linux? Yes So actually I like the fact that the clouds have teams That work on their own branded Linux on the cloud I know that large users of those clouds Have good reasons essentially not to use those Because that would be tremendous lock-in But in fact I think there's a positive side To the work that those teams do Remember they see the other half of their infrastructure In a way that we never can And so for example Google does this as well They have teams that are essentially trying to figure out How to make the guest go faster How to make the guest more efficient And what they do is they figure stuff out In a place where they can go really fast They don't have to ask anybody's permission Or no one else is going to care effectively So they figure stuff out and then they tell us And hopefully we're really good at taking what they've learned And moving that into Ubuntu The Ubuntu that you get on each different cloud Is tuned for that cloud because of that process And genuinely they're in a better position To lead that process for their cloud than we are So I'm glad they did it And I think you shouldn't feel that Ubuntu is a second-class citizen On any of those clouds We have great relationships with them And they feed us a lot of information And there's good quid pro quo in that The tool set on AWS Linux is more developed Than it is on their Ubuntu and... Do you mean the AWS tools? Right That's good feedback, thank you So we've got time for just one more question Maybe two Let's see how this goes So one of the concerns that I've had For quite a while in open source Is that we continue to abstract away the lower level And in a lot of ways that's a really good thing You know we've abstracted away the kernel with Hal and Debuss It makes it a whole lot easier to Interface with devices on the system Now we're abstracting away configuration Of servers and services that Such as MySQL, MariaDB And that's also a great thing for operations But we have to hand off everything that we're developing To our children And are we about to create a world where we have children Who are never taught to develop on the kernel Because there are no kernel developers anymore Our children can't develop at the low level Our children aren't going to write software Machines will write software for them For sure So my question is... I hope it's not a dumb question Has container technology made Cloud platforms that run on hypervisors Such as Zen and KVM Has it made them obsolete effectively Because of the performance benefits? No What we expect is that you'll get clouds Where you can get either or and both Containers and NVMs Today there are still reasons in a public cloud For you to want to be inside a hypervisor Inside a virtual machine Reasons for both sides For the host and for the cloud guest In a private cloud case That's much less clear In a private cloud The main reason that we see as containers mature To keep VMs To the question earlier For alternative operating systems Where if you want to run something that's Q and X Or something that's in DOS Or something that's written for Windows On the Linux host You couldn't do that in a container This will be a graceful transition All I would encourage So that you feel comfortable with it Using it in places where it's useful for you Certainly useful also for getting more Out of the VMs that you buy on the cloud Because you can slice them up And so you can be more confident Stuffing more software into the VM And keeping that software Somewhat isolated from itself For management purposes One of the cool things that LexD got Over Lexi Was the ability to guarantee quality of service To do CPU pinning To guarantee a certain amount of time Or RAM Or IO effectively to a container So starting to gain all the primitives That you'd associate with a hypervisor Ilan Well thank you very much Again Mark If folks have more questions for Mark Maybe he's around all day And maybe you can catch him in the hall here Thank So a couple of quick notes About the program for the rest of the day First as I wanted to thank you all For being members of the Scale community It's been 14 years that we've gotten To get together with you guys And have our large reunion with our closest friends And family from the open source community Just all 3,000 plus of you So thanks for coming out every year As you know I have a couple traditions Each year at Scale The first is we're running Weakest Geek Tonight in this room at 7pm And you've got some great contestants That'll be on stage here For some comedy gold After that we've got the Scale's Game Night Which will be just behind me here In Ballroom's INJ And so you'll have a great time to play With board games, video games And lots of other great surprises And then one last administrative note We have Two talks that switched on the schedule So please keep an eye on Guidebook Dan from Victor Ops will be going In the 11am slot Sorry 1130 slot So again thank you everybody for coming out We're looking forward to seeing you tonight Please If you see a Scale staff member Wearing one of the yellow shirts Or the Star Trek-y black shirts Please thank them Those are your AV and tech crews Here at Scale