 Welcome everybody just before lunch Here we're gonna head to talk about Drupal and the open web and the New Zealand government and the keen-eyed They went to Drupal South Brisbane would have seen the similar talk there with the Australians This is the New Zealand flavour. It's a little bit more slides and a little bit less time. So just bear with me For those that don't know me my name's Sean and I help lead a team of talented people that look after enterprise customers I work for a MZIO and being in the Drupal Sphere for Too long Maybe a dozen or more years So the problem statement I'm here to try to answer is how popular is Drupal and and the open web in the New Zealand? And if you have a bit of money, you can actually probably pay to achieve this Following services but Me a real staunch open-source advocate. So I needed a more transparent way of doing so if you plug in wapalizer and Wapalizer under the hood uses puppeteer, which is a chrome orchestration engine You can achieve various The next statement is how do I get a list of all the New Zealand government? And just like in Australia. There's just too many sources There's gov.nz or slash organizations if you want a to z you can do some snooping on the transparency logs and the trails as well But the main problem is is that there's no ranking or importance associated with those and Here I've picked on the inland revenue who I used to work for and the Wara Council where I used to live under so But one of these sites is going to be a lot more sort of important to the country of New Zealand. So we need a way to quantify this and Toby actually let me Into the secret about this site. So there's actually a cool little site called dom cop And they have a giant list of 10 million Domains on the internet sorted by popularity And you can download it. So a plus And it's got this thing called page rank attached What the heck is page rank for the people that have been in the web for 1996 you would probably Remember there used to be a page rank toolbar you could add to your browser and it would tell you the score And it was really important to get a big score, you know Because that's what Google used back in the day solely to determine how likely you would appear on the search results For the purposes of this talk The score was zero basically means that their site is low quality or just brand new A score of 10 would be like Wikipedia. So if that's how you Think about it page rank is logarithmic with a base of five Similar to the rectus scale a bit different So this basically means a page rank of four is five times more authoritative The site with page rank and you can convert it to decimal for the purposes of math. I like then we can add stuff and Just like in Australia, New Zealand is also victim of the mogs and link rot and Where I've got a pulled out a couple, but big cities has moved We won't tell you where And the Auckland City Council They can't be found especially when it's flooding and Lins, I think you go you get bonus points for this era page. It's just Crawling its scale and let's just say a lot of New Zealand government domains have encapsular sitting in front and a Capsular is not a my home might be in a capsule are not friends anymore. So we had to change it a few times luckily dynamic ideas exist and For the people they just want to see some graphs Here we go. And this is based on March 5th data. It is not perfect underscore that it's the best that we have available at the moment and If you have a brand new site, they've just launched. Yeah, don't be sad if it doesn't list just yet But this is the one chart. I can't actually break it down by state in New Zealand because we don't have any Not like Australia, but what you can probably see at a nutshell here is that silver stripe is actually Dominating with over one-third of the sites that you likely visit on a day-to-day power by silver Unknown is only 22% was actually quite low It's actually higher in Australia and Drupal 11.6 coming and Then it's actually quite hard to see but there's actually extremely long tail of CMS's and I'd say just a lot more in general and I just pulled up the Australian one just so you guys can compare and contrast so So Drupal over there about 27.7 and the next top is actually squids So very different kind of composition sites even though, you know, roughly the same Demographic the top 10 sites We've got health coming in page ranked 5.8 7 which if you convert to You know normal base 10 about 12 and a half thousand te Papa doc stats the COVID site immigration, you know The Christchurch City Council Sure Now here's a part. I actually had a lot of fun with was actually pulling out all the weird and wonderful thing as a course of doing this presentation and First thing I'd highlight is that Drupal powers roughly, you know, 11% of all the digital So that helps to like when you're at the code sprint on Friday, hopefully that will help you You know realize where the efforts going Silver stripe is definitely the lead and one one sort of Observation I had from this is that if you do supply a common web platform Like in Australia, it happens to be based on Drupal in New Zealand happens in the base based on silver stripe it's hugely influential and Government department loved this so I Think that's a real big win for the teams involved And squizz is less popular in New Zealand, which I found weird They've got a lot of headquarters and people here Drupal by version I don't know if you know this, but you don't have much time to hang around on Drupal 17 So I think it's November so No pressure No Drupal 10s either, which I found kind of interesting Small smattering of But this is by far and away my favorite chart out of this exercise is that roughly three-quarters of all the powered by So this I think is absolutely really happy there's still a few sites that don't believe in certificates and Yeah, there's always a few And I find this one particularly I don't know like a little bit irony maybe like the sense of their site so much that they don't want to display any content Yeah, so it's just an Apache index page good stuff and Yeah, just like in Australia people kind of get sick of just dub dub dub, you know like what if I come up with a new site What now So enter dub dub one You know, it's the holy grail dub dub two that's for pros and Then they're like other dub dub one dot math, you know, like this isn't just a test page It's an enterprise page and then I thought these guys actually stepped the game up. They aren't dub dub 100 Like it's an actual site. You can visit this thing It's about the centenary of the First World War. So the domains a little bit of a play on words And I thought well, it's only a matter of time really so my challenge to you guys is on a dub dub 9000 like make it happen There's an awful lot of redirects happening in a non-sensical fashion This is extremely common in the New Zealand government and For the people they can pass HTML in the head. This actually does a redirect in your browser after zero seconds And it's an actually be 200. It's not a redirect response cozy and so very difficult to crawl this because You need an actual browser and here's a lens example same thing And this is actually a fully fleshed out CSS images. The full works just to let you know We're going to redirect you and this guy has actually Reimplemented a engine X rewrite map in Japsk Perfection like mwah dangling DNS This is potentially a security issue So I've redacted the domains out of it and I'll probably get in contact with the departments after this but Suffice to say if you point your DNS at Access provider, this is a zero and Then you forget about it. Maybe you decom the is your side, but you leave the domain pointing at it I wouldn't do that This one points the site host So, yeah, I'll probably reach out to those government department do And we're also seeing the sort of rise of engagement platform Also as well. So from consultations to Yeah, just generally getting feedback and from the constituents and I came across a few apps during My crawling here one from datacom could data scape Another one could sit in space and then the last one is bang the table But they've just rebranded to engagement HQ and then I thought I'd leave you with the highest quality fine So we've got the perfection of layout here one that one spacer gifts We've got tables because CSS were never kept it was perfected 20 years ago and has never been updated It's got support for modern browsers like IE for it's got mm preload If you recognize this function, you read the side is ill It's got dogs in the home page and instead of a search button. It's got a button called fetch It's got TLS though. Think about that for a second. Um, yeah, this is it. So if you ever wondering I go Visit them because I've got Google next. I'll see a spike in traffic and I go what's going on Dog safety dot gov dot NZ. Oh, I love it That dog's got a really long tongue. I don't know what's going on there. So going further I'm gonna also probably Make this something that will be trending over time because I realize is giving a snapshot of the data is only so useful I think actually having the trends over time and seeing if Drupal's increasing or decreasing or the relative Changes in the landscape would be more important I think also the US government would be super interesting as well because they've got 50 states be a bit hard to condense down but and Yeah, I still want to publish this data as well. So I still want accessible Yeah Again, there's been a bunch of Wapalizer changes and there'll be maybe a dozen more after this talk as well just for better SNFs for technology and stuff like that and That's thank you for coming. All right. Any questions? Tom Right noted. I could be a kid. Yeah, they might block me from entering the US. That's Yeah, I mean I mean often you Sorry. Yep. Yep Yeah, so the question was how aware was the New Zealand government of this information and would it be beneficial? So I think it would be of benefit to them to be more aware of this, especially things that security angles like DNS Stuff like that. I think it's super useful to to know about But also maybe if I've got sites that I just Need to be put to pasture like maybe just Been a bit proactive and maybe making it static and sticking them on you know Static hosting provider like GitHub pages National Library. Yeah, there's already a system for this like let's just let's just use it Having a lotus notes application Yes, I don't know the most secure thing the internet So the question was how do I like not there's a small fraction of Drupal sites I couldn't discern the major version from and like to answer that question. I'm not actually doing deep SNFs as to Going any further if your site identifies and you know the meta tag Then I will pick that up If you're obfuscating it because security and obfuscation is your thing then It's not it's not going to go any further. Obviously you still can discern it It does not end like I have used other tools in the past They're a bit more aggressive and they will empty five hash literally every static file that you present and then compare that with the no one hashes and But that's super aggressive. It has heaps of requests and I haven't I've tried to be nice to the site so Yeah, and like I think just in general like if you are if you do have a website I think it's quite important that you do present the major version. I think that's quite useful I don't want to know your minor and your patch care about that but at least Sure major is quite you and that goes for all CMSs as well like Silver straight four versus five like I think that'll be really cool