 Yeah, we are just talking about our experience with the Osmo-Komstek at the Congress last year, so It's a little bit chaotic, so slides are from Kevin, Nils and I will talk about it, so hopefully it will not be a karaoke We are well prepared just like for Congress. Yes, it's similar to it Yeah, so this is how we started so at least you can see here. It's still 3G is sometimes working sometimes not This basically tells how good the data it's the data over 3G work, but it worked To the I think last week ago. I fixed the bug why it wasn't working. I I broke it before I I No, no, I think it was 3G Yeah, what what we have done, so let's start with the frequency So we got actually two frequencies. We got 3G in some band gap. We found Up up there in the 850 megahertz band. So it's actually it's a US band It's used in Europe, but not for 3G or not from GSM or anything. It's actually used by those microphones, for example but we could get a license and Seems to be we did not interfere with each other at the Congress and we also managed to Borrow a couple of RFCNs for GSM from Telefonica, which was quite great because it was quite on short times this year So the problem is that there is no GSM band left actually I mean, of course, we could have also used the five megahertz for 3G for GSM, but Yeah, the problem actually is in Germany. There's no real free spectrum. And yeah, this is how we how we basically worked out It's the last Congress. I think we had four. I don't recall the exact number of RFCNs. I think four I think four or so with quite a low Transmission power about I think 100 milliwatts for 1800 and it was 10 or 20 milliwatts for 3G So here you see we used the Sysmo VTS for For 2G and for 3G we use IP access which worked at 3G we did not had any handover or Anything related to it. So if you move out of your 3G while having a call, of course, it got disconnected But for 2G we even had handover and it worked So yeah, here you see where so this is the Congress, it's quite big actually But we don't know if the coverage was good or bad, but we didn't have so great statistics I will come back to that point later. But yeah, it was lots of base stations and the deployment worked well So we had more software problems and hardware problems Guess where the GSM room was It's where the one or nine and the two are together in the same small room Yeah, so we had basically one huge 2G a handover cell basically this one was one which could cover all cover the middle and all a little bit to the 2G cells around it So that was the idea that you can basically even walk with having a phone call from here over There was bridges Over here, and you do actually two handovers by by working there. So that actually worked Yeah, this was our great setup what we've done so it was a couple more demons Oh, yeah, right and some important stuff so two years ago We had to create this while true around the whole setup because some of them were crashing other ones not But last year it were everything was better. We only had one while true loop only everything else Work stable in a quite stable way The other ones just stop because we kept stopping them to try new stuff Yeah, but yeah, we already fixed some of the bugs there was also interesting to see if you have a setup with couple of thousand people, but I think it was around thousand Sim cards online. Yeah new features We managed to get 3g voice working. So 3g has a little bit different amr 2g has so 2g and 3g has a little bit different amr in short So it's also I think how they are encoded and Before we just couldn't directly connect the 2g to a 3g call We could we could only do 3g to 3g called before but this time we managed to make it working and could even Call into the other network. So at Congress we have won the GSM network But the GSM network is connected to the phone operation center. They do like DCT They have it's much bigger DCT network They they do there and they have a lot more subscribers and they do all the call routing They do the numbers and everything. So basically we connect our GSM 3g network to their voice server in the end Yeah, and because last year so two years two years ago We just deployed 3g and said yeah 3g is working fine We have no idea we don't have time because of this big Well-true loop around it, but this year we said, okay, might be there better way that we can have stable and unstable Users at the same time so you could Enable and disable 3g via usd. So you just call usd enable the 3g in the HLR and that way you You could enable it the same for 2g so you could basically disable 2g and I've heard some users Disabled 2g and 3g at the same time. I Don't know how that worked So it came about like 3g was so experimental and there was also actually another idea to say that like We added a couple of patches one was to send to the HLR whether the subscriber is connected on 2g or 3g So we could enable or disable it But the other one was also to send it via sip to the pock. Why did we do that? Because Thomas had the brilliant idea to if in case the subscriber is connected by 3g to tell the the subscriber Via a like the point was we didn't know whether voice was working fine So his idea was when he's calling via 3g to first tell him by a voice Wavefile you are connected via 3g and voice might be experimental Which obviously wouldn't work if the voice doesn't work And if it if you hear the sound you're fine, then you don't need to know it So I mean that was one side One part of it and the other was the ussd to enable or disable 3g and then I went one step further because I wanted to test If 2g is available Does it if 3g is not available does it switch to 2g and vice versa? So I also added a a switch to enable 2g and by that I created a Path where you could block yourself out of both 2g and 3g and have no way to get back in and I don't think many people did that in fact, but I managed to do it. I was like, oh, you're disabled too, you know, yeah, oh damn To grow in a database and fix myself again Yeah Yeah, also, we didn't had any inter wet hand over anything So if you switch from 3g to 2g you just have to complete Yeah, you have to do a routing up area update and of course no hand over between those and between 3g to 3g only 2g work well So from my opinion we could say we had stable CS which is Also quite important so people could say okay. We don't like the DCT network. We would like to have GSM and in my opinion I was quite reliable available, but Yeah So except something broke down Some somebody disconnected one building by a small cable which was actually in our room I don't know who yeah, but they came to us and fixed it themselves. So it was really nice This was our ticket system. It worked quite well. So up till we arrived. We had like the usual ticket system Online, but then we switched to offline ticket system and yeah, it really worked great that way. So my opinion I would like Do it the same way again at the camper Yeah, the place it doesn't drain on otherwise all the tickets are lost Sixth hopefully Wait Can you explain how the picture works so which issues are open and which ones are solved Good question sort of going from left to right is the more volatile Undecided issues to on the right the blue ones are the fixed the done ones basically To me these steps that I can't really see So but basically the door wasn't used because that was too unstable for the ticket system thing with some something like here left one is Un is open and right is closed Yeah, so We still have to work on it, but I mean So for one thing as We as team has to organize with two other team basically so for one part, of course, we have to Coordinate and communicate to the phone operations center which much which also much more improved over the last two years The last three years, but we also have to talk to the knock off course because we are connected We first need one. We need our layer to network across the whole side Or we don't need layer two, but we use layer two and on the other parts, of course, we have to have some Cable wall ports connected into our layer to network. So that one also improved a lot and so we are depending Most likely on the knock to set up our systems I mean the connection to the park is more likely our GSM server must connect to their server over the zip connector but Yeah for the knock so we have to cooperate so it's also somehow hard to let's say build one week before up because at that point We don't know if net is network still there It or another example. Yeah, okay replace our base station up there. Oh, somebody's building a building in front of it That's those kind of forms or so but yeah, but I mean we managed to get GSM Working at day one that was I think two and a half day earlier than last year So yeah, really really improved as as a team Yeah, I don't know where the number comes from 17,000 Sim cards so far so across all yeah Yeah From the HLR Yeah, but so so as again we improved on the statistics But they are still not working reliable. So we had statistics, but they didn't really look well. So we On one side. We didn't have some time to look what's wrong with the statistics on the other one So we would have created also nice dashboards How I mean was the coverage good how many call Errors did we had and so it's interesting statistics We all hadn't really time to look into it why they did not work For example, we had like two and a half calls. What does it mean and Other really strange statistics Yeah, for that reason we couldn't even tell you hey, how good was the network it worked for me yeah, and This is I think one of the phones which did not work anymore because we switched to a mar Yeah, exactly. So the point with 3g was we didn't do any transcoding so we forced a mar on to 2g and Lots of phones can do a amount to 2g the Nokia phones and some older phones do not support a amount to 2g so they could send SMS's but it was impossible for them to To send to make voice calls and it's quite a pity because on these conferences You bring your old phone which is reliable which has lots of battery which is small because you just want to be reachable You don't you already have a smartphone for something else So yeah, one of the big issues was that the old phones weren't supported anymore because we enforced a mar and we didn't do any transcoding Yeah, but I think it was your old phone There's lots of other old phones that still worked anyway but of true, of course, it would be nicer to also support what fr1 even and then Dynamically choose which one the phone is capable of yeah or send SMS Hey, you have a nice phone there, but actually you cannot do any calls, please by a new one You can send a voice message For example, we could do that. Um, oh wait Yes, so that are the to-dos we we collected there there's still a lot more to-dos So I mean the coding we already talked about and I don't think if either was really possible without contracts so far Yeah, 4g. Let's let's jump to the camp talk about that that thing or I don't know that Dexter or so Talked about it right about 4g Otherwise what I can say the contact to the park was very good this time and even weeks before Congress I was having Talks and even like phone conferences with two or three with with linsus and tomas from the park and we had VPN tunnel set up on our like dev server connecting to the park dev server and we were already Using the Congress Network when we were still at home and basically only would have had to move the VM onto the Network premises except some some guys are not looking at anyone decided to completely wipe out the server So we had to set up everything from scratch again But also that worked pretty nicely because we had everything in a git and Ansible and so on and so on the I actually also use the conflict templating nonsense that I wrote in my Osmo dev git some of you might know it and Yeah, all in all last year I was really You know it was really Frustrating because I was working on the Osmo MSc split for a long time And when we really tried it everything just basically fell on its face and it felt a bit like my fault And you know, I was really yearning to see the network running smoothly and I got this in December and that was really nice to See, you know that all the fixes Of course also due to the tons of TTC and three testing that we're doing now and The improved stability we got from that really, you know drove our network to a much more stable State and was really nice to see it running Yeah, I think also that that the The team also improved. I mean like three or four years. We are three people and now we are 10 to 15 people So also a lot more people came through and said, oh, we are nice project Let's let's work together on it. That was also quite great also from the organization standpoint. So we We had we have meetings before we are preparing the setup We're also having a test network even with the together with the park is it's possible to basically Test before Congress everything and not at the Congress that are some proof I mean, we have also a lot of to-do's on our side. For example, we Lost a lot of core dumps of the crashing network and the locks together because Yeah, we didn't test it before That that's a crash dump collection and locks and pickups work like well I have even an idea how we want to copy it over and and so on. Sorry Yeah, I think it worked quite well at least if you only use 2g you had to stable Connections this year Yeah, and also with all the new split-stack of course Yeah, I think so so far for the last Congress this that was it So we have a lot of to-do's but I think that would be more likely the camp discussion or talk Because all our to-dos are now at the campus So it's also nice to do more than one even the year But I mean the problem is where to get the licenses and to it because the park is doing for even the year or even more I don't know exactly but of course you got much more practice when doing it more often Yeah questions so far I'm wondering how did you restart the components? Did you just shut them off or? We don't have to restart them usually they crash Okay Good answer, but there are system D services and system D is restarting the service afterwards Okay, I remember all the banners were compiled with all to optimization and that actually made like Investigating some core dumps Like more complicated. I think next time it would make sense to avoid this optimization The big problem with you know Tasting patches and so on was that the hardware we were using was an old Rack that looked really fast You know judging by the noise it was making But it was also running on a cryptid disk So only compiling the Osmo IUH Source trees it took forever like On my laptop Compiling everything takes like what three minutes five minutes max and there I was like sitting that's half an hour later It's still you not even halfway through and I'm just waiting At one point I completely crashed the entire system by removing some libraries by accident And then just want to quickly Recompile and reinstall and then the whole thing went through and was down for what an hour or two before the bloody server The fun part of the year before so that was last the last Congress they had this Nice noisy machine, which he said, okay, that would be more powerful the year before we did everything on the APU The same setup and it was much faster. Yeah, the point was after the APU We wanted to have a proper system and place what we got was something like what two three times slower than the APU Yeah, so everybody is also invited if you like to play with with the camp or Congress network just Yeah, just join us and have fun at the Congress or camp Okay