 Today's webinar will be about open data, so last time we have delineated our catchment and now we want to populate that map, that project with open data and today I'm going to show you what's there to do that. So I'll first introduce myself, I'll keep it a bit short this time because we have quite a varied program because later Kurt will tell you about the QGIS community because QGIS is not just great software but it also has a great community and you can be part of it and we also, after the exercise, we have a mystery guest that's related of course to today's topic. I'm very happy to have this person here, I'm not going to give it away yet and then we'll have time to ask the questions and until the geo beers. So I'm Hans van der Kluest, senior lecturer at IHE Delft Institute for Water Education, my background I'm a physical geographer. I studied at Utecht University in the center of the Netherlands and I also did my PhD there on integration of satellite data in soil moisture modeling, field work in Morocco and Spain and then I started working at the Flemish Institute for Technological Research as a researcher in environmental modeling, working on land use change models, urban remote sensing for urban heat islands, water quality, those kind of things. Active with open source already at that time we had a nice team working on Python and exchanging knowledge. Since 2012 I work at IHE Delft as a lecturer in ecological modeling. I'm a board member of the Dutch QGIS user group which was just established at the end of last year and I'm teaching GIS and remote sensing in my institute but my interests are also well anything with open source GIS modeling remote sensing. I'm a QGIS certified instructor which means that with all the courses you follow with me you'll get the official QGIS certificate. After successful completion which supports QGIS but also you have something which is an international certificate and our institute shows that we support this great open source GIS. In our institute we have a nice group on QGIS for remote sensing for hydrology where we work on water accounting and water productivity for example. I will show you a little bit about open data that we use there. In my projects I work on spatial data infrastructure, sharing of data that's if you connect many GIS's together you'll get that and the open standards and open data that's all the topic of today's I'm going to tell you more about that later and as I say every week we are not just people behind the desk although now we are a bit locked in because of the situation that normally we also like to be out of the field and I know that many GIS people are also field people also like Kurt to be out there and do hiking and making maps of the things that you see so field work is an important part of the GIS world and they're great tools also you can use for that. If you want to contact me you can send me an email, connect to LinkedIn or other social media. I'm going to give the word to Kurt to introduce himself. Hi everyone, Kurt Menke I'm based in Albuquerque, New Mexico, USA and I run my own consulting business named Bird's Eye View and I'm also part of the Q Cooperative which is a venture that started up about a year ago which is myself and several core QGIS committers and documenters and trainers looking to provide support services for QGIS so if people need custom functionality or plugins written people at the Q Cooperative can help with that. I also run a program called Community Health Maps which I'll talk about a little later and I do a whole mix of spatial analysis, cartography, teaching, I wear a lot of hats being self-employed and in addition to co-authoring QGIS for hydrological applications with Hans, I've written several other QGIS books another recent one is Discover QGIS 3x which is a big 400 page workbook that you could use to get a really thorough treatment of all the capabilities in QGIS and I'll kind of keep it short today because we're going to have a longer program but you can find me via email by the addresses at the bottom or LinkedIn or Geomenke at Twitter. Great, well Kurt you're also the next one to present so I'm going to stop sharing these slides and you can show yours which will be all about the QGIS community. So I'm just going to spend a few minutes talking about the QGIS community and I think a lot of you are probably aware of this but if you've never really thought about it when you first download and start using QGIS you're joining a community and so QGIS is a software but it's also a community and an organization so these pictures that I'm showing here are from some of the recent QGIS contributor meetings this is the last one that was held in Spain. So QGIS as an organization you can find this flowchart online and it operates as a democracy basically so there is a project steering committee PSC with a chair and a board and they vote on important issues around the QGIS project and there are other components of the QGIS organization so there are national QGIS user groups and every national QGIS user group gets one vote on issues that come before the PSC. There's also some QGIS committers who have been appointed as voting members to the PSC so collectively there's a lot of representation and ways to be involved even on official decisions within QGIS. So what makes QGIS such a success well part of it is that there are you know it's just a fantastic piece of software but that's really because of the people the community around it and it's you as a user so again everyone on this webinar is part of the QGIS community by default and whether you're contributing code or doing other things just using the software working with other people you are part of the community and so that combined with the internet especially these days with COVID-19 all the collaborative tools we can use to work together even though we're on different continents that's really what makes QGIS such a success. So it's a real team effort and QGIS really strives to be a friendly inclusive respectful community and so there is a code of conduct for example there's a link down below at the bottom of the slide that you could go to to see what the code of conduct is for QGIS.org and I think one of the nice things about QGIS is that there's not really a barrier between being a user and being a developer a lot of the developers are users a lot of users write plugins and use code and you can contact people who are writing new features you can ask people questions in fact when you get on GIS stack exchange or one of the QGIS list serves you know you're talking to someone in the community and so it's a broad array of people around the world that make this all work so here just to put some faces to some of these people I'm not going to name everyone on here but these are some of the people who are you know heavily involved in the QGIS project the one person I will name here is Gary Sherman and the upper left who's the one who started the QGIS project and now runs LocatePress that Hans and I published through so these are all people just like you and me and I think it's really nice that we can all work together and even if we're on different continents you know there's regular communication via list serves and IRC and GitHub that allows all of the decisions to be made and all the great software to be produced and kind of as part of this I want to give a thanks to Andreas Newman a lot of these slides I'm showing you right now were either taken or inspired by his 2019 Acronia presentation so it's kind of part of the openness of the community oftentimes when someone gives a talk they'll make the slides available afterwards and welcome people to use them so I just want to give a shout out to Andreas for compiling some of what I'm showing and so obviously I think the first thing people think about when you talk about contributing to an open source project like QGIS is source code but there's a lot more than that that goes into making QGIS function so there is all all of the writing of plugins coat coding of QGIS itself but there's also things you may not have thought about like maintaining the IT infrastructure and the servers and things like that behind QGIS and then there's all the people who are making training materials and issuing certificates and contributing financially so some of these it doesn't really show up probably very well but some of these are in green and some of these are some of the non-technical ways that you can contribute to QGIS so donating money running a local user group organizing local events answering questions online these are all ways that you know anyone can be part of the community and contribute to it so another thing I recommend if you haven't been to one is the next time we're allowed to have face-to-face meetings is attend one of the contributor meetings or one of the local user group meetings in your area and so these are pictures I've always found these great I can't wait till we can all get back to meeting face-to-face I'm really grateful that we can all meet on zoom right now but these face-to-face meetings are really important to keeping the community alive and some of the relationships I've created like meeting Hans I met Hans at a QGIS hackfest so these are really important events and so these are just some shots from different events that have happened around the world so there are a lot of local user groups as well in fact there are official national QGIS user groups so for example Hans mentioned that there's now a Dutch QGIS user group in the Netherlands and there's a US QGIS user group that I'm part of which is much smaller than it should be given the size of our country here but there's there may be one in your country you can go to the link at the bottom of the slide to see what user groups are out there and if there's one in your part of the world and if there isn't you could be the one to start organizing that and setting up a QGIS user group so these become places where you can meet other people in your community who are using QGIS and share knowledge and network show tips and tricks even do some fundraising some of the larger QGIS user groups or some of the largest funders to the QGIS project itself financially so there's a lot of important communication that goes on by local user groups and so this is a map that shows all the national user groups that are out there and I think this is still pretty up to date but all the ones in green are countries that have a QGIS user group and an official one so if you're not in one of these green areas you could start one if you are you could contact people from the link at the bottom of this slide and find out who is kind of doing the organizing in your country and start participating in that so another thing I wanted to mention because Hans and I are both really involved in this is that for education there's a QGIS certification program and so in a nutshell this is a program designed to provide high quality education in QGIS but also community involvement in the project so one of the things that happens if you want to apply to become a QGIS certified organization one of the things that you're asked for is documentation on all the ways you've contributed to the QGIS project and if you haven't really been an organization that's contributed yet you'll be asked to do that and reapply so everyone who is handing out QGIS certificates all the QGIS certified organizations are organizations who are giving back to QGIS in some way it's also a way to provide revenue for the QGIS project so if you are in a course that where you receive a QGIS certificate from the instructor part of the certificate is a 20 euro donation back to QGIS.org so I think was it last year there was over 5,000 euros raised for QGIS through the certificate program and this is this one is Anita Grazer you've probably heard of if you've been on Twitter or Stack Exchange or anywhere online related to QGIS and at some point I don't know if she originated this but she called QGIS a duocracy and I always really liked that term and I found out there's actually on the community wiki a page about duocracy and what it means if you want to look it up but this slide you're looking at this little gif is showing the unique values palleted raster renderer that Hans has showed a few different times in this webinar series so a few years ago this didn't exist and myself and some other users were wondering you know trying to figure out how to render rasters that were categorical and had some kind of unique value and the one that you're looking at on the screen here is vegetation and eventually one of the developers suggested that we scope out what we would want as features for this renderer and contact one of the developers to see what the cost would be and so we ended up doing that and contacting North Road and getting a quote for it and it wasn't something that any one of us could individually pay for but collectively we were able to raise all the funds amongst 10 or 12 organizations and within three weeks we had this palleted unique values renderer in the QGIS nightlies and it's a really empowering feeling so one thing I like to remind people of is that if there is a feature that you find missing or something you'd like to see improved you can work on that you can do the coding yourself or you can hire someone to do it and it's a really empowering important part of QGIS and any open source project. Another thing too that I encourage people to do is if you encounter a bug in QGIS report it because if you don't report it it's not likely you know it may not get fixed if it's not a common bug or if no one if no one ends up reporting it then no one knows about it and it won't get fixed so it's really important as you run into things to report them so there's some steps here that you can go through you report those on GitHub and you know it's like the GIF here says help me help you really provide good information when you're doing that you know you need to tell people what version you're using what operating system you're on all that kind of basic stuff so that they can understand what your issue is and be clear about what kind of help you're looking to get or what kind of bug you're getting so really I guess the message here is to to really just become involved and don't just sit back and wait for someone else to take care of it for you because you can be an active part of that and this kind of goes for sponsoring new features as well and there's a couple links down here to these two blog posts that Nile Dawson one of the Qtis developers wrote about how to effectively get things changed in Qtis and those are really worth a read if you're interested in getting a new feature developed because he has some really good thoughts on the right ways and the wrong ways to go about that so one thing I think most people probably realized if you've been using Qtis for more than say four months is that Qtis has a really rapid release schedule there's a new stable release every four months every year there's something called an LTR which is a version the coin is a long-term release and that is supported with bug fixes throughout the year but no new features so for most production shops or people teaching with Qtis that's the one they're recommended to use and so if we look at some of the more important Qtis releases you know we had the first release in 2002 and then version one and version two and now we're up into the 3x line and at any given point in time there's going to be a long-term release which as we're sitting here today is version 310 Akarunya there's also the latest stable release which right now is 312 Bucharesti and you can even install the nightlies so there's multiple versions of Qtis that you can choose to install and work with and again most people are encouraged to use a long-term release just because it's a stable version for an entire year so it never stops and in June there's going to be 3.14 released and I don't know I don't I think there's still some ideas on what to name that might be called Pi and then in 316 in October we'll have then that'll become the next long-term release so that's kind of what the timeline continually looks like around Qtis development and part of this that I encourage people to look at is the visual change logs so for example 3.12 was just released fairly recently so if you want to know what's new in Qtis 312 you can go to the visual change log and see all of the new features that were part of that release that are new to it and those exist for every version of Qtis you can even go to the help menu in Qtis and access the visual change logs from the help menu within Qtis itself they'll open up in your web browser and with every release I promise you there is a an incredibly long list of new features that are exciting to try out so so long that I usually see things that I want to play with and try out and it usually takes me you know months to get to them all and try to figure out a good opportunity to sit down and try some of the new features as they come out so I just encourage everyone to follow Qtis so if you're on Twitter for example there's a an official Qtis Twitter account there's also a lot of other people a lot of news for Qtis is put out on Twitter so if you're not on Twitter there might be a good idea also github is where you know the code for Qtis lives and where you report bugs and things like that so that's another place to follow Qtis and I just encourage everyone to think about how you can become more involved in the Qtis project generally speaking you know at the very least working with people in your own community to form user groups or meetups and talk about all things Qtis and support each other so remember Qtis is a duocracy so ask yourself what will you contribute so I just want to thank everyone for you know indulging me in this and keep using Qtis thanks Kurt there was a great presentation on the community we'll keep the questions until the end I'm going to switch to back to my presentation so keep your questions that you have further for Kurt until the end and try to answer as much as possible in the chat you can still use the chat for further questions okay so these series of seven free webinars they follow the chapters of the book as you might know already and we are now at chapter five so we did already in the first chapter in the first webinar we covered preparing data from hard copy maps we learned about georeferencing about digitizing a bit of styling already then the second webinar we went into importing tabular data like spreadsheets or comma separated files and doing a spatial interpolation the third webinar was about spatial analysis with map algebra and last time we have demonstrated how to do stream and catchment delineation an important topic for people in in hydrology and water management and then today we're going to continue with that about adding open data to your catchment because we need data if we want to do water management make our models interpret what's happening in the in the water balance in our catchments next time we'll cover calculating the percentage of land cover per sub catchment and go into more vector analysis and then the last webinar will be about making a beautiful map with all these great data and Kurt will show you that part in the demonstration so when we talk about open data it's always good to to look at the definition of open data and open that's for open data open source software or open access it's not just open that you can download it so pdf with a map is not really open you need to be able to to just use it but also to reuse it and have the right to redistribute it and you can according to the definition only put two requirements to it that's to attribute so always say where the materials come from and you can put another restriction on it that is called share alike which means that everything that you derive from it should be also shared with the same license which means also open so once it was open it should stay open forever that's about open access and yeah it's up to producers of materials data courses to determine if you want to go for open or not it has to do with a with a value chain it has to do with the business model those kind of things but there's one exception where I have a big opinion about and that's publicly funded data by governments and you know in some countries they have really good laws on that like in Europe we have to inspire a directive in in US we're also quite good at it and I hope Trump is not turning much back on that some other countries also really do a good job but many countries I work are not fulfilling this statement that I make here that I think that publicly funded data by the taxpayer to your government and data is then collected from environment of water and all these things that they should be available as much as possible for for the people to do analysis with to use it in GIS to do statistics on it to make models and yeah you already paid for it so there's no reason why you need to pay for it again of course I know many people will argue about security and privacy yeah that's super important should be preserved but in my work I often see that that's used as an excuse not to share data openly and this really hampers the progress of our work especially work that I do for IHE like yeah we need to make delta plans in other countries or assist in modeling but if you don't have data you can't do much and I feel that we are always stuck in that trap to to get that data and I hope with this positive presentation of today the positive webinar you will see the value of it there's much more to say about it I have other webinars about that that I will also share and that you really see that this is essential if you want to make progress that's the same now with the corona crisis you know if all this data is not available or a government hide it from us then yeah that's very scary you know on the other hand yeah we want to measure corona related things with apps but we also have to be aware that we don't want to share our privacy and so there are also limits to it there's always a balance there but don't let it be an excuse not not to share things and when you want to share data traditionally you work in your GIS on your computer with your own local software your clients QGIS preferably but if you do that in an organization or in a country then it's very difficult to share the data and therefore we have to move away from that and work in spatial data infrastructures in the 90s they were talking a lot about databases and I'm a bit allergic to that word because that's just a part of it and those old folks they always say ah don't do that we did it we set up all these databases and they never use and they don't work spatial data infrastructure is not a database it's an infrastructure like a road and it's much more than just storing the data it's about discovery of the data it has a search engine and catalog you need to be able to to find if you look for rivers in a certain country it needs to come back with the results like if you use google it's about visualizing things before you download it you want to see maps you want to query already the attributes of your your vector data etc you want to evaluate if the data is of the right quality for your use the meta data is very important to make you judge if it's useful for you and finally if you've decided if the data is useful for you you want to access it and not just by downloading shape files or downloading a pdf from the website no you really want to have a live link with the data on in the in the spatial data infrastructure you want to use it from apps you want to create services around it and feed your models with it while the the data the original source remains in spatial data infrastructure that's what a sdi is and there's a relation between sdi and gis that most of you know like on on your your laptop but you can interact between your gis client on your laptop or google earth or any other tool with um uh with the spatial data infrastructure and the key there is the open standards from the open geospatial consortium the so-called ogc standards i just mentioned a few here there are many more there's wms which is just uh rendering a picture from the data wcs web coverage service is the is the ruster and that feature service gives you the real vector data and if you have your projects around an sdi you can simply connect to the sdi get your data over and work on it and that's something that you can see here in this animation so we're going to connect to an sdi that we created with help of different projects at ihe one of them was a mama say project in the mara river basin this tool was developed by by cartosa where you can simply connect from to just direct with a geonode geonode is an open source stack for spatial data infrastructures really great tool and here i'm just downloading the wms of the river basin boundary and then i can combine it with the other data another thing uh that we are going to see in the exercise is open street map and uh for people who know don't know open street map i'm going to explain it a little bit so i probably the whole world already knows google maps but google maps is very useful we can use it to navigate to find things but it's very well developed in urban areas where there's businesses second it will it's not really free your you pay with your privacy it combines all your data from gmail with other services from google to uh to build all kinds of statistics and serve you with dedicated uh uh advertisements but the most important restriction for gis people is that google doesn't give you the factors it just gives you the picture so a great alternative is open street map it's voluntary gathered information so the contributors are owning the data so you can be a contributor you can be part of this nice community like you just it has a very nice community and people organize mapatons where you can uh you you can map parts of the world and this is an example for kenya from narrow county where we have our projects where the masai people live and a good friend of mine is a masai living in that area when you look this area up in uh both open street up in google maps you find nothing in google maps still not you have to zoom out quite a lot to find the first feature well on open street map you can find the hospital the schools the roads everything and i know the people are using that in that area uh these are traditional masai people that uh you have to live in that area how do we do that at ihe we uh with every gis course that i organize i also organize a mapathon and uh during our short courses in september kurt already joined a few of them um yeah we map a part of the world for the red cross and uh we did that area when there was a big drought in the masai area in the mara river basin and it's great fun i just make sure that there's drinks and pizzas and the students really do a good job in digitizing a project for the red cross and you then think yeah well now that's a bit impossible to organize big mapathons and it's not very cozy to be more than one and a half or two meters from each other but you the good thing is you can also do it from home so there's a nice tool map swipe when this recording is on youtube i will put a card here that points to a nice video uh explaining map swipe a nice comedy that the two people made uh but it's basically a tool where you can point uh on your smartphone while you have some some time you're in your you're doing your hobbies you can just point to to building settlements on the on the screen and swipe to the next one and this is all feeds into the task scheduler from the humanitarian open street map team and you can find those tasks to map on the on the website that is stated here tasks.hotosm.org if you have a login for open street map you can join these tasks and help mapping parts and help the red cross and other humanitarian organizations to do their work there that's it that's great to do if you're bored and you're at home during corona instead of doing other gis stuff this is still gis related we're gonna use that data that's the whole point so open street map data is great for humanitarian aid but also great for us as gis people where we are working in areas where the data is not readily available so i'm gonna move now to the practical part this is where we were last time the styling got a bit improved in the meantime but i'm not giving away everything because kurt is going to to do that in the in the last seventh webinar so you will learn everything about these inverted shape burst fill polygons but what i wanted to do first is what we missed last time because of time is saving these layers into a geo package to proceed with them so i'm going to show that so there's a nice tool which is called package layers and that tool basically packages your effector layers that you have in your layers list you can simply choose them here into a geo package and you can in the meantime save those styles that you used here also in the geo package so i'm going to create a new geo package i made a new chapter 5 folder here i'm going to call this your data so geo package is like a little portable database that you basically can store most of the things that you need and instead of sharing shape files with all the separate files you just have everything inside the geo package i'm gonna run it and it's done and then in your browser panel you'll find it so i made a favorite already of chapter 5 and there it is and there we see those two layers and you see that we still have the rasters not added to it and these rasters they come from chapter 4 that we did last time and then the trick for rasters is that you can simply drag it and what i need is the the dm so there is this dm clip that's the right one i simply drag it to the database and it says import was successful and now you see that that's also there the style is in this way not imported i can start a new project and add those data from the database to prove to you that it's there and it's working so i'm going to add the catchment boundary the clipped dm which i lost the style so i'll style it quickly again and the channels with the styles that were stored in geo package so that's quite some magic and i also had the open street map layer there so i'm going to add the open street map from quick map services plugin there so i'm going to duplicate this layer i'll do this quick fix of the styling so i'm gonna rename this one and that one i'm going to make a hill shape and the second one let's first style the first one go to the styling styling panel choose their single vamp pseudo color and just a bit of repetition of what you learned before create new color ramp i choose their cpt city and that will give me a few presets and i'll just simply use the topography elevation one if you click this box you can save it as a standard gradient then you don't have to go through this all the time for me that's always good to show you otherwise you will not find it um and then we have here the hill shade and you will say well it's a dm how can it be hill shade well there's the hill shade renderer here that on the fly creates a hill shade there that's very nice you can change the rotation the orientation of the the sun and i choose your bilinear you learned last time or in the map algebra session that that will improve the visualization when we are zoomed in by smoothing it a bit then the only thing i need to do is blend the dm so it's the wrong one i need to do that with the dm to be careful that you choose the right one there and since i've blended the hill shade it blends all the way through uh the open street map layer that's of course know what i want so let me make sure that this is now set well multiply and the hill shade is still there's probably a bit of a delay in my choices or something wrong but yeah that's what i want so there it is so the next thing is to to make a group here to easily switch between the two hill the hill shade and the dm so i'm going to add here a little group group selected i'll call it dm so i can easily switch on and off the dm and put this one under the rivers there and we see the boundary okay and now uh let me save this project in chapter five and i'm not going to save the project in the folder i'm going to save the project in the geopackage so if i want to give this to somebody else i just need to share the geopackage and it has everything in it so how do you save this in a new geopackage project well the geopackage already exists i'm gonna choose here save to geopackage and then i can connect to this chapter five database that i created open and give it a name here then i do okay and let's see in the browser if that happened need to refresh it and we see our project now in there so if you share the geopackage then people have the layers the styles and the project the styles of the vector layers were stored within the vector layer part but for the rest it's in the project so it's also maintained if i shared okay now to the purpose of this this webinar to deal with open data um first thing i'm going to do is connect to a spatial data infrastructure uh from the the european commission and therefore i'm going to bring you to a website of the european environment agency it's called disco map it's an sgi you see it here search dataset in sgi and it has a lot of environmental data and it uses these open standards so i'm going here to land and it will load and i'm going to load the layer of koreen that's the european land cover map and i'm going to load the one for 2012 and there's here one in the wet market tour version that's refers to the projection and if i click here it opens our gis uh online which i can also directly connect to from qgis but i need this wms protocol so you can read here the meta data and learn more about the data always very wise to do before you download it i'm going to copy the wms copy the link and i switch back to qgis and there you can do it from the browser but you can also do it from here this is the button to open uh data sources if i click it i come in the data source manager and there's one here wms wmts uh remember that i talked about geonode that's the one here and i'm going to create a new connection and i'm going to call it uh ea land cover uh land cover paste the link here you see here wms protocol click okay and i do connect and uh it will go to the server and comes back with all those layers related to the land cover the clc 12 the koreen 2012 now what i want is some transparency because i'm going to do it land use type or land use type so then i choose the png option here and i also want to use the contextual wms legend and i'm going to select here first the wetlands so i'm going to add it close and bring it up here so the wetlands here are in the headwaters of the the rural river and uh that that makes sense these springs are there and we can check on the open street map what they are and this is the the natural uh the the natural parks that we have there for the eifel and here are the high fence in uh in in belgium and those are the springs there in the eifel in the uh and belgium in the high fan area so that's nice let's have a look at the other land use land cover in the in the study area so go back there and now i want to see the artificial surfaces so make sure that those things are checked click add and there we are have to load from the internet so it takes a little bit and there we see it we see that the headwaters are a bit less urbanized than the the northern areas but we also see these great purple patches and that's interesting to look at in a bit more detail so we can see on the open street map background that these are uh big open pits lignite uh mines where they dig up lignite here in germany and you see that the filled sink function uh remembers from last time just went through it because this whole mine got filled up by the algorithm which of course is not possible in reality so you can also add other layers uh but i think this is uh sufficient for now what i um want to do is i'm going to add uh things from open street map basically everything you see in this backdrop from open street map this is just a random picture but i can get every data there in vector format in qgis and that's something you do with the following plugin it's called the quick osm plugin here i'm going to switch it on so this very nice plugin made by a chantry mine i'm going to activate it it's slow here it goes and then you find it under vector menu quick osm so the quick osm plugin is very useful to uh to get open street map data and i think it's crashing at the moment so i'll just restart qgis i'm using a lot of resource at my computer i'm making the recording of the the webinar edit in here and there it's back installed so go here to uh i have to probably install it again because it was still open probably no wise to activate plugins where you have open another qgis window i just did that to uh have a bit less overhead on the project but that was maybe not a good choice that's probably causing the problem so this is the quick osm plugin and um open street map uses key and values and if you click this button it will open a website where you can find all the combinations of keys and values it's quite a heavy website that will load here a bit cached here and you can see here keys and values so amenity bar if you look for for bars and you use that one and it's still filling the page but you can find if it's point or line of polygon and description example picture how many features are there in open street map and how to how it's rendered on the open street map so we're going to use these to uh to add data open data to our catchment i'm going back to qgis and um first of all i want to have the rivers from open street map so i'm going to call uh here a uh waterway and then i'm going to query all the rivers you can also use the other ones or if you keep them open it will download all of these i'm just going to use the the rivers here and i can choose here in which extent and that's an important one to set because otherwise it will look in the whole database and you will run into problems and of course i want it here in a layer extent of our catchment which is the root catchment boundary so choose that one then under advance you can choose if you wanted that point lines or polygons and uh our rivers are lines so i switch off the other ones these ones you keep as they are and then you simply run it and it will use the overpass api then to download those line factors if you have slow internet you need to increase uh the amount of for the timeout which you see here it's successfully downloaded i'm getting back my qd screen here and here we see the waterway rivers i will uh style it so you can see it clearer i want to compare it with the rivers on the map so make them green not blue and uh the blue lines that you see are the delineated rivers and the green ones they come from open street map so you see there's quite some difference between the real rivers that people digitized based on uh on satellite imagery and aerial photographs and the blue lines that we delineate it but you don't have always those rivers available therefore the delineation is is also useful to know so that's nice and uh you can see then when i remove the dm that those green lines are following the rivers that are printed on this map let's do that for a few other features so go back to uh to the quick osm and uh let me see in the book i want to have there the quarries so normally you're gonna look for the the right um keys and values for that here i'm going to use lent use as a key and for value i choose quarry i choose in the layer extent and the root catch and boundary go to advanced i want them as polygons i run the quarry and there it is and um i go to those big patches of the the lignite mines that's of course interesting to look at so what we see here is uh let me first style it a little bit i'm going to use one of these preset styles that's really nice and what we see here is that the delineated river goes through it and the one that i downloaded goes around it so that's already interesting to see and uh we can also compare this with the google satellite so i'm going to use your google satellite to see if there's any difference and we see that it's quite similar so what i'm going to show now is again those layers from ea to do a comparison and i'm going to add here the artificial surfaces again to compare the mine so we'll load that was in 2012 if the classifications were okay it's still loading it's a bit slow there it is so we have to look at those purple areas i'll put the catch from boundary on top so we have the open street map we have the artificial surfaces and the satellite image and we can see that there's quite some difference the mine apparently moved there's another very nice tool to do the comparison and that is this map swipe tool that's not the same as the map swipe i discussed with the open street map but this is very nice if you want to do a comparison so if i click this and i click a layer i can swipe that layer and here you see it so that's a nice way to compare different layers i can do the same with the google satellite and open street map so here i'm going to compare it you can also do it the other way around so that's a very nice tool if you want to compare different layers so that's basically what i wanted to show you because at the time i don't want to go into the styling of these things you can oh that's well a very important thing to to explain to you so you see that these things have this little chip symbol i'm going to switch off this map swipe here that means that it's a temporary layer it's a scratch layer so it means that it's lost when you close QGIS now there are two ways to make this permanent one way is to click right and choose make permanent but another way to have a bit more control on how we want to save it you can choose and save features and by default it chooses geo package and i can simply save this one to our geo package that we already created this one and i can give it a name so i call this quarries quarry and you can save the projection and now when i save it it will just go into the database so that's nice so you can do that with with all these layers and then you have that in in your database we can prove that again by refreshing here and we see that the quarries are in there okay for the hydrologists in the room i also want to show you some other sources there are many data sources but mostly the problem is that for areas where at least my students work there's not so much data available and you have to rely on open street map for example but there are a few websites i just want to point out and we're going to go here natural earth very nice data set if you want to quickly add a lot of features to your map it has cities country boundaries we use them also in the book and it comes already with pre-made qjs projects if you go to downloads then you can download qjs project and you get all those layers raster and vector another nice data source is hydro sheds and uh hydro sheds has a lot of hydrological layers hydro basins hydro rivers hydro lakes many are derived from uh dms like you also learned how to do that yourself but uh yeah very useful to look at and then uh we have um this one that we use a lot at ihe delft is the feo open data portal for water productivity um but i just want to show you the catalog of data here so this is for africa at different resolutions so just choose this one uh actual evapotranspiration you can download it here but it also has this wms connection so i don't want to share with you so i'm going to stop sharing uh now and before we go to the questions from the chat i'm going to give the floor to our mystery guest and our mystery guest is uh etienne trimai i'm very happy that he's here and um he uh he is the guy who made quick osm and he has worked also he told me uh when we were preparing for this webinar that he also worked with kurtosa on the geonode interface with qjs but i'll give the floor to etienne and go ahead thanks a lot hans thanks a lot for inviting me so yes i'm the developer of quick osm i started this project uh five years ago it was in the chip and uh now i'm still maintaining the plugin because i'm still using it uh quite often so i'm working on it only during my free time uh the project is hosted on github so you are more than welcome to join me like uh there is translations uh like the project is translated to 11 languages uh always documentation um i'm keen of having feedbacks of like what is missing in quick osm what like how you use it sometimes because we don't know exactly how how our users use an open source software because we don't have any like i mean we don't have a lot of feedbacks so i'm keen yeah to have feedbacks um i have plenty of ideas about quick osm like i want to make it uh easy to download open-source map data when we don't know for instance the key value that you showed us uh hence so i want the kind of wizard uh i want some presets like okay i want to download uh a map about bicycles and then you just have the full presets of queries like bicycle parking bicycle lanes uh and you have all the styling coming with it uh like already like the bicycle lanes the one way on the streets so i have plenty of ideas it's just uh missing times and sometimes yeah like so feel free to join uh on github um now i'm working for uh free ease uh it's a gis uh open source company so we do qg score development uh we do also qg plugins uh for desktop and for server also we do some uh projects for qg with some post-gis database uh setting up some forms etc uh of course we do trainings about qg post-gis and our main tool is also a lismap web client i'm going to demonstrate just after so just on quick osm so there's a few things that like i could show more about like what has been done just now it's also possible to run quick osm using the qg processing model uh you already showed us the processing model right uh so i'm going to demonstrate this um there's also some different actions that quick osm is providing when you download data so quick osm is basically scanning like all the fields that you have in your layer and if it detects like some mapillary pictures or if it detects some url you can open them straight from qgis uh so then i will show yeah a lismap web client so what is lismap it's an open source tool like to help you to publish your qgis project on the web uh so basically like we have some qgis configuration like where you can set up like the symbology you can add some forms on your layers uh you can have some print layouts uh you can customize a few things in qgis you can also set up some settings using the lismap qgis plugin to enable some extra features such as database access rights uh editions and the thing is that it's like lismap is using qgis server so everything that you do on your qgis desktop you will get it on the server and then in the web uh the same uh like it's also available on github uh i put just some links like about the demo um it's also available on transifx for translation so for now we have uh 21 languages so i'm going to show you a quick demo about uh quick osm and lismap so this is a so you can see my qgis right yeah so this is a project that i made before um so and already showed you like uh quick osm um so usually like a few tips i just start writing like i saw you were using the drop down sometime it's long and you can just start and it will just autocomplete uh just a quick tip i wanted to zoom first uh in my area to download the data so here for this instance where i'm just downloading uh like some fire islands in the layer extent no can my extent yes so we've quickly assembled so so that's downloading uh osm data from the server but you can also like if you have a local osm file you can also use this tab to load a local osm file so i have my fire hydrants now if i check the attributable emergency fire hydrants so i was talking about like let's say uh you see i have some mapillary pictures so if you have the plugin installed on your laptop uh you can uh straight open the mapillary picture from the plugin here i don't have the mapillary plugin so it will open the web browser with the picture itself yeah here we are you can see my fire hydrant um so let's say uh there is a typo or something like a survey date or something i can also uh there is some default actions uh so i can for instance use joseph joseph is the main open strip map editor for open strip map data so if i click on it um it will open gsm or you can use uh uh the online editor to edit this data so there's a few like actions like this provided if you have a url it will open it in a website etc um so i'm going to remove this layer yep okay so i was talking about using uh quick osm in a processing model so i already made this fire hydrant uh model so here you see i have an extent i'm building a query so that's so you see i have a list of algorithm and here quick osm is also hiding his own algorithm in the toolbox so i'm building a query here so i'm downloading the file and then reprojecting the layer because the data comes in degrees 43 26 so i'm reprojecting into meters in my local uh uh system then i have my fire hydrants i do a buffering here of 500 100 meters and i set some styles automatically so now if i launch this query so fire hydrants i just double click so this query is is like already set up to download like fire hydrants in my area so i can use kind of extent i'm going to save my results fire hydrants that is hp so that's my area it's my buffer i'm just going to remove yes so that we launch the model the processing model downloading the query like the overpass api and will automatically styles my query so i'm just going to move them outside of this group so yeah that was for the quick osm part so now let's say i want to publish this project on the web um so this is quite a like there is quite a few things in this project i can show you that i have layouts for instance i have a district card i hope you can see the screen so it's an atlas for instance it's already set up to have the map and showing like a per district it's showing sub districts so it's quite a complex project sorry it's showing like some bus lines some charmerie i can show you the attribute table i hope you can see it so here for instance i'm using like some neighborhood sorry the project is in french and then i have a picture for each neighborhood and i have also the website and um yeah so let's say i want to publish so i made a lot of styles like showing these neighborhoods these charmerie i'm going to use the lismap plugin um so it's a plugin that you can download in the qgis plugin manager and here i have a few tabs where i can set up how i want to share my project on the web so here i have my fire hydrants so i can rename this layer same fire hydrants i can set up some link for a layer and also i can enable popups i'm going to show this so there's quite a lot of panels that you can use uh if you want to share like the attribute table you can do some database i'm going to show this so there's like to make like thumb manager atlas to filter layer so when i press okay then it's saving a file and if i go in my web browser here so that's lismap uh the open source project i was talking about and i have here my qgis project and here we are like lismap is reading the qgis project and making the legend again using the same rendering engine it's qgis server behind uh parsing your qgis project reading the settings and i find again my fire hydrants here if i check i can find my layers um i was showing you that i have some pictures and some links so if i click on the neighborhood i have like the data for each neighborhood i showed you that we got some uh layouts also uh related to each neighborhood so sorry i went quite quick um i can click here district card so it's opening the pdf that i made in qgis everything is like trying to replicate qgis desktop on the web uh there is the attribute table that i can display so here i find again like my attribute table displayed the illustrations the website um there's quite a few things that we try to replicate and the last thing that we are working on the next feature of lismap uh lismap 3.4 that pretty really soon so i know you already saw a lot of data these uh about the covet 19 but we're also doing like we started this project this week so this isn't like we are like we can build without any programming skills just using the lismap plugin in qgis i can open it uh covet 19 yes yeah you have have this project uh i can set up some database so in the next version of lismap we have more like charts possible html templates bar charts so you can set up and the idea is just to publish this one so here's the result so i can filter um so this is for the full france area but if i do like per province then all the data is filtered for like each um province so yes yeah that was my presentation about like quick waysem quickly and how i can publish back some data but my fire advance on the web using lismap thanks that's great hn uh really great to to see that you make such nice tools i think this also relates very much to a question that was earlier in the chat about uh dashboards the last thing that you showed that's really useful to make dashboard yeah we are trying to yes like this database well yes it's down our map we have also plenty of ideas and it's open source in something it's on github uh or we provide also some hosting solutions if needed but the idea is to really like yeah trying to replicate qgis desktop on the web nice so i'm gonna open the floor uh for uh for discussion um so are there any things uh court that came up in uh in the chat uh questions to hn or questions to to me yeah rosa had a question um about uh if you can share his wfs so yeah we can share like also data is available as wfs i mean it's one requirement when you publish as with lismap it will ask you to publish the data and if i open my attribute table here i have an export button and you can download like uh as a geopackage uh or georgison excel file and uh the wfs is recreated like there is the links also uh here uh it's publishing as wms wmts actually like we can also have wfs but yeah we are using qgis server uh all these or gc uh services wms wfs yeah fs and then we have also some models like wps to publish like qgis processing algorithms on the web also you know more questions that came up yeah rosa has a follow-up question related to that um how do you keep the symbology with the wfs um well it's all like uh the server like it's we are using the wms we are using the wfs it's lismap who is doing all these kind of things in the background for us and we are passing the xml project like the qgis project to get back like the form uh how like the like the tabs i it was a quick demonstration of lismap couldn't show you everything so uh but yeah we try to mimic as much as possible mm-hmm make sense yeah anymore questions that came up there's one some questions that i i was checking in in the chats was a bit related to to quality or resolution of data um i always see that a bit differently um of course resolution is never good enough but what what do you have what's the alternative so i always have to see it like that you know we can always say okay if we use the google uh or it's a google satellite for georeferencing it's not good enough yeah but do you what do you have if you have something better use it i saw somebody sharing this this very nice feo soil map 250 meter resolution yeah do you have something better you should always ask that and it's the same with open street but yeah that's created by people that can be errors yeah well do you have another data set you can use another question for it can where can we find something like a guide to use lismap uh i can put the link to the documentation of course when everything is in p-tub uh i can put the link and you will find the documentation also uh docs but i'm just sending you the link to the next version of the documentation which is not published yet but it's like the slash next uh makes a huge difference in the documentation uh it's not yet public but i'm giving it to you um it's for the webinar yeah so hopefully during this lockdown for the covid 19 i will spend also like it's on my roadmap to spend also some time improving the how-to using lismap but we try to make it as straight as possible just uh make your project open lismap just open the lismap plugin to create the lismap settings files even just by default and just start publishing it on the web of course like i didn't show you but you need to install lismap or to ask us like to host it for you but um just like the basic configuration i'm sorry i need to just uh nearly working great um if there are no further questions for now you can keep them for the the geo beers i suggest in sake of time that we continue with the the last few slides before we go to the geo beers um so as you know that we at ihe delft offer a lot of free course materials check gis opencourseware.org for more uh follow the youtube channel and register to that subscribe to get automatic updates and um you can also find our short courses on the ihe delft website really nice for face-to-face when the covid situation is over and to go for the qd certificate and we're working on some more online courses also with with curts and we'll keep you updated about it we think uh the word to curts oh yeah so i think you will probably heard about this in the last couple of webinars but um just to mention that there's a program that i've developed called community health maps which is based on an open source workflow for public health workers um there's going to be some open course material up on this in the near future including a two-day course if when it's in person it's two days um and so you can go through it at your own pace and it's a vector-borne disease surveillance workflow using qgis um so just stay tuned for that oh yeah so last week i mentioned that i had done um i was interviewed by the mapscaping podcast about qgis and uh you can certainly give that a listen if you haven't already and um just as a shameless plug um they're going to be interviewing me about data field data collection related to qgis so that would be um input and margin from luter consulting and q field so i'll be um recording another episode of mapscaping um that'll probably be released in the next couple weeks so i'll let people know about that great great podcast i can really recommend to to listen to this one so um next week we're going to cover a bit of factor analysis calculating the percentage of land cover per subcatchment we also use open data we'll use the land use land cover map corine 2018 which is not yet validated completely um but really downloaded so don't you we're not going to use the wms but we are going to use a database and uh the data plot leak plugin will be used to make uh graphs so really something nice for next week then um it's time for the geo beers