 Hello everybody, welcome on this first live session on my YouTube channel and it's open data day so we have some special guests here and feel free in the YouTube chat to post your questions while we are discussing and demonstrating the Watt plugin today. So let's make a little introduction round. I'm Hans van der Krust, I'm a senior lecturer in GIS and special data management at IHC Delft and let's give the floor to Natalia, please introduce yourself. Okay, so yeah as Hans says I'm Natalia Cardenas, I am an agricultural engineer with a master also at IHC Delft and nowadays we are working here in the Watt plugin project so it's where we are going to present today. Thank you, let's go to Fabian. Thank you Hans for the invitation and the space. I'm Fabian, I come from Colombia and I'm a electronic engineer doing my master in artificial intelligence and robotics, happy to hear. Nice, thank you. Let's go to Akshay. Thank you Hans, I'm sorry if there's any noise from my side. I'm Akshay Donthi and I'm also a recent graduate from master's degree in artificial intelligence and robotics and I'm part of the Watt plugin team right now. Okay, thank you. So it has been a while since we have been in a live session together I think so maybe you can give a bit of a heads up of the latest developments with the Watt plugin. Okay, sure. So for those that maybe don't know exactly what the Watt plugin does so it's a plugin that we developed that connects the Kujia software and the Wapr portal that is an FAO platform that provides data for Africa and Middle East in different levels of resolution so it's focused for agricultural purposes so what we developed was like a plugin that can just connect directly the portal the Wapr portal with the Kujias and it makes it easier for users of Wapr to just put it in Kujias directly and then just use it for their own like wishes and these things so we already released the first version like few months ago and now today exactly today we are launching the second version of the Watt plugin we are really excited about this because this has like really cool things and a lot of improvements because our first version of course was like the testing case and now yeah we include a lot of a lot of cool things I don't know if I start explaining it now or we maybe mention it later. Well maybe you can give a little heads up of cool things that so as a teaser for the people who are watching now. Yeah so for making it easier for the users we are filtering now the data so as I mentioned before the portal has like a huge catalog and different levels of resolution so before we were not so clear in how to search for the data so now for the user it's easier because they can filter the data in the levels in some cases the countries also the time frame the time the time level they and then can save it in their own space in their own folder and also for example we also are giving them the the possibility to the user to select a polygon the area or even to do a bookmark and it's easier for the users just to select exactly just the data that they want and don't like download the entire roster of the continent that will take a lot of space and a lot of time for downloading so this is one of the things that we are including nowadays what else we are including also more indicators so the WAP plugin has two main features the first one is the whopper catalog that is the one that is going to help the user to download directly the datasets from whopper to QIS and the indicators calculator features this feature the indicators calculator gives like the possibility to the users to just do some water accounting and productivity assessment to their areas so before we had it but now we also make it easier for the user to use it and also we included more more indicators so it's just more of an approach nice well i think we're all quite eager to see what what will be implemented and to try it today in this live session feel free to ask questions in the chat if you have any questions you can also introduce yourself if you're watching meanwhile i think we can move to to the demonstration what everybody's waiting for and then meanwhile we'll also introduce a little bit what whopper is about because we also need to look at whopper and to see how we can use QGIS to use the whopper data as Natalia explained with all these cool new features so let's have a look at QGIS so here we have a fresh install of QGIS and yeah it's also important to to notice that that we support Ukraine in what's happening in the world so let's not forget about it and stand with Ukraine so i have a clean QGIS install here and the first thing what i'm going to do is to look for the plugin in the plugin manager and of course i've been touched with the the team here you need to first go to the experimental plugins so i'm going to check this box and then i go back to all and i search here for lab plugin and then i can find it here so it's still an experimental version it has some information here some people gave ratings it's very nice but you see it has been updated to version 2.0 and what's also important if you download plugins there's always this more info if you click on this you go to the homepage of the plugin here you see that and in this case the github at the end of the session we'll get back to that and it'll be guided through the documentation that is available but i'm now going to install the plugin and that's as easy as this and what you can see now is this little button here that appeared the web plugin button appeared here in the toolbar makes more sense to have some background map here the only thing i installed here in this profile was the map tile plugin because i find it so cool that i want to show you also a little bit to have a nice backdrop there's a video from last qjs open day which explains how to use the map tile plugin but i want a nice satellite background i use it as a raster tile to put it here let's zoom to to africa and i want some borders on it to distinguish countries and there's this open street map here and this is a vector tile so i added takes a little too load but once it's loaded we don't just get you can ignore this this error it's probably a style that doesn't work but you can see already the labels from open street map but if i put this on the top one moment move to move to top here then i can see all open street map data and also styled in the way you're used to it by looking at open street map but this is not the pictures that you get with the quick map services plugin for example in this case i have some layers here so i can remove the background and i can remove everything that i don't want to see or i want i can change the styling i can change the the label settings here so i'm just gonna remove all the polygon filling here because i just want to country boundaries and lines on it to have a little bit of context for what we are going to download with the map plugin well that should be okay like this so the first thing that we need to do is to sign in in the map plugin because if i open this it will open a the web plugin dialogue and the first tab here shows the sign in and it needs a the token from your vapour account so i go to to vapour and we'll provide the links in in the comments of this video but if you simply google vapour you'll end up quickly on this feo vapour website where you can find all the the data that we can also download with the plugin so there's a catalog here of all the data that is available and it comes with metadata so if you click on it then it will give you additional information and you can download it but then you'll have the whole map of Africa and Middle East you can use a odc link so these are other ways the traditional way of using vapour without the plugin but if you're a GIS specialist i think the the plugin makes it really easy as we will see in a bit so that's the catalog and you can query data for for a location if you click on the location for example you can get here the value you can also create a time series so let's say i want this from 2009 to 2021 for that location 2022 then i can run it and it will return a graph with in this case the gross biomass water productivity trend through time so a really nice useful data source but for using this in the plugin we need to have an account all right there's one more thing i need to explain there are three levels here the 250 meter resolution data is available for for the entire area covered by vapour so this african middle east then there's some areas with 100 meter data that you can see here and there are a few areas with 30 meter data for specific case studies that are in projects that we are working on so we can for example choose koga in Ethiopia and then we'll see the results for that area here and that's then at 30 meter resolution now if we want to use this in the plugin i go here to my vapor after i made an account i go to my profile and i can generate here an api token it's a private token but i will remove it after the video because you can also revoke it that i'm going to use this one for the plugin and later i will revoke it so this one will be void and then i go back to the plugin the plugin screen here and i can simply paste the token here and click sign in and then it says api token confirmed access granted and that means from now on i can use the data through the plugin and i can also save the token so not every time i need to fill it again so here it's now saved in memory and now each time that i open a web plugin i can click load token it will look for the location where it stored it and you don't need to bother about that too much now there are two more tabs here vapor catalog and that is for downloading the different vapor data we'll go through that in a bit and there's the indicators calculator with a whole set of indicators that we can calculate after downloading the data from vapor so let's give it a try and download some data from vapor and let's choose an area in in Ghana for example tile server is building the picture here let me zoom a bit out and meanwhile i can choose here here workspace these are different workspace but we will only focus on on vapor here we can filter here the level that we want to use i'm going to use here level one first so the 250 meter data and i can put here a time filter and for this first example that i want to show you i'm interested in annual data decadals every 10 days you know what long term is and tell you what what is long term not exactly but that's how some of the data from vapor is provided but maybe some static data sets monthly and seasonal so let's try first annual and for level one you don't have the country filter because that's for the level three data and we can choose here which data we want to download and i'm going to download here the precipitation and because it's annual it's of course time interval year and i can choose here a year so let's do 2021 that's the newest here in the database and i can change here an output path so let me save it here and create a new folder let's go with what so now all the data that i create will be saved to this uh what folder and each data type has an file extension that's automatically given and that will be recognized later when we use the indicators so this has level one precipitation annual but i can give it a prefix and so it's useful to do it if you want to recognize it later so it's wise to add the year and you could also add the place or other things but you can basically put anything there in the file name and here now you can choose the area for which you want to download it and you can use the entire canvas extent or you can digitize polygon so let me just digitize a polygon then you need to uncheck this box and then i go to get edges and now i can draw a polygon here and it's not like the QGIS tool for making polygons so it will automatically close it so you don't need to click right that's that's what i found out um let's go back to the window so if you are done with making your polygon then you can say save polygon coordinates and then it detects 10 edges here and i can choose download and here's where the magic happens it will download the data from vapor and now it's downloaded so 100% raster download complete and i now need to change the path here to what we are using and then it will recognize in the drop down all the data that you have downloaded so here i have this level one precipitation click load in canvas and there we have it this is chirps data so here is just one pixel yeah that's what i was going to say because this is level one is 250 meters of resolution so of course the the polygon it was too small as you said is chirps data so we just have one pixel but if you select like a bigger a bigger instant it can be seen the proper raster let's do use canvas extent yes yes let's try that one so i just changed the name so we can recognize it i can do download there it is and now you see it's added here to the list which is a very nice feature i can say load in canvas and now we have here the rainfall clipped to the canvas area so that's very useful there's a question here from bob semi what is the resolution of chirps natalia um i think it's in it's in one or five degrees but it's quite a course as you can see here um we can uh so measure it but you can find it in the metadata also so it's like five kilometers yeah but here's a sample of course yeah so for for chirps it's it's five kilometer data but for vapor it is uh resampled to um to the 250 meters so therefore yeah we cannot do magic and add uh details so it's just that each of these pixels probably consist of 250 meter pixels i can find that easily in the layer properties so here you can get all the information the minimum maximum and the cell size um which is in degrees i think because the projection here is epsg 4226 which means it's latitude longitude and that means that this is in degrees so it's a decimal degrees i guess so that's nice to download level one in this way and let's try uh level two data let's go to another um area zoom out let's go to um let's travel to senegal today and i'm going to choose here then level two and i want uh decadal and i'm interested in net primary production and there um you can see here that it's decad the 10 day period so you can choose here a year let's choose 2019 and you can choose the month so just choose something like uh june and then you can find here the decades for that month so you can see day 1 to 10 11 to 20 21 to 30 just choose one here and um i'll edit this prefix here so let's do 2019 06 i call it 2 for the second set of decade days and then it will be saved under that name and let's do a polygon again so get edges digitize a polygon let's take something here on the on the edge level two is 100 meter and uh download sorry save polygon coordinates don't forget that and i will download this one i see uh meanwhile it's downloading uh malus gave some uh answers here so the resolution of precipitation is five kilometer the reference if i purchase duration is 20 kilometers and other data sets are 250 130 depending on the level thank you and uh precipitation and reference et are available daily decadal monthly and annual time scales great that the team members are also in the youtube so they'll help us out with those questions i always have to look up these details um so we see that the download is complete we find it here in the list so i can do uh loading canvas and you see it's nicely clipped to our polygon and um let's uh zoom to the layer here and you can then of course apply a styling uh as you are used to so let's do a single bam sudo color and uh probably it makes more sense to show this in uh levels of green so here we nicely see uh the result so that all works uh very fine and very smooth so uh now of course we also want to see the level three data so the 30 meter so let's change this to level three and i want it uh monthly i want it for ethiopia and i'm going to choose here um the actual evapotranspiration and interception for koga and let's also move to that area i'm not sure if it's in the there's this nice new thing i'm using qs 3.24 and it has a geolocator so geocoding so i can see if the place koga uh can be found here and there's probably many places called like that but it doesn't find one here in ethiopia no i think that koga is the is the name of the irrigation district okay something like let's do abyss down or something let's do abyss abbey bam hope you'll find it yeah so if i then click on it it will bring us to to abyss and now we're in ethiopia so that's a useful quick tool it uses the nominatin geocoder uh from um yeah from open street map from the database and uh let's zoom a bit out and see where uh koga is near idar so let's focus a bit on this area and see where our data will end up and um so actual evapotranspiration for koga for a month and i'm going to choose here some data from 2020 maybe you can do a bit more of zoom in yeah you know where it is i don't know where it is i i i know it is a bit more a bit more okay but we can always zoom after downloading to zoom to where is called merawi the more or less is in that way okay but we can zoom to the layer that's no problem because it will just download koga right yeah if you're using the canvas extent it will only download whatever is inside the joint box so it's good to have a zoom out so you're sure that the uh exactly get is inside the scope so if you don't know yeah if you don't know exactly where it is like me then you just um zoom out so you're sure that that part is downloaded it will not download a wider set but if you know it of course it's good to zoom in um gonna change this to something that makes sense so 2020 oh eight it has this k og identifier here and um use canvas extent click download meanwhile there's a question from my loose to the lab plugin team is the plugin correcting for conversion factors um yes yes yes uh i'm like uh maybe foyan can help me i'm sure that for the indicators calculator a the the the plugin does that so you don't have to but i'm not sure if for what for catalog also so our goal was to make the the bridge between the catalog and the plugin as direct as possible so what you're getting from the catalog when you interact with it is exactly the information that's available in the in the website so of course it's depending on the internet so you need internet for the plugin to work out uh so we're updating the information that we're putting in the in the interface uh on live and uh and the goal there is to for you to have access to the explicit data that the the the database has so when we are downloading the rasters we're giving explicitly that um the the the the factor that's given by the by by kuyas by buffer uh database so we actually have this uh possibility in our hands to make a conversion factor by default but uh we wanted to to um keep or leave the decision of the conversion factor to the user itself um so explicitly is downloading the pure raw data um if you want to have a conversion factor you will have to do it on your hands but uh when you're using the indicator calculator is using a conversion factor that is commonly used for for that procedure I think it's an important question and maybe something that you'll be taking into account when you have here the measure to indicate the unit that you are downloading because some people might be using your plugin without checking the conversion factor in vapor so that's something we have in mind yeah and uh yeah like when like any user of waver that goes there as hands show at the beginning of the demonstration uh you can see for example for the data set that you want to download you can see in the metadata that you have to apply some correction factor to put it in the right units like for example if it is a evapotranspiration map to put it in millimeters there is one common unit for for for this parameter so yeah so uh uh so what Fabian was saying is that the raw data is more or less what you can access here in the vapor portal as a same so here it is indicated that if you want it in the right units you have to apply that conversion factor that in this case for this data set is 0.1 so yeah we thought to add it but to add it as a as a feature of the of the plugin but also we are letting the the user to to choose that but for sure for the indicators calculator we really need to to have it in the right unit so that's why we put it by default okay that sounds good you could also keep the choice indeed in the interface of the plugin for the user to apply the conversion factor or not so it's good to avoid the confusion because here we don't know is it applied or not that is a bit I think the point yeah it's good okay it has been downloaded so we'll find here the result let's load it I think it's clipped it to Senegal or something or I'm looking at the wrong one yeah that was the previous one that you downloaded I think it didn't show up let's try it again yeah maybe you put it so search for the right one yeah yeah that's the right one move it to the top here and zoom to the layer and here we see where it is no you can see it yeah so um actual evapotranspiration also let's give it a little style here and blue maybe so you see that it is clipped to the boundary of that area of interest for the 30 meter data so we have tried the different levels and now let's have a look at this indicators calculator where these equations are applied to calculate all kinds of indicators that are useful for management of agricultural areas I think so you see a point to the folder where you have saved your roster and I'm going to first use this equity indicator and it will let you select the the data that is needed for it so here it needs the actual evapotranspiration or the potential evapotranspiration is it but here I have already for this area the actual evapotranspiration interception and I can now calculate the indicator I don't need to fill in anything more and it gives me now this value of 20 and yeah Natalia maybe you can explain what this means sure sure uh so yeah like before I go into the details in in the indicator about the indicator equity so you can see in the in the indicators calculator feature that under the indicator that you selected you have a handset the the equation so that's how the plugin is computing the indicator by itself and it also points out the rasters required for that so to don't make a mistake it just will allow you to just pick that one so going again back to the today indicators so for example equity is is is an irrigation performance indicator so this with this one you can measure for example for your irrigation district you are like providing or allocating water for each water user right so with this indicator for example you can see if all the water users are having like in an equity way the the access to the water so more or less this is what this indicator is showing so for example if we have a irrigation district with different water users some with huge areas and some with small areas so equity what yeah so this indicator what it says is if you are giving the right amount of water depending on the requirements of each water user so more or less this is the equity indicator and is measured in this is a percent percentage value so of course if you have 100 is that is perfect it's super equity and if you have less than 50 of course is not so great so this just allows you to measure that okay great let's try another one um we can use the overall consumed ratio and we see here again the equation and what we see here is the data that it needs so the actual evapotranspiration but also the pcp the precipitation raster but i need to download the one belonging to this area first i'm going back to the catalog level three Ethiopia and um but i think the precipitation is level one so i need to choose here level one precipitation and um of the the same date and months so fortunately i still have it written here so we can choose here and august 2020 and i used the canvas extent so i'm sure that it downloads this area um i also add here to g so i'm sure that i don't forget that this is the same area yeah and um as a download so these two are really good examples because for example for equity the result is a value and for example for over over a conservation that is the one that you selected the output is a raster so it's also indicated in the in the info of the indicator that you're like selecting which which is your output or not but yeah so here we have the actual evapotranspiration that we already had then we just calculated or downloaded precipitation and it needs this volume of supplied to command area in millimeters so what's your suggestion Natalia five you said right yeah let's put five just like and then i can put here an output file name that will also be saved then to our folder so let's call this ocr and it's calculated here we see now the result of this indicator so it's a spatial one it results in a map um which we can also then style so these are the results of our indicator so that all works fine if there are any questions in the for the people watching now please use the the chat we have time to answer questions and i think what i would like to i would like to go to Fabian to tell a little bit about where to find further documentation information so i'm going to add Fabian's screen thank you Hans so what if we wanted to provide is as i mentioned and from Natalia and the team itself we want to provide a connection directly to the database and also assist in some level the process of calculating indicators so many of the features that you have seen in the user interface are helping to filter out and support the the calculation process and from the experiments that we have done it's reducing considerably the time that you need to do such process so in the in the repository page that you have access to the um plugin or through our social networks you can access the wiki page which is here located in there we can have the general information of the region behind the creation of the plugin and its two main functions which as you have already have shown Hans is to interact with the catalog and to calculate indicators and in addition to that we're providing the information to getting started which is covered for installation so you perfectly have shown how it's the process with uh kuyas how the plugin still experiment also it's still open for improvement thanks to the the feedback of you guys from the internal community and we have several options for that so right now the the plugin is accessing the in the kuyas repository which was the openly used we also have the option to go directly to the github repository and download the zip file and install the the plugin through this file type which is fairly straightforward it's quite simple and problems free and at the end you should get the icon of the kuyas plugin as you had in your user interface so in addition to that we have some tutorials which will help the users to get used to the elements that are in the user interfaces the different tabs their functionalities and what to expect while performing our different options of interactions of again the loading to the database we also provide some guidelines and support to the interaction with uh map or database as you showed uh with the use of the token is something that we cannot skip of we are accessing the data from from the database and we have to provide the the certainty to the query that we're trustworthy users so the token is needed but as a user you have the option to save it in your local memory and use it as many as many times as you want so that's a nice support from our site it's not something that you have to do every time in addition to this we have what is the interaction with the catalogs so the first time you go into the database website you feel like you're swimming in an ocean of data and really hard to find a way to move around it so the online working that we are using to update the option that we have in the user interface lets you know which data is available which one is new which one doesn't show up for maybe for some reasons inside on the side of the the database so what you get here is what is available and it's a format in a such a way that's easy to to uh navigate through it so we have some descriptions about the meaning of the features how to interact with the resulting raster type the structure of the names so this name was it's important so everyone knows exactly which kind of raster are interacting with the country the year time frame specifically and again in order to avoid complications so the the need of download a whole country what you're trying to do to your project we develop the alternative to use the coordinate selections so if you don't have to wait any more to download the full raster which may complicate things in in time resources and memory support so now you have the the option to limitate your project to a specific comeback center to the coordinate selection which makes things faster and you can also use the different tools so that uh qis provides so the bookmarks helped a lot with that you just can change fast the campus extent and you're ready to go and for the indicator calculators we know that there are still users that have uh this their specific folder with some rasters that they have been working on so uh as i said the the the user interface is trying to help to avoid mistakes so any indicator that you're selecting is going to filter or scan the folder that you have selected as a workspace for the specific name structure that will give the information of the raster so if you want to work with your own rasters you have to stick with the nomenclature that's given by the information of the indicator calculator and you will have access to all the features so it's a bit um uh a trick and also a night but it's also good a good practice to uh help your rasters properly enabled and properly organized um so as a final uh commenting in this area we have uh our issues um option open for all of you guys any kind of problem that you run while interacting with the plugin or any possible improvement that you feel that you would like to have in the future uh we're open to it and we'll open receivable suggestions with the best added and try to implement that as soon as possible thank you that was really useful to see uh this whole documentation available for us and to learn more about it but also if we indeed find uh issues that we can report them here and that will be taken up here by the team i've already interacted with them with some of the issues which has been great um yeah just uh we have a little time left 50 minutes um if there are any more questions from the chat please let us know i would like to ask the team what is what are your plans for the near future so from the plugin side we're trying to expand and to uh i mean the difference between the version one and the version two in terms of the user experience have changed a lot it has improved a lot uh so um that's part of the interaction we have with the community so we're expecting to receive happy feedback and also suggestions to further improve uh the plugin um that's from the plugin side um of course from the team side we would like to have more opportunities like this with the uh the community to interact with them and to get to know what is needed so we're certain that we're helping a lot with functionalities of the plugin but we don't want to stop there sounds good i think after seeing what you can do with the plugin there are lots of people here who uh yeah who want to learn more about it and try it and maybe even organizations want to have trainings on it or have certain features developed by you guys that are useful for their day-to-day work in the agricultural sector using this kind of data so i see here uh from our loose congratulations on the launch i think it has been really cool to have you here as a guest on the channel to launch this version 2.0 that's really cool thank you so much welcome so just before closing off i don't see more questions here in the in the chat i just want to show people where to find more open materials because it's open day-to-day and next week is open education week so i'm just going to show some some things that we have available for you so you might know that there's a GIS open courseware website where you can find a lot of free courses on many different topics but all with 100 open source software and you can find courses available in different languages soon we'll launch another one in dutch on the field data collection there's this very nice one on processing drone images with web odm but last year for open data day i compiled a list of open data resources here and here you can also find vapor of course but also a lot of other resources if you miss anything please let me know i will add it to the list and on twitter i started to thread on qjs plugins for downloading open data so i've added a few that i know by myself it are which are very useful like now this nice plugin the web plugin but there's also the map tile of plugin that you've seen srtm downloaded plugin so a lot of different things so if i miss anything please let me know i think that was all i wanted to share with you and yeah looking forward to see you again on the youtube channel or in some of our other activities that we do with the itc delft and the team and it was a pleasure to to have our guests here aksai was dropping in and out let me add him also here so thank you very much for joining i'm going to close the session and hope to see you again soon yeah thank you for the invitation it was like the perfect like space or environment for launching our our our web plugin version 2 and better in the open data day so it was a really special moment for us and hope that all the users just have a good experience and as Fabian showed just let us or give us your your feedback in our github so thank you hands it was a really nice experience for us okay thank you very much bye bye