 Hello, everyone. Welcome to NPTEL course on rural water resource management. This is week 11, lecture 2. In this week's lecture, we have been looking at data for rural water resource management. And while we discuss the initial part of the course, I have already mentioned that there is lot of data issues. And that is why we have seen different agencies and different resources for data. What we found out in the last lectures, there are publications and NGOs where you can mine the data, which means you have to read them, understand the data that they have used the methodologies, and you can take the data. There are two types of data mining. One is you take the data from which they took the data. And the second part is where you have their results coming into your work as data. For example, if they give you a rainfall estimate and runoff. Online you could get runoff like discharge from the government data and also other data sources. However, you can also get the result from these papers as your data. Now let's go on further and look at the other sources of data. While in the introduction for data, I mentioned that there are both NGOs and publications reports as knowledge products, and there is physical data. These are the two types. In the physical data, you do have state agencies, and that is what we will be focusing on today. So state agencies have different departments that monitor water. Every state the terminologies might be different, but it is your duty to find which is the state agency that monitors the data. Some of the examples are given below. You have the irrigation department, the forestry department, climate change, water department. Because for irrigation, water is the major input because irrigation means application of water from other resources, not your rainfall irrigation. And then you have your forestry departments. And then you have the forestry because it has a lot of water structures and or land use land cover, which can help in assessing the water budgets, the climate change department, the weather department and water department. The weather is IMD, where you get rainfall data and humidity data, temperature data to estimate your different parameters. Whereas your water department has more data on the actual water like discharge, surface runoff, groundwater, those kind of things. So there are some examples for these databases. Some examples are PWD, which is the Public Works Department from the state of Tamil Nadu. Then you have the MAHAHP, which is the MAHA Hydrological Project or Maharashtra Hydrology Project. And then you have SWID, which is the State Water Investigations Directorate of West Bengal. The second one is for sure it is Maharashtra. So you could see that certain states will collect data based on their need and the budgets are allocated similarly. So it is on the mandate of each of these states to collect water and manage water sustainably. So please understand that these are important aspects for groundwater management and other water management in the rural setting. And the data comes from multiple platforms. The state agencies have their own rules and regulations for monitoring, which is need not be the same for the central government. However, you do have other resources and activities that can be part of it. Each of these agencies has a considerable amount of budget, manpower, and officials. In fact, some of these agencies are guided by IAS officers, where they have a lot of experience on the field in working with these systems. And sometimes it is led by the state collectorate or state officers who are like IAS cadres. So moving on, we will have an example of a state agency and see how data is collected. So the one state agency I would go in and check is the tndata.gov.in. And you could see that the central database is the same. So you will not have different databases in different websites. That was initially done, but nowadays all these databases are stored in one repository. So it is your duty to go and search for these data in Google and find it. Why I'm asking you to search through a search engine is because there is a possibility that sometimes the links change for which you need to keep updating yourself. For example, the WRIS website I said initially it was a different website and now it has changed. So it is up to the user to always keep updated on the data portals. I will go through this website and then showcase some of the data so that you could find the data sets etc. There are also multiple agencies and websites such as the India Water Portal, which also stores these kind of data. And sometimes you have to pay for it. Even state agencies, they would require some funds. For example, the PWD I mentioned in Kamalado, if you are using it for research and academics, you could go through the head of the institution or your professor. Write a letter and you could get to these agencies, state agencies, and try to see if they give the data for free. Otherwise, it is not as expensive as the other data, so you can still buy it. But however, I request you to please try to find if it is low cost. If it is high cost, please go through your academic institutions. If you do not have an academic institution, then you can go talk to them why you want to use the data. For example, the village development plans, master plans, if you want to work on your own village for water access etc. Then the price would be definitely different. These agencies are normally kept in the capital of the state. Okay, for example, the PWD offices are in Chennai, the Mahab HP projects are in Mumbai, and the SWID is in Kolkata. So please try to see if you have access to these locations. If not, please try to see if you could meet them. Normally emails won't work, you'll have to go physically and talk to them. So go physically, talk to them on why you need this data, write a good letter, why you need this data, what are you going to use it for, and specifically what data from what range. For example, if you have a boundary watershed boundary, you can ask this is the boundary. If it is a village name, you can put it as a village name. So that is a village extent you want. And clearly mentioned that these are the data I would need for these many days. For example, you say groundwater data, I would need it from 2000 to 2022. Only some agencies have put it on the WRIS website, which is the Indian government website. Most of the other agencies have not added these data online. So please don't say that the data is not available. It could be there, but you need to go and visit these agencies and find it. Not all are online because of sensitivity issues caused in hosting them online. They don't keep the data, but they do share the data. Let's take an example. The Tamil Nadu government data, I'm going to vote now. So what you see here is just a normal Google account I have opened, just a Google webpage. I'm going to say Tamil Nadu water data. So what you see is TN and this center, which is a data portal for the Tamil Nadu government. Sometimes you get these warnings, you can just click on it. And the other catalog I mentioned is the TN.gov.in. So once you click the TN.gov.in, this webpage will come. Okay, it is a little bit slow. Sometimes it just needs some time, but then yeah. See here the Tamil Nadu Envis, which is your environmental kind of department hosted by the state council for science, technology and environment supported by the ministry of environment for us in climate change, government of India. So you can clearly see that there is a state agency, which is the Tamil Nadu state council. And then it is supported by the central government. So this is the India logo and the Tamil Nadu logo. Okay, environmental information system, which is in this, and you could see here come down and see what are the different data that is available. Details of water resources, let's say I would like to see Coimbatore. Okay, and then the river basins and other data, the maps, all these things you can find. Okay. Yeah, so sometimes these websites are not, you know, possible to open because sometimes they are not working. So if you have these kind of issues, don't worry about it. You can also go to the Tamil Nadu.gov.in. Okay, I'm just going to keep it up so that the other websites can open. And then here you can go catalogs, the Tamil Nadu.data.gov.in, which you saw here. Okay, so Tamil Nadu.gov.in. This is the second resource, water resources, Tamil Nadu.gov.in. Okay, so you have these resources and this Tamil Nadu government came. Then details of dams of Tamil Nadu can be there. So all you have to do is click open data implementation. I'll show it again. In the website, you can just open data. See, this is not the same for all state websites. So please understand that I cannot show all the different states in India and their watershed, their water data. It is because that would be lectured by its own, right? So every week I have to take one state. So you would just go here and find where it says data. There sometimes would be a search box. Let me move my screen to see there's no search box, but you can click the open data. Okay, so which I've clicked and then catalogs. Okay, so I clicked catalog and this has opened. There's a guideline and then there is a catalog. So in the catalog, I'm going to just type water. When I type water, there are multiple subdivisions for it. So it is coming on the Ministry of Environment, Forest and Climate Change. As I said, that the ministry is from the central government. You can do it by source. You can do it by state government, Tamil Nadu. You have the municipal administration of water, Chennai water and then municipal department of economics and statistics. You can filter by sector, which is census, cooperation, drinking water, sanitation, environmental factors, water quality, water resources, groundwater, et cetera. Let's click the water resources. And you have water bodies in municipal and corporation areas in Tamil Nadu, which is very important. The WRIS may not have all the water bodies mapped. You can do the groundwater water bodies we've done. So I'm just clicking the groundwater to see if it's the same thing. So you can take this out. And you can see region-wise details of tanks in Tamil Nadu. See these tanks we've already seen in the class how important they are. And if you would like to see how these tanks behave and model it in your system, do a water budget. It's very important to understand these things. So you could click it and it'll ask you what type of data you would like. There are four data sets and you can download them for free. Similar to the WRIS website, you'll be asked with some questions on, you know, like why you want to use it, how you want to use it, those kind of things. So for example, details of tanks in Trichy region, Madurai, Madurai, Khyambutur, et cetera. So there's only four data sets. Not all is there. As I said, there could be two issues. One is they did not put everything online. And the second is that maybe it is sensitive so they keep it in the office. And as I said, this is the office address and stuff where you can go and find them. Try giving them a call. Email sometimes may not work. So you can try giving them a call. Or if you have any friends in the state's office near the office, you can ask them to go and meet the chief engineer. And chief engineers normally will tell the rules and regulations, which is why you want to use the data you have to clearly mention a lot of signatures are required. And then you would talk about where and how the data is going to be used. And then the details about the data. Normally you'll have to pay by demand draft. And then they'll send it by post or email the data post means like a hard disk, like a physical CD ROM, they will put it, or they will ask you to come and take it in a pen drive or email from a Google cloud or any other cloud they will share. So these are the different types of data you would formats you could export it in an XLS is your Excel. So let's click Excel, and it will say the same thing do you want to use it for commercial non commercial. See, commercial means you're going to use it to sell it to others. It is kind of unethical and wrong to take raw data for free and then sell it to others at a price. For example, you have your village panchayat office, and they want to estimate the rainfall so that they can plan agricultural crops. If the panchayat office requires you to collect the data. If you go to this website and say commercial which means you're going to collect the data on this website, and then you're going to send it to the panchayat then there is an issue. There is unethical and also an issue because you're making money out of it. So always try to see if you add value to the data, then you can sell it. For example, you run a model, you put a lot of time, you clean it visualize it, then it's different story but the raw data you cannot take and then sell it, and you will be caught. If that happens a lot. So let's say non commercial and academic, same thing you can give your name. Give PC. And then submit. So this thing is also like what it is and how it is. So once another website just opens to down, make you download the data. I'm not going to download it. I'm just going to show how to do it. There it is a data file. Okay, let's just have a look at it, because we are here. It has downloaded. So what did we do we do to cheat. And then I'm going to click it to open it. So once I'll share it again. Okay, so what is happening is the Excel is sharing. And then let me see if I could open it. Yeah. So the data is already on and I would, you know, take this data and use it as needed. Okay. Okay, so the DNN this also has other data on the maps, the boundaries, and then maps of India is a commercial software which company which they have cited here. So that is one way to do it. And then now you could also, all I did is some water data. I clicked on Envis not much data is there not always the first link you'll get all the data. So go here, I went to the second classification DN dot data dot in, and then I found this page. If you want to go back, you can go back to the data catalog, you can also write to the chief data officer, asking about clarifications basically the same email. It can, it can go to that email. Okay, so I'm going to go to catalogs again when this website opens. I'm just going to say ground water and then water quality in India, etc. So we have some statistics. How many people have access to six people have visually looked at it downloads views how many people have viewed the data. Some visual analysis has been done. So all these are there across India but because this is for Tamil Nadu, they might have it truncated. So we are only looking at the state in this lecture, the central government exercises we have see or we'll already add to it in the next couple of lectures. Okay, so with this one more I will show is the data dot government dot in. So if you look at both this website data dot go dot in, which is Tamil Nadu, India's data dot go dot in and the TN data dot go dot in. The only difference is the TN word, which means Tamil Nadu is, is there coming in front right because both are government agencies. One is a state agency supported by a central government. That is why you see the central government logo here, whereas you see the state government logo here. This is almost the same aspect across the data platforms, and you'd be able to see all of this in this year so you could see all these data. And similar to your thing you have a number of data officers, visualizations, themes, you could search the catalog here just click the catalog. Let's say again Tamil Nadu water, and you can get it. So you focus on one region, as I said, okay. And then here it is some some data surface water quality in Tamil Nadu. How many did we get. Normally the search would tell you how many and then let's say it just goes on it's not three, it just goes on a lot and more similar results so daily stock Tamil Nadu household household survey source of drinking water locations Tamil Nadu 2001 water bodies in Tamil Nadu. So you'll have these both the data in access in two different sites one is a Tamil Nadu site, and then the data.gov.in. Please don't get confused it is the same data, government data but hosted into different locations, both are free. So now this is the point when you take these data for free and put it on your website and charge the money. Then it becomes unethical you will be sued by the government so be very careful what you can share for cost do not sell something from the government for free. Okay, so just be read through the rules and regulations it will clearly tell what you can sell what you cannot sell. Okay, so this is where you could do it. You can also go back to the catalog. And then you can click ground water. Let's say our tank. See the tank word can be different in different regions but let's say you have one to 14 and the data. This requires distribution of surface lift screens on the irrigation schemes, tank ponds and use etc. So you have multiple data and most importantly, it tells you about how many data set views downloads and see if the download is high that means people are using it. Okay, and then you have the updated date when it was updated you know mostly want to see the very recent one so you can click here, you can go to 11 so me most recent date, and then click search again. Then what would happen is it just reorganizes itself so now you have village water, a wise surface flow schemes. It was a bit in 2018 still we are in 2022. That's like a four years average difference. Okay, so be, as I said, sometimes the data may not be the, you know, most recent one, but you need to work on what data you have. So reassign realign your problem statement with the data you have there's no point in saying no data, you need to tell what data you want to use and how much so we have seen this, how to search for data in a one particular state website. And then we have also seen how to download these data in an Excel format, you can also go to data dot government dot in and then search for data and download. And then the details of the data officer which is him a lot of them are the TMT is through money and a lot of data of statistics, and their address and phone number is given, this looks like a mobile phone. But as I said please do first send an email. Sometimes they do, because the volume of emails are a lot, but most of the time they do reply so you could get a reply, you can talk to them and see what can be done. I will include today's lecture on the state data sets and how to analyze them. We've also looked at how ethical it is to use the data for your research and sell it, you can sell a product but you cannot sell that data product from the government. You should do your work, analyze it, make it as a problem statement, etc. model it and then you can try to augment it. This course is about solving rural water issues, but it is also important to build a capacity of people who can use these materials to like consultancies right because not always the government agencies can solve these small small issues in Geos for example they could charge for these kind of work. So thanks a lot I will see you in the next class on more data sources for rural water management. Thank you.