 Okay, so I'm just going to go over the program that we're going to bring in some data for real quickly and you guys might be familiar with this program already you might have presented on it. It's just the COVID-19 vaccination program I thought that this would be a good one given the current state of affairs. And you know you might be grappling with this problem yourself either soon or already have. So, I'll just review it really quickly, because I believe you've already talked about it. I'll just select one of these facilities. All right, so it's the COVID-19 vaccination program is basically broken up into two separate components. The first component is where you add in the demographic details of a person. So you indicate what date that they were registered in your system, you enter in some identifying information, like a national ID number, their name, their sex, their date of birth, their phone number, things of that nature. In order to register that individual so you can find them later on and kind of make a shared record for all of their vaccination history, right. So I can just enter some example information. Let's say they're registered, I don't know, yesterday. So you can see some of the information that you would typically enter. Of course, you know this area is from country to country this is, as you would have discussed already right this is just the kind of generic version of this, but then country by country they they implement their own version of this, that is then modified but for the purposes of this exercise. I just want to kind of show you the overall program how it's made up, and then we can see how it can bring some data in. But it falls that are associated with this as well. So, once I enter in that demographic information I just, you know after I register them in. You know I might enter the vaccination data on the same day I might not just depending on the process. You know in some cases, people are registering all their individuals or their populations or subsets of their populations. Before they're actually providing the vaccination. In other cases they're just performing the registration of the person and the first dose on the same day. Let's say in this scenario that you know everything's occurring on the same day. And this is really the second part of this vaccination program. Right. So you have the data then that you enter related to the actual vaccination. And this is really the two components that you're dealing with in this particular program. Other programs that you might look at might have more kind of separation more stages as we call them separate processes that you deal with as time goes on in this case you might have a second dose, for example, and this is just the same information actually that's collected during that second dose so let's just go over some of the information here. You know you identify if they're pregnant or not. If they have any underlying conditions and if so what they are. They've previously been infected with COVID-19, and then all the vaccination information right the vaccine that they've been given manufacturer expiry date of the vaccination. Say it's next year sometime. The dose number and then some other information so this is all related to the actual vaccination that you're providing to the person. Okay. So when you start an implementation you know if you've been doing things in another system, you might have this data located somewhere else right to begin with, you might just enter it all in an Excel register you might enter this into an access database, you might use some other system that that you know might not be might not have been serving your needs at that point in time, but was just set up temporarily in order to kind of get things done so I've seen this in a couple places where to get started where they've just been using you know Excel basically to enter in all their data line by line they enter in one person and they enter in all the information related to that individual. So in those scenarios if you then switch over to something like DHS to you might want to bring over that data that you have right you wouldn't want to re enter all those records that would be a significant time sink and you know it also be quite difficult to do. Okay, so one we're bringing in this data, you know, the first thing we have to do is kind of look at the data and determine, you know, if there are any significant issues with the data. Then we try to kind of format the data correctly. Formatting the data can sometimes be difficult, but this app that the history again a team had created has made formatting the data much simpler because you know you just look at it like a regular Excel sheet basically you don't have to make too many modifications. And we'll have a look at what the sheet actually looks like. And then you know there's this whole process of mapping Eric went over very briefly in his demo. The mapping for tracker data does take a little bit longer, but you know if you're importing quite a significant amount of records, it will save you a lot of time, of course, especially if you're not kind of too familiar with the, you know how you would import data otherwise inside of the DHS to. So, if I have a look at this, you know, and I want to break it up into these two, two stages to two pieces of information. The first thing I want to do is kind of look at the data that I have. And the reason why I mentioned this is just going to pull up some, some sample data here. This is kind of anonymized data that we had about 40,000 records, basically, and that we were dealing with that were in this format and I've just taken some examples of what they had. And what we had to kind of grapple with to try and fix so I haven't provided too much information here just some demographic details, just so you can see maybe an example of, you know what you might see when you're looking at various types of data. As an example here you see duplicates, right already duplicate records that have been registered. You see some issues with the date of birth, for example, you know these are not years, it's not year one year two right so all the years have been at wrong for their date of birth. And then the identifiers as well right there's all kinds of different formats for the passport. So this is an example, right. When I when I mean you might have to kind of go through the data and just clean it up a little bit, or maybe significantly clean it up if it is really kind of problematic. Then you know you have to look at the data a little bit and just determine if I have all these old historical records, and there hasn't been a lot of data validation occurring on these records. You know, you might have to clean up clean them up first before you can get them in a format that would be useful to bring them into the system right so that would be the mix of demographic information that's used to identify this person, as well as any information in this case related to the vaccination. You know in other cases it might be you know in Eric's example TV case surveillance for example, if you're doing this, doing something related to that so whatever program you're working with. It's not a problem with both the identifying information, as well as kind of the core programmatic information that's, you know, being used when you're tracking this individual through that through that service, or whatever you're providing and tracking. So, you know, when you have all these records you would go through some process to kind of clean it up a little bit and we don't have to get into the kind of granular details of that, but just to orient you to the fact that you know, from a from a point of view, you might have to give some some time in order for this to happen right. You want to make sure you identify the time that's available in order to clean this data up before you're kind of thinking about bringing this into a system because typically there will be some errors, especially if you know you're bringing in a significant amount of records and say bring in 50,000 or 100,000 records for example, or even more potentially right depending on on how many records you've entered into whatever other tool or system or even an excel sheet that you have. So, so you do want to give a little bit of time for this as part of your process so you know, if you're thinking about oh I need to bring in data from another system. You know you do want to make that consideration and, and you can have that expectation that it's just going to be done like right away, because you know the date there might be some issues with the data beforehand before you actually get to the point where you can bring it into the system. All right. Okay, so after the data is formatted, you would want to kind of put it is cleaned up a little bit, you would kind of want to format it in a way that is accepted by the system that you're bringing it into and in this case, you know, if you're bringing it into DHS to, there are different ways to format it because there are many ways to import the data into DHS to, and we're just going to talk about one approach because I believe it's quite easy to understand compared to some of the other ways you might bring in data to DHS to. So if we're looking at individual records, what we have here first you know the way the sheet looks, you know don't worry about it too much we're not going to go through and figure out how to format all this data in different ways. Once again this is just to understand the process a little bit and some of the time and steps associated with that process. Right. So if I look at the sheet it has all the information basically that we just covered within the sheet itself. Right. So, if I look in DHS to, we talk about, we select a facility first before you register that person. Right. When we register that person we have a date in which I register that individual. And then we have all this demographic details that we went over. Right. And then within after I've registered them, they will receive their vaccination, either their first or second dose. And we have a bunch of information related to that that visit that they actually are, you know, tracked and recorded related to their vaccination history. So within that sheet but what we have basically is one line per individual. Okay, so this person here, for example, all the information on this one line has all the data that I need. It's kind of in a different format but I've actually uploaded the template to the Google Drive, just so you can have a look for your own purposes if you want to get an understanding. See, this is what you would see in a regular Excel registry anyway. Right. They just keep one line of information for one person. And then, while it might be in one Excel sheet, it could be spread across several Excel sheets as well. But for the purpose of this, let's just say at least this part is okay. And it's all in one spreadsheet. Okay. So in the case that, you know, you have this this way, and you don't really need to do too much right if everything is kind of aligned in such a way that you know, you're able to have this, then that's okay. But if you have both the trouble with the data being kind of problematic from the standpoint where there's all kinds of issues with the data. And then you also have the data spread across multiple spreadsheets. And, you know, there are also problems there with those spreadsheets in terms of the format of some of the information. You know, then you would want to give it a little bit more time. So the more complexity involved in kind of cleaning and preparing this information, you do want to leave a bit more time overall for that step to bring the data into the system. Right. So, you know, probably if things are very neat and tidy and there has been some kind of built in validation and you know, for the most part, things look okay. So all you know, even if they are spread across one sheet, there's a kind of unique identifier that can be used to link them and the unique identifier format is this kind of, you know, well built. So if they're using a passport or something or a birth certificate, then this number is consistent between those various spreadsheets that are available right. And the less kind of messy the data is the less time you will need to spend or allocate to this whole process of cleaning it up. Right. So when you're making estimates, in terms of how long this would take, it's just some considerations to have. Right. And then likewise, if the data is quite clean and nice, it will take you a lot less time to format it in a way such that you're making it ready to bring it into the system. Okay. So there are tools and other things that can help in terms of formatting this in such a way, especially if you know the data is linked across various sheets or various, you know, pieces, disparate information or even in some kind of database that wasn't kind of well built. And they're just in problem problems with that information that you need to kind of deal with as you go through this process. So, after we have all this information in a format that's acceptable to DHS to, and we can then basically bring the sit. And what we do is we map all these variables, you know Eric showed you quickly when he was bringing in the aggregate data mapping that there's this mapping process between the program indicator and the data element, you know we basically do the same thing, but instead of mapping between you know different aggregate data elements. We're mapping between all the different data elements, and, and all the registering information that are in our program right so if we look at the program again, we would map against all this demographic information that we see on the front page. And we would also map all the vaccination information that we see here. This would also take a little time but in terms of estimates of time it's very short, like you know maybe one day for a large amount of data maybe even less, depending on you know how fast the person is with working with these tools. So, so you know, so, you know, if we're trying to kind of come up with it. Once again this is to help you come up with an estimate of time to understand this process a little bit more. You don't have to take a ton of time to to map the variables as long as everything is consistent. If you have are improving, you know your configuration and have modified a lot of things. Then of course it might take a bit more time once again to map so if what you're seeing in DHIs to for example, is a little bit different or significantly different than what you have in all your various Excel sheets because you know there are different types available now that you're moving to the to DHIs to perhaps then the mapping might take a little bit more time. Okay. So let's just go over to do this that. Okay, so this is the same app that Eric showed his demonstration that the data import wizard. It allows you to bring in aggregate data as he showed, you can also bring in tracker data. Okay, so it's quite useful in the, in the sense that you can bring in both the data types. It allows you to kind of manipulate both data types and map them accordingly. So I have a mapping save for this registry, and I'll show you how to kind of the process of creating a new mapping quickly we won't map the whole thing because that will take a little bit of time, but just to show you how to map a couple things. But for now, I'm just going to take the data I have, which is the sheet here and import it basically bring it into DHIs to okay. So just drag and drop that file. Okay, and everything save for now so I'm not going to get into all the options but then we'll review the options after after we've shown one example okay. So here we have some options to map all the information this is similar to what Eric showed in terms of matching the organization units. Okay, there's a lot more information that you would map in this case just because you're mapping tracker data of aggregate data, but the process is the same and we'll go over this right. So here's all the demographic information that we saw on the registration page right, the name, the sex, the date of birth, the address. Okay, things of that nature that would uniquely identify this individual. Okay. Add one. I think I added the wrong file. Let's make sure. Sorry. And then you know we would we would kind of map all that demographic information to our Excel sheet you can see some of it's filled in already right. The given name is mapped to the given name in the Excel sheet some of the names are different in the system. Then they are on the Excel sheet and that's okay. So so we'll go over actually you know how you do this process a little bit right. The part is mapping all the information collected on the vaccination event. Okay, so we go through and here's all the individual data items that are within that vaccination event and we go through, and we map them to our Excel sheet. Okay, and if you're using some other process, even though this is more like a visual interface to map things. I mean you would basically be doing the same thing at some level, whether it be some other process that you use, or it be some kind of user interface that you would map these items, but you would always want to give some time for the person whoever's helping you with this or if you're doing it yourself to map these elements out right to take the data elements in your system, and map them with the information that's kind of being brought in through whatever mechanism you're using it might be an Excel sheet it might be another, another system. Okay, and however that's being done you would want to give some time in order to map the characteristics between the data you use and kind of the DHISD system that you're bringing this data into. Okay, so once again we'll go over the specifics of this in a moment. Okay, so once that's done, you know, I've all the mapping's been completed already. We can get a preview actually of the data that's being imported so I just open one of these up. Here's this individual that's on the spreadsheet. Okay, so for example if I go back to my spreadsheet. Here's this person here. Okay, this is my first person James Holden. He has these, these ID numbers he has the sex. Okay, and you can see here, some of the information that's going going to be brought in as part of this process so it gives you a nice preview before to the system. Okay, and there's a bunch of different tabs up here because you're registering the person right you're bringing that person in with all their demographic details. And you're also creating what's, you know what's called an event basically this is all the vaccination information, right so this vaccination event will be associated with that person that I'm bringing in right it's all on the same line. It will all be uniquely associated with that individual. And we should see this as well. Okay, so I'll go ahead and import this. And here we have a success. Okay, it's brought in everything. So we can go ahead and just check if it's been brought into the system. So just go to go to track or capture here. And I think I brought them in ostrich ostrich center and vaccination program. Okay, so here are the people I just brought in right so here's that James Holden for example who was the first person in my list. So if I click on his record. I should then see the vaccination information also right because we brought in both the individual as well as that vaccination information. And you can see all the data spilled in for that individual. And if I expand their profile here. We'll see that their profile is also filled in with all the information that I brought in about that person. Right. So, yeah, once we get to the stage where we prepared everything, and everything's ready to go. So bringing it into the system, depending on the amount of records of course if you're bringing in a lot of records you will need some time to import them all. Just because you don't want to probably throw in you know try and bring in like a million records at once if you're trying to do that. But you might segment it off into small batches and do it that way for example. But you know, generally, once you're able the larger part of this process is cleaning and formatting the data in a way that will be accepted by the system. And when you're kind of coming up with time estimates in terms of you know making adequate time for this to happen. You know that is going to be a much longer process versus kind of, you know, once you are ready to bring it in to the system after everything's been mapped. So I would say you know this whole process of formatting the data cleaning the data, and then mapping the data to you would want to include that might not take a long time to map the data necessarily, especially if you have someone very familiar with the system and someone very familiar with the data working together. But you know those should all be included in your estimate of time when you're thinking about bringing in this type of information. Once you get to that point where everything is kind of clean formatted and mapped, then the process to bring it in. And you know it can take a little bit of time as well, but the amount of time for that is going to be less. And it increases with the amount of records that you are kind of bringing into your system and if you have a lot of records, then you will need a little bit more time so you can allow the person to helping you or if you're doing it yourself to kind of batch that off into smaller pieces. So they can bring that into the system. All right. So let's just go back and discuss some of the steps to map this data because whether you're doing it here in a user interface, or whether you're doing it maybe you just have an Excel sheet with two columns or something like that, or whatever you're doing in order to map this data. This is an important step when you bring it into the system. So I'll just show some examples of this using the template I previously brought in. Just bring that in. Okay, so when you're bringing in tracker data, you have a couple of things to kind of consider so let's just go back to tracker capture to to have a look. So again, we won't get into so much detail but just so you understand a bit of the process. Let's go back to some of our records actually. So you can see all the information that we require is on this page, and you need to make sure that all these parameters are included right. So the person you're kind of bringing into the system, the case or person or, you know, whatever it is that you're bringing into the system, they need to be associated with an organization unit of some kind. Right, so that could be a facility or a district or, you know, whatever your hierarchy is kind of built around. Okay, then you need a date in which that person gets registered into the system. And this this will differ for from system to system right but at the minimum you will need these two. I'm kind of key attributes, and then here. I'm sorry this is adverse events wrong program. Let's go to that. Okay, you can see in this case they also have this latitude and longitude this is their location. So if you have that information you could also bring it in. So if you're using a spreadsheet you might not have that information at the time, but if you do of course, you can bring it in. And then, you know all this profile information, it's different from program to program from place to place. So depending on your configuration, you know you just need to keep track of all the information that you're bringing into the system. So let's go back to the kind of mapping here. Now I only have one organization unit in my Excel sheet and that's why it's only recognized one organization unit so if you have more like right now I just have ostrich health center. But if I had more those mappings would also be displayed. Okay, and you can see here on the left side is the source on the right side is the destination the destination is the DHS to the source is the Excel sheet that I've uploaded. Okay, and you can see here there's a dropdown so I can, you know, if for whatever reason these names were vastly different, where I was using some other naming scheme perhaps. And I normalized my names in DHS to and they weren't normalized in the spreadsheet, you know, I can of course, you know map them to whichever organization unit in the system that I want to right so it's kind of depending on you to make sure that it's appropriate when you're bringing in this data. We also have this enrollment date okay it's called enrollment date but this is just in this case, the data registration right so when am I actually registering that person into DHS to, and we just take that, and we can select, you can see here if I click on this, all the columns from the spreadsheet are available, right. So what I can do is basically select one of the dates that you know I'm using to register that individual. In this case, if I look at the Excel sheet. This one. This one. Okay, I have a date of registration column. Okay, and I can select that date of registration column from the dropdown right so I'm just mapping each and every field to DHS to use kind of terms, or in some cases the metadata as well. Right. So, these are these two minimum fields that I mentioned, and then we go through the same process and we just played this matching game with the rest of the spreadsheet right. So, you have all the demographic details here for coven 19, and you go through, and you just map the left side with the right side right. So, here on the left side this is everything inside of DHS to on the right side here this is what's in your Excel sheet. You just select the box, you can select from any of the columns or headings in your spreadsheet and you just make that mapping one to one as close as you can, based on the spreadsheet that you're kind of entering right so I think that I missed one here so I can show it. So for example I have this unique system identifier. I have this column in my spreadsheet called system ID. Okay, and this is my unique identifier in this case that I want to map. So, if I just type in system ID, or I just search, or I just use the dropdown, whichever one. Okay, I can then map the left to the right side and now it's been saved, or sorry now it's been mapped to the to this kind of identifier within the DHS to system. Okay, so it's not too complicated to do this mapping if everything's kind of clean and ready. Okay. And you also in DHS to have these, you know what we call option sets. These are these drop down lists, right so in the case of sex for example, I have male and female as my option sets. And then if I look at the item here, there's this button to map options right because sex has this dropdown list, right so any field that has these dropdown list. We also have to map these to the spreadsheet. So I'll just click on one to show you. Okay, so once again you have the destination on the left destination meaning DHS to the source meaning your Excel, and you just enter in, in this case there's not a dropdown because it doesn't read all the individual unique items that you entered for the data, right it just reads those headings, at least at this point in time it will do that when you go to import the data. But then you know if I look at my spreadsheet and I look at the, the fields for sex, right, I've just written this male and female, but in some cases if you know, let's say you just put M, you know, M and F or something. Right. And then, then you could map those as well. Right so if this was how it looked for all my columns I could just say, in the spreadsheet. This is how it looks. And then I want to map those to the options that are male and female the full thing in my system. Okay, so it's completely dependent upon what your data looks like. Not everything might be one to one in terms of how they're spelled or how they're matched, but the whole idea is to enable you to match what's in your Excel sheet to, or whatever you're importing I should say, from whatever source system you're importing from to the DHIs to system so even if things are a little bit different spelled a bit differently named a bit differently. You should still be able to map them to the system and this is true right now because we have this nice interface to do this, but even if you were just matching them in an Excel sheet or something like that right with the two columns side by side, you would want to be able to perform this operation and provide a bit of time to perform this operation as well. In this example for I have covids the name of the data on is covids occupation. But here I just call it occupation in my Excel sheet so even though they're not the same. You can still map them together. Okay. I'm so you do this for your entire. So you can see why I said it might take a little bit of time, depending on your program, because you could theoretically have many more data elements, or you could have many of these options that you have to map. But you know, the process itself is not too bad. Once the data is cleaned up, and you're able to make sure you can map between your source data and the DHIs to system. Right. So in this case we're just matching left and right sides, you know, using these drop downs basically, but if you're doing it in another process, it'd be similar process right just mapping all these pieces of information. Okay. And once this mapping is done, you know, you can save it. And then it'll come in to bring in the information. In this case I've already imported this so it's not importing was importing new some new. The system ID basically which wasn't mapped before, but everything else it's not going to reimport you can see there's no new entities, which means there's no new people that I've importing. There's no new events, there's no new vaccination information because all the vaccination information is the same. The system ID because I added in the system ID field. So if I were to import this, it would just update this field. Okay. So this is a pretty, pretty neat tool in order to help you perform some of this operation. But for the overall process, it's just so you can kind of understand how you would get there as well. Right. So importing is the final step. And really, you know, there's a lot of tools and a lot of different ways that this can be done. But, you know, in all cases, regardless if you're using this wizard or you're using some other way to bring the data into the system. You know, in many cases you will have to review the data, clean the data format the data and map the data right. So those three three steps are essential. Before you bring the data into the system because if those things aren't aren't kind of ready or available, you're going to spend a lot of time just kind of not being able to to map the information in a correct way, or running into lots of problems. Like if you're bringing this data into your system, there'll be all kinds of validation issues, perhaps. So you know, making sure that those things are in place beforehand. You'll have to do the largest amount of time that you will want to kind of allocate to this task, if you need to bring in some type of historical data. Okay. So I know I went through that quickly, but this was more to see you understand the process overall, rather than giving you, you know, a detailed background on how to perform this of course, if you are interested in more information on how to do this. Down on the app, we have the app available in our demo instance, and I've given you the data as well. So if you want to kind of, you know, just review the recording and manipulate the data a bit and see if you can get it to work. Please feel free to do so and you can ask us questions about that we're happy to help you. But, but you know, just so you know I hope you get a better picture in terms of the time allocation. You might want to consider for this and hopefully you're not asking people in the future to just like do it the next day because you will have seen that it's typically not the case where it's going to be possible in some cases, especially if the data is very messy, and it requires some cleanup because that will take a substantial amount of time. Thank you.