 So what is the validation rule in DHS2? The principle we are going to share here, it will be based on how to understand how data quality, the principle of data quality, define what is the validation rule in DHS2, understand how the validation rule can be used to measure consistency in DHS2. We're going to execute some validation rule in data in 3.4. We also going to execute some validation rule, a bulk in the 3.4, it is for one facility, and in a bulk like where we are in the district and want to check the validation, version, validation rule for many organization units. We also describe how validation rule can be compared against calculated threshold and execute validation rule using threshold in the data quality app. So the validation rules, the component of validation rule, we have four big components of validation rule. The validation rule helps us to calculate the consistency of data. But before reaching there in the consistency of data, the principle of data quality according to DHS2 are four. They are completeness, they are correctness, they are timeliness and consistency. Completeness reports understand how data is being completed in the system. Correctness is to understand how the data are precise or not. So the data we are putting or the data manager who filled the form, the data he put in the system are correct or not. The timeliness is linked to the time and it is to measure if the data has been reported on time or after the stated time and the consistency, which is the many component here in data quality. That's where we are using validation rule to compare the actual value against other data elements, against threshold, against external like survey, external value from survey or others. Yeah, again we are presenting how those four aspects or four components of data quality are correlated together. The completeness helps us to start over the form, the completeness. It's echoing like in the hall, it's not echoing. Yes, it sounds like it's echoing coming out of the two sounds. It is coming like an echo. Is it the same for everyone or it is only you? I think there is a bit of an echo, maybe I don't know, maybe the room you are in, I don't know. But for me, I get also the echo, I don't know the others. My echo, they are saying there is echo in the echo. Let me do again, let me explain this slide and you'll tell me, maybe it was because another mic was open near my computer. So are you still hearing the same echo? An improvement. Okay, I guess I think there was another mic open near my computer, that's why the echo was occurring. So coming back to our presentation, the data quality, according to the WHO, has these four components, the completeness, the internal and the internal consistency, the external consistency and the consistency. The completeness helps us to trigger like the consistency. Before you measure the consistency, that has to be completed into the form, that has to be filling into the reporting form. And the completeness also goes hand-to-hand with the timeliness because when we are completed also, the form is reported on the time it has been filled in. The consistency can be divided into two parts. There is internal consistency whereby we can compare the valid, we can compare that element. The validation rule is comparing the data element entered from one data element, one part of that element against the other part of that element. That is for internal reporting form. Within one reporting form people, the validation rule can compare some data element against other data element. The external consistency is like comparing the data reported from one reporting form to other external source. External source can be like survey value which has been imported into the DHS2 or the threshold which also is a calculated value against we're going to compare the data entered with the threshold. DHS2 allows for this various aspect of data quality to be checked. In some case, additional work may be required in order to ensure availability, available data is necessary for comparison. Like especially for external consistency, there is an additional work which has to be done to import data which has been collected through a survey or to put some formula for the calculated value like for threshold. That is what they want to say in this line. In some case, additional work may be required to ensure availability of data. DHS2 is not a substitute for every possible data quality check that can be performed. However, DHS2 can enhance the quality of data that is being entering substantially by using the built-in feature to review the data prior to analysis, interpretation, dissemination, and feedback. This is like the whole idea of the validation role is to help the verification of data entered before they have been disseminated or you are sharing them out is to check the consistency of this data to see if these data are correct are these data matching the set criteria. Talking about the validation roles, validation roles consist of three parts. Most, especially, there is a left side whereby we set some data elements. There is an operator which is here in the middle and there is a right side. If you can see below here, we have an example of malaria case treated against, we are comparing against all suspected malaria. So the validation role here will come to say, to say it like malaria case treated should be less or equal to all suspected malaria cases. You understand here the idea is like the case which has been entered in, the case which has been treated cannot exceed all the cases we received at a certain given health facility. That's where we have the operator which is showing like the case on the left side, the data in the left side has to be less or equal to the data in the right side. Note that this rule tells us what should be true. For example, the rule is not Rotavirus 2, Rotavirus 2, second dose-administrated which are higher than the Rotavirus 2nd outlier. So this, like on this example, it is saying the validation role also is coming to state something which is true. It is not like stating something which is taking out of nowhere. So it has to be based on a true, on a logical situation. When we think about data, when we think about validation rule, we can actually consider different examples. There is different way of building validation rules or different example of making, creating validation rules. There is validation rule based on logical rules. The validation rules built in or made based on logical rules. For example this, the previous example we showed, malaria case treated which should be, the logical rule here is here in the middle which should be less or equal to the suspected malaria case. You understand that the logical is like we have some people who showed up at our facility and among those people who showed up at our facility with malaria symptoms, the people who has been treated cannot exceed the people who showed up. So they have to be less or equal. Another second way of building or creating validation rule is using threshold. Using threshold, here it is, we have an example of Rotavirus 2nd administered which also should be equal or less than Rotavirus threshold for that month. Here we can calculate a value and from that value, we compare the entered data against that value. Meaning like we have to go and calculate a threshold. After, later on we will see how to calculate a threshold or I will show you an example on how to calculate a threshold. Then we compare that threshold value with the value which has been entered into the reporting form. So basically these are the two ways of building validation rules. The first one is based on logical rules. The second one based on a comparison with a threshold, a calculated value. The validation rules can incorporate data from aggregate data entry, from event capture and from target capture. I guess all of us are familiar with event data entry. So these are the reporting form people are using to report data. Aggregate is like for the monthly routine data or some program indicator. But let's say it is like for monthly routine data or quarterly. The event capture, most of the time it is individual data. The event and the target capture are individual data which have been captured. Event is like coming from a one event or a survey. And target capture is like a visit or a stage reporting from where by people coming and have been followed on every visit. So the validation rule can be incorporated into this form to enable to check the quality of the data which has been entered. You could collect data from tracker those administrative by individual child and compare these to an aggregated threshold that you have calculated from a particular time period. So from a tracker capture where I was explaining that it is individual data which are being entered following visit of a person or some time also for a person. Let's say in a person here in this example is a chart. You can calculate, you can incorporate a validation rule to calculate those data against a threshold a calculated value which has been set based on a particular period. You are also able to evaluate if this rule are violated by either viewing them in data entry having them run on a to to check if the validation rule are correct. You know we have set data. Remember the previous slide we say we have set like a logical rule my malaria case treated has to be less or equal to malaria all case of suspected malaria. So after setting that rules we can check if that rule has been violated or not by viewing it into a data entry form or by running an automated scheduler which will define which you can define or by trigger or by triggering them via a validation rule analysis. So you can go and perform a validation rule analysis. The system will show you the rule which have been respected or and the rule which has been violated. Can I hear something from the audience? Is so far are you okay or should I continue or it is okay? It's fine from me fine from me. Thank you. It is good to know that people are following. So I guess from here we can there is a second part of using validation rules which can be generated from program or specific outlayers but can we jump in and do one first a demo so that we leave a little bit this this too much theoretical stuff and we go for a demo can give me a few minutes. I show you what I've been talking and then we can continue with this slide. Let me shift. So to view this validation rule we are going to use an instance. The same instance will be used also by you all participants and you also going to test by yourself what is a validation rule and how you can review a validation rule. So as usual we log in. As I was explaining the validation once you are in your system inside your instance the validation rule can be viewed either through this. Still we can see the slide only we cannot see the instance. Oh you can let me share let me I think the best way is to share the entire screen. So now you can see. Yes I've logged in. I think this process every one of you mastering it. I've logged in and once you are in the in your instance you are going on the app. And you can check your validation rule either by passing through the data entry app or the data quality app. So for this first part we're going to first go into data entry part. As I was explaining the internet is taking long to display the data entry thing. So we are in the data entry form. We're going to choose we're going to choose a facility and check if the the validation rule which has been set up have been respected or have been violated. Let us choose a facility a given facility. I guess all of you are seeing my screen. Yeah thank you. Yes so we'll choose a given facility here we'll choose data entry form and we can select like a period a given period. So there is three way where you are in a data entry form. There is a three way you can check the validation rules. You can check the validation rule first by clicking on this button run validation rule. A second way here on the downs down of the reporting form you can check. You can click on this run validation rule. The two are doing the same but also the third way is like to complete first the form which will trigger the process of generating the comparison between the data entry form. So I can complete here and after completing here I can see if the validation rule are respected are being violated or not. So on this specific case you can see we have a warning message which is showing us that HIV test a validation rule called HIV test positive male plus HIV test positive female has has to be less or equal to HIV test performed male plus HIV test performed female. In other words all HIV test all HIV test performed the result the positive result coming from all HIV test performed has to be less than all the performed test you understand that is a logical a logical rule the the result the positive result has to be less or equal to the all the test which has been performed. So here the data element is being divided into male and female but the the rule here is to check was the HIV test positive less or equal to HIV all HIV performed. So in our case we can see clearly that on the left side this is the left side if you can see my screen this is the left side on the left side we have 1001 99 case of HIV a combination of HIV positive male and female which are not less which are not less than 296 tests performed. You can clearly see it here even down it is the same HIV test positive male and plus HIV test positive female has our notes is not less or equal to HIV performed test male plus HIV performed test female. So this is the way you can check if the rule you stated in this form has been respected or not. So for us to go and to check if or to correct this we can correct this by status. The validation rule can show clearly what is the problem so we can see the problem is on this data element the data element called HIV test positive and HIV test male female and male. So if you are going if you are looking into this section you can go and you reach to this section of sex where we have the HIV test performed and the HIV test positive. So this one the the addition of these two are lesser than the addition of this down here or yet it has to be the opposite so the test performed the positive test has to be less than all the tests performed. So we can correct this value we can correct this value and check if the validation rule is still is still there. So once I have correct the value I can go again and use this button or as I showed you use this button and run the button so you can see that rule has been respected and the warning message disappeared. This is how we can check the this is how we can check the validation rule this is the one way of checking the validation rule another way of checking the validation rule is to use the data entry the data data quality app. So notice note that on this on this first way of checking if the rule is respected not you can do this way only for one facility you can do this on a bulk like on a many facilities at once. So imagine that you are a supervisor you are at national level or you are at district level you want to check if the data entered all the data respect the validation rules you set into the reporting forms so you cannot if you have many many facilities you cannot go you cannot have that time of going and perform the check on one facility then you choose you go to another facility then you go to another facility so the best way of doing it at a higher level you can run that test on a bulk like at once I can run this test on all these facilities. So to do so I have to use the data quality app I have to pass here through data quality app and once I'm in the data quality app once I'm in the data quality app I have this three section but for us we're going to use this first section validation rule analysis then I can run validation rule I can go here select my select you can see all these are all the the facility I had before so because I want to run for all these facilities at once I select the district after selecting the district I can go here and select the month I can select the month let me go maybe three month time January up to March and then here I can go here also and select the HIV validation rule and after selecting HIV validation rule I go down here on this button called validate once I run the button called validate I can see one facility called Cardinal is the one in April which has violated the violated the rule and that's the rule which has been violated is that the HIV test positive less or equal to the test performed are not respected you can see here the left side which is the HIV test positive is higher than the right side which are HIV test performed so to see in details I can go here and click on this button to get more about this violation if I'm kicking I'm clicking there the system will show me the system will show me the name of the rule which has been violated and the value on the left side the value which has been entered this is the value for HIV male positive this is the value for HIV female positive and on the right side this is the test performed for male and this is the test performed for female so I can see the detail and this allows me to go back to the form of this facility and change change the value to match to match the exact rule most of the time the person can do a manual error when I when entering the data or when calculating you remember most of this value coming from a aggregation of the case we are coming one by one and the end of the reporting period if it is a monthly they can calculate by adding one to another one so sometimes the data manager or the the nurse who is the one doing it can make some Mario manual calculation error so after seeing the error where the error is coming from I have to go back into the data app form remember this maybe I have to go back here into the data app into the data entry form and check we can see the error is saying cardinal hospital gateway I'm going here cardinal hospital gateway the data set is HIV the period is I think it is March let me check the period is April 2021 I can go here previous look for April 2021 and go here to check the value who are exceeding or not are violating the rule I have to reduce this maybe two if I'm reducing this like this 2023 please go ahead for the question yes Mr. Nair thank you firstly I would like to know whether the reporting share with us and then secondly you are very low for me thank you I don't get it there is there very low yeah yeah you are very low you are very low ah you don't get my voice I have to to speak loudly my volume is fine for me okay let me try to raise to raise the voice so thank you Mr. Nair for your comments so we go back to that form you remember we see after running a validation rule analysis we see on this district we see this to this same facility has on two different period violated the rule we set it before so we are going back the purpose of checking this is to go back into the form and correct the value but normally this is maybe I can correct it directly but in the normal situation in the current in a normal situation you have to call back like if I was the one at the district level I have to call back the data manager of this facility and tell him to explain why this difference if we to discover or to find out what was the reason for making this error maybe maybe it can be maybe it is a manual error maybe he's this sometimes people say is cooked value he didn't even had time to see what he's putting in so before you change the data of someone you have to get his approval or to get explanation from him to know why the person to know why the person has entered this error but let us suppose let us assume that we have contacted him he explained to us the real value and here where it was 123 we change it into 23 maybe typing error and then we go back and run the validation rule to check if the rule is still respected so we can see the rule is not yet respected we have to correct it again until until we get you can see the rule is now respected and it is not for this month only it is for this April you remember it was for April and it was for February 2022 so we are going back again next year Feb 2022 we can take we can go directly to the sex section and the other error is coming it is the same rule which has been that is being violated so I am going to change here and put one I assume I have talked to the data manager and showed him the error where the error coming from and he tells he told me the correct value that's why I'm coming here or I can tell him to change so the best way even is to tell him go there in that reporting form in this period you change you made this mistake so you have to put the correct value after doing so you can come at the central level and run again the validation rule to check if it is okay or if you don't have access on this you can be having access on the data you can be having access on the data quality app because you are at a regional level you have access on the data quality app data quality app you rerun again you rerun again the validation to see if the error you notified to the data manager he was able to correct it you can also notice here that the value the value has the value to run in a validation rule you have to run it using the same three dimension so you can you run a validation rule using the organization unit and the period so after running this I was you remember on the previous example I was on the bad district I choose a very long period it is like since January of last year up to today I go down here also I choose the HIV validation rules and I can do validate to see you can see down here validation passed successfully so meaning like he has corrected the data so this summarized what I explained into the the first slide before we start the second part of the slide I would like to hear from you if it's okay or we take another example my side thank you very much Hamza we have learned a lot from you in terms of the validation rules and you have clearly indicated about the two ways that you can go to that validation rules whether you can come at that interval or that quality issues and also you have clearly explained about the left side operator and the right side so thank you very much and the feedback mechanism is that to be asked data managers thank you thank you anyone who wants some clarification or we can continue with the second part so Rebecca here hello hello it's Rebecca I just said to know yeah thank you I wanted to know whether it keeps the system keeps a track of these errors thank you Rebecca for the the question the system keeps the track of the value which has been changed not here on the validation rules but here on the data entry forms like if I'm going here on the data entry form you remember that is where we change the value so if I'm going back to the data entry form and I want to know what was there previously and what is there now I can double click here on the field which I was like I'm on the central level on the regional level or district level I want to see maybe just seek the data manager at the facility level to change but I didn't know what was the previous I didn't like memorize what was the previous value and what is the current value so what I have to do I go back to that form I can clearly you remember now the rule has disappeared but maybe we can go to another you remember it was showing us the rule which was violated so I can go back in the data entry form and double click where I think the person changed where I double click where the person changed and I can see I can clearly see that previously it was 43 now it is 40 no no please previously it was 23 now it is 43 you can see the dates the last so on this date we can see on the first data entry the data manager put 23 on today's you can see today's where I am changing the system it is 43 I can do so also for the for the other I can do so also for the other where is the other field also sorry my screen is like on this to close this and to show you that I can perform the same into the other I can go here again also and check on here audit tray you can check also the value was previously 21 now is 56 and here I can have also the name of the person who stored the data and last modified this is where you can you can the system keeps the track keeps the the history change of the value into the system and if you are the level on the higher level you can check and you know the data came from this value to this value am I answering very good very good thank you sir yeah anyone else yes sir no yes sir I have a question sir yes how long does it take for the data to reflect on the on the right on the variation if it's corrected on the entry page how long does it take to sink to show on the rules I want to immediately or probably yes no no it is because it is once you hit this complete button you know this complete button because let's explain let me explain when you are entering data into this form in the reporting form data are being automatically saved into the into the database so from this form it goes directly to into the database so if you are running that's where I was showing you that there is three ways of running the validation rules even if the person did not complete but you can use this run validation rule on this this this one this button and it will show you directly when you still on the data entry on this form without even going to another form you run these validation rules if you have made already the mistake even if you have not yet filled this down part but if the rule has been broken at this level the the the the the rule will pop up and it will show you the warning message thank you sir thank you too Rebecca I saw another hand are you coming back or is the same previous hand no no no it was a mistake Bashir please go ahead thank you Hamza we have seen how to check the variation using the two the data entry and the report up but I'm not sure I think I didn't get it how do we create this variation because on the on the slides I have seen the left right side and some formulas so yes is this variation are with the system or you have to create the validations thank you for your question this validation you have to create them the system gives you the the features and you can go in and you create them the tomorrow session today is just to review to review the the validation rules but tomorrow session will be configuring the validation rules so please be there on the tomorrow session I can have you I can show you a small just small to show you we are using this app and you can go you can go there and create now here I can review all the existing validation rules and if I want to create I create I do here on the plus and create a validation rules but I'm inviting you on tomorrow session that's where you will see how to create the validation rule using logical rules or using a threshold or another calculated value or imported value from external sources please be there tomorrow today we just review and we explain we introduce it is like an introduction on the introduction on the validation rule how they works why validation rules and tomorrow they will show you how to to do the validation rule thank you thank you thank you too and kalugi bay beila please go ahead thank you thank you very much can you hear me yes kalugi thank you very much for the session my question is on the validation rules do you do you have to first run it by yourself isn't there a way you can automate it that if I know I don't want positives I mean total tested male and female to be less than the positives identified is it can't it run it automatically that whenever I enter like a positive authority and total test it is 10 it should just flag it read such that you don't have to run the validation for the times I've seen instances people don't run the validation rule they just go and complete the data set isn't there we can automate it thank you the when you are on the data entry form when you are on a data entry form before when you are hitting the complete button if you don't complete the the if you don't hit the complete button the validation rule cannot show you but when you are hitting the complete button before it save that the the form is completed at this time it shows you that this rule has been violated I don't do you remember let me maybe go back and show you show you on let us maybe change and take another district we try another district and see if we have a validation rule so there is no data maybe let me find last year is that okay maybe I have to go back here and find another facility and check okay like this data there okay well let me try to to incomplete here and before I complete you know when I putting the error the system will not show you will not flag me directly but before when I complete I click here on complete the system will ask me and it will flag you the error to flag the error and showing you the error and where the error is coming from is showing you the error is coming from these validation rule so if you are the one who did the validation we can understand but even if you are the data manager you can understand that the positive case are exceeding the total case you had so another way of automating it is we will see it in the some some slides to come whereby you can generate an email which will come and a message which will show you the rule which has been violated so that is another way of automated the validation rule but here on this form it's not like after doing it from here I have to complete first in order to get the error so I guess most of the question has been answered can we uh-huh let's mr. Leba thank you yes I have a slide question yes when you run the validation I realized that it shows two sort of two error messages yet there's only one error I was wondering as to why it shows two can you run the validation again if there's yeah the same error is like duplicated yeah something like that why is it doing that normally it shouldn't it shouldn't this should only flags you one error okay it shouldn't normally it should it just flags you the error but here it is this duplicating the the same message twice I don't know what what is exactly how was that now I'm just one quick one I think on that what you see you see those are different the validation rules so they they set two validation rules in the system so there are two validation rules but looking at the same thing that's why it's shown yeah thank you prosper so as prosper is explaining you can see this there is HIV look at the name even the name here you can see they are different so even though they are doing the same but it is two different validation rule okay okay thank you so much thank you too so we can continue on another with the other slide and I hope now this first part you are okay with it yes thank you so we're going to going back to the slides so generating program specific outlayer statistical tool outside of the HS2 can be used to generate this value ARA, STATA and SPSS in order to generate and use this information the HS2 you will have to export all the source of data out of the HS2 and put the outlier data back into the HS2 after everything has been generated so for data entry generally you know you you you you said some outliers you said some outliers so that you can compare your data entry that is like to know if your data are correct or exact you said some outliers and you can compare the data which has been entered with those outliers so here you can use other tools which are not which are outside the HS2 to generate those value to generate those outliers you can use they are suggesting these three tools but if you have another one you can use another one and in order to use that outliers value generated outside the HS2 you can you have either to import those data back into the HS2 there is a mechanism you can call them back into the HS2 using API or you can export data from the HS2 outside the HS2 and you go you import them into those other statistical tool and you compare the data outside the HS2 or you import the outliers from those outside tools and you compare them into the HS2 into the HS2 there is a functionality called predictor the predictor can also be used to generate outliers these can be advantages in your data if your data is already available in the HS2 so most of the time because the data managers the facilitator reporting every month in order to buy in other tools if it doesn't require too much complicated calculation you can still use the HS2 this feature called predictors which can make you can help you to create outliers and to compare the data against these outliers there is no need to export modify data to ensure it is compatible with another tool and likewise that's the outlier that the outlier data imported file is compatible with the HS2 so this here we are explaining for normal calculation which are not involving too much complex complex mathematics you can use this function called predictors and it will save you first you will not need another outside tools secondly you don't have again to import back or to import in data from the HS2 outside or from outside to the HS2 predictors are data element value that are automatically generated from sample of current and past data depending of the period you have specified to be included in the calculation to make a predictors you do a calculation you make a formula and based on what you want what you want to to to compare with so if it is an immunization program in malaria program you have your formula and you can do the calculation then that predictors the value which will be automated or will be automatically calculated we have to go and feed a data element you have to create a data element give that data elements the same name of the predictors and the data which will be calculated from the calculated value will be auto-populated into data elements so for example here to review immunization data quality predictor can be used to analyze previous data in order to generate reasonable outlayer for future data so another advantage of using predictors it can help you first of all to check the consistency but second it can help you to predict or to generate data for a future period you can find generate if you want to learn more about these predictors you can use this link and get to know more about how to to make or how to create predictors so here we have example of predictors as I explained to you you will need to have a formula so for example we could specify that the formula of generating data is average plus three times standard deviation so you can make this formula and put into the predictors and if the secondly you can specify the period the period the period against which you want this period this formula to run you want this formula to run on data of we this formula you want it to run on data of which period so you specify the period like here we can say the last 11 months that precede last month so to if you want to generate data from like they say December 2020 here the formula or the standard is you run the data for the period of last month before prior to November before November prior to the last month of the month you want to calculate to generate data for so another criteria another is to remove any value that is considered as an extreme outline this also when you are setting an outline you you remove you have to set some limits meaning like those extreme outliers you have to let them out so example like this example when I'm trying to illustrate it we want to generate data from for this December 2020 you have to learn 11 months data for 11 previous months excluding November this is what I was saying so to have the data of this one so you can count if you are counting this it is 11 months and you take that 11 months the average of this 11 months is this 122 122.8 then you put its standard deviation then you put a formula to calculate the outlier the outlier will be the average of those 11 months prior the last month plus three times standard deviation and we have 173 the 173 will be the data we predict to be in December therefore a value above 173 in December cool reasonably be considered as an extreme outlier in this case so in this case as it was stated before we have to remove the extreme outlier meaning above 173 we we don't need those data using using the generated outliers once we have generated the outliers we need to check our data to ensure that data value do not exceed the outlier that has been generated whether via predictor or imported value so the outlier you remember that's we say that the outlier can be generated whether using the predictor or imported data from an external tool of your choice based on the formula you have specified we could perform a manual check by reviewing the actual value versus the generated value to them to determine if they are outlier if you want to check if they are outlier into your data the data you you they entered the data in your system or in your reporting form you could perform a manual check to review if the data the actual value you have against the the generated value you can determine if you have an outlier or not so for the example once you have value entered this are the organization unit or the facility these are the data which this organization unit or facility remember we were on a router on an immunization program and we say maybe on a rotavirus the rotavirus second dose given when to compare the second dose given against a threshold which has been set so we can see on this month of january 2019 we have six thousand seven five seven six thousand seven hundred and fifty five fifty seven which are extreme very very extreme comparing to the threshold we set it on that period and you can see the other value so if the condition was like the dose given has to be less than the dose given has to be less than the threshold set you can see these other facilities are meeting most of them this also is ex violated the role but these three and three four five in these six only two facilities have violated the rules but the other four are within the range set it using the generated outliers this may be difficult however if you want to look at many time periods organization unit and that element together at this this may be very difficult however if you want to look at many time periods you remember we have to generate an outlier we have to look at a many time period and compare organization units and data together at the same time at the same time that's when we are using these outliers we can also use validation rule in order to compare the actual value that has been entered with the value we have generated as outlier out outlier via our formula to check for consistency so if you want to check the consistency of data over a certain period of time we can use validation rules to compare the actual value the value which are in the system entered in the system against an outlier which has been generated via a certain formula to check the consistency of the entered data this is being used most of the time like for let's say this example of the example of the immunization whereby they want to see if the entered data are reflecting the truth are reflecting the reality on the ground or they have been cooked or just put there to mess just in purpose of reporting so you set an outlier and you compare the value which has been entered against the outlier this can be run in both data entry as well as to check the consistency or to check to run this validation rule you can use both the two methods we use in the data entry form or in the data application data quality app then you click on validation rule analysis in case validation rule analysis the same way as you use the same way as you use in logical rules so there is I guess we need to do some another exercise or have to present you something about this outlier before we go to notification also we still go back to we still go back to the system and I guess we have where is that one second or let me let me go directly here to check the outliers I think we are so we can if you want to check some exercise to check the outliers I don't know if I am still everyone is still seeing my screen because I shared the entire the entire screen yes I go back to data entry remember they say after setting your formula and creating an outlier you can check if the validation rule is respected or it has been violated through data quality apps or through the data entry data entry apps so we are going here on the beetle health center going into immunization and we check maybe it was generally of this year and the same we can run we can run validation rule either through here or through the other parts then once we run the validation rules we I'm feeling like the screen is small are you seeing all my screen or it is too small so you can you can see the last one the last one is for rotavirus administrated the rule was stated that it has to be lesser or equal to the the second rotavirus administered that has to be lesser or equal to a rotavirus threshold so if you are seeing the left side here we have 133 and which is higher than 127 on the right side that is that is why we have that is stated that we have violated this rule so another way of checking this validation rules it is either you can also go into the other way the data app the data quality app through validation rule analysis and you choose your I think it was something like here okay I can take the entire district or I can take one facility I can go here directly science January do validate to check if there is some validation rule which has been violated or not as you can see most of the most of facility has not respected the validation rules let me make it a little bit smaller you can see all these facilities like for this the hepatitis B dose given which should be less than the total used the total used and wasted those the validation rule name is like hepatitis dpt hepatitis B dose given has to be less or equal has to be less or equal to the total total dose used so the total dose used it is coming from a calculation also of the dose at the stock stock at the beginning of the month against the the the the the the the stock used during the month and we have the total used during that month so the dose given has to be less or equal to the dose used it cannot go it cannot go beyond that's you see they give 388 dose while they have used they stated that they have used only 382 so this is one rule this is the second the same rule which has been violated here this is for all this facility I think they all violated the same rule the butterfly the beetles the cockroach all of them have violated and no no there is another one the ipv dose we have here on fly hospitals the ipv dose given the same way should be equal or less than all the dose used so you can see 167 is higher than 160 so the same way we can go if we choose one of one of these we can go and click on the details to see to see what is the what is the the the the the the value we can see the value on the right side and here the value on the left side check again so so far is there any question I think this is like the same way the verification is the same way than the previous the only difference is here is on the previous we're checking against the logical value but here we are checking against threshold value which are calculated value or outlayers any any any question can you maybe suggest with my co-facilitator if we can give to people some minutes to pause and to go back for this exercise yes rohinda good um I would like to ask if there is a way to to run this data outside uh dhs2 by using uh not on rr right python does it require any flagging or there is a loop where you can do your analysis locally without using any other flagging there is two way if you follow the the presentation there's one way you can export data from dhs2 to outside and you choose whatever statistics code tool you use to calculate outlayers so there is a part maybe there is another session after tomorrow which they'll be showing you how to use the pivot table and data visualizer whereby you can analyze your data and export them outside dhs2 then once it is outside dhs2 you can go and use the statistical tool of your choice the other the other way is input within dhs2 you set an outlayer using predictors so the predictors in the predictors you set the formula once you have set the formula then you'll compare the value coming from the predictors with the value which has been entered in the form and the way to compare it after comparing them that's how you can come here and you show the rule that has been the rule that has been violated I don't know if I'm answering yeah thank you so you can either do it in within dhs2 without going outside and within dhs2 you'll use outlayers you'll use outlayers set from the formula and using predictors or the other way you go the other way is to go to go to go outside you export them outside dhs2 and view you use your the statistical tools of your choice maybe we need to know as yes Stephen thank you very much what I wanted to get clear maybe we are using the predictors to set the outliers then we depend on the outliers to set the validation rules I don't know whether that is right we are using the outlayers yes we are to set the predictors then we use the validation rules which takes into one part the actual value or the data we want to check and we compare that actual value against against the outlayers we set into the predictors I don't know if you are getting me yes I get it now you are getting that so the out the predictor is a tool which will help us to calculate a formula to calculate a value which will be comparing against the current or the actual data which is being entered into the system so I saw another raise hand I guess it is it is an old one so maybe I may suggest we hello yes hello thank you thank you um so I want to know what are these notes because we have these notes a power point presentation yes you don't have them yet have you rolled in into the mood or instance not yet have you logged into the slack channels only watching on zoom yeah so so there is a slack maybe let me before we we send people to take a health break maybe we can take through them all the channel we are using and from there most of the people will be familiar and they will roll against it against a welcome back we are we stopped on running running validation and roll against a threshold or a calculated value so to put you on we want to review with you then after I can let everyone log in and check all the exercise we did together and then after we may go to another topic so we can take this few minutes I just show you how to review and then everyone of you will log in and try to review and to check by himself is it okay for you good fine so starting are you seeing I have to share the screen again this is the instance we will use to for this exercise you remember like yes briefly the validation rules helps us to check the data which has been entered into the reporting form if they are consistent or if they are true to check the consistency we can use logical rules or we can use a threshold which is a calculated value and we compare the value entered against the calculated value so in brief this is what we have seen so far in the slide so we want to check them here into the practice so to check the validation rule there is two way of checking the validation rule either the data data entry apps or into the data quality apps we are going into the data entry apps we are choosing a given we are choosing a given facility we run the validation rules against a period we want and we have on the data entry form we have three button we have this button which can help us to check the validation rule we have this button down here which can help us we can also have the complete button which help us also check the validation rule and to check it we just hit the complete button and we see if there is no problem of validation rules there will be no pop-up message message if there is a problem if there is a problem you can see when you are running a validation rule a pop-up message which will show will warn you it is a warning message which will warn you and show you what is the error which has been broken or what is the rule which has been violated so in this example if you are looking at the same time as me I just entering some fake data here and run the validation rule down here and the system warned me with a pop-up message telling me this rule called HIV test positive against HIV test performed has been violated whereby the positive tested are higher than the test all the tests performed so in this case you have to go back to the form and change the value to the correct value prior to this as I explained you earlier you have to call the data manager or you have to call the responsible of the health facility which reported this data and ask them to correct the data to the correct value you don't do that on their behalf you just ask them and they correct the data so after correcting the data you can recheck again or you can you can recheck again using the data entry form this is one way another way is going on if you have a lot of facility you want to check the problem they have you can go against you can select on a higher level of the hierarchy and it will show you all the reporting form of the facility which are under your supervision to do so we have to use the data quality app we are passing to the data quality app we run we click here on validation we select let's say a district we select a period we select a period we select the validation rule you want to check and we click on validate the system will show us what are the validation rule which have been which have been violated to get more on this era we can go here on the details section and we click on this show details button the system will show us we don't see we don't have the right to edit the data in mr senyuva wants to edit data then the system will show you the left side the data element which has been put into the left side the data element which are in the right side and you can see where exactly the data like from here you can see that this is 4 000 while for male tested positive while the female are 80 so obviously you just assume that it is a typing error and you call the person he puts the correct data so for us we can go back again into the data entry form and correct this data this is one way we are going to correct data it was in april or in general then we can go back and correct the data i can again run again the data quality of run validation choose the period choose the validation rule to check and choose the district where i was before and you can see that first rule has disappeared i remain with the rule from the crowd health centers where also they have the same the same error they have 3 000 so i can again go there for the period of april on this crowd health center health center on hiv on a no it is not on april you can see the pop-up message here which is telling me that the rule has passed successfully so this is one way for checking the logical rules there is a second way for checking the threshold the value against a threshold we go back again to the data application we go back to the data application app then we choose we choose this facility we choose for this time we're going to choose for immunization and also we have to choose any period let's say this period we're going to choose this period and we can run a validation rule as the same way if you are running the validation rule it will be like the validation rule should be less should be less than or equal than they used the ipvidos should be less or equal today the given should be ipvidos given should be equal or less today ipvidos used the total dose used here it is coming from this calculation here we can see there is this error it is coming from this calculation where the ipvidos used we have ipv where is ipv yes ipvidos used it is the calculation of this for the under one year and this for the above one year then they combine these two value which is has to be less or equal than here on the stock we have ipv they used ipv here on the stock has to be the starting month minus or like the starting month plus the receiving minus the frozen minus the expired minus the broken minus the missing and we get the and minus the ending balance so we get the used to get the used is to do this calculation and we take this opening balance plus the received then we subtract the frozen the expired the broken the missing and also the end ending the month or ending the period the reporting period to obtain the used value so this is another way of using some calculated in addition of two or three data elements against another total of an additional or matico operation of two or three data elements in other ways using the threshold i want an example of using the threshold let me check one example using the threshold i guess we we check one example of using the threshold that i can see i'm running the time and i want you to log in and to do it by yourself this is still ipv i'll find another one so in brief this is what we saw from the beginning so now i want all of you please type in this this link into your browser i don't know if let me share with you i want to share something with you can all of you type this please you type this into your browser hello are we together yes okay so you type you type this into your browser after typing this into your browser i guess you have it you will be directed in hello after typing this you're saying hello yes please come in come again i didn't get you well no listen i told you that my sister in that one i'm in call waiting that's here you don't have access in this one i'm in town i didn't drink it i brought it yesterday but i'm calling you i couldn't get you huh can someone no listen i said i'm a sister in that place i'm in kumbh over time i didn't feel any current giving me problems so my current can't be hello are you are you gonna assist me yeah i'm zah damn yeah i will assist him i have sent him a private message thank you to the supermarket here say okay then but you see that now you coming there's someone here maybe i have to meet him so thank you uh everyone is on this page please have you reached a displayed yes so you can go here and create an account and you hit create an account and you create your account you put your username i'm sharing this you're not think oh i'm sorry i'm so sorry that's okay so i was here are you seeing this screen yes now we're seeing it and now you go on this button create an account yeah then you put your name name just a short name and put the password you confirm a password an email phone number and you hit this button of create you create your own account yeah don't don't put space between your name if you want to put a name just one name is enough or you put your name then in the middle you can put a dot like my name is hamza and the that is i can put hamza in or hamza dot the that is it so that will be depending on but don't put hamza is space and then in the but is put only one word i guess all of you has are able to create an account yes now you can look the with the account you created you can look the in here we put your account you put the password you set there and sign in most of us are here a lot if most of us are here then we can go then we can go here then we can go here into the end we choose data entry up as most of us are already there we can did you download this document from the from the instance training instance have you downloaded this document oh no there is three documents there is one document for the slide another document for this exercise and another for additional exercise so this hello hamza are you numb hello so let me just send the link to everyone so that they can download it now yes so meaning some people are not in the training instance yes yes people you have to please you have to go into the training instance because we are even going to share the word of the day so how are you gonna how are you gonna submit as you have been present without having access to the to the Mudo please try to access Mudo there is instruction on how to access Mudo on the Slack so please please before I share the word of the day make sure all of you are on the are on the Mudo on the training instance so that you can download the material you can also fill in the word of the day to prove that you have attended today class today session so this exercise we are gonna we are gonna take it up we're gonna take 15 minutes to run the exercise to check it is just checking it is not we don't run anything we just check this stuff up to page up to page let me see I think page 10 then there is a remaining part we have to finalize or we have to go up to page 12 then from page 12 you stop or page I give you 15 minutes up to 20 27th 15 minutes for this exercise in the chat box we can be helping some other people who has access difficult difficult to access or to interpret this is Abdulrahman the page is not numbered but when you are scrolling you will see page 12 we'll see that we are on the page 12 the activity is to to just review these validation rules you review them either passing through the data app or passing through the data quality up data entry up or the data quality up then you run validation analysis then run validation I'm answering Gania Yacub there is this person called Zoon Cheme Nagnon as I explained earlier tomorrow it will be a session for configuring data validation uh validation rules so if you want to see how to configure validation rules please attend tomorrow sessions and they will be showing all the the rule we review today how to create them and to put in your conditions thank you or a tapping error so the idea so the idea the idea the main purpose of this notification is to let people the beneficiary react quickly and provide solution to the data quality problem the notification should be meaningful and be sent to the right people otherwise they will become and ignore ignored over time so whenever you are sending or when you are configuring a notification validation notification you have to give it the the right meaning and the message which express exactly what is expressed exactly what is wrong and also you have to send the message to the people the right beneficiary the people who can take decision who can take action don't send like a message to people who does does have anything to do with with that message in that case they will send this message in the spam and the the aim of alerting them the aim of requesting them to react will not be reached because it will be taken as a burden so please when you are configuring a validation rule notification please make sure the message will be sent to the right people and will be having a meaningful message so thank you this is the end of this presentation we have to go to I have to bring you through the the same instance to show you how the validation rule will be sent out into the DHS to internal message and tomorrow they will show you how to configure them and also if time will allow tomorrow they can even show you how to enable like an internal server email server so that the message can go directly to your emails because you want people if an error has been has been detected in a facility at a thousand kilometers from you they want you if you are program coordinator or you are an MNE you have to report it directly they want you to react in a timely manner so let us go back to the let us go back to the instance and we show you the validation rule so to see the validation notification you have to go here you remember on this nine point where we found all the apps and we go to the message message application you have to go here are you all see my screen are you seeing this envelope here on the right corner so you have to go here on this internal DHS to message are you all of you seeing this one this part then I click there I click there and it will show me why for me I see it from your screen but it's not present in my study list let's see can you meet please then you can see in here in the part of validation are you all seeing in the part of validation yeah um I for me I'm seeing it from your screen but it's not present in my instance maybe it is different of right we don't have the same right but we will see if we can upgrade your your your role and get to see all these apps so going back here so I went for all of us I went here on the landing page which is the dashboard so from the dashboard you can see on the right corner you will see this envelope and the envelope if you are clicking on the envelope you will see this is an internal DHS to messaging system and you will see here on validation if you are clicking on validation it will show you the validation like this all this validation has been run automatically when we are trying to when we are passing through the run validation analysis then we can see here if you are clicking on one validation it will show you it will show us the rule which has been violated and on this present case we have wrote a virus second dose given exceed the calculated threshold you remember what we we saw in previous it's it this happened on this facility called big goal hospital gateway the same happened on the facility called Beatles health center on the flounder health center and with different values it is the same rule which has been broken but but the each facility broke the rule with different values so this is the way of seeing the notification through the system another way of seeing the notification we can go through another way of sending the notification we remember that we present that notification can be sent manually to send the notification manually we can go through the data quality up we go through the data quality up run validation rule analysis we take we take like the desert district we choose the period we choose the period we choose here the immunization threshold and here if all of you are seeing my screen we click here on send notification then once you click on send the notification we validate it will send notification to the recipient so notification will be sent to the recipient and here it will be it will it will showing these rules it will show this rule to the recipient how to enable people like recipient to receive this notification you have to go here in the settings if you are here in the settings so what they what we saw in the slide was like validation rules can be sent manually or can be sent automatically and can be sent using three channels it is dhs2 internal message this is what i showed you through this envelope can be sent through an email or it can be sent through a sms but in both email and sms it will require it will require the it will require the sms and the email to be configured the server sms server and email sms gateway and email server to be configured meaning like they will specify this server go and collect the message from dhs2 and send them through the specified people so for the email in order the system to send email to the recipient we have to go to the set in the setting of the system and allow each user or the user we want them to receive this notification to allow them to receive email notification and if you want also for sms the same thing this is what i'm showing you passing through here through this nine button like this menu and you after you select on this menu you select settings when you are in this settings panel you go to emails you go to this email is to set up in an to set up email server there's a place we specify there's a place we specify send email to sorry if the internet is taking a little bit time so you can see here on the down part enable message email notification enable message sms notification i don't know if all of you are seeing this part this is where you specify for email once you choose yes yes it will send meaning like this user is being is able to receive sms from the system and email from the system so this is after enable the user to receive message when you are you can even go here now on the data data quality apps and send the notification and notification will be sent to this user if the email server is configured i think most of the the material has been covered i don't know if there is one question or my co-facilitator if you can add something in order to make people if you are specifying here send notification and the user is unable is able already to get an email and sms once you are doing validation it will send sms it will send the sms through the internal dhs too and email and sms if those server has been set in my fellow facilitator if they can help me you know they can add something or if thank you yeah i think just want to thank you for taking the people through the session i followed all of it and it was quite interesting i don't think