 Hi everyone and welcome. Thank you so much for joining us today. I'm just going to leave one more minute to have more people connecting and then we're just going to dive in straight away. We have a lot to cover today. So I would like to just start as soon as possible, but just one more minute just to have a little bit more people. Oh yeah, I guess we can get started. I'm just putting a video just to say hi to everyone so they can you can put a face behind behind the voice. And but I will stop the video just to make sure that we don't have any hiccups while sharing my screen and going through the slides. Just one minute, one little Athena point that I would like to request you like we have a lot to cover and we have one hour for today. So we might not be able to cover questions and that's that you might have. So we are kindly ask you if you want to like post comments or suggestions or if you have any doubt or questions in general. Alice is kindly posting the link to the COP thread that originally showed the publication of the guidance that we put out. So if you just want to put your comments and your questions there, we can continue the conversation there once the webinar is over. So thank you very much again. And I will just start going straight away. I'm just going to stop the video. So so we are here today. We're here today. And we have quite a lot of attendance, which makes me very, very happy because I know that it's a very hot topic for a lot of people. And it's incredibly relevant now more than ever. So over the past three years, more or less, there have been a lot of like direct inputs and indirect guidance as well. And we have learned from also a number of countries and different implementations how to use the system to support call it. I'm going to call it either campaigns or SIA, which stands for Supplementary Immunisation Activities. And we have seen like a national scale campaigns like for example, Uganda and Bangladesh. And we have also been amplifying of course, these experiences by like more than 50 countries actually, who have integrated the routine information programs and in general systems into their national DHIS2 systems. And I think we also have more than 40 countries that have have started up taking DHIS2 for their COVID-19 vaccine delivery plans. And of course, like we have other emerging use cases that we continue to to to uptake and evaluate from from field learnings and different use cases. And of course, different either like, for example, new functionalities like for example, RabbitPro, and which by the way, tomorrow there is a webinar RabbitPro, chances are, and if you're further interested in that, I would strongly recommend you check it out on the COP and you sign up. It would be very interesting as well if you're into this kind of information. But yeah, so we have like a whole range between the standard modules that we have put out between the learnings that we have in the field. And and of course, we tried to put everything together to condense all this information to be at use of our of our end users. You might have seen this before is the usual immunisation tool kits like that I've been using since last year from from the annual annual conference. But this gives a little bit of a visual of the immunisation toolkit developed in partnership with the WHO, UNICEF and CDC, and includes a wide range of configuration packages, also some dashboard designs, and also analysis, absolutely support these these analysis. And of course, these can be useful routine but also for known routine type of data. And the main goal of course, especially considering what we are talking about here is to increase coverage to the maximum and reduce, of course, the number of zero dose children. And of course, what we're trying to do today is like have an overview of how to use all these modules, all these kits all together in order to see what we can do for SIS. So we have like a wide range, as I said, to like use digital tools to monitor preparedness, but also the implementation of the of the effectiveness, but also the efficiency of vaccination campaigns. And of course, we have from our standard packages as well that can be used in in in triangulation to see where our gaps are, how our how our programs are running and such. We have, for example, the ADSR that like it's a this a routine surveillance for where you can check your trends and outbreaks, the API modules for routine immunization data. We have, of course, now with with these new guidance, we can triangulate all this information also with campaigns data, of course, of course, I mean, we are always like based on our population use for denominators and estimates. And all this information can be can be let me triangulated together with like census data or any kind of denominator data sources to map, for example, where our gaps are, or to in general visualize and and and analyze where we can improve our activities. The general structure of the documents that we have published is divided into into three more or less. So and it also targets different audiences depending on where you're standing in the implementation and the uptake of the of the modules, but in general, like the configuration and the use of the of the of the HIS2. So on the use side of things, we are just going to give you an overview of the what you can use within the the HIS2 portfolio and how you can use it for the planning, the implementation and evaluation of the different stages of of a campaign. There is also a part on design that goes to be more on the technical side of things, more on like people who generally use the HIS2 on a daily basis and know how to configure this part. And of course, these needs to like match also with the needs of routine monitoring system, but also for the needs of updated and ready to use real time monitoring. And finally, of course, we have also section on implementation. And these is more like on the non configuration side of things, but there are still fundamental information that we need to take into consideration when when configuring, but in general uptaking the HIS2 for campaigns, like for example, performance testing, what kind of management of users we want to go forward with. And these are also used. We have also learned from the field because of course, one thing is generating these modules on a theoretical level. But then we also try to uptake the information that are generated from the field to also feed into this kind of documentation because it's fundamental for other users to see how things are being implemented and how they have been used out there. So we're going to start with with the use side of things. And I've divided it in in three main stages. So of course, the pre campaign, which is the planning, where you start monitoring your your your your information, you start with your micro plans, any kind of assessment before the initiation of the campaign, and also probably like some visualization on a map to see even clearer where where your your gaps are or where you want to target your your efforts. The second part is how you can use data as to during your campaign. So on the implementation stage, so check your coverage, having your real time monitoring, try to identify where your gaps are being at. You could monitor your logistics, so you can check your administration and your efforts on on a real time basis, both on on efforts for vaccinations, but also within, for example, your your your team who is actually delivering these these vaccines. And of course, at the end of the campaign, the post and post campaign are meaning like the evaluation. So be it like the update of the map to like configure and like and and see what kind of differences you had pre and post campaign, you can compile these these reports and and visualize and triangulate this kind of information also with your routine information to see what kind of improvement there is and therefore to keep also your national system up to date so that you can continue your effort to reduce the gaps in in immunization and of course target all that side of population that maybe would not be able to be reached otherwise. So to start with the with the with the pre campaign side of things and planning should include, of course, the plan of information system, the resources, the frameworks, but we have divided it in in different steps that we think that are incredibly important in order to get started with the pre campaign phase of the of the use of the HIS. So the first one, of course, it's the planning side that you need to start with your stakeholders and it has to include, of course, operational kind of information, budget considerations, frequency of data collection, hardware, for example, what kind of connectivity you have or kind of training you might need for your end users and and of course, the human resources as well for like the every day uptake and management of visa of the data and also for the and when I say this, it's a data entry, it's not analysis, it's making sure that the data is there, evaluating whether the data is correct and such. So these are all very important considerations that have to start from the very beginning. And then you have, of course, other design considerations that you have to take into account about the campaign structure. So and this is most importantly, the hierarchy that sometimes might be underestimated, but one of the key points when you start creating and setting up a system, it's of course, the hierarchy and and of course, the relevant outputs that you want to monitor during your campaign. And then you start kind of like working backwards, what where you're doing these things, what are you trying to look after? And then you start, for example, deciding how you want to collect this kind of information. For example, you want to involve like Android app or you would just want to do web data entry, whether it's like a real time, whether it's a perspective data entry, and of course, not considering also like the user configuration for the management aspects of things. Of course, the free campaign side also implies some some levels of testing, which is normally, of course, prior to roll out and and it's fundamental to like test a little bit of configuration and also the performance of what you have set up. Maybe you have started like on paper, considering like the kind of information that you have on routine and such. But of course, yet again, the the SIAs in general are a little bit different from your routine. So you might require different kind of training, you might require different kind of of periodicities and different kinds of of performance to make sure that this kind of information are actually like in real time delivered to the people who are actually monitoring and making sure that the program is running fine. The testing comes also handling with the training. It could be with the training of trainers that kind of has like a cascade training to target the field teams or in general, like having like some kind of considering that you might have also some some supervisors that have like some teams to supervise and in general, that will have to make sure that this kind of information are reaching the appropriate level. And finally, what is incredibly important on the pre-campaign side of things is the communication and the support structures between the higher levels where like the campaign is more evaluated and is monitored. And of course, the field operations because like that you can ensure what kind of like some kind of like feedback mechanisms that can be up taken and used on a on a on a real time almost and that there are some loops also that can actually like an improved quality of the data and for example completeness and accuracy. And there are also in the documentation, of course, you can also see that there are some some some links and some tools that are also available in different kind of of the of documentation, a little bit from UNICEF, a little bit from the WHO. So please take advantage of these tools that are also referenced in the documentation and make sure that all these things are actually in place before you get started. So the tools for the HHS-2 for running. Rating data, normally it's collected, of course, like in different instances or directly all in the HHS-2 national systems. But it's a key resource, nonetheless, to identify low coverage areas, or for example, under immunized areas or to make sure that you have like the right targets at hand. And and of course, the HHS is widely used as a routine system for immunization and also surveillance data. And many countries have also adopted these kind of standards that can be that can be uptaken and and used throughout your routine activities. And and we have also some some examples out there. Of course, we have like many, many examples that are like outlining the documentation as well. And and of course, this is what kind of tools are available at hand for you to start up taking them and start running your kind of information. So you might have your your metadata packages or toolkits, call them what you please, which are the ones that we have mentioned earlier. So the EPI, the DSR, be it that you might want to use trucker and individual data. We have the VPD trucker. We have the immunization registry and these could give us the all the kind of routine information to like start seeing where the trends are low, where the coverage are low, where is the uptake reduced? And then you can triangulate all this information with some triangulation dashboards that we have published in collaboration with the CDC as well, that are, for example, the immunity gaps and the program performance where you start triangulating also the the immunization information with your surveillance information that can eventually afterwards be integrated as well with the SIA information to have like even a wider level of of information that you might want to have a look at before planning future activities as well. And of course, we have also a bunch of of of applications and for example, like scorecard, the bottleneck analysis to like have like some results oriented analysis for for the coverage, for example, among the many things or for example, you have the action tracker that kind of like try to identify a little bit where are the next step and keep track of this kind of like next step that you might want to take be it during being before be it after of the campaign. And of course, we have also a degree of of micro planning available in the system, of course. And and this will cover also in in the in the next few slides. But in general, we have also a bunch of webinars that we have already covered on advanced population mapping, but the core outs nowadays has evolved a lot and there is like a wide range of informations that you can gather in the maps in order to make sure that your planning and your supervision of the activities are actually up to date and well established in your in your systems. So here we are indeed with a micro planning, which is an incredibly important part of your of your planning of your activities, as a matter of fact, because there are some some range of of master plans that you need to take into consideration to build these kind of activities. So campaigns in general, you need to have like a resource estimation, operations, you need to like take a show, make sure that you have the supervision, the tools, the monitoring framework, of course. And of course, we also know that campaigns in general require quite a lot of population estimates and not everywhere population estimates are available and up to date or with a with a high quality of data. And of course, these inability to find where these target populations are can hinder the outcome and also the chances of achieving the goals that you are setting for these campaigns, be it because you think that there is less population that you actually estimated or be it because you actually don't have up to date estimates, you're capable based on your microplan based on this data to actually reach all these population because there are more than you expected, of course. So you have to like be able to have some kind of like a forecasting to have more favorable outcomes, of course. And and of course, like geospatial microplanning, it's invaluable. I would I would actually say and and it needs to use geospatial data geographic information system to support planning, monitoring, service delivery, of course. And of course, like we have a range of of of layers, a type of maps that we can use for the planning, but also for the monitoring of the of the campaigns that can be up taken in order to triangulate these data, visualize them better and making sure that you have the maximum kind of visualization needed in order to start implementing these kind of activities. So here we have different different range of of useful layers, for example, that you could use. For example, we have part of population estimates where you can have like when you can start having, for example, estimates of populations like we desegregation, desegregated by age and gender, but in general, it uses grade three and walk up as resources. Of course, we have structure maps that are using the Google Earth Engine and it contains already a huge portfolio of of of already mapped areas, of course. And there is also an application that is can be used to starting from the from the 239 version of DHS2, which is the Google Google Earth Engine that I imported. It's a bit of a tongue twister for me, sorry. And these and these up will allow the allow the Google Earth Engine to data to be important directly in the in the system to visualize these these data and also other analytics and use them in indicators as denominators, of course. Four countries that use the DHS also as an HMIS, a master facility list can also be at hand and can be incorporated in the in the hierarchy of the of the system. And it can be used and reused using like the organizational hierarchy for for what you already have, or you might have to like create other sites, depending on the kind of of implementation that you're running. We know that routine sites are not necessarily the sites that are used also for for vaccination campaigns. In some cases, vaccination campaigns can also run in schools as much as churches or other any other kind of of of units where that normally would not be present in in hierarchies. So then you might want to have also an organization unit profile where you can visualize the kind of key information on how facilities and and of course, we have also the facility catchment layers that that can be obtained with grade three and cross cut and can generate and draw facility catchment areas. And of course, I think it's almost superfluous to underline the importance of catchment areas in the in the delivery of like health campaigns in general because why because clear like a clear delineation in general of the catchment areas like can help a lot. Users and in general, even program managers to identify where which sectors that are covered by which vaccination sites and before also make sure that everyone can be covered with the activities that are being planned directly in DHS, for example. And of course, it has to be mentioned that micro planning can be once the everything is put into place can also be always at hand because there's no need to visualize these things always being connected. These dashboards and these kind of visualizations are available, of course, offline and can be downloaded and in the device and visualize at any time, even if you don't have any kind of connection. So if you are the deliverer of these vaccination activities, of course, you can also have your your maps of your of your of the sites that you will have to cover directly on your phone, for example, if mobile mobile devices are available and having always a hand to visualize and data and see how the facilities are doing. And of course, there is like a little bit of a teaser here, but there are upcoming features as well on the side of mapping. One is the settlement extent where you can have like a data outlines of the settlements and the travel time between settlements and facilities. And you can imagine that between that or I didn't I didn't call. Can you please, everyone, make sure that you are able to please. So I was saying that between that and the catchment areas, you can imagine how incredibly useful this can be. So not only you're able to make sure that everyone is covered, but you can also evaluate the distance between like even the further settlements with the vaccination site. On top of that, you can also have, for example, the catchment area of the travel time where you can generate the different type of travel times for for the catchment of the facilities, of course, that you are planning in your organization unit hierarchy and you can like generate by different travel times or greater travel times, depending on what kind of implementations you're considering. And of course, you can also print your your your campaign maps and therefore you can be having not only in your in your mobile devices, not only in your desktop app, but also like a perversion of what you have worked on, you know, there to visualize your campaign plan. So you see that in general, you can like can cover a wide range and we'll also be able to cover even more a wide range of resources in order to triangulate and also visualize this kind of information directly in maps, which is an incredibly useful tool in general when you're when you're planning, but in general, you're trying to like not only planning, but also routinely monitor where you're at with your efforts and what are the next steps for your for your programs as well. And here, for example, I wanted to just cover a couple of examples because it's worth it because we always learn from the from the field and what they're doing. And there are a couple of examples like Uganda and Bangladesh that are there are incredible for what they've done. And it's worth to be mentioned as well, because they've been using DHS to for their campaigns. And of course, there are different different kind of aspects that they have taken and different approaches to the same to the same concept after all. So I thought it would be relevant to us to mention it. So for example, Uganda started started taking the kind of information used for their denominator from their innings, which is their education information system. So they're using DHS also to manage their education. So schools and in general, like the school, like grades and children and roles that include the different school systems. And of course, you with the with the children that are enrolled, you can have this kind of information on the on the target population, for example. So they have started thinking that during the vaccination campaign, the whole district is involved nonetheless. And of course, some in some cases, the decides are actually the schools themselves. So they started actually collaborating between the district education team and the health team. And they started taking the targets from the role list numbers from the target population. And of course, they started working on their micro plan, based on the target values that they've had coming from the education system for the number of children enrolled and also quantify the commodities that it would have been needed in order to in order to carry on these these activities by vaccination posts, for example. So you can see like how different kind of resources, when well managed and triangulated can actually generate much more information that can be incredibly useful than to carry out targeted efforts. And of course, we also have, for example, Bangladesh Bangladesh, like started running a national campaign for users and Rubella back in back in 2020. And you see the degree of vaccination delivered. I mean, we're talking about like very large scale vaccination campaign and and the evaluation came out that they covered more than 95 percent of the target children. And and here, for example, again, they started triangulated geographical information with the vaccination centers in high and low risk area. They started working on their microplan where, for example, they had like their number of children, how many vaccinators they would have, the supervisors, like what kind of like any other HR that they would need in order to carry out all the all the activities. And they have triangulated then these information with their logistic system, the LMS, so they actually required they populated the information that was required by the vaccination activities. And they started then rolling out to to make sure that the supervisors were able to manage and also making sure that the kind of information that was actually the system was of quality and target and show gaps in real time. So they started from from different different kind of sources. Be it that then you start from your normal routine HRIS and you start bringing in other kind of information like microplanning, like logistics before the rollout in general, using different kind of resources, making sure that your microplan is strong and well and well rounded. Can imagine like what kind of important outcomes you might have to monitor and and continue your your your activities during the campaign. And that's why we are heading out during the campaign as a matter of fact. Here we have like once again a wide range of steps and kind of information that you might want to consider while you are you are rolling out already in the campaign. So whether you are collecting data in online or offline, we know that connectivity is one of the key common challenges that we see throughout the different campaigns and but we know also that the Android app can be used and and will reflect that the configuration of the HS2 instance and and that if you already use the HIS, of course, there is no need to for like a father work of interoperability between your your desktop, the HIS to where you configure your information and the data entry directly in the in the Android app. And of course, the data can be synced whenever there is connectivity to the to the main source and and be visualized. So there can be different sources also to enter data when you don't have an activity and on top, of course, of the Android app, we might also have like SMS's that can be used. We have also like during the campaign, there is like an aspect of data quality and an approval that might be needed in order to make sure that the information that we are basing ourselves our decisions on are actually realistic and and are truthful to the activities that are being running. And and of course, this can be done with a variety of of resources. There is like, for example, like during during the Bangladesh vaccination campaign, there has been like a data approval app that has been created at talk. But in general, like there is also some kind of validation internal validation within the system that can actually achieve that kind of the kind of level between the data entry and and the analysis. The data quality app, of course, sorry, I forgot the quality app also like like you need you need to have access to it, of course, but it can also like start start being using also for for feedback loops back to the field, as we mentioned earlier, is one of the key information that you might want to run down to the to the fields users directly that are engaging data entry. So making sure that you have the right resources to monitor the quality of your data, it's fundamental and that can only be achieved with real time monitoring via dashboards. And of course, dashboards are one of the core functionalities of the S2 and and be it with maps, be it with people tables, be it with graphs. And and of course, we know that we have a bunch of of global modules that can be reused and recycled and uptaken and mapped to the local to the local needs configured and customs, depending on what they use is and and and the needs are. But of course, there's also can be some some customs dashboards that can be created locally. And in order to make sure that the end user experience is is the best possible for for the use case. And of course, we have like other kind of integration and other kind of tools that can be integrated with the with the S2. And as I said before, wrapping pro is a global good that has been used in numerous actually countries nowadays. And and it's also used to facilitate field level communications. And as I said, tomorrow there is also a webinar for that. So anyone that can be interested in that. I would strongly recommend to like look it up in the C.O.P. and and sign up for that because we're going to talk further about the bi-directional communication tools between DHS to and and rugby pro. And then, of course, we like we were mentioning during campaign, one of the key information is actually making sure that if someone is visualizing something that is a bit odd, whether there is like some kind of like odd information or some numbers that don't make a lot of sense or any other kind of feedback loop of even of like how the activities are run directly in the field, it's very important that these kind of feedback mechanisms go bi-directionally. So from the field above and from above to the field. So the supervision of the campaign can be done at different in different ways directly in the system. There are like some alerts that can be visualized directly by the data encoders that where, for example, the submission is complete, especially if you're working offline, it's very important to make sure that you have found a place that you have where you have your productivity and that the data is successfully being being synced with with the online server. There is like a degree of skip logic for identity identification of the key populations or any other kind of important rules in order to determine the targets of your of your activities. There is like a bunch of feedback widgets that are available. There are available in the system directly. Be it, for example, there are like a bunch of truckers with that have this kind of feedback. And for example, there are also like you see right here below the validation that can be set up directly in the system by making sure that data elements as they be and follow certain level and degree of logic between them. So you make sure that certain numbers are not above some certain other numbers. So make sure that like there is like some kind of coherence between like the different kind of in data elements and indicators that you are visualizing. And and of course, you can also like set alerts for thresholds, like for example, especially for surveillance, if some kind of thresholds are are passed, you might want to alert the right people and you want to make sure that the right actions are being taken. So there are different ways that this kind of information can be visualized. It can be an internal kind of within the system alert that can be immediate on the screen. It can be like a message within the system. We can have this kind of information also emails, for example. So there is a degree of of of kind of feedback loops that you can already incorporate in the day use of the of the system itself. And of course, here we have some kind of functionalities as well. So you have like system generated notifications that can actually with the alerts that can actually account for data quality checks or even programmatic to know fairness. And we can also like set up reminders either to something data or to enter data, of course, because you can check also in your dashboard, the degree of completeness and of information, for example. So you can also make sure that the directly from the data entry there are also where that is kind of information that's not decimated and is required. And of course, you also have program rules that can be warnings, can be message that can be like the feedback in general, be it for real time data entry, be it for retrospective data entry, that can be either for warning, but also like to support the decision making for the real time monitoring. And of course, you can also set up an SMS gateway and that can receive information and SMSes to and from data S2, of course, because we said that we can enter data directly with SMSes, but we can also have the system directly sending this kind of information yet that, for example, thresholds have been passed, information is not complete. There are certain kind of validation rules that have been broken. So we can also have this kind of like feedback loops that start from the higher levels to the lower level and vice versa in order to make sure that the quality of the data and the the quantity also as well of the data, because we can also monitor the fact that some some sites maybe they are not sending the information. So we can also like have this kind of information fed into the system. And here, for example, we also have, for example, custom dashboards when you are visualizing all this kind of information and and analyst analytic tables must be generated and and refreshed before the data values can be displaced, of course. And we can have like the normal dashboards or we can have also custom dashboards applications, like, for example, the one that we are showing here that it was the one used by by Uganda for their their campaign. And of course, to actually see data real time. And and in these case that you were they were able to see different levels of information, different kind of information. Of course, the kind of information is very much the the usual one that you would expect from from a vaccination campaign, both on a level of vaccination delivery and also on on the side of logistics, because it's fundamental, for example, to count the stocks, but to count to count the vials, the wastage and things like that. So you see, for example, that, like, you can either use the what's already in the system or develop further on top of the system. And of course, you can also have different degree of supervision. We have two different examples here, for example, you have like Mozambique, they have during their audio campaign, they were like different degrees of validations, either with validation rules and data cleaning, but also like during during the cleanup of the data and the district level teams and also the provincial teams were also like feedbacking and discussing with the first layer of data entry to making sure that all the information that ended up in the system and was finally analyzed was the real one that actually was that was monitored to begin with. Or for example, in Bangladesh, you were in the in the MR campaign, the one that we mentioned before, that was incredibly large scale. They had a supervision supervisor checklist that was used with a with a capture app actually, as a matter of fact, and the household visits to do kind of like the follow up of the vaccination activities to make sure that every every planned household was actually covered. They were actually having a capture app called a household visit. So there are also with the native core informations and the native core apps, there are also a way to actually elaborate other kind of information that you can use during your campaigns for supervision for feedbacks and in general to making sure that the quality of the data that you're analyzing is up to date and correct. And then you have, of course, the POST campaign, the POST campaign, we know that you just might not be the core kind of information system that you want to use for the campaign for the campaign coverage evaluation, especially if you run the surveys and such. But of course, there are different kind of ways that you can use it can be used as a data repository. For example, your surveys can be run nonetheless in other in other applications or in other other softwares or any other other tools. And of course, you can make sure, though, that this kind of information that is coming out of your or your vaccination campaign coverage surveys, it's fed into the system because the system can be used as a repository for this kind of information where especially if used as an as a national to may ask can be triangulated even further with routine data. There is there are also, for example, with the Bangladesh campaign, there are also applications that have been developed for rapid convenience monitoring. That was you don't use the events if we could be used offline and can be it can be, of course, used to locate also the different the different locations of where the survey is being done. I said it before as well. We need to make sure that this kind of information falls into the into the national information system and that it is integrated with the routine data in order to triangulate for the long run in order to make sure that this kind of information is also used for the planning of the next activities. And of course, once again, these apps that we mentioned before, we can also use them for the the customers decision making. So be it that you might want to check what kind of like bottlenecks you've had or what kind of bottlenecks you might want, you might encounter later and what kind of like actions you might want to track in order to avoid the ones that you have already encountered. And yet you have you might encounter as well in the future with other with other implementations. And this brings us directly in the in the in the design side of things. So the first part was a little bit more more general on like what kind of like the trust to tools can be used for for the general use of the of the of the of the trust in the campaigns. But then there are as I said, there are also some water considerations that we need to take into account when we design because we're not designing for routine systems. Now we're designing for something that it's on top and it's additional activities on top of the routine systems. So what we need to take into consideration the hierarchy, for example, and and of course, setting up a hierarchy that is suitable for over a campaign operations has to be taken like has to take into account what kind of degree of information is entered, for example, is it overlapping 100 percent? For example, what it's in your national HMAS is it taking into account a different kind of degree of sides because, for example, with the Ugandan side in the in the national HMAS, probably the schools are not part of the of the routine side, but you can have other sides added up in another instance and then triangulated and bringing all the data together at a higher level. For example, I don't know at this level where all this information can be then triangulated. The frequency, we know that, for example, the frequency of routine data up till now, we can go down to daily information, but a lot of routine data is either weekly or monthly. But it needs to follow up also with real-time monitoring. So we're talking about daily, probably, uptake of data. And we need to make sure that this frequency is also matched and uptaken by a different kind of like a degree of users because probably the number of users and people that are using the app during the vaccination campaign is also increased. The population and, of course, as I said before, the population is an important consideration and it has to be taken into consideration hand in hand with the frequency and the hierarchy, of course. Why? Because in some cases, the population is often at yearly level, while, for example, the frequency of the information is on daily level. So you need to make sure that your indicators are also set up in order to make sure that you're getting the right outputs, for example. And of course, then you also have the metadata. And actually, we know a little bit that between the routine vaccinations and the routine immunization package and what we have put out for COVID, there's really no need to go fancy in the sense of like recreating the wheel. We can easily recycle the data sets that are already existing and simply edit them in like very minor ways in order to have them ready also for immunization, supplementary activities, actually. It's a matter of fact. So a strong, a strong suggestion is actually to recycle what you already have in the system and make sure that to make sure that everything is in place and that you can simply, very simply target the core kind of information that you really need for supplementary activities. And then, of course, we have the analysis and which might require some degree of customizations. But the most important part is the fact that it has to make sure that it's visualized in real time and it has to visualize the right kind of information on, for example, like data on the vaccinated children or whichever other target population you have, the kind of like a cold chain stock data and try to avoid for example, sensitive data and identifiers that are not necessarily needed for at higher level to be visualized. We mentioned the fact that your organization union hierarchy is definitely different from the routine. So there are important considerations that you might need to take into account. So what kind of time of you you might take into consideration? Are we talking about only health facilities that are actually already overlapping with your routine system? Or there are also like lower levels that have to be added. So maybe communities or like not even health related structures like the schools but it can never be a tree if necessary. So but still you need to consider it when you're setting it up. What kind of like level we're talking about be it for analysis, be it for data entry, be it for in general, like the setup. We're talking about administrative hierarchy. I'll be talking about health districts not in all countries are actually overlapping. So we need to consider also what kind of like aggregations we want to use because that also reflects, for example, for example, I don't know, we catch materials can be completely different catchment areas. What the campaign then is be is going to be integrated in the national issue mayors because as we said, we need to make sure that then the overlap of the hierarchy is doable, be it at a different level, maybe not at the lowest level, but at least a level of aggregation that can be, for example, at least on a district level. What kind of groups you might want to have, which can be very handy if you just come through hierarchies that are incredibly extensive, like we know that campaign hierarchies can be because we are going some in some cases even lower than the the health facilities. And of course, the degree of access. There is like some degree of like we all know it, there is like we can allow data analysis or and monitoring or levels. Or in general, we can play around with the different with the different levels and roles that we want to give to the different users, which might also be quite more than we normally would and we normally have. And we said it. We we suggest to actually remodel and recycle what you really have. At the end of the day, the core metadata that is suggested also by the different organizations, it's always the same population data, the uptake, the incidents, the call chain, the stock data, if there are any kind of adverse events. So what we actually suggest is to recycle what you have. There can be two different approaches. You can be a manual approach where you actually start learning the existing metadata. That can be done by literally anyone you don't need to be have a degree in any kind of IT related actually competencies. And you just need to adapt, for example, like the code, the naming, you might want to have some kind of prefixes if you have it already in the system to make sure that you can recognize them and separate them very easily between between routine and any other kind of of the campaign or supplementary kind of data. And then, of course, these will assign automatically a new ID. Or, for example, you can have a flat file approach where I mean, probably the shortest part a lot of the time of actually editing the metadata because you can just like kind of like find a replace in both. But at the same time, you need to make sure that this doesn't replace automatically the ID and therefore you need to like replace the ID yourself in order not to override in this kind of information that otherwise cannot be triangulated because you have actually started using the routine kind of information now as the supplementary information. So what we mean is that you can easily recycle just make it just make sure that whichever approach you take, you make sure that there are like some core kind of informations that you pay attention to in order to make sure that you're configuring very well your your your metadata. And of course, when you're setting up your system, you can also like consider different ways of setting it up. Like, for example, this is a dimension that we wanted to like highlight, for example, because we have like a very good example from Nigeria. For example, for supervision, like you see the degree of the Nigeria implementation, we're talking about more than 40,000 facilities that could have actually needed to be created. Can you imagine having 40,000 cut options? Like it's it's it's almost crazy. So instead of what they did, they started using different kind of combinations that combined with a different all units actually had different access. So you would actually needed to only have like a handful of kind of information in order to analyze the performance of the mobile units. So you can actually like add different kind of metadata in order to make sure that you are supervising and and analyzing the right kind of information. You can add some kind of extra data elements, like, for example, for vaccination campaigns, it can be useful to add that elements. For example, to identify the vaccinated that you that you are assigning a specific or you to or any kind of other level to it can be done because you also have different users as well, of course, and you can also add a data element for the team number as well. If you're using instead the side of the users that anyone has like different kind of users, you can also track down who did what and where, for example. And of course, like we said before, category combos can also be exclusively visualized for certain kind of users or group of users. So you can actually be able to filter this kind of information very easily, even with like extensive size or extensive kind of like data models. One very important, very, very, very important thing when you're setting up your indicators, of course, the coverage, the coverage. We know that I mean, why do we got a campaign at all if you cannot measure your coverage? When setting up your coverage, please make sure that you're using it correctly to use the overtime aggregate indicators that use the period offset function that is available for any kind of version before the 23512 actually. Because, I mean, at the end of the day, coverage indicators that use the sum, let's say, of the like that use like the 12 months as the numerator instead of the analyzed indicators is a more accurate way of calculating the coverage rather than using the old way. And I think that that's very important to mention because you actually will see that the outcomes will be very different. And finally, very quickly on the implementation side of things. These are actually implementations and considerations that have to be taken, of course, per country, a per campaign basis, because it has to be accommodated on the local context. There are different ways to accommodate this kind of information, of course. There are like even more outlined in the in the documentations that we have put out for these kind of activities. But we wanted to just like make sure that we mention at least the core information. And some of the main configuration considerations, of course, it's for the data collection. We know that DHS allows different ways of data entry, including the Android that we mentioned before, but we can also support hybrid implementation that can actually combine different kind of paper-based and electronic reporting, depending on the needs, of course. And so some considerations have to be taken into account when the to inform the implementation plan. So whether, for example, there's going to be real-time data entry or retrospective data entry, the which level your primary data collection will be. So which kind of users collect the primary data using which tools? The level of electronic reporting, we said there can be some kind of hybrid implementations where you might start with paper and then the electronic reporting comes at a higher level. It's absolutely fine, as long as it's considered where this level is, which can be like also dependent on the degrees of connectivity, for example. And of course, the modes of electronic reporting. So it can be directly in the app. It can be with SMSs. But again, this kind of information has to be considered when you are implementing. The key benefit of this flexibility is that no interoperability solution is required when you're using DHS because once the data is entered in the system, because DHS at this point becomes almost like a repository of the company data. And of course, the added value is the fact that you can enter data offline. Possibly, of course, in a mobile device, of course. And then you can actually synchronize this data in a second moment whenever you have a connection and which means that actually there is no need to leave the field, even if you have like your first, like let's say your tallying directly on paper. And of course, you actually have to start planning for scale. For high-volume campaigns, it's recommended that a dedicated DHS to instances used during the campaigns to then actually be integrated with the national HMIS for triangulation purposes. And that's also to preserve it to be the stability of the routine HMIS and to try to avoid any kind of disruption. We know that like it can be either of users or different kind of hierarchies and such. So we also suggest to like if there are like a major kind of like deviations from the routine, it's also best maybe to like keep it separate and then integrate it in a second time. We need to plan how many organization units and how they are distributed in the hierarchy because of course, we mentioned before that the more information units, sorry, organization units, the more expanded it can be and there are different solutions of design that you can actually update. The number of concurrent users, we know it that different sites might also imply different users, might imply different number of users that have to be employed directly just for these kind of activities because it's a one-off activity that actually entails many more users than just the routine activities that you might run throughout the year in these specific activities. And of course, the kind of expected data values. So like are you using trucker or are you using aggregated because of course the expected data value that you can expect with a trucker is a completely different kind of degree that what you can expect with aggregated data values. So these are just like a minimal range of considerations that you want to take into account when you're planning for scale. There are many more in the documentation. I would strongly recommend to go check them out. And of course, together with that, we also need to mention user management. So when you are implementing you need to take into account a different range of information. And this can be the kind of role that people have. What kind of regulations you want to assign, what kind of supervision you want to maintain and what kind of tools you want to use for this kind of supervision for health worker or data clerks or both at which level. And of course you need to maintain some a degree of data privacy that is in line with the local regulations. And you have to make sure that these data privacy is maintained throughout the planning and the data entry and also the monitoring. Because of course campaigns, my chances are also directed by different stakeholders and you have to also make sure that different people and the right people have access to the right kind of information. And of course, finally, we also strongly recommend a user acceptance test. But can be with a small kind of sample that can be with a small but representative sample of end users and actually to try to optimize the configuration and gather some people from the implementers, the testers and to make sure that like also at a degree of usability, everything is in line before getting ready to actually roll out. So making sure that you're documenting this process, try to walk through the step by step, the users, stop timing, for example, the workflow because we know that campaigns are incredibly demanding activities and you might want to maintain limited timing to that. And of course, you might want to retest your workflows right before throwing the model to the campaign and make sure that actually you have tested everything and the foreseen as much as possible, any kind of hiccup that you might encounter, and in some places try to have some kind of contingency plans. Finally, only two minutes in with delay, I've achieved my goal. You have here some resources which are the vaccination campaign documentation with the different chapters of user design and implementation. You have the demo instance where you can start playing around which is an environment of a fictional national as you may have system and you have like the different metadata packages that you might want to, you can be a useful resource to get started or to actually confront what you have in your country together against what is recommended at global level. Overall, we have like, you know that we have our HISP network and you can get in touch with your local HISP group for technical assistance. Would you like to actually get started collecting or bringing into the national HDMI system stuff that you have already collected? Overall, you can contact them, but if you don't have already an established link with the HISP group, you also can use the email here and we'll be glad to actually answer or in general put you in contact with anyone who can help you out. Do not worry, the recording of these webinar is available and of course we also post all the relevant links and of course the slides that you can actually access at any time. And with these, I close the webinar and I thank you all once again for joining us and I hope you found this kind of webinar useful and it has been posted throughout the chat a few times. If you'd like to continue the discussion on this topic, please feel free to post any kind of comment, feedback in question or anything related in the link of the COP that has been posted in the chat. And yeah, I'm looking forward to actually continue this conversation in the community of practice. So thank you very much once again and keep in touch, cheers. Thank you, Victoria. I just would like to add that this webinar was recorded and we'll be sharing the recording as well as the presentations with all of you. Bye tomorrow, the latest. Thank you.