 Welcome everybody. This is the first open-air monitor for funders community call. And yes, there is a question. Yes, the recording will be available also for you for all the registrants of this call. We had 34 registration, so we will provide the recording and the notes after this meeting. Okay. And I think we can start, even if someone will join a little bit later. Because we have some ice breaking question for you just to know you better. So I'm going to share my screen. Okay. Please. You can now use the square code or give me a second because I didn't put in the chat the link. Or you can go directly to menti.com and I use this code. 65017233. I will also give you a link in the chat. Let's see that you are joining. Good. So, we can start. So I would like to ask you, where are you working if your funding is the national funders, something else, a field specific funders or an international mostly shipping funders. Even if it's an organization, you can put international. Okay, great. Thank you. The second question is where are you based. Thank you. How would you better define your role in the funder agency, like if you are a project officer, policy officer. Okay, great. And the final question by now, what's your knowledge about opening monitor. If you know it and you are using it. If you know it, but you don't have use it yet. Or if it's the first time for you. Okay, so it's the first time for some of you. So now Harry knows how he can go. And I'm giving the floor back to Harry, who is the service manager for opening monitor to introduce you. Okay, thank you. Okay, great. Thank you, Julia. Let me share presentation. Okay. I think there should be. Okay, great. So hopefully you can all see my screen. Remove something from here. Yes. Great. Okay. Okay, well, hello to everyone. My name is Harry Dimitropoulos and I'm going to be introducing the first community call for opener monitor. And the focus is for funders for this call. But, you know, if you're not a funder, you know, please don't leave because this monitor is not just for funders as you will see. And okay, so the, the, I see that some of you have used actually saw some familiar faces with some of you. I know you some, I know of you but haven't actually spoken how it's useful for them and then do a demo kind of, which can be interactive you can interrupt me at any stage and ask questions and then it will be q amp a so. Thank you for coming because this is our first community call and as you will see throughout this presentation, the, we want this to be a community driven tool. So, okay, progress. Okay. And why monitor, I suppose, most of you will know the importance of monitoring, you know, you're an assessing research activities. But just to give an overview for for people maybe the, that our first time seeing the service so in general we want to the assessment of research activities is obviously a key step in the decision making process for every organization invested in such So, in the case of funders for evaluating the proper allocation of grants, for example to maximize your impact to society. For an institution it could be looking to for to find hidden potential and room from improvement in different areas for research initiative it would be considering expanding its network. These are some of the examples. So they're reliable and timely monitoring and evaluation of research activities are indispensable for the efficient allocation of resources and the overall decision making process for an organization. So this slide basically knows that monitoring will help you know yourself first so what are the resources that you're you're putting in and what is the research output that is coming out. So for funders you want to maybe want to see is easy are your open science policies were working. What are the collaborations you're having with other funders and institutions, the different visibility pathways that work for you and the impact you're having. And that will help you understand more the and identify for example research pathways across key dimensions, give you insights and you discover new opportunities for where you can focus, see what works what not, you know reveal hidden potential like that. So then, you can go to the next step which is to position yourself, you know, use all that information to make this decision make find the best way for reporting your results and improve and optimize basically your future actions. So specifically for open air monitor. Our motivation for building this service was that we wanted it to be relevant for the community so it should be based on indicators which are co developed with the community and would make sense to all. It's, it's something which is based on an iterative process of talking to the stakeholders whether it's funders institutions and seeing what the community wants in order to provide it. And also because it's open air it's based on open science and open data service to to be inclusive transparent and then all the results that are produced to also be able to be replicable. So we want to coverage, all the space of open science so we want a comprehensive view. And for this will we're using the open, open air research graph, which is a global linked research graph. We have data resource from open nations around the world, and it goes beyond publications so includes research data software other research products and patterns and things like that. And it should be fully embedded in the infrastructure, starting from the current providers all the way to the included metrics. So it was based on on some principles that we're trying to follow and principle of openness and transparency so our methodology methodological methodological assumption. The assumptions we have should be openly and clearly presented. The coverage inaccuracy should be based on multiple, multiple data sources so that's why we're using the open air graph and extend our coverage to the fullest possible extent in order to provide meaningful indicators. Our construction methodology must also be described in detail so that it can be verified and used by the scholar communication community to create ongoing updates to our proposed statistics and indicators. So all our indicators should be well documented. And the methodology is built around well established open databases and already known knowledge extraction technologies and like nlp machine learning using operational workflows in open air to one time the results. And also, it should be something which is trustworthy and robust. So our methodology also strives to be a reliable aligned to other assessment methods so that can be operation operation allies, using reusing conjunction with other assessment methods. So this is in case you haven't seen this view of the kind of the open air research graph pipeline, on which all of this is based. So you will see on the left here, we have the open air research graph combines data sources and data coming from multiple data sources. It aggregates and collects and harmonizes them. So this will be metadata relationships and anything we can get from the open community. And so these are then deduplicated because many times we have, we find the same entity from different sources, whether it is a publication, which will be, you know, could be a pre print postprint a published version. So these there are considered an equivalent object, but then we keep the, the provenance or wherever each of these sources has come into the graph so we can always go back. And also we want all the entities to be deduplicated not only the publications but like organizations might have different names and we want to be merged to the same entity. All this is enriched by our data mining, full text mining and inference system in open air, which enhances all the links, which enhances the graph with extra links. For example, you know, links to to funding and links to patents and classifies publications and things like that. And there is also a post cleaning step where everything has to be harmonized according to control vocabularies. And sorry, I forgot to press this and the then we have the statistical analysis stage where we take all this data, and we analyze it in a way that we can produce metrics and indicators, which are relevant for the community and for the monitor So just a quick view on some numbers and this is as of today so the oops, apologies the in the open air research graph at the moment we have 146 million publications, 18 million research data 312 k research software items from 111 data sources k data sources, a link to 3 million grants from 25 funders and 180 organizations and they're all linked through citations and semantics. And all this is has the system infrastructure to support it underneath. So I'm not going to go into the details of this but so that you know there's a public subsystem data mining and provision subsystem. There's also different resources and a test subsystem. And as you can see over the years CPU ROM and disk usage has been increasing. So we're expanding as the needs of the users are, are, are expanding and in order to support all this. So, the open air or dashboard is has three types of aspirates at the moment. It's one for institutions, one for funders and one for research initiatives, and for each of them, we have allocated someone that can be your contact point for one to one sessions in order to help you set up the dashboard, understand your needs, get your feedback for new indicators, curate your data or, you know, and solve errors that you might find so the idea is that we will we have tailor made monitoring responsive to your needs. And to briefly mention also that there's another type of dashboard we have which is will not cover in this call which is the open science observatory this is specific for countries so you know this is open science data for for at the country level. Okay, so what do you mean by dashboard on demand. So what we have is at the bottom here. We have the open research graph, which includes data for the organizations, you know funders and institutions. This is our common, common global asset. And then we have our open air experts in data mining statistics and data science which augment the data space in order to produce metrics from which we can then produce the indicators that the community has requested and could be for collaboration for SDG contribution or something like that. All these indicators are then combined into profiles. So at the moment we have profile default what we call default profiles for different stakeholders for institutions for funders and for research which is the starting point for building your profile so when say a new funder comes into open air and we will create the resources give the resources and and start from the default profile. So the expert in the loop, the open air consultant, you will be communicating in order to understand what these indicators are and how to apply them in your specific case so how to customize the dashboard and how to make it into your own needs. So, and also there's a team sharing bit here so that your dashboard can be used in different ways, in a sense that it could be some view. Some pages will be open to the public others could be where you invite team members to share some indicators and others could be just private to the manager of the dashboard. I'll talk about that in a minute. So let's have a look at the indicators that we have in our dashboards. They're in this these kind of themes of funding research output open science collaborations and impact. We're still producing indicators there are many indicators in the pipeline so which all of them will be ready by the end of the first quarter of 2023. So some of them are in beta. But most of them are there so we have the funding theme where it's all about grants and projects and the indicators relevant to that. Then it's so this is kind of the what goes in from the funder and the what comes out the research output so this is indicators for publications data set software other research products, and things also for data disciplinarity fields of science and that type of thing. There's a specific theme for open science so we're looking at fairness indicators access rights open access routes, different types of general business models. There are APCs and compliance with the planet. And also for collaborations and then at the moment based on two kind of areas via project participation so with which other funders are we co funding publications, and also via co authorship and co creation. So that is the impact section which at the moment is based on reach and frequency so downloads citations and very soon will have also the impact on for different sustainable development goals. So this in order to to be useful it's important to have a kind of a granular view and break down the indicators by different fields of interest so you will see as we go along that they could be by research product type by domains like field of science by time so you can see trends by countries by data sources by funders and things like that. So the features that we have are that we want to make the dashboards as user friendly as possible so there are also interactive visualizations as you will see. And they're exporting capabilities so you can download data and visualizations in different formats. There's filtering. There are also filter subsets of your data. There is browsing with direct links to explore the other service of open air where you can see all the research outputs. And I will show you also because the monitor provides aggregated data provides the end statistics and indicators but you many times you want to you see something that might look strange or odd wise. That year these numbers are you know why are they so high or something so you want to go back and see what what what caused that. Also you you might also it could be also interesting for finding errors in the data or things that have been missing so you would expect more results in some area and you don't which means that maybe some data is not considered because it's not open or something like that. So it provides useful feedback and you can also edit visualizations to your liking and move around the the indicators. And regarding privacy settings we have three kinds of visibility statuses so this is, you can have public indicators, which is for external stakeholders this is for showcasing so you have a dashboard for you, which everybody can go and you know, look at. Then there is a restricted indicators. Again this can be grouped into restricted pages or subsections where you invite team members for internal monitoring. So you want to know these are not publicly available but they're useful for for the your team. And then there are private indicators which could be work in progress or preparing something for a review, where it's only the manager of a dashboard that can that can see it. So the regarding the one to one one one expert consultations. So the, the, the person is there to help you so for funders it's me initially but then I might redirect you to other people is to help you understand the dashboard features, how to edit your data and how to manage it so the user management as well. And then it's also to hear about your feedback for the different indicators or new ones that you have to you would suggest to develop. And also to discuss things like data quality and validation so you know what data sources were included. So it can work well and and things like that so it's always an open channel so that this is your service and for I don't know but in the from the questions at the beginning. So not funders were others, but some were funders that knew about the service but haven't used it. I'm not sure if we have because there was an invitation for some funders from outside to come in so I'm very briefly when I mentioned how a funder can join open air. There is this link here the slides will be provided to you, which give all the information needed so we were limited method data set of project information this could be provided in a in a file like CSV. Excel, but some funders also have an API from which we can directly get the data and and keep them up to date. This is via data exchange agreement at the moment but we very soon this will become an MOU with which will be more clear and will be more useful for all of you. There is no personal private details are required so this is usually information that many times the funders already have you have in your on your on your own websites and pages. Fundatory fields like the project identifiers and start an end date of projects and things like that, and some optional, like the organizations involved project description and budget if you want the monitoring surface to to support budget monitoring as well. So now is where the kind of interesting stuff was start I'm going to go into a demo where I will show you the dashboard. Go through the indicator the themes and the different documentation that is provided. I will talk a bit about user registration and management, and also then go into the functionalities of the back end the administrator interface so you know how to adjust and customize the monitor to your own needs. Oops, that's too soon. Right. So let me change. I want to share this. Okay. So. Okay, so hopefully not. Oh, my browser. Great I got. I got a message saying my internet connections unstable please let me know if there's any problems. Okay, so this is when you go to monitor dot opener dot you move some of zoom controls out of here so I don't, I can see what I'm doing. Okay. So this is the landing page where you can find some information on how to get started so this is really for people that haven't had a dashboard first where you just basically say who you are and we get back to you. It's not useful for people who are already in this call so you've gone through this level there's always a help here where you can submit questions to our help desk so you will see that. So, you know you can get support at any time. So, browse that and there's also an about page where you can learn the process and have some general information. This is before being signed in. And also there is a resources page where here you can find the things I was talking about technology, what have been heritage and inferred attributes that we have and the constructed attributes. So what approaches to be used. So for example for general business models, mostly we mostly fall on pay was approach. So this information is provided there. And we also have an indicator page where you can see where you can see the sorry indicate. Yes, where I hope you can hear me because I seem to have been connected and disconnected. So here are the indicator themes. And from where we also provide tables for the different indicators use so some are coming soon some are there so you can see the different indicators I'll be showing so the all that is there. But anyway, mostly people will go in browse dashboard and you can filter for example for funders and what are probably available and I will go to the European Commission. Maybe because it has the most data at the moment and all indicators are applicable for some funders, not all are. And I will start from here I will also sign in because I might want to use some functionalities like filtering. Okay. Right. Okay. So what we have added since I mean some some of you have seen the monitor, I don't know, a couple months ago and there's many changes. So one of the things added was an overview page where you can put some key indicators you want to have in the first page, the moment has for can put any of the indicators we have there from the others. And publications over time. Here's the thing about the graphs being interactive. You look numbers and click on specific things you want to see you might want to see only say the peer reviewed or that line. So there's the things things like that. And also from here, there's this tool tip where you can view something in full screen. You can print a chart. Right. You can download it in different formats being JPEG PDF SVG vector image, or the CSV so the data behind the graph or an Excel, or view the data below as a table so if I click on it there is a table below you can quickly see that I'm hiding it now but you can also see the numbers by going through this. So there's a lot of publications over times data sets over time. So now here's an interesting thing. Ooh, what is happening there. I'll come back to that in a minute when we go into the data sets detail. So this will be interesting if I was. If I'm the funder that have has this dashboard to see what's happening there. I want to see is that a mistake is something different happening there. So let's put a couple for openness here. So for example, what is open access what is called access for the publications and similar for the data sets and one collaboration indicator for co funded research outcomes over time. So, then we go to the funding section, which is information about how many participating there are sometimes maps so you can see projects granted to what countries the growth of projects over time. The top funded organizations by number of project participations and the top funded countries. The highest funded projects and things like that. For Horizon 20 sorry for you. There you're very commission we also have a horizon 2020 page very soon you will have because we do have the data for FP seven and now soon we will be adding Horizon Europe. So this has more additional information so projects by pillar. So this depends on the funder, you know some funders do not have say pillars or this kind of thing, but these are more tuned to specific funders. And yeah projects over time project funding over time and project funding by pillar for example here again here somebody can click and look at more specific, you know, sub sections of the graphs and things like so these are interactive. Now, this was kind of the input the funding the projects. This is the output so the research output which is divided in these sections for publications for data sets and data management plans software and other research products. Here we have a game publications by country by type article, you know book thesis with different types they are the top 10 publication types a different view of that graph basically publications over time, average number of publications per project publications by context Now this is specific to open air so if I go to connect. So in open air we also have the connect service, which I'm not going to go into too much but we basically have provide gateways, or different types of communities research communities and research initiatives. So, you know, some would go or or and universities network or that's for specific for Coronavirus or for the diary you committed to talk about these things like that. So these are developed for specific communities with specific needs. So, since we have that in open air, we provide this which could be useful could be not so you could disable it basically saying which of your publications fit into any of these categories so you know there's there is so many for COVID 19 and things like that also here I'm going to say you can also maybe zoom with some some graphs by doing this so you can zoom and, and so this is another useful feature. And now by, by, so you can see by data source type so you know was it from a data repository or funded database and journal where did these come from share of projects that produce publications over time. The top 15 data sources. I can see we have archive here and most productive projects and the top organization based on the produced number of produced publications. All interesting stuff and also there's a section on peer reviewed. So, this will be for the peer reviewed publications have some different graphs here, top 15 publishers. I'll come back to this so for example here. I don't like the way this is displayed because I've not seen some of the publishers here because the graph is too small. So I'm going to show you how to customize and change things like that. So this is the first section when I go to the manage section. So the section on database. I mean the others are kind of similar but there are differences so this includes also some new indicators on data management plans by data source and over time for for them. And there is data sets. So here, remember we saw strange things in the data set graph here at the beginning, we also see here that okay data set includes different types, some are data set in the way we understand it like tables of numbers. But there's also other things included here and we see a lot of images so we're going to go and see what images, you know what was relevant there so if I, that's where I can actually go here to browse data up here. So remember we had resources. Okay, I'll actually go back to that. Let's go to browse data. So this gives you results for specifically for you via open air explore. So here, if I go to Right. All right. So here. So here I want to select the research data only and the year was 2019 I saw where that strange thing happened. Oops. So if I filter by that so there's many filters here so you can see I see a bunch of images. So what is all that and then I realized that in that year in Zenodo we had a lot I have some million of images that came via this project, which was about innovation consolidation for logical digitization of natural heritage. So that explains that, for example, in that year so this was a massive input of images. Okay, let me go back to. Yeah, sorry. Okay, so I'm going back to the to the monitor. Okay, so we here we will continue now with software is similar but they could be some differences again here. Yeah, top software repositories and things like that, and other research products. And now the new indicators are the open science indicators that were not available before September or the summer, and they are divided there are provided for publications data sets and software. So we have open access indicators, general business models and processing charges indicators for plan S, they're coming soon, and there's some fairness indication now so let's see the open access. So there's a general account here for what embargo restricted close access and some we don't have the information available in the metadata, but you can also see the information also over time. And, or publications by access route. So gold hybrid bronze. Again, you can see the bits that you want if I remove. So it can check the graph and also over time. And again, published version versus versus deposited over time so in a publisher in a repository or in both top journals by number of gold by number of hybrid whenever bronze and green. So in the APCs, you can have the open access publications by general business model over time on diamond transformative journal and by grant support and full the top 15 full open access APC journals for your output. Diamond transformative journals so indicators like that. And for fairness. At the moment it's based on PID so how many of the so this is the bars are all publications and the black line is how many of those have PID so we see a really high percentage of them have. And then what types of PIDs. So, most of them are DIYs and, again, whenever there's Oh, what do we mean by PIDs you can always go here to the terminology and construction and look at the different attributes and the many, you know, PID identifiers. And if you click there, it takes you into a page where it gives you all the IDs that are relevant and we're using in the graph. Okay, I went browse no I didn't want to go I want to go back to dashboard. So I'm back to my dad to the dashboard. Similar things for data sets and for software, where here we only have open access and fairness. And then there's some collaboration indicators at the moment they're the ones via project collaborations so and here they display that if they're publications software data sets and other such projects and then over time. And impact indicators are coming soon they're available in beta actually go and show you there in a minute. But first let me go to the manage section so here up here you can see you can return to your dashboard there, you can browse data via explore, you can look at the kind of resources. There are things about the open air ABI is information how you can access some of these, you know the data and information from the graph. And then there is managed so if I go manage I enter the manager you. So first in order to go there you need to have access so this is not open to anyone. And so here is the user section so for example, you will. Already have asked for access as managers or as members managers can edit things and see every section of the dashboard, whereas members can only see things without which are made public. Or to team and restricted to team members so it's easy for a manager to invite other managers what once you're in there you can go invite manager and add the email. With the only problem here that the email must be the same one that the user has used to in open air. You need to first register in open air and then, and then be able to invite somebody otherwise he won't recognize the person. Again this in the in beta I will show you there will be an FAQ where we'll have question question answers for things like, you know problems like that because sometimes people invite people that are not already in open air and it is usually that but you know we're always here to help with any of these. So the first page of a funder is a kind of general page which most of the things are locked there for us there are links to the index and things like that. But here you can change your upload the logo or, or change the status of your, or your entire dashboard so to be public restricted or private. So you could apply for everything but then we'll see how we can customize individual sections. So the part with indicators is here. So it's the same structure as you see before. But now it has things where you can create new categories, or you can delete things and the, let me show you here about the privacy thing so for example here. Yes, sorry. Yes, if I may interrupt. Since we only have 12 minutes. Maybe we can ask first if there's any questions. Okay, otherwise you can continue. Thank you. Can I wrap up one second though just want to show one feature and then that's it because I think many have reached this stage and they don't know how to use this. I just wanted to say that here, you can go into either change the visibility of a specific graph, or go into edit where you can change things. And remember I told you before something was large or smaller so you can change that and also change, you know how you would want for these things to appear and kind of have a preview of it. Before you save it, and all these things are this is not actually a good page to show this, but these things are kind of movable so this I can, I can grab and move somewhere else. And stuff like that. But you know if you have specific questions on these we can we can go into it. And from here you can preview, you can preview the public and restricted view directly so you don't need to go back to the browser. Okay, I'm stopping here for questions and an answer for the Q&A session. And sorry that it took too long. Thank you. And we would like to remind you that open areas are no profit organization. So we are not making any profit from this. Okay, so, do you have any questions. Anyone would like to take the microphone on. I think there's a lot of things in the chat which I couldn't see because I was. Yes, I took care of this, but there is, if you could very briefly tell us how the project validation and the links come. The work that you do, Harry. Okay, so yeah with with right okay so with funders with the information that we get so we get the information from the funders. And the first step is we, we try and find the products that the projects and the products in the open air graph that you know match those projects. And that could be either from metadata that is provided by the different repositories already, you know, somebody depositing something in Zanotto my link it to a specific project. And by the way the project list there is again given by in Zanotto by open air, or there's the text mining that is done so text maybe I don't know if you want me stop sharing I don't know. So the text mining that that is being done so by text mining we're trying to find links that are not there in publication we scan the full text of publications not just the acknowledgments and we text mine for funders it's for funding information but it's for other things links to data sets, links to patterns bio entities and other things that could be interesting and are provided in the graph. So, once we have the, the first set of results, we send them to the funder and to verify. Usually we have hand curated everything so I can tell you know we found these problems but and and and these we we seem to having trouble with or something like that. There are a couple of iterations with the funder saying oh yeah that's because you can use this search term in our acknowledgments. We also sometimes refer to this as some somehow differently. So the mining is tailored to, you know, to the specific needs of the funder. Then once, once this looks okay it runs in the open air graph and the results are shown in the beta portal so this is the beta explore so the way we have the explorer page. Where we can only you know we can show to you with the. So this is the normal export page but there's one for the for for beta, where you can see the links and look around and see if there's anything missing. And if satisfied then these can go to production at the same stage that we produce the better results we can also produce a better monitor dashboard so the, am I still sharing my yeah I think I am so that we have also a better monitor version where you can have your dashboards in beta. So where here we test things before they're released in production. And here. There is also the things I was saying that they are to come so how to works is actually going to be changing and there's going to there's an FAQ at the moment is still we're still editing so that's why it's in beta. There's some, you know, additional help. So, and it's an iterative process, you know, over time for a fund. Change the like European Commission there in Europe, so the funding itself this this is again an iterative process, and we have noticed that by doing the text mining, when for some founders we actually get a lot of links that we would never get otherwise so it's very you know this enrichment that happens in the opener graph is extremely important and we have figures to show it but I don't have the time to show you the table now. Okay. And there was a question a question by blacked. That was about the indicators and the metrics within the research cycle. And I was wondering if practice satisfied with what we have showed as indicators. You know, absolutely. It's, it's rather because I think in the slides you mentioned full coverage of open science, and because we interpret open science as as much broader cultural change that also affects the research process before the I just wanted to make sure like it to what extent are you going beyond just the outputs and as I said in the chat, obviously also that this is not the process and the outputs are not completely distinct you can read from the outputs, how open the process before that but just that that phrasing full coverage of open science, that does mean something in terms of yes, that also includes the process so you might want to take a little bit of care really specifying what exactly you're looking at. Okay, thank you for the feedback and also the what he had said before in my chat we need a next time also to have somebody from the graph here to because this again is is is, it all depends on the data we get in the graph, which want to make it as comprehensive as possible. This is good feedback thank you. Okay. So maybe I can share my screen if you have some questions, and then we will go back to you. So, Harry, are you okay if I share my screen again. Yes, please. Yes, so let me stop sharing. Okay. Okay, so if you have any questions that you would like to type. And we will go back to you and we also upload or modify the FAQ. Otherwise, type in the chat and we will go back again to you later on. Okay, waiting. Okay, questions in the chat. Okay, I'm going over. I don't know why sorry. Okay. So, I would like to ask you if you would like to have a future community call and with which frequency. Can you please vote on your mentor. It looks like every three months I think which is what our impression as well from what will be useful. Okay. Neither too soon and not to to infrequent either. Okay. Is there any event in which you would like us to present open air monitor that we should look at. If you are not logged in, go to menti.com and use the code. It's 6501 7233. If anyone has other questions and would like to take the microphone. I will stop sharing. And then let you speak. I'm just going to add. Most of you have but my email on in the chat so that people can communicate. So please, you know, feel free to talk to us because this is the point we want to, you know, just the, the, the dashboard to your needs and also for specific funds that have a dashboard. Usually we afterwards arrange specific meetings to go through all, you know the questions for if you go at your own dashboard you might see that some indicators are not there so why are they not. So, you know, the top projects have project numbers but they don't have acronyms. So there are some indicators that work for acronyms on you where you can see you know the top projects by acronym because a number is not very useful. I have the information is there if you do want to see it by number. It's in your, you can manage it in your dashboard so, you know, any questions and feedback as well. It's very useful for us. Thanks, Harry, and thanks everyone for joining this call. Thank you very much as well. We will share the recording. And if you have some questions and you would like to go back to us please do. And we will repeat this committee called in three months. And we'll send you an invite again. Thank you.