 Thank you very much for joining. It's always a great pleasure to welcome you in this monthly open air provide community course. So we are running this community since September, October last year. The idea is to share recent developments and to share the services, the details of the services that open air have for content providers. So it's always a pleasure to welcome you. We have different people in this call from managing different kinds of data sources of open air and also part of the open air community, the open air network, national open access desk. So it's a great pleasure to welcome you. As for all the other community calls, just to check if we are already recording, okay, perfect. So we have always this first three, four minutes where we provide some updates and this is what I am going to do in the coming minutes and then usually we dedicate one some more time, like 20 minutes for a main topic for discussion. And today is the on the the users account service, our user statistics functionalities available in the dashboard and but behind because this is a service also available in other components of the open air ecosystem. But we will focus today on what we have in the dashboard and why we have this service and how can you enable and use the data from this service. We will count with our colleague Dimitris that is the manager of this service technically speaking and he will do a presentation and then we have more time for questions and comments, not only about the users counts of course the first part is dedicated to the users counts service but then you can also address other issues related with other services or issues that you are encountered using the dashboard. So this is the time to use. So usually we dedicate 50 to one hour, 50 minutes to one hour at each call and you will feel free to put questions in the chat or to just unmute yourself and ask your questions. So I have four main informations to share with you. There are always lots of things that we can share but one is not a good information because unfortunately we were not able to put in production in November the new, the developments that we are doing in our broker service so we thought that we can do it until the end of November but unfortunately we were not able. For sure before Christmas we have it as soon as possible in December we want to have it so other priorities we faced other priorities and unfortunately we didn't dedicate the time to finalize our technical team didn't have the time to finalize what we need to finalize so this in fact is already available in beta but so we need to put it in production as soon as possible and we hope to have novelties in the coming weeks for you. So if those that are not aware so I'm just please be aware that we did one call entirely dedicated to this the broker developments we did it in early October so the recordings are available but basically just for you for those that are not aware so I think it's important as you know we have the broker service running two years in open air and the visible part of the broker service are the metadata enrichment events that we provide via the dashboard and we realized that the way that we are delivering these events to the end users to the repository managers via the dashboard was not completely scalable for us in terms of the management of the infrastructure and we realized that we should do some changes the service is quite good and mature but we have changed the way that we are delivering the metadata event so just for you to know some of you are already aware of that because you have participated in previous calls but I just want to share this slide just for so what we have changed is that we have now three phases and until the the second phase we just deliver 100 events metadata enrichment events for for you to be aware that we have relevant enrichments for you for the different categories of events that we have available links to projects the abstracts open access versions the pids of the different events that we have we just create the sample okay be aware that we have events for you we can expose you 100 or less depending on the events that we have available for you and then if you are interested in a specific event in a specific get cat type of event category of event you just go and create the subscription and only after the creation of the subscription we can deliver for you we will deliver for you all the events that we have available can be 200 or 2000 depending off of each repository but so we are not sending the total metadata enrichment events for you in advance without having your interest or not so first we exposed you okay this is what we have to offer you if you if you are interested in for example metadata missing pids or missing links to projects you just subscribe and then we are going to send you all the events related with that we and we will notify you about that so we are not sending you all the events if it's not necessary and relevant for you so if you want so for sure in the coming year we will have another call dedicated to this and when when it's in production we will do a quick demo in the i hope i hope to have it in the first call of the year in the in january but but be aware that you can listen to claudio wazzori from cnr e3 presenting the these changes in the in the broker event so and the other the other thing is that in the in the last two or three months is that there were at least two translations of the the literature guidelines version four so it's available in the in the in our website guidelines dot open rdu the translation in in spanish there is also a translation in in portuguese so if you look into the to the website of our guidelines guidelines dot open rdu you'll see that we have guidelines in the version four in english and the in translation also in spanish and be aware that there is also our colleagues from ebect the brazilian institute of information science and technology also did a translation in in the end of september and they have it available in a like kind of publication in their repository so be aware of that so it's a brazilian portuguese translation so if you if you want to to to know more about the guidelines and you want to do it in your own language spanish or or portuguese you can you can do it already and then a novelty about the users the users count services so new infrastructure workflows the data from the statistics already available in production so almost all issues the majority were fixed the meeters will talk about that later but be aware of that we only have some issues with some graphics that we are presenting in a minimal number of repositories if you have if you encounter graphics that they only have that until 2018 please contact us but but we are aware of that and we will solve that in the coming days but we we have the list of repositories that have this issue but all the data behind the the queries and the reports that you can get it's correct only the graphics the visual part is not correct but maybe the meeters can add some more information about that during the presentation another thing so we have decided that after the broker this new way of delivering events this update the next update will be the new functionality the multi-user access something that you all are asking for to have since the beginning finally we find time to do it basically what we want to do and we are almost there it's a you know I have a slide here to share so basically the idea is that under the update tab of the dashboard you will have new the new new menu a new tab update permissions where basically what you can do is that you can invite more users to access imagine and manage your data source it's not your account of course it's not sharing the account is sharing is providing access to another account to manage the data source the repository for example this case is a print screen of the university of menu repository so our manager that is Ricardo Ricardo will provide access to other persons to manage and we don't need to share the login and the password so we just invite others to and to and we assign these permissions to other this is something that lots of of of you base maybe in this call and and in in different presentations I've asked it to have so we are happy so we have already checked all the requirements so we have this prepared and we hope to have this soon in the in one of the coming updates for sure we will have this new tab under update and you can invite more users to access and to and to manage your your your your data source so these are the four highlights that I want to give in this first part now we will dedicate some time to the main topic of the of this session and I will invite the meters you can present yourself the meters and then then run this presentation we will have also a mini meter for you to collect some some feedback so stay active in the coming meetings in the minutes also to come up with some some some feedback for us because this is important at the end we will have questions if you want to to ask questions during the in the shot you can do it do it during the presentation of the meters but at the end we will have time for questions also about these updates or about other things so Dimitris yeah thank you for that let me share my screen and thank you I see some more people that have joined so thank you for those that have already joined you can you can turn on your camera or then for the questions and answers also do it in using the microphone because it's this is a community call and this is good to see faces okay can you see my screen now yes perfect yeah thank you so uh hello let me welcome you also to in the 10th community call of open air the main topic is the is about the users count service which is one of the services offered by the open air ecosystem and I'm Dimitris Pierracos I work for Athena Reset Center and together with my colleague my colleagues from University of Bilford that they are just I can Yohesir Vangen we have developed the users count service of opener the users count service actually the service that measures the engagement and the impact of this engagement or to the content offered by open air and I will explain in detail what this is all about during this presentation before that I would like to ask you just for a warm up to participate in this uh many meter questions you can go to this link and use this code we have created some questions there and as you know Adre will you share your screen yes I will start to share my screen and share okay thank you many results I think you are seeing my thank you my screen okay first of all would like to ask you if you are using any kind of a user statistic service whoa let me draw no okay so eight out of the 50 people don't use any user statistic service at all okay can we go to the next question so that makes our presentation very interesting because the majority doesn't know the service at all or has it knows about the service but hasn't read it yet okay and then last one so if you ever use the for those who have used some kind of your statistic service what which issues have you identified uh privacy technical issues standardization accuracy don't care too much okay so your main concern is standardization then accuracy and then okay if you don't actually care too much okay that's fine that's fine okay thank you thank you these are the questions so I can go on with my yeah excellent contributions yeah sure yeah so after this warm up let's proceed with presentation these are the topics that will be discussed I will provide an introduction to the service which I will try not to extend it with a lot of technical details and I will focus mainly on the most attractive parts which is what you can get from the service how can you get what are the interfaces and the tools that we offer and that could be used to get the interesting analytics from the service and I will also present how can you participate how you can register them be a member of this service so you can have access to hopefully all these interesting stuff that will be shown uh today so first of all um uh where is uh where does users service does users count service is placed inside the open air infrastructure and open air ecosystem as you may know open air uh simply collects research from content providers like institutional repositories aggregators uh data archives and a lot of other content provide types of content providers and a set of open air services is applied to this content for example the duplication harvesting the mine and the final outcome is the open air uh research graph the main entity of the open air research graph is the research project which could be a publication a project organization uh uh dataset etc and what the users count service actually does it measures it simply counts the usage of the of these research products across content providers in other words it measures how many times a particular research product is accessed and this access refers to either metadata views or downloads of this research product and after finishing with accounting the service produces statistics user statistics about the the performance of of the product uh the usage of the product not only inside a set of content provider but also across many content providers where this research product has been accessed so this is more or less a description of the of the placement let's say of uh open air uh users can serve inside open air so how we do it um what is the architecture that we have built and what are the workflows that are used for the users count service well we're following we're following two approaches the first approach the first one is called push since the users activity information is pushed directly to our analytics platforms and in real time to achieve this we have um provide a set of tools in the form of plugins or scripts that could be uh installed or executed in case of script of a script in at the repository site and push information send information directly to our analytics platform the analytics pattern that we use is the open source analytics platform which is called matomo uh maybe you are aware of it um this is our first approach so um we install um or provide scripts and we retrieve uh usage activity role users activity from content providers directly to our mat to our analytics platform um the second approach is called uh pull approach since we do not retrieve the actual role usage activity but we collect user statistics uh in the form of reports that are prepared using um standard schemes like the counter code of practice for which is provided by counter initiative initiative these reports are collected from aggregators like for example iris uh uk so in both cases either push or pull uh uh approach uh following these two approaches information is stored in our statistics database and which is fair and is further processed and combined using information from other open air resets uh uh graph items in order to produce the user statistics for uh either the resets product or uh the content provider for example institutional repository these user statistics are uh then published uh uh in our open air infrastructure uh portal infrastructure like explore or provide or they are available um using a open open apis uh following the susie light uh protocol i will describe this later so this is more or less uh our architecture and the workflow just remember that we are following two approaches the push to collect directly um usage activity and the pull to collect uh already available standardized reports this is a rather technical uh uh slide uh just to uh be informed that we are uh our main infrastructure based on hive and bala we have moved from the old infrastructure which is uh which was in a PostgreSQL database and for an analytics platform we are using the matomo uh open source uh analytics thus to uh summarize the usage count service features um we follow two approaches for tracking the usage we call it push and collecting counter reports standardized reports um we follow the pull approach um the all all information that's collected is anonymized so we keep uh we preserve users uh privacy and we anonymize the ip the ip addresses of all uh usage activity that's collected uh by exploiting the metadata duplication um service offered by open air we are able to accumulate the usage for the same set uh outputs i will provide a certain example later in this talk and finally because uh most of you are uh worry about the standardization we produce counter code of practice compatible um reports uh these are standards based use statistics and this allow us to uh compare our statistics and statistics that we produce with statistics from other data sources so just keep in mind that um in terms of standardization we are compatible with counter code of practice uh which is now uh offered in which now support release for and in the next uh version we will support also counter code of practice release and five so um keep in mind that um uh usage counts is a measure of of of scholar impact we measure the the engagement of of of uh resets products uh we we simply count and we produce results about how a particular resets product is used and the uh since impact is number let's see some numbers so if you go to the uh provide dashboard open as code provide that you you can see the the performance uh in terms of usage activity of a very certain uh repository for example umino you can see the number of use of of using the downloads and this is the graph uh that that is uh shows the evolution of um of this service uh for this particular repository this is the graph that Pedro mentioned that has issues and the statistics are displayed only until uh 2018 although we have collected information uh until uh last october this is will be solved in the next uh in the next days and uh as a content provider as a repository method you can also use this interface to ask uh to retrieve reports specifically for a period of time for your repository using this interface which is provided by content provide uh the dashboard um you can also see this the same information in the other portal of uh the other interface provided by by by open there in the explorer portal where you can see the same numbers for this uh for this repository uh and you can check it in the uh explorer dot open net uh dot edu this is uh not only for um repository management but this uh public you can see uh uh the performance of other uh repositories there uh another important thing is the in exploring you can see the performance the users statistics for uh a particular uh product research products for example a publication you can see that the this publication has been has 167 accesses total use statistics uh from from these statistics the 82 are downloads and 84 are total views and one opener uh one is opener uh views and but the most important part in this um for this item is that um uh aggregation of this number so the 82 downloads the 84 views have been aggregated for more than uh one repository so we have this information and we'll be displayed in the next version of the explorer um so and you can check it in this slide you can see that the 82 downloads have come from two different repositories and the 84 84 views have also come from uh two different repositories so uh this information is uh important and we can have it uh using the by exploiting the the duplication service offered by uh open air uh reset graph uh apart from a general services uh portals of open air for the provide and explore we have recently developed a portal dedicated to the users current service where you can find a lot of information about the users current service such as the architecture there is the various resources that are offered for this service you can also have we can also provide uh have a contact form where you can ask us about the service and most importantly we have numbers we have analytics and we have analytics like the total number of um uh user statistics that we have in our uh uh uh databases the number of the total number of repositories and the total number of user downloads that we have collected so far worldwide and you can set for um uh user statistics for a particular country for example for Spain you can have um the repositories and the views and downloads for this particular European country and we also have uh reports for um uh countries uh outside Europe from uh uh for example Argentina because we have collected also statistics for uh uh uh uh la referencia the national uh uh south america aggregators latin america aggregators uh in this uh uh portal you can also see the evolution of uh open air user statistics uh service you can see we have started with a few statistics and now we are uh evolving too fast and we are collecting uh and producing a large number of uh views and and downloads apart from these interfaces you can also exploit the usage counts uh open air dot u or user statistics api uh it is based on the sushi light protocol and from there you can retrieve again countercode of practice at least four compatible reports standardized reports um you can have article reports book book reports uh item reports like using identifiers like open air uh id doys or i record IDs etc you can have a repository report using identifiers this should be issued by open air or open door or general reports using identifiers like uh is issn um this is an example of of the report that you could get by using this api you can uh on the left you can you can see a repository report and on the right you can see a report that is retrieved by using a particular uh uh item one of our stakeholders could be a funder so we can have information about uh funders for example you can see here the number of downloads for all uh uh funders that are using that we have collected in open air this is an important information if you are a funder and we can provide uh similar uh analytics for other uh uh stakeholders uh and now how how can you join this service how can you um participate you can register by the provider's passport if you are a literature repository data repository journal or aggregator by registering the service we will provide you with the um um instructions to join the service uh so from your side or your side you have to download the tracking code for your repository we you have to configure according to the instructions that we provide and then deploy the tracking and from in our side we will validate the installation of the tracking code and inform the repository manager that everything is is okay and the service is up and running without any issues by enabling the metrics for the selected data source you will be able to retrieve the repository software that I mentioned initially for the pull up for the push approach which is provided either as a patch for virus or virus version of the space from the space four to the space six as any print plugins for version three and most importantly we have developed a python script which can be used in any platform in any other case so it can be used for this patient it prints also and they they are available and you can install it you can run it you can execute it easily and send us any kind for any kind of usage activity from your repository so um about the future and um we have to engage more research uh content provide more content providers to uh to count more instance products like research data monographs books etc um we have to move to we are planning to move to counter code of practice release five and we try to offer more analytics more enhanced visualization to cover uh stakeholders more stakeholders etc and we try to build a use that counts have that we combine and deploy the formation for many research products example publications with research data so thank you very much for your attention this is more or less the presentation of the service and i'm ready to answer to your questions if is any thank you great many many thanks Dimitris so i think it was a very good presentation clear so we are aware of the the features of the service which works what we can offer and how to enable or register in the service can you can you clarify how many repositories have we already part of our part of the service are benefiting from this service you you have the updated numbers yes yes i've as mentioned we have around 200 repositories that have uh yes that are using the search this is a um a number that is shown that that can be accessed in usage counts to open a dotu portal if you go there you will see the numbers for its country for its in the worldwide in total okay thank you so you can turn on your microphone or camera if you want and ask questions and try to clarify any specific issue if you have any relevant topic that you need to issue problem with the dashboard you can also put in the the comments here so we have already in fact some questions okay that i will we have one question in the chat and also in the google doc okay the chat i was i was checking the google doc and thank you for for that i'm also i will share my screen also so the question in the in in the chat where is it um yes i have been able to show this Jordan right yes the journal i have been able to say this yeah yeah uh how can i i think this there is a button that allows you to retrieve the service to retrieve the data sorry um from there to uh artist what is it the the the the dot so every label can i download this that uh the the report okay okay yes yes i think that in the open provide open a dotu there is the functionality there is a button that allows you to download the report but i will i will check it yes let me let me also do one and i can share okay Jordan Jordan we will demonstrate that then we can address this issue uh there are other questions here in the chat also let me share my screen so thank you for those that have created them so Cristobal from from Barcelona uh can the the open air users count service track the uses that come directly okay yes this is an important question to the digital object pdf for instance from the google school this is an important question Cristobal and this we have a clear reply to that because we we did a pilot in the past yes yes yes this is this is why we have used all these patches and plug ins and the generic tracker because um we have we have to to solve this issue we had to solve this issue because uh if if uh uh a request arrives from google scholar to a repository uh using some client-based let's say um uh code uh software uh this request uh is not uh uh track so that's why we are using this um uh software either by plug ins or uh the generic tracker and we count all any kind of request that is arriving in the repository so we are not missing anything i hope i answered i have answered your question i have replied to your question thank you very much um we have other other questions here uh okay i stopped sharing my screen without okay sorry i stopped sharing the screen that i didn't realize i stopped okay we have a question from ellie thank you ellie for your question from from dance from the the Netherlands the narcissist is a national aggregator and being harvested by open air can the users counts be used by our different repository managers yeah this is the same issue um it's not currently the the the the the the proper answer is no it's it's possible uh if we do some further developments it's not possible currently in what we have now in fact uh the meters maybe you can clarify a bit the the work that we are doing with uh with uh with la referencia is in fact uh can be used by by a national aggregator like like like narcissists because la referencia is the the latin america network of repositories the data will be provided for the nodes for the national nodes for the for the the national networks of repositories and we will have data collected for la referencia that then we can distribute for the individual repositories and the type of approach that la referencia is doing is something that we can also do in open air if we have time and effort for that Dimitris do you have something to add to that uh not something special most specifically i think we can follow a similar approach with la referencia with any kind of national aggregator so for sure we can we can uh we can enable for um ellie this is something that we can do between to enable this service maybe we can we can talk um offline so we can we can change some emails and we can enable this service for this specific aggregator uh then we will start collecting uh data um what is important is to collect data then we will find ways to deliver the problem is deliver the data for the individual repository managers this is not possible to do it now collect data uh from from from the aggregation the aggregator itself we can do it but let's see what what we can do for the individual repositories because currently this is not physical but um yes there are there are yeah but we need to we need to put this in our in our in our because there are several issues for national aggregators that we need to address always the same for now we have a reply for those issues for now we have the iris where we collect uh reports using uh the countercode of practice uh i don't have a service for that yes yes and we have also uh la referencia where we collect uh from their um aggregation system let's say but we have to find a solution it's uh as you mentioned the problem is how to collect data do you see the question from sir from biliana yes you're right biliana just take it and i think it has to do with um the name it's serbia and montenegro i i'm not sure what to say i will check it i will check it with my the developers of the portal if you go to analytics yes in search for the country uh i will i i will take it if it is an issue yes we will see we will fix that because okay okay and just to make some note if i chose the serbian montenegro there is no result there because yes yes that's what i replied just now i think there i think there is an issue with us with the string the service in modenegro i will i will check it but the the statistics are there don't worry now it will be solved soon thank you and then do you want to to ask the other questions i don't make a comment liana as you have but yeah yeah your main problem i'm yeah yeah i'm really disappointed because the things which are properly work uh last two or three years and our special repository manager used this both this all of these services a lot and now they are just stopped working exactly they are working but not working properly let's say the monitor dashboard i know my credentials i see all my validation history but now i could not found any of repositories and i know there are 15 of them there in provide in provide the provide yes in the monitor there are these three funders we have it also for months before we have all of them all funders there so this is my complaint that uh developing you are right things and the all things which were stable are not anymore yes in the monitor monitor uh i don't have an explanation for you i think this was um already um presented by other people with responsibilities in open air that i think it was uh an error it was a precipitation i think i'm i'm i'm with you i was lucky because the information of the portuguese funder was there because what was the first pilot but but this is so it's not not good to have it for provide provide this table okay let me say provide this table we have an issue with you all log in it's it's a login issue it's not a service issue okay the i think i hope so i i think i can say that the provide this table that we are increasing and then providing more functionality since we have delivered the service first in in september 2018 i think uh almost every semester we have introduced something new but yes you are right so andre we really need to check why reanna's login don't have access to the repository this is something that we need to we need to talk with the three or four persons because we didn't find yet the where is the issue the issue is somewhere between any uh connector that we are not sure why so aai so there was an update today from the the aai the authentication service um so we need to check when we when we we play with uh with in the same service in this dashboard for the case with different apis with different services so we can encounter this kind of problems reanna it's a promise that after this call we will do our best to so good there is no need to give a highest priority but no no no this is important because we we receive the same type of request sometimes so the the usual problem is that repositories don't repository managers don't find the data source in their login but usually the issue is that is related with previous registration so someone registered that data source using another login another email and now we need to change it but we usually we solve it we solve it in uh one hour or in 24 hours so we can solve it quickly um but sometimes we have this this issues with let's see let's see i'm not sure if some of my colleagues that are here in the call can help but i don't think so thank you morris if you want also to to talk about your use case or you you can talk but uh so you are in um yes i can project so uh thank you for putting the question here because then we can provide more information here sure if i think maybe this might be too complex to to answer and we need to talk it offline uh but uh my use case is uh that that i'm in a project with 11 universities i need to collect uh publication data but also i want to collect um use statistics from them to see what what the usage is of course um but i i'm not i'm not a provider of uh of all each of these so uh either i need to uh ask people to give me the cz file or whatever that's been downloaded uh and put it into my collection or maybe there is an easier way uh to do it with an ip api or something like that i don't know yes yes um the the answer yes this this should be possible using um our our api and we need to check if it's possible for all because we need to check if we have as direct that's the sources this uh repositories from this 11 universities or other kinds of that the sources from this 11 universities some of them may may have um for example um journals or journal systems this kind of things but we need to check so we can we can talk offline and i saw i saw in the call i saw in the call someone from Barcelona let me check if he's here Maurice um sorry for no no no it's not here um but um for your for your knowledge Maurice um poly I'm checking so it's the Polytechnical University of of Barcelona they have a similar use case so in fact they did but but of course they it's only one um it's only one university but they have used our api to check for the the duplicates and in in their repositories to check for um uh and to and to enrich or to fix issues in their repository so yeah I uh the colleague from the Polytechnical University of Barcelona have already presented that in um in a in a webinar in the end of October he presented in a conference and also in the end of October but it's only in Spanish so I can put him in contact as a use case and just talk with him but but be aware that we this is possible to to do so we are talking about the duplicate publications and I think Dimitris is also providing some more information about yes about the use statistics um you cannot for now you cannot collect all this information with one single request but um you can try yeah you can try to use uh uh our api the one that I mentioned above and you can just uh check for an item um there you will provide the doi and you will see all this information that's available for that doi why oh yes yes and if it does not have a doi but a handle or other identifier I think we covered doi's all oi ip mates I think identifiers uh don't remember I think if you if you check the api we will find information what can be used as input yeah you can contact directly and check the check this together yes and can you put the api or the the link to yes documentation okay thanks you put information in this document but also we can can exchange an email and you if needed we can put you in contact with other persons but the api is is up to date and you can you can try to test it and good thank you thank you super and then for Jordan the the the answer I was not I didn't read before so what what we have is just currently what we have is just the the the results that you can we don't have a way to to extract for for to CSV the results of the reports so you can see the results per per item you can check the the views and downloads but we don't have a way for you to download yet we need to to have it it's in it's in our priorities in the beginning of the service I remember that we we thought about that then there were several issues with the scalability of the user's statistic service that we have faced it and and and and solve it finally now Dimitri's next step is to to put this in production so the all the results per query of this report we need to to put it in the in the in a way to click and download the CSV file this is feasible and we just need to prepare it I think I'm not thinking yeah so maybe we need to check in our next management meeting and then provide some information here in the coming call or or we can we also have the contact from Jordan we can we can send the information yes this is the the the same the same for the broker events Jordan you are aware so we only have a way to manually check that information and to manually see it in the dashboard but for the broker we when we release this when we put in production this new way of delivering the broker events it's not only releasing the new way for the new workflow subscribe etc is also releasing the way to download the CSV file so for the events this is will be in production soon for the statistics we need to to decide maybe this is a topic for our next meeting the management team and then we we we can come up with them in our roadmap with a specific timeline to to to deadline to have this delivered program delivered thank you for your question and for the the screenshots okay perfect so so when it's off pass too thank you for for for your questions and the the meetings do you have anything else to to to help no just to thank you all for your participation and hope you see you joining the the service okay yes for those that are already part of the service I think we hope that we can you can now finally have the the proper data and play with the information and have some to date graphics and and reports that will be useful then now that we have the data presented in the correct way then we will try to find and to have your requests about new ways to deliver this information so we have already one request from Jordan and that was trying to find the button to download the results of the reports and for sure we will have others so this is a community effort that we need to we need to find the good ways to deliver the service with proper quality of the data but then creating features so we will have the first call in December in the in January next year I'm not sure when it is but it's in the first week I know that the first of December the first of January is a Friday so let's let's see if we can do it in the first week in the first Wednesday of January or in the second we will put all the calls until the summer in the coming days here in the in this page okay be aware of that so we will put there you can put in your calendar so for sure we will put in the coming days from January to June all the calls and if you are not a subscriber for the for the newsletter of open air and the specific newsletter of provide just go to this web page openair.eu newsletter provide and subscribe or check the previews so we have several articles that with the guides about other services that you may are from your interest so thank you very much if you don't have any other questions so let's let's close this meeting if you want to put any other comment in the in that document that Andrea shared you we will check it during the day and tomorrow and we will provide information if you want to be contacted just put your email there and we can contact you many thanks and the recordings will be available after this this call and we put available the recordings in the presentation in the website bye bye all thank you for joining it's always a pleasure to to wrap these community calls it's for the benefit of all okay thank you very much thank you