 I would like to thank you again to be present here in another OpenAir Open Access Week. We are in the first day of the OpenAir program for this week. And I will start just with some simple housekeeping rules of this event. It's being recorded and the recording will be made available in the event page. So in the future you can revisit this session or share with other colleagues. By default your microphones are off but during the discussion we are free to open the microphone to put your questions. And you can also use the chat during the session to put your comments or questions. And at the end during the Q&A session we will answer you. You can also raise your hand to ask to speak. The presentation as well as the recording will be shared with you in the event page so you can revisit the contents. And if you are using the social media to share this session you can use these hashtags. We are referring at the bottom of the slide and also refer to OpenAir. So today we have Ioana Icripari from Martina Research Centre and Leonida Pistringes from OpenAir that will present us today in the OpenAir Monitor Institutional Dashboard. It's one of the OpenAir services that is targeting institutions, organizations. And today our colleagues will talk about this service and explain all the functionalities and you are free to ask questions to them in order to understand more and to know more about the service. And I would like to give the floor to my colleagues and Ioana please, you can start. Yes, hi everyone, welcome from me as well. Leonida and I will present the monitoring dashboard today. It's one of the monitoring services of OpenAir. Let me share my screen. Oops, here. Okay, can you see everything? Yes, it's perfect. Thank you. Okay. If you want to jump in with a question at some point, please do or use the chat. Okay. So, let's start from to make sure we have the same understanding. Let's start about the importance of monitoring although of course you know this. Well, there is a lot of money going into research activities. Well not enough if you ask me but it's still, it's still a lot. And at the same time, the research and innovation space has been changing a lot. So it has been growing in speed, complexity, interconnectedness and sheer size so that it has become something that is very data intensive and the ability to actually get information out of that data in order to make decisions that are effective, efficient, optimal all together for your organization and your organization has become a very difficult task. So what we would like to do, what could we like from a monitoring service is the ability to learn about how you are conducting business let's say in the effects that it has. So what are the resources that are getting in what is the research output that is coming out. Are you following through with the open science policies that you have in place, how are, how is your network of collaborations growing, are you becoming more visible over time, where is this coming from in particular. And what is the impact on different parts of the society is extremely important to be able to know about these things to have data on these things in a structured way that so that information actually comes through out of there. And this is the only way that one can organization can really understand the pathways that are affecting its impact in the end, and to gain insights on what are for example, what should be the next investment in terms of general in terms of resources, what are opportunities that this that the organization has in order to grow, what are the weak spots what are the areas where you know we're kicking but this way one is able to position themselves and make decisions report to find the for example how well they're doing or what they need to change. And in general, be able to deeply understand and make a story of how these research activities. And you know what is really going on there and what are what are the future steps for them in order to to align with with an organization organizations goals. Another approach to these questions which is why the real motivation of building this service is that we want to make it relevant for the community, you know, open air is you. We want the indicators that are presented in the monitoring dashboard that we will show later to be co developed with the community that makes sure that they're relevant that they make sense to all that we're all speaking the same language. It's all about, of course, open science and open data because we want a product that is inclusive transparent so that any sort of assessment that comes out of it using it is replicable. And we base the monitor on the opener graph so that we have a 360 view of research activities that that goes beyond publication and also includes a research data software other research products or what we have projects we have patterns we have all sorts of things. The opener graph links. The, because it's a graph database, it has the links between them so that an organization is able to track what the connection are and eventually be able to talk about pathways. I think everyone this call at least cares about is that it's fully embedded in the US ecosystem from the content providers to the metrics that are presented at the end. So that's how that's what our motivation of creating the way we do. The principles that we followed are basically, of course you can see them here but they, it's basically a two prone approach. The first prone is policy intelligence, which means which refers to leveraging big data with AI and the connections that we have in the graph. And a human in the loop and state of the art technology and to make sure that we provide someone that really goes beyond what is a simple extraction from data. So augment the intelligence that is available, given all the tools that we have this high tech tools that we have available right now, keeping the organization the expert in the loop. And also making sure that all these intelligence has a regular updates so that timely decisions can be made. The second prompt that is extremely important is that we are we design something that is based on open and fair data, and also open and transparent and reproducible methodologies. This is key for both the assessment to be replicable. But also, in order to create these links within products open and fair data is extremely important and it also plays into the automation of all this procedure. The opener graph which is what we base everything on in case you haven't seen it I'm going to briefly present it. So this is the graph pipeline. It starts from the combination of a bunch of data sources. That includes different research products, the metadata for those programs relationships between them, and so on. All these goes through a duplication process are here in the middle before step two, where we make sure that records that are the same record but we find it in two places are merged into one. So that we don't have superfluous information, we do however always keep all the instances of the record so that we know that how it looks like in each instance and I mean it's metadata. Then we have our infrastructure our inference system that extracts information and enriches this method data with additional things such as a project links for SSD G's and first food of science and other type of stuff. So that in the end, we come up with passing the cleaning of all that final cleaning, we are able to conduct statistical analysis in order to present indicators of monitor based on the needs of the community. So that we make sure that we produce something relevant. I do not really know what these numbers mean, but as I just wanted to mention that the system infrastructure of the graph and the monitor service that basically is set up it's ready it's working and there is a cluster dedicated just for these tasks. So basically we find to be reliable, which is of key importance for the methodological principles. So what do we create in monitor we create dashboards on demand for and I will explain what this is in a second for institutions, funders and research initiatives together with each type of dashboard. We also create an open air expert that is responsible for designing and co developing with you the dashboard and making sure that the data qualities on parent so on. So we, we've built a monitor to be a one on one service in the end to make sure that it's really, it's really, it's really used and satisfies the needs of the organization. I will briefly mentioned the open science observatory that is another monitoring service of open air that is it's for four countries is country based, and you can go take a look at this address here in the bottom. Okay, what is the dashboard on demand, starting from the bottom here we have the open research graph which is a common global assets, and part of which is data for an organization that is included in it. After everything passes to the pipeline and we have the graph we have our opener experts in data science statistics and data mining that create a metrics and augmented data space, so that we move on to the next step indicators for different types of measures can be created. Some examples indicator for collaboration for institutional openness as to this contribution and so on and so forth. Now the way the this indicators here and this profile that we built because the default profile, our community led. We have our experts that are able to create all sorts of metrics and statistical analysis. And we get we have the directions from the community on what to actually do with the graph in order to make sure that the profile stage relevant. So after this default profile is created for institution. Let's focus now on institutional profiles. So you built your profile so an organizational and organizations profile, which means that we dedicate resources on just for this particular organization, and the expert that works closely to augment this default profile and change it in any way so that it stays useful and relevant for you and also is takes into consideration the data that is shown and works and improving and so on. The last step here is the team sharing the profile is built in a way that you can invite team members to view it and make sure that they contribute and track the same what they need to track and so on. And this is what's a dashboard on demand. So, I'm going to talk about a few things a few characteristics of the profiles now the institutional profile. So that Lonidas will go in into details when he when he does a demo. So there are several indicator themes that we are focusing now is funding research output open science collaborations and impact. We are going to cover to have a good coverage for all of those by the first quarter of 2023, but there's already a lot of indicators included. And the rest of them are in beta for testing right now. Now when we talk about research output we mean, and the different types of research products, and the fields of science that they cover whether they're interdisciplinary or not, and so on. So for open science we have worked on indicators on different fairness aspects of access right and open access routes, the different general business models article processing charters and compliance to plan as type of indicators. So we're going to come to collaborations we're going we're working on examining two different types of collaborations we have project participation or be a co authorship or creation of data sets and so on. And in terms of impacts we have the focus is along two lines right now, the region frequency of research activities so downloads and citations and sustainable development goals. Is my institution contributing to. And for funding which is the first step actually although I left it for the end by accident refers to the grants and projects on different founder for an institution. These are the themes that have by been prioritized by the community for us right now, and any new indicators that will be developed or any shifting focus will come from other community and from our users. As we said before also. In order to be able to make any sort of decision or extract information from all these things. It is extremely important to have a granular view of what is going on. So we break down indicators and present them in visualization by different fields of interest from the product types of domains time funders data sources and so on. This is really depending on the needs of the institution. So we have built a profile with things that we've been told are very relevant. But, given that an entity create is existing the open air graph, we can always produce. You know a new indicator based on if this breakdown or whatever that someone this metadata element element that someone has in mind. It is important to briefly mentioned here that we have we have an internal tool that can readily create these indicators, which has been proven to be very useful in the past because it means that we can edit the dashboards quickly to make sure that they're more understandable and easy to use. Okay, some of the features that are dashboards include that you will see also in a minute, the visualizations are interactive and they have exporting capabilities, so the data can downloaded as well as the visualizations to be used for analysis for reporting whatever the needs are. They are filtering capabilities. And there's also the ability to browse the data behind the indicators via links to open air explore. So what is when you say that publications are increasing over time. The applications that you are include is something missing. This is of extreme important to us because this way we can work together with the users to examine the data quality of what we're showing and make sure that it is representative of the activities of the organization. And there's some editing of the visualizations as well. We build the the privacy settings of the profile in a way that it can be used for three different types of needs. So we have each indicator that populates in the profile can be set up as public. So the combination of public indicator this public dashboard can be used for showcasing. So for example an institution could invite a funder to examine how they are performing. The indicators can also be set as restricted. And this can be used for team members of the organization so only someone invited by the institution can view these indicators. To view the restricted dashboard let's say and then the indicator set as private that is that is for work in progress and only the manager of the profile can see and ask. So all of this all of this comes with the with a very important asset for us, which is the ability to customize and validate in our one on one sessions. So we have one on one sessions with our institutions, of course, depending on the frequency depends on their needs and availability as well. And then we start by presenting the dashboard features the editing and units their management them. Now we give them a tour of the service and everything they need to know. And then we work closely with them to get feedback on the indicators and potentially develop new one. You know, work on the data quality and the validation in the end of the profile so are all the important data sources included has the duplication worked well, are there any numbers, you know the having a monitoring dashboard and viewing things in aggregate allows them often for someone to spot a mistake easily you know why is there a huge jump in 2008 doesn't make any sense to me. And then this allows us to zoom closer to the data and either explain what is going on and add it as a comment to the visualization or improve the data quality if there's a mistake. So this was briefly on how we set up the monitor dashboard and why we set it this way. And now I'm going to pass the floor to Leonidas. Thank you. Thank you for the presentation and thank you all for joining this session of presenting the open and monitor service. As soon as we will proceed with the demonstration of the service. Three things basically on the user registration and management will see the process of how a user can contact us and become a dashboard manager and have a dashboard for her institution. And then we will see the functionalities of the backend administrator interface. And how to set up shop, how to set up your dashboard. And we will see the front end of the dashboard with indicators themes, how the users will see your institution's dashboard will briefly see the documentation of the indicators and of the service and visualizations. And at the end we will have three rules. I will present the three slides on the two essential steps that you should take in order to have a data quality and validation of your dashboard. So, let's start for at the home page of the monitor service. Let's say that you are affiliated with an institution and you want to have a dashboard. What do you do. It's pretty easy you get in contact with us and the easiest way is to press the get started button at the home page of the monitor service where you will be ready. You will be ready redirected in a form where you will fill your information regarding your name, email, institutional email, your job title and the organization, the institution that you are affiliated with. After we receive this contact form, we will get back to you in the 24 to 48 hours, informing you that we have received your quest, and we will start the process of allocating the data for your institution from the open research graph. And create and create the virtual machine the dedicated server that will be that will serve for your institution dashboard at the open air infrastructure hardware infrastructure. When your institution dashboard is ready, we will get in contact with you and you will receive an email from the service in order to register yourself as a dashboard manager. The email you will receive will look something like will be like this one will hear for the purpose of the demo we have the open air university. As you can see in the email, we have the URL that we will click and use the corresponding verification code in order to accept the invitation. And of course, you can see that by launching using the service you accept and agree to open air special data protection policy. So, after clicking the URL, we are redirected to the monitor service where we sign in with our institutional email, the email we used in order to you used in order to contact us to create your dashboard. And after signing in the service, the platform request for the verification code from the email, and after ending the verification code. You accept invitation and you are registered as a dashboard manager of the open air universities institutional dashboard. The first screen you see is the administrator dashboard where you can manage your profile. The general tabs here the general tab the indicators tab and the users tab. Let's start with the general tab where you have to, where you have here general information regarding your institution. Where you can change to see if it's, it's a correct information and maybe you can change the name or you can add a description or a link to the logo of your institution. You can select the status. You can change the status of your profile of your institution dashboard to the options of being publicly restricted and private as you are not setting your presentation I will get back to this later on, while describing the indicators tab. Now let's see. Let's go to the users. Where we have two type of users the managers and the members. The managers are the users that have access to the administration dashboard. And the indicators and where they can edit the profile the indicators of the dashboard for the members or any public user without an account to see to the dashboard profile. The members are registered users that have been invited by the dashboard managers and they only have access to the profile the restricted profile, or the public dashboard profile and they do not have access to the administration interface. Let's go to the administration interface of the indicators. This is the administration interface and the dashboard profile as it is shown to all the entitled users according to the status is here by pressing the dashboard at the top menu and by pressing manage we return to the administration dashboard. Here, let me show you a few functionalities that you can change in the indicators in the numbers and the graph that we present, and then I will go to the public dashboard profile in order to see to see a definition and description of a few of the indicators that we provide. First of all, let's see the status of the topics and the profile as it has been as I told you earlier in the general tab. We have three statuses, it is the public status the restricted and the private status. These status when a profile, a topic or a graph, if it is set to public, everyone will be able to access it and view and see it through the monitor platform without signing in. If, respectively, if it is restricted only the registered users as managers or members of the institution will be able to view the course their respective topics or indicators, and if it's private, no one will be able to see the topic or the indicator or the profile, apart from the dashboard managers through the administrator interface. These statuses go from the top level of the institution profile until to the bottom level of a graph or a number, a graph or a number. So, let's go to the dashboard interface. In order to see a description of the topics and to see any indicative metrics and describe an indicative metrics of the topics. So if you have already seen in the presentation of you Anna, we have the topics at the left side of the bar we have the topics, the basic categories of indicators, the first one is an overview. We have a summary where we have a few indicators and metrics for the user to get an idea of the institutional profile and the institutional dashboard, and all the other categories are going into more detailed information. We have the overview section where we have in numbers, the production, the research outcomes of the institutions, the publication, the data sets, data sets, software and other research products. And we also have graphs. For example, we have a publication trends over time, we will have a comparison of all publication with all publications which are represented with columns with the peer reviewed publications and the grant supported. Of course, as we can, for example, at this graph, we can deselect a peer reviewed publication and see only the comparison of all publications to the grant supported ones. And by going inside in the lines of the column, you can see the values of the publications. Respectively, we have data sets over time, and we have a few indicators on the openness. For example, the publication openness over time where we see all publications, compared to the open access and the gold open access ones, respectively, following up to the more detailed topics. All of these topics contain indicators regarding the projects, participations, and the funders that the institution has in the overview tab. We have a few graphs on the project participations and the project participations, the European Commission project participation by framework programs. We also have, we also have the topic of the horizon 2020 with the participation and funding information to the indicators of the profile, I'm giving a short brief description of the tabs, the topics and the indicators, because we don't have much time in order to go one one by indicator, we can do this after a lot of words if you want to have a dashboard in a one to one consultation, following up on the research output topic. We have the publications, data sets software and other research products will go through the publications sub topic as indicative for our demo where we present indicators on all publications and the peer reviewed publications. From the total number which have breaking down the publications by type, the publication trends over time, the publication by type and overtime, and a few more graphs regarding the top data source data sources by the number of the publications they provide for this institution and the most productive projects and respectively for the peer reviewed publications, we're breaking down by type, the peer reviewed publications over time and also of course here we have the top 15 publishers, where we can see by number of the peer reviewed publications. Respectively, we have indicators for data set software and other research products. On the open science topic, we have, we're breaking down on public publications, data sets and software. On the publications tab, we have the open access category the general business model and processing charges and the furnace on the open access category we can see the publications by access rights. Over time by access rights we have the open access publications the embargo restricted closed access and the ones that we don't have any information that we have them as not available. So here for example we can see that the open access dominates as a as an access right for this institution and if we deselect the open access we can also see more clearly the numbers, and we can have comparisons respectfully on any category that we select. We also have the publications by access rights and by founder. As you can see, because the biggest funders with the most number of applications have a different a huge difference through most of the other funders in order to see the information for the other funders we can zoom in at the graph, respectively, and see the information for the rest of the funders. And of course, we can also select and deselect the access rights. Basically we will have indicators where the open access routes of the publications where we present the green gold and high publications by the green gold hybrid and bronze roots. And we have the top 15 fun fun there's accordingly. Let's go to the top to the general business model and processing charges tab. The open access publication trends by general business model with a for general business model without which are full open access with ABC is the diamond business model transformative general and the hybrid. Here let me interrupt my presentation in order to tell you that everything that I am telling you now is documented and we will see the documentation part of the finish the demonstration of the indicators. We have the fairness tab where we have several graph displaying the publications by attributes that provide the furnace that promotes the furnace of the research outcomes, such as the publications comparison with the publications that have a position identifier over time. You have which compare the all publications and the ones that have a persistent and fire, for example, in this for this institution for the open air university, most of the publications have an open a persistent identifier. Okay, sometimes we are having issues on loading the graphs. Let me move on to the collaborations tab topic where we pretend the co funding research outputs by type and we have a chance of co funded publications over time. So this is the institutional brief description of the institutional dashboard. Let me go to the administrator in the face of the indicators in order to show you that you have on the graph you have partially editing. You have from changing the status, you have partially editing rights and you can also export the graph in as an image or as a PDF document or as SVG vector image and also you can download as a CSV or an Excel file the data table the data that is used in order to produce the chart. So, let me go to the resources menu where we have the detailed document documentation of the service and indicators first of all let's go to the methodology where we have the terminology and construction. We're here we describe all the entities and the attributes that either are here we hear it or in fair via entries from the harvested records at the open air research graph or the constructed attributes that we construct, according to the methodology that we describe. For example, we have the general business models where we fully document. What is a fully open access channels, fully open access general business model a subscription channel a hybrid or transformative one. And in most of these cases on general business models and a PC business model will follow the unpayable approach. And one last thing regarding the dashboard dashboard on the browser and on the browse on the browse data data. You can see at the discovery portal of open air at open air explore all the research products that are used in order to produce the indicators at the monitor service. You can browse search and the filters at the open air explore service. And finally, excuse me, I forgot to mention that the resources tab. Menu at indicator submenu will provide lists. Where we document it's indicator it's metric that we have in the institutional dashboard. And we also have a few extra metrics here that I didn't show you at the dashboard that are soon to be incorporated in the profile in the institutions dashboard profile. The indicators that are soon to be incorporated are remarked with the coming soon or coming soon and beta comment in the table. So this is pretty much a brief demonstration of the service. Let me go back to the presentation in order to finish up by telling you the two important steps, a sense important essential steps for us. In order to have data quality and validation of the institutional profile. Which is the first of it is the duplication of the organizations of your institution and the identification of parents child relationships, departments, schools, and others. What we mean by saying the duplication. We gather as you already might have known we gather gather data from multiple several data sources around the world globally to the open air research graph and then institution is this is displayed in many of these data sources with a different name or in a different way. So we have the open aux platform where we provide you access and that you are entitled for your institution you can perform the duplication you can see all these different names that have been presented in the seven and collected by open air in the several data sources and you can select them. If they are indeed your institution you can select them in order to have them as an entity and provide you with better results. And of course, another important thing is that you inform us for all the data sources you have at your institution regarding any repository you shave or an open access journals or even three systems at your institution. So it's very important to register and validate your data sources in the open air provide service by following the open air guidelines. So that they are incorporated in the open air research graph and will this and this way will provide you at the monitor service even better results with quality and the profile will be validated. And of course by having your data sources registered at the open air provide service, one of the most important things is that automatically, or your data sources will be registered at the European open size cloud infrastructure without the need to do anything, but from your side. So here I have a screenshot of the open walks platform where we can see for example the University of Mino where first of all we have a few information regarding the university and few identifiers that have been collected and that the duplicate sections below. We have a duplicate that have been found in the, all the data sources that open air collects data from, and at the right side, you can select if which which duplicate or not is to be incorporated and treated does one organization. And following up on the benefits of registering your data source at the open air provide dashboard. As I have already said, you will be fully embedded in the eOS infrastructure. We will have accurate and qualitative metrics. You will have visible and richer content, because the open air in the provides everyone reads your data and we give them back to you and reached. And of course we have the link science as you already taught in the presentation where we have links from and to the research products and of course your collection will be up to date with alerts and reads and additions. So that's all from me. Thank you very much. Thanks for your presentation. So we have some time for questions so please feel free to open your microphone if you prefer or write your question in the chat. We already have some comments and questions in the chat but our open air colleagues are answering the questions that are related with the access with the access for example. If you have some questions about the institutional dashboard or the monitor service in general please have this opportunity as we have here our specialists and service managers here today, you can put your questions. I would also like to request to the participants to to answer our questioner that my colleague Paula posted in the chat. The questioner to to give us an evaluation of the session in order for us to collect some valuable information from from you in order to improve the coming sessions. If you have some doubts for example on how to to request taxes to have a dashboard Leonidas already explained it. But if you are interested to request a dashboard please you can do it and you can start for example, asking for some information. Maybe one thing to say is that we have changed the dashboard a lot we are planning workshops to validate indicators and get some feedback on them. So this involves a lot of people that will give organized in a way so they can give feedback on both indicators and the functionalities. So if someone is interested in participating perhaps they can shoot us an email. Thank you. You can use the contact form in the monitor page or you can use also. Let me write here in the chat our email. No, that's email. Sending a message to this email address. To create a ticket in our open air ticket system and your request will be directed to the proper opener colleague. As we don't have any questions I think we can close the session.