 We're here to continue a series of webinars we've held about research discovery and I'm using, you know, OSF as an example, we have some cool new features for discovery that we like to show off. In fact, the audience here today is going to be among the very first to see some stuff we released just last night that we're really excited about. So we'll look at that here shortly. We had two previous events that if you didn't attend, they are available to check out with the slides and the recordings. One is a general discussion on discovery and search on the OSF and another focused on using discovery as a research funder and like a program officer type role. And then today we're going to focus on, from an institutional perspective, someone supporting researchers and a research institution and all of the challenges and opportunities therein and where discovery comes into your role. I'll show you some stuff that is available on the OSF in a couple of different ways and then we'll have some time where I can actually jump in and show you live some of those features and then discussion. To use the chat like we are here to tell us a little bit about yourself. This is really wonderful to see all these different places that everybody's coming from. It's really exciting. So continue to do that. I'm also going to just kind of ask you some questions as we go and you can drop a thought in there, a quick phrase. And then there is a Q&A, the separate Q&A panel for Zoom if you want to drop some questions and it's much easier for us to sort out what's a question versus just observation and the introduction if you put those in the Q&A. And then my colleague Blaine is here on the panel and she's going to jump in and either answer your questions or we'll flag me so that we can talk about those as a group. So again, welcome. If you're just joining, please do feel like you can throw an introduction in the chat and I'm going to clear some Zoom stuff out of my way so that we can get started. So today you get me as your guide. I'm the product manager here at COS and my role is to work with the technology that we're going to talk about today and interface that with users obviously but also research communities of a number of flavors like institutions and we work with some institutions in particular very closely and we'll talk about that today. But continuing to build our technology toward your communities and use cases rather than something that we just kind of toss out there and hope that people will use. So that's primarily my role here at COS and Blaine and Amanda that are running our show today are also our sort of primary assets in support of this goal at COS. And what we're going to look at today is just generally talk a little bit about how research is and becomes discoverable and where the institution element of that fits in in particular. A lot of you probably hear a lot about some of these things frequently. So I might be covering some ground that you're familiar with but bear with me because I do have some cool stuff to tell you about where that meets some things that we do in particular with connecting research across the life cycle and then OSF search in particular as I mentioned we have some really new stuff that's very cool that we want to show you and then how to use some of those things. And like I said, I'll show you some of those live and quickly for those of you that aren't familiar with the OSF yet I know a number of you are because we have some friends here in the in the audience but to just give you a quick sense of where the OSF stands in a landscape of many many research tools that you and your research communities rely on the OSF is is not a typical data repository or research repository. Instead what it wants to provide is tools across the research life cycle that support each of those phases for a researcher and a research team and a research community. It's free for researchers to get an account on the OSF and to begin using those those features and they'll never hit a point where they're submitting a pre-print or submitting their data and are asked for a fee in order to do that. So it's always free for their their research purposes. Now we do have some additional features that communities can use that do require memberships and we'll actually talk a little bit about those shortly. And just to give you an idea of where the OSF comes from and how we make create our priorities and and develop our tech here at COS. And there's really these three really broad community buckets that we work closely with and are our sort of source of inspiration and the direction that we go as an organization and as a technology. And so these three are our members and supporters. As I mentioned, we have memberships that use our suites of tools that are built on the OSF and get funding from other organizations. They're obviously a major stakeholder in our mission and in our technology. There are the research data contributors and readers of the users of the OSF that are creating new content and sharing that with the world. And then readers that are coming to consume and use and refer to that information. And then we have the technology itself is built to be integrated with many other tools, some of which we'll see some examples of shortly. And so this is not something that is a one and done reference to our members or our users or integrators, but rather as a constant dialogue with these communities and many, many communities that fit within those large buckets. But our priorities at the OSF and at COS are developed through those conversations. So that we're building toward what their needs are, while also sort of building things that users and researchers at the forefront of open science practices can start to take advantage of right away, even if their their communities aren't quite all caught up yet. They can help to pull those along by using what's possible through the OSF. So when that comes to what you're responsible for, largely at research institutions that are trying to help your researchers be responsible for, you get into the the research sharing and discovery element and what you hear all the time is making your data, making your metadata fair. And certainly we take this to heart on the OSF. And so we'll see some examples of this as we go. But we want to enable you and your researchers to make your work findable. We have a lot of different identifiers that we utilize and support. And some again, some new metadata, rich metadata, robust metadata options we've added this year that I'll show you. Having open and accessible standards so that even if I do have work that's out there somewhere, it actually can still be accessed and utilized over time and interoperable where those standards are now can access. My system or this system from yours and be able to reference those. We'll see some really cool examples of that that you're probably somewhat familiar with, but the OSF takes advantage of and then reusable has licenses has provenance on where this data comes from and what it's been through. So that I can recognize it's it's how I can reuse that data. And all of this is is thrust upon communities like yours. Not that you aren't out there pushing this, you know, without the stick of of compliance from research funders, because many of you I know you are you were very interested in advocate for this or pushing your research communities toward open practices because it's valuable for them and for you. But then also there are increasingly expectations that these practices become normalized and so research funders. These are examples and the first two over here in the in the US, but also in other regions where research funders and agencies are expecting research data management and sharing it at least to be provided in order to get the funding that is necessary for a large component of research. And then that they're sort of setting a tone that many other agencies and funders are following and research data sharing and politics and management is one piece of what is really valuable when we start talking about open practices and that one and having robust metadata is something we're seeing increasingly more of as far as those expectations, which is fantastic. But then there's there's lots of other opportunities, too, that may be still kind of below the surface in terms of what is openly expected and is being called for, but yet could still be extremely valuable to your own work or those of the researchers you're supporting, like pre-registering or essentially a management plan for instead of just your data, your entire study documenting that early and having those then be referenced in your your papers later on, which goes back to our our life cycle priority and having your code and your data dictionaries and other supplements in addition to your data be available and open and fair really contributes to that long term viability of your work. And so thinking about the OSF in particular, we've always have been trying to prioritize both ways for you to share and describe your data and having robust metadata as well. So this is an example of one of our interfaces in the OSF and OSF project, which is really good for active project and data management. And you can see we've got files and data stored in here in a way for me to describe it. It's linked to further data and descriptive elements and then has metadata like keywords and has our our Providence activity log down here and then several contributors and institutional and object identifiers, which we'll talk about here in a moment. And what we realize, though, is that there's still a lot more to allow you to describe your work effectively. So earlier this year in January, we launched another metadata page, which has some new metadata fields, including using the data site schemas or resource type field. So this is a pick list to help you describe what kind of information is this this object that you are sharing. So this one is a bunch of collected information. So it is described as a collection here, but you can describe this as a data set or a or a paper or I think it's 14 or 15 different object types that data site enables and then also funder support. This one being particularly critical in those compliance areas we were mentioning earlier. So as a researcher, you can now add your funder through the Crossref funder API, funder registry API. So they don't have to try to remember precisely how to spell it and then the funder has to try to find it in every which way by searching for it. Instead, they pick it from the API list and it has a funder identifier to be easily found that way by the funder and by others. And then affiliate institutions. And I'll talk a little bit about how this is enabled here in a moment, but when you sort of cross-reference all of these metadata and get some really great opportunities for not just discovery, but also from your perspective as research support at an institution, you can learn a lot about the activity at your institution by utilizing all of these tools. And I'll show you some of that here shortly. So just to summarize what's now enabled in the metadata on OSF, we primarily are using the data site metadata schema. So we're trying to standardize as the fair goals would have us in that there are areas we support in the OSF that are not quite generalizable to the data site schema but everywhere possible, we are using the data site schema. And we use the control lists for those resource types, the funders, the disciplines, license dates, obviously. And then authors and affiliations where we can use persistent identifiers for those. So OSF is already supporting a number of persistent identifiers for objects with DOIs or could IDs for authors, they can add them to their profiles. And so they don't have to manually include them every time they submit new content on OSF. They just include them with their author profile when we submit those with the metadata. Roar IDs for those institutional affiliations. If you haven't heard of the Roar IDs before, those are, it's the research organization registry. So it's similar to an ORCID ID, but for a place. And I can tell you more about that if you are interested, we're friends with Roar. And then also the crossref funder registry for those funder identifiers. And then you can use relationships that are enabled in the OSF to connect all of those various things together, the people, the places, the things that you work with across the whole life cycle. We have those relationships enabled already so you can connect it all together. And then we have, I'll show you our application profile for metadata, which is really a neat tool which outlines all of the metadata that we support and enable on the OSF. So you can see all of the possible relationships and the standards that are referred to in those resources. And then you can also, even all the way down to the file level, add specific metadata to those files, including a description and the data type. We don't meant DOIs for specific files. We do that at the container level, but you can add a specific metadata to each file. And I'll drop a link to this in the chat or maybe Blank can grab it for us. But this is our metadata application profile which is completely open and public. And you can see Gretchen here is one of our colleagues on the product team is our primary owner of the metadata application profile, which is a librarian and metadata expert who is a resource for many of our members and users that we refer to earlier. And so you'll see that it gets updated every time we have new relationships and metadata enabled on the OSF, but it's really neat. I just kind of captured a piece of it here, but you can see the standards that we refer to, that being again, one of those fair goals. And then all the labels that get used across our metadata on the OSF. So really cool instrument here. If you really want to know all of the universe of metadata available on the OSF, then the application profile has all of that. And then we have support guides for all of the metadata practices on the OSF that are available to you or to your researchers to realize and demonstrate how to take advantage of those tools that we just talked about. And then a really critical part of any of that is that as with the interoperable part of that fair standard would tell us, is that this is only so useful if it's just stuck here in the OSF and is not findable or interoperable with other systems across the research lifecycle. So one of the important things was to support the infrastructure that other research communities are relying on. And so I just grabbed one example here of a project that we support actually, this is a data management and sharing plan for an NIH project that we're working on here at COS. And you could just see just within this short snapshot that we have a contributor with their ORCID ID, Nicole here, and then data site standard pick list fields with the resource type. This one is labeled as an output management plans or data management plan and it even includes a language reference there. And then that funder identifier in this case, NIH included some other information about the specific program grant as well in here and then has some license information and the affiliation. And so now when that gets submitted, we meant a DOI for that, this object here and that goes to data site and now data site has all this information about what we just submitted, including the general metadata like descriptions, but also the license information, the language, the creator with her ORCID ID and her affiliation. It includes information about the VOSF which is the publisher host as a repository in addition to her affiliation and then the funding identifier itself as well. And now whether you're coming from the funder perspective and an NIH program officer trying to find all the impact that your funding had over the last year or we're COS trying to collect all the cool stuff that we're sharing and producing or just Nikki that's trying to continue to update the things that she's working on, the identifiers will sync all of that together. So you can, in Nikki's case, she has her data site and ORCID sync on. So she didn't have to add any of this manually to her ORCID record. It gets added automatically to her ORCID record from OSF via data site and through those identifiers, any of those stakeholders can find that same information. And this is just a look of on the OSF side. When we search for it, we find that same information and a summary of that particular project. Whoops. Back a second here. And so I have a sort of animation to summarize all of this and OSF is not alone in terms of tools that offer some really cool features like this. There are other repositories too that are really great in our community. And where the OSF is unique is that it has all of those lifecycle relationships enabled. And let me go back here and play this again because it's stuttering on me a little bit. But when a researcher comes and supports or submits their content to the OSF, we wanna learn some things about them. So we have their ORCID ID in their profile. We have their ROAR ID for their institution that they have an affiliation with. Let me put this out for a second here. See if this will play for us. And as when they submit that content, we pull that information into the OSF. Maybe not. So I'll just sort of point as this, the information we have about the researcher comes into the OSF. We meant to DOI for that content. Include all of that that we know about the author and about their content. So the DOI now has the ORCID ID, it has the ROAR identifier, and it has the DOIs for all of the associated data and other data management plans, all the other objects in there. We meant that from data site, that same info can go to the ORCID record of that particular researcher. The funder information is on there, the funder identifier, where NIH can consume that and determine where their funding dollars are going in terms of outputs. And then the ROAR identifier is on there. So the research institution can similarly discover all of the content that their researchers are depositing their sharing and through those open mechanisms, in this case on the OSF. And so where that comes back to that life cycle conversation is those relationships that are enabled there. So that DOI with a ROAR ID and an identifier and a funder identifier can also include all of this other information about your research. It doesn't have to be just a paper and you're done, but it's a paper that's linked to a pre-print, that's linked to a data set that's linked to my pre-registration, my analysis plan from the very beginning, all of that's all associated, it's all in the metadata, it all gets submitted to data site in that DOI. So where does this part sort of link up on the institution side and those ROAR identifier? So we actually have a tool specifically for that in the OSF, as I mentioned, a researcher can always get an account for free on the OSF. Now, if a research institution wants to sort of take advantage and track all of the cool work that their researchers are doing and sharing on the OSF, then this is a tool that they would utilize. Here we go. And so this is OSF institutions. We actually have a couple of members in the audience today. And where this tool comes in is verifying where the researcher, that the researcher belongs to your institution. So we use single sign on for that, which you use probably for many, many services already at your institution. And that verifies that a researcher is part of a particular university. And then at that point, the work that they do can get affiliated and aggregated. And that helps to meet those requirements of data sharing and showcase the outputs and impact being loaded word here. But generally the aggregate of impact that your institution is having from an open practice perspective is where this tool comes in. And so that when you become a member, it's not just an infrastructure offering, although that's really cool. And I'll show you what it looks like here in a moment. But for all of your users on the OSF, they get help desk prioritization. Blaine who's with us today is one of our team members who frequently supports users in the help desk. You have a dedicated product owner. So Gretchen that we mentioned earlier and others that has needed from my team on the product team will support your needs and using the technology as well as related open practices. We have onboarding materials for you and trainings that you know how to use all of these pieces. An institutional dashboard and aggregate page which I'll show you in a moment. And then we submit reports. Right now it's twice annually which aggregates all of the cool usage that your community is leveraging the OSF for. So that any of this you could track and report on your own. But we'll also submit reports for you to simplify that task. So before I jump in to show you some of those pages live just to quickly summarize where this fits into the new search features on the OSF. So we have a lot of the search features you expect on a data repository like the text searching and wild cards that are available there. But where it gets really neat is you can filter by those OSF content types so we're in the life cycle that research is coming from or what it supports. You can filter by those funders that we talked about earlier and then the affiliated institutions by the providers. We support community services for registries and collections and preprints. So communities can stand up their own versions using our infrastructure. And then those relationships we mentioned earlier whether they've connected data and code and other resources. And so there's millions of combinations of all of this and you can have as many of these combinations as you want. And so from an institutional perspective being able to actually, I mean just jump right into this live here. So let me go to the search page first. So this is our search page, the general search page on the OSF and if I'm a reader who was interested in knowing we saw University of Maryland earlier so I'm gonna actually use them as our example actually right there. So just right off the bat before I even start on some of my search operations I can limit things down to just content that is affiliated with someone from the University of Maryland. And then now I can continue to filter that down to just the subject areas that are of interest to me or the providers that they've submitted their content to. We'll see there's a couple of our general OSF ones as well as one of our other community registries. I can also see all the other institutions that they may have collaborated with in this case they have something that they've worked on Cornell University, another one of our members with. So just from the general search page I've got some of these things I can take advantage of right away of course you can flip it around and start from a funder for example we started with the NSF we can see which institutional members have something that is funded by the NSF. So we have a few here from ourselves here at COS as well as Notre Dame, South Carolina Virginia Tech all members of course and then what is something we just launched last night. So you are again one of the very first to see this I'm gonna pick on Marilyn again here. So this is their brand new aggregate page which is really neat. And now you can, now that we're on their page I can filter by the content types on the OSF so I can see all of the users that are from verified to be from the University of Maryland through that single sign on 768 of them that have been verified affiliates. We can go to their OSF profiles from here there's actually some more another release coming in a couple of weeks that's gonna put more information about the users in here which will be equally cool. But then I can also see their OSF projects and use those filters that we were mentioning earlier. So I could see all of their OSF projects that have associated preprints for example and use that filter forward to go over to our registrations I could similarly narrow down the resources that are from University of Maryland or our registration and have related data. And then the preview here will always tell me how many results I can expect if I were to use one of these filters. So in this case, I've got some lower numbers but then I have some up here that are just too high like I'm not gonna sort through 152 University of Maryland registrations that have the CC4 license. So I'm gonna continue to narrow that down into some more manageable number based on maybe if there's another collaborative institution here not in this case, but by subject or provider and continue to narrow these results down. So this is a feature that is available only to those OSF institutions members but some of those elements we were talking about earlier trying to keep track of the compliance and other obligations. There's a lot of tools here now that Sarah at the University of Maryland could take advantage of very quickly. And if she's gonna advocate for her users to integrate their ORCID ID or to include their funder on there in the metadata of their work on the OSF they'll see the return on that right away. It's not something that's hidden away. If Melody here were to add some of that metadata to her project, it's immediately gonna be available to discover and filter by on the University of Maryland page here as well as the general search pages. And that I think is really important to sort of motivate the Melody or another users to take advantage of those tools. I can just quickly see that there is a benefit to that work. So that's largely why we've done this and the sequence that we have enabled this metadata and then created these really neat search features to take advantage of them. So those are things that anybody, any user can start taking advantage of adding their funder information and their ORCID IDs and then OSF institutional members can take advantage of pages like this and that extra discovery that the Roar IDs take advantage of. And there's, we even added some new discovery stuff here. So we add more IDs to cross-refidoys for preprints. That's a new feature that's discoverable here now. And then also even files that are within containers. So they have quite a few files here obviously that are affiliated. So some really, really cool stuff to learn within these pages here. And then the general search page that enables some discovery and learning and tracking from an institutional perspective in particular. Let me just wrap up here because I'm gonna tell you a little bit about what's coming next that is related to this. So we have these really great standard metadata fields that were important from a fair perspective to be consistent in the kind of things we're trying to gather from our users. But at the same time, being standard like that isn't gonna capture a unique metadata that some communities or projects or disciplines are going to have. And so what we're gonna do for that is enable a tool called the CEDAR embeddable editor. So the CEDAR workbench is a tool that anybody can use, it's built out of Stanford where you could build your own metadata taxonomy and then it's hosted there. And so by integrating the embeddable editor we could select some of those community taxonomies and then those are available on the OSF for a user to select and then complete fill out all of those unique metadata fields and items. And then we include that metadata in that same OSF object and some of it would be discoverable through those same tools that we just looked at. So a huge opportunity here to add some unique metadata that a standard approach would never be able to satisfy. So this is coming soon, we've just started this project. So a few months, this is something we'll share out but we're really excited about enabling that for other communities. And then I'd just like to wrap up on this note where the metadata things that we talked about and the other practices, a lot of you are doing most of this already, it's really impressive how fast research institutions have been able to get adoption on a lot of these practices but even still, if there are pieces here that you're not doing yet, you're not a poor advocate. It just means that there's more that we can do to help you to support those. And just building on top of the practices that you have now that you're already using like really robust metadata and encouraging the Orchid Records and DOIs and things like that is all amazing and unlocks so much stuff. So continuing to do that is amazing. And please do talk to us about struggles trying to get to some of these other items but just keep taking that one day at a time and building toward more of these practices as appropriate. And if your discipline or community is rejected for registration or something appropriate to them then that's completely fine. But those are tools that are available here in the OSF if that is something that they wanna try. So I'll leave this resource page up while we turn over to the Q&A. I blame we'll put some of those links in the chat. All right, let me open the Q&A here. Please do drop questions in the Q&A though if you have anything for us. We have a question. Do you also link the research product with registration of clinical studies? So if you registered your clinical study with like clinicaltrials.gov, for example, then what they enable on their side, obviously we can't control. But if you have a public DOI for that registration and then you decided you were gonna archive some of the data outputs or something on the OSF then you could link out to that pre-registration as a relationship. We don't have, data site doesn't have a resource type for the study, it's gonna be called study registration I think is what it's gonna be called and then the next data site release later, hopefully later this year. So we can't add that to it yet but we will shortly obviously because we have a lot of those on the OSF but you would be able to link that DOI to your other OSF outputs. So I hope that answered your question. How do we measure relevance? Great question. So this is something we talked about a lot in terms of what are the different fields or different ways of sorting that we would enable. And so one of the things we do there is all of the different fields that, actually let me just go back here and I'll show you. So all of the different fields that the search discovery tools are looking into, so if I just try science here, you can see in each results here, there's really cool just as you would expect in something like Google will tell you where we're finding that term as this context field. So in this case, science was twice a keyword and these all categories is not a great example of this. Let me switch over to registration. Registrations and so we weigh which fields these are coming from a little bit differently in terms of how they would rank in the relevance and then try to include ones that have some pretty robust metadata. So these included manually added keywords in this case or this registration. So that elevated some of the relevance ranking here but relevance is a tough for any search tools is a tough thing to sort of decide upon. We have some more features that are coming soon for example where this will search among the contributor names too. And so that'd be one that we would be careful in terms of how we weighed it. So that somebody named Joe Science isn't just gonna pop up all the time on these relevance rankings when I search for that term. But that's a great question. All right, are there any other? Oh, I see some questions in the chat. Mechanism for verified users when they change institutions. So if a user changes institutions for one, they won't be able to continue to access the OSF through their previous. Oh, actually Blaine didn't answer this but they won't continue to have access through their previous institution if their verification is no longer enabled but they could still continue to use the OSF. That account belongs to them. So we give them a method for setting a different access using a password or using ORCID ID to log in so they don't lose any other data. And then if they do join another institution or they can actually be part of multiple institutions at once. So if I were to, let me go to my dashboard here and I'll show you. For me personally, I have two affiliations. So when I start new content on the OSF both of my affiliations are on by default. And if I somehow were to continue to join more institutions simultaneously then I would have more available here. And if I were to leave completely be out of one then one of those could be removed completely but in this case I can just turn it off for this submission so that only COS will be the affiliated institution for my submission here. So yeah, the affiliations can be removed by users and in some circumstances by the institutions. And as you go and continue your career and become affiliated with other organizations you can have those be newly added to your profile to your account as available affiliations. All right, see another question about, oh about some just chatting again later. Yeah, please do if you want to talk to us send us a note, send us an email and I'll be happy to set up time to talk to you. Alejandra asks OSF institutions for, is it free? I mean it's not free there is actually still a entry level membership option at 2,500 or sort of typical option is at 5,000 as Blaine mentioned here and those are annual fees and you get all of those features that we mentioned earlier but your researchers do not, they don't have to be part of an institutional member to start using the OSF that is, the OSF is completely free to them but if they want those affiliations available and you want the aggregate page as an institution then that's where you would need to become a member. All right, any other questions Blaine? That seems to be it. All right, fantastic. Yeah, thanks everybody for all the engagement. Wonderful to see participants from all over the world today. Really, really cool. We do have a, we have webinars at least one a week. So some are coming up that are about these interfaces we talked about today. We also have one that's really about jumping into the introduction, the basics of the OSF which is a new, really a new kind of webinar for us. That one is a week from today. So please do come and join us for those two or send your community members to come and see if that's something that they want to try and we would love to talk to them and talk to you. So please do you reach out to us or send us your contact info and we can reach out to you later. But thank you for joining us and hope to see you again.