 Okay. We're a little after the hour and it looks like most folks that are planning to come have joined. So first I just want to say welcome to this OSF collections webinar. I'll introduce myself. I'm Nikki Pfeiffer, Director of Product at COS, and my colleague, David Miller has also joined in this discussion. He waved. I don't know if he wants to introduce himself. Thanks. I'm David Miller from the obviously here from the Center for Open Science as well. I work on our policy initiatives with funders journals and societies on obviously promoting open science practices and policies. Thanks, David. Thanks for joining us today. So, we'll go ahead and get started. Welcome to the webinar and OSF collections. We're going to talk about the recent infrastructure that COS has developed and launched that is intended to support research discovery collaboration and reuse, which is the OSF collections infrastructure. So you've all joined us today because you care just like we do about research integrity. In fact, I think just like us you have a commitment to a framework for research which fosters the principles of research integrity, ethical, responsible, transparent, and rigorous as the top priority. This framework that we're talking about is all designed to help support a change in research culture. We need a framework that will foster communities and be empowered to demonstrate these new norms. So this pyramid sort of represents what is the peers, the different tiers that are needed to really support a research culture change. The first being infrastructure that makes it possible. A user interface and experience that makes it easy for them to come in and do their work. These are communities that foster these these beliefs and these practices and make it more normative incentives that make it rewarding and policies that make it required. In order to foster these new norms and communities we need this infrastructure to facilitate open sharing collaboration improved rigor research and to ensure that research findings are discoverable reproducible and reusable. The OSF collections is a is a solution to facilitate that for funders societies, journals communities, just general organizations with this, this initiative and important factor lab groups and consortia projects. This OSF collections enables them to advance their open policies and incentives to demonstrate their transparency and rigor of research outputs through their sharing and collaboration and to ensure access and reuse through discovery. So a quick overview of OSF collections OSF collections collects and aggregates OSF projects. It displays them on a branded discovery interface and it leverages the OSF project structure and flexibility to enable collaboration and rigor and research workflows, making the research process open transparent and accessible. So we'll do a quick focus in on different areas where a collection can support a specific audience need or stakeholder need. So OSF collections supports needs for funders where they can implement their open policies they can track their compliance of those policies among their research community. They can incentivize more transparent methods and research, they can make all the outputs discoverable they can able and enable reuse of those outputs from their research dollars, and they can cultivate more knowledge exchange between the researchers they've funded and beyond. Looking at the same for a collection use case for a journal. It helps a journal organize the supplemental materials that underlie the research articles, it aggregates that underlying data. It demonstrates the transparency and rigor of those findings that are being published. It also allows you to connect more with the community as they're doing their ongoing research efforts, not just at the end. And it supports the ability to be top compliant. And just looking at collections for communities of practice, which has a broad sort of span of opportunities it can help aggregate just the open outputs the data from a large study, or other methods and methodologies that you want to share across your community. It can help demonstrate what best practice looks like and it can connect with the community in ways where they can share and collaborate and foster those new normative behaviors, and it really facilitates sort of that open sharing and ability to see what's see what different projects are doing and be able to engage in collaboration with them. So at the core of any collection is the OSF project. Again, that's what is being aggregated in the collection or OSF projects and let's do a quick refresh on the re the robust functionality built into the OSF that supports open transparent and rigor in the research workflow. So at the core of OSF we have open source develop software we have a public open API OSF projects have a very flexible structure where you can have granular permissions and access controls with the ability to add components and folders within that structure. You can register DOIs for for projects and components, you can affiliate your institution. It also the OSF supports 11 different file storage integrations allowing you to not move files back and forth, but actually be able to just connect with where you currently are working. The OSF also supports over 500 different file types meaning some of those special files could could be easily rendered and viewed in the browser, and also the OSF offers file metadata actually to be coming very soon but something we've been working on we're excited to offer that later this year. So now I want to demonstrate collections to you. We will sort of start by looking at a population populated collection that exists already at their brand and discovery page will navigate and look at submission using the submission simple submission workflow will look at how a custom metadata for a collection submissions enables you know better discovery and organization of the content and finally we'll look at how the OSF project that is part of a collection. How it affiliates back to that collection. One second while I transition. Thank you can see my screen now so here we have a collection on coronavirus outbreak research on this landing page you can see the branding colors and a logo for this this collection. This is all something that can be provided by the admin of the collection that's customizable. Also notice that the name in the URL is something that you can brand as well. So coronavirus would be where you could swap your organization's name if you wanted to. So if we start to look at the functionality on this discover page, you can see that you can facet your results so currently shows all results but you can facet to look for things like all active COVID-19 research and it will populate only those those projects that fit that criteria. You can also further refine your search by putting in things like tags that will then facet the results even more to find only COVID-19 active projects that have have been tagged with stress stress related research if that was something I was interested in looking up. You can also do the same like I've done with tags for contributors if there's a specific contributor that you know published research in this collection and you're very interested in finding that. And potentially you know reusing data or collaborating with them. You can also sort the results by relevance the modified date oldest to newest or new to newest to oldest so I have it ordered so that I can see the most recently modified studies mean they've had the most recent activity. Now let's look at how submissions to this collection happen and what the process what the simple submission workflow looks like. So when you go in to add to add to collection you're you're taken to a page where you would select an existing project in your OSF profile you'll be able to populate it brings over the metadata that your project already has but you can certainly update that existing metadata that might make it more relevant in discovery for you in the collection. You can see the list of contributors already on the project if there are none you can certainly add others and do granular permissions for each of them and you can invite users that are not on the OSF very simply with their name and email. And the last part is the custom metadata that each collection gets to put together when it gets set up so here we have being able to submit your coronavirus research and and type and tag it whether it's Mars SARS or COVID-19 related. So I will pick one of these and also to provide the status active archive completed or proposed again these are customizable so a collection could have a journal issue and volume. For example or funder might want to put their specific program areas and the status of the work to be able to ensure that you can keep track of of those projects as they come in as every project gets submitted to the collection. It is going to be made public so that it's discoverable if it's not already. So let's look at the one of the projects that was in that first collection that we were we were sorting through the results. So one of the things that on these on these projects it will indicate that it is part of this collection as well as the metadata that was associated so the type and status are here. What's interesting is that this collect this project is also containing supplemental materials for a preprint that's on site archive so you can see both of those aspects of where this research is being indexed and discoverable. Okay, I'm going to switch back over to the slides and David's going to talk a little bit about the different partners use cases in examples that he's been working through with several folks. Thanks Nikki. Yeah, and just to address one question from Adrian that came in. This is really what I'm going to focus on right now. Can you say more about top compliance. And before I say that I really want to emphasize that the three are the top guidelines the the reason we exist as an organization is as a culture change organization who advocates for better practices and policies around open transparent and reproducible research. And these OSF collections are really designed for institutions to support the implementation of these types of practices so I'm going to Before I give a couple of examples of what a funder and what a journal is doing to complement their policies. I'm going to step back a little bit and describe the top guidelines precisely what they are and Give some examples of what we're doing to support implementation of policies and practices that lead to more open research that's more verifiable and more easily reproducible. So the top guidelines that transparency and openness promotion guidelines are a set of eight standards for journals or funders to implement That describe how grantees or how authors should Instruct this audience on how they should apply these practices to the work that's getting funded or published. So an example of that would be the the data transparency standard. Each of the different standards are can be applied in one of three levels of increasing rigor. The basic beginning of the top guidelines is a requirement for disclosure simply state whether or not the data are available or for take an example from some of the other standards, whether or not the the materials or the code are available, whether Not reporting guidelines have been used or other steps such as whether or not the work was pre registered. It goes up from there requiring such actions or requiring that a third party verify that these actions have been done to a sufficiently detailed degree. But most of our work is really focused around Really raising the bar a little bit just to make sure that it's simply clear and easy to understand whether or not the funded work or the published work Has underlying data materials code or pre registrations available with it. I'm going to actually Take over the screen share. So Nikki if you would be so kind as to stop sharing your screen. I'm going to point to And I'm going a little bit off the cuff here. I'm just going to go to Share okay and the top guidelines as I said are for provide specific recommendations for funders and publishers. To give instructions to their funded work or to their published work. The authors of that to describe steps that should be taken To share data to pre register the work or give recommendations to those entities for how work should be replicated. These were again published in 2015 and for the past several years we've been supporting institutions and and funders and publishers with implementation of these practices. They're widely endorsed in the publishing and funding community. And a lot of our recent work has been around evaluating the degree to which various entities are adopting these policies and supporting adoption of these with individual stakeholders. But more of what we want to be doing over the next several years is Providing specific tools for entities to to to complement their efforts. And so here's an example from the International Life Science Institute of North America. It's a funding organization. Supported by industry in order to Support research in in life and environmental and health sciences. And so here's a collection that they have up on the OSF and this is as part of the Effort to implement the top guidelines. So they require disclosure amongst the recently funded work of whether or not the work was pre-registered. If the work was pre-registered they Require verification that the results are being reported as specified ahead of time. And require material sharing. So amongst the work that's recently been funded. I believe they've been doing this for about six months now well roughly here is a sort of a list of ongoing projects that Are under those mandates that are being Covered by the top guidelines by you'll see North America. Here is one of the projects that has recently been Uploaded and who's who's I believe that the study is not yet completed and so their data on the project has been Uploaded and who's I believe that the study is not yet completed and so data aren't yet available but there is a registration of this study up and available for For readers to evaluate And this is the again the pre-registration that covers the pre-specified hypotheses data data collection plan and data analysis plan. Once results are ready for that. So this was just Obviously register about a week ago. There will be a The ability for researchers to post whether or not the results are being reported. And of course it's not available here yet Because I was just implemented within the past week. But here is an example of a pre-registration. This is a the example of registration. If you go to our main registries page and look for an example. This is the first one that pops up. And this is a study that we were conducting with a couple of colleagues on evaluating how folks pre-register. And the work for that has been reported as a preprint and so that's available for for review at this time and we're, you know, currently in review for publication at a journal but as of right now. And the work for that has been reported as a pre-print. And so that's available for review at this time. And we're currently in review for publication at a journal. But as of right now, the results are reported right there. The Journal of Business and Psychology also strongly encourages data sharing and access to just registration, but they're not they're not the level two that I described with the International Life Science Institute. They are strongly encouraging data sharing and instructions to authors indicate that that there's an expectation that data be shared. And during the review and acceptance of articles, editors reach out to the authors and instruct them to share any materials that are shareable. Post any data that can be shared or posted. Post the analytical code if it's available to be posted. And this is something that's been that the editors there have been doing for the past again, roughly six months. And here are the articles and data that are that are that are available from the most recent issues in the journal. And so if you go to any of the OSF projects that are associated with them, you can see which materials the authors have determined are are shareable and they would like to make available. So this is the online syntax that is available from this particular author. And there's sort of a variety of different instruments and materials available for this project. Again, associated with a particular study that's been published within the journal of Business and Psychology. What I'm going to do right now is stop sharing this and pass it back to Nicky for a little bit more description about what we're doing to roll out the roll out the offers for this. Let's see my screen. I see your screen. Yep. Okay. Yeah, so that was a great overview from David and, and hopefully gave you some really good real life examples of how a collection could fit into your specific needs and workflow. Sorry to butt in. I see the presenter view is being shared. I'm not sure if that's the one you wanted to share. No, it's not. Sorry. Maybe swap displays. That might be the, I'm not sure. There it goes. Yep. That's right. Okay. Perfect. Sorry about that. So OSF collections is, is an interface that we're offering. It's branding and aggregation on top of what researchers can get just by using the OSF. It provides a different view into that subset of projects. We're offering that an annual fee of $5,000, but we are discounting that currently to 3,500 annually, because we are still working on it. We currently are offering the branded discovery page submission and custom metadata, but we are planning to add onto that moderation layer. So there would be the possibility in the future that as these submissions, these projects get submitted into your collection, but you can accept or reject them before they're made public on the, on the discovery page. And even in that workflow, there's a little bit of opportunity to give feedback to the submitting authors on any aspects of the metadata or materials that you would like included perhaps that aren't there or any, any sort of feedback on those collections on those projects for the collection. So that essentially wraps up our portion of an overview and review of the OSF collections. But we certainly want to open up for any questions that you might have. We'll, we'll look at the Q and A and answer any of those that we haven't gotten to. So if you have any of those, now's a good time to go ahead and write them in and we'll, we'll work through them. And also just to thank you for your time listening and learning more about how OSF collections could support your needs. And if you have any questions, you can reach out to either David or I or email addresses are on the screen and we look forward to hearing from you. So let's see if there's any, anything in the Q and A. Looks like just more about the top, top compliance, which I think David has covered. I don't know if there's anything further you want to add to that David, or if anyone has anything else to ask about those. Yeah. Really it's, it can complement any of the different ways to implement the top guidelines. And frankly, one of the ways that we often see in funder language or in journal author guidelines, we see things that we describe as not being compliant with the top guidelines, we call those level zeros encouragements. And one of the things we want to raise the bar with is to get beyond that and sort of require disclosure, require transparency when it's ethically and legally available and enable what we call computational verification or computational reproducibility to check whether or not the work can be done. And frankly, the OSF collections can support any of that range of implementations that we don't like those, not too effective encouragement level zero type things OSF collections does support that if you encourage activities such as sharing and point to an OSF collection, that can be a way to support the types of policy you see all the time. If you want to raise the bar and I'd be happy to help you work through that to standardize disclosure requirements level one, a mandate for data sharing level two, or even computational reproducibility level three OSF projects in general and those OSF collections in particular support any of those types of implementations of new policies. So, so I wouldn't say that any of these are force you into, for example, an open data policy or an open data mandate that you might be hesitant to implement. There's often lots of discussion about the best way or the appropriateness of going to those higher level open data requirements. If you are interested in OSF collections, it doesn't push you into that. It really supports encouragement or disclosures and gives you a place to point authors to so that they know where data sharing can happen if they wanted to. But if you're in the camp and you're ready and able to push the button on a sort of a stronger open data mandate OSF collections is still sort of appropriate. That can be the place for that happens. If there isn't already an existing repository appropriate, or if you want to make sure that the work is registered prior to conducting the study, those as I showed earlier, each of these projects supports all the different open science practices that we advocate for data sharing, materials and code sharing and other activities, especially things like registration, which is commonplace in some communities, is brand new to many other communities, and we're working to make that as easy as possible for any researcher that's kind of wanting to dip their toe into that for the first time. Thanks, David, for more detail on the top compliance and how it fits well with OSF collection. Well, we have no other questions that are open. So if you think of those, please, again, feel free to reach out to David or I. Our email addresses were on the slides and we'll be sending the video and slides out to you. Those that are on the webinar now registered so you can certainly follow up with us that way too. So I think that's it. Thank you all for joining us. Goodbye.