 Okay, well, I think we'll get started. Thanks everyone for joining today. This is the second in a series of webinars directed at publishers. I'm Heather Staines. I'm the Director of Partnerships for Hypothesis, and I'd like to introduce my colleague, Nate Angel, who's our Marketing Director. Greetings, everyone. Working on a lot of the, talking over a lot of slides today with me. Just a couple of housekeeping items before we get started. We have had all the attendees join in mute mode, and that's just to keep the noise down, you know, during the presentation. But when we take questions at the end, just give us an indicator in the chat box that you have a question and we will unmute you, and you have the opportunity then to ask your question. We will be recording this webinar for later viewing if you have colleagues who are not able to attend today. So we'll be sharing that out, and it will be available via our publisher website. I'll be putting some links into the chat as we go along to help guide people toward things that we mentioned. Great. So first I want to talk a little bit about what we're going to be covering today. We can go to the agenda. First we'll go into a little bit of information about how Hypothesis works. Then we'll talk about how easy it is to integrate Hypothesis into your platform. We'll talk about options that are available if you elect to have Hypothesis assist you with that implementation, and then we should have time for questions at the end. So as many of you know, you're joining here today a little bit about Hypothesis. We're a kind of unique position. We are a non-profit tech company. And we can do things a little bit differently because of that. We're beholden to partners who share our vision rather than investors who share our company. We won't be bought by the competition. We work with targeted small groups to build up our audience strategically. We build up quite a considerable number of users that way. We create open source software so we can involve the community in the roadmap and development of Hypothesis, and we depend on open standards for that same reason. In February of this year, the W3C, the standards body for the web, did approve annotation as a web standard. So what that means is in future, browsers will come with annotation capability built natively. So just like you choose your default search engine, you'll be able to select which annotation client you prefer to use. Very excited about that development. So first a little bit about how Hypothesis works. And Heather's going to pass the baton over to me to talk for a few minutes. And we're working with the assumption that most people on the call are already familiar with annotation, of course, and then Hypothesis in particular. So there's a couple of things we're just going to spend some time reminding you about the basics about annotation and Hypothesis to make sure that we're all on the same page. But the key of this kind of conversation that we want to have is to help you understand how easy it is to get Hypothesis integrated into your own website or publishing platform. And so we're going to start out by talking just for a second about what the kind of basic capabilities of what Hypothesis is trying to do consist of. And so the first one is the idea that Hypothesis enables users to annotate in layers over the top of documents that are in their canonical locations. And so this is a little bit different than some other annotation platforms that ask documents to be moved to a different location in order to be annotated. And so this is really key to publishing, right? Because the idea is to keep your publications in their canonical locations and add annotation on top as an extra capability that can enrich the experience on top of that publication. So that's one of the key elements of the difference that Hypothesis brings to the table. And then this is just a really simplified schematic diagram to remind people that there's two major pieces of technology at play in Hypothesis. And it's what you might call a common client server architecture, right? So the client is the tool that we as users interact with on top of documents in order to do the actual annotation work. That client speaks to a server where we authenticate as users and it stores our annotations and the references to the documents that they belong to over time so that they can persist so we can log out, log in, come back and search and browse our annotations in other areas. And so understanding this, the difference between the client and the server is one of the kind of fundamental things to bring to this conversation. And so what we're going to talk about in this next part is about ways in which users are able to access the annotation client, right? So Hypothesis is hosting a kind of default server environment that's a reference implementation of an annotation server. And the easiest way to be able to take advantage of that kind of service that we are offering to the world is to equip yourself as a user with the client so that you can go out and start annotating. And those annotations would be stored in Hypothesis default server environment. So there's a couple of different ways that folks can get those, that client, that Hypothesis client to start annotating. There's ways for people to just share links to annotations that they've made that then even if the people that they're sharing with don't have access or know about Hypothesis or annotation, they can click on that link and it will bring up the document that's been annotated, the annotation and the client to start using it. They may not have an account yet, but they can at least start to browse. So that's like the sort of easiest way that people end up getting acquainted with the client. There's also if you're a user who's made the choice to equip yourself fully with a client and you want to use it like Heather does, Heather holds the record as the human being with the most annotations. There are some robots who beat her up but just barely so. She equips herself by having a browser plugin and so she carries the client with her to every website she goes to. Well, what we want to talk today, though, is about from the publisher perspective how you can embed the client in your publishing property in your website or platform so that every user that comes to your site has the annotation capability already waiting for them there rather than having to know about it in advance, have a link or have the client embedded in their browser. So embedding the client in the website is the easiest way for a publisher to deploy annotation on their website and take the next steps to kind of enable annotation for all their users. And so it's really easy. I'm a non-technical person. I have a little bit of technical background, but it's the kind of thing that I can do. In fact, I've integrated hypothesis on my personal blog and it was really easy to do and just walk through the steps of how that happens. So in a basic implementation, which there's no cost to do, there's a simple step for the integration piece, which we're just about to talk about. And that brings all the kind of basic primary annotation capabilities to all the users who show up in your publishing website or platform. So let's just take a look at what the integration looks like. And so to embed the client in a website or platform, there's really only one single step that needs to happen. And that's a single line of code that we just showing you the example here on the screen that reaches out and grabs the default standard hypothesis annotation client and brings it into your platform so that every user has it available to them as they're browsing your publications. And so there's a couple of different ways that you can get this line of code into your into your platform, and we'll talk about those in just a second. But the point is, is that, you know, it's much like adding Google Analytics or some of the other tools that are out there that are offered to the to the web. It's just a matter of embedding the single line of code into your platform. And as we go along, if there are questions, feel free to feel free to use the chat or the question feature in zoom to to queue them up and we'll we'll answer them when we get to questions and answers. So now obviously, if you want to embed the client in your in your website or publication, you know, the technical folks who steward that for you, whether it's you or someone else can probably just manually add that line of code in. But there are several different platforms that already have a kind of native module or plugin that adds the hypothesis client to to their platform. And you can just see the list here. It's not every platform that publishers might use, but a couple of key ones that are more commonly used that the open source community or hypothesis have collaborated to make these plugins so that they can be easily embedded into these systems. So you think things like Drupal and WordPress and OJS and Omega. The other way that some publishers are now integrating hypothesis is by working with their platform hosts. So with folks like out upon high wire and gender and silver chair are looking to enable annotation for any of their publishers who are who are using their platforms. And so if you are a publisher who uses one of these, these sort of, you know, more universal publishing platform providers, talk to us and we can we can help guide you to the way that it's easiest to work with that publishing platform to get hypothesis integrated into your into your system. So that's, you know, just to recap, there's a couple of different ways. But this is how easy it is. There's a line of code that needs to appear in your website. And that will make the client appear for all users. And then there's a couple of easier ways to help that line of code appear in your platform if you're using one of these particular systems. Now there are configuration options, and we're not going to go into a bunch of detail about all the different sort of nuances that you can add to to the client once you get it in there. But just as an example, some folks want to make sure that the annotations don't kind of interrupt the initial viewing experience of their publication. So they want the highlights that are anchored to the annotations to be hidden by default, and enable the user to just turn on highlighting if they open the client from from its controls and start to actually read the annotations. And so with just one simple configuration line, you can you can make sure that the highlighting is hidden by default. And there are other configuration options as well. We'll be distributing these slides to all the participants as we go along, so that you can have all the links to this to this work. And so just to remind folks, so you if you've taken this step right of embedding the client into your, your, your publication platform, what does it bring you right? So it brings all your users a universal client client that allows them to do all the kind of standard capabilities of an of highlighting an annotation that that hypothesis offers. They would in order to actually start annotating, they would need to create an annotating account so that their annotations could be stored in the server environment. And in this kind of default basic implementation, they would be creating a hypothesis account, an account managed in the hypothesis namespace for our default server environment. And we can talk about other options. But in this kind of free basic service, you can get all the capabilities for all your users. And they, they would walk in the door with all the capabilities of the client. Behind that client, right, each user and group that they might annotate in also has a very robust annotation dashboard that kind of brings all their annotations together into a collection that they can browse and search. Using various parameters, they can view annotations and collections of tags or through time. And they can see both their public annotations, their private annotations, they can share their annotations from there and they can jump back to the context of the pages where they made the annotations. So there's a very kind of rich dashboard environment for people to look at their full collection of annotations. And then a couple of other points to make about that, what this basic service brings to your, to your, you know, your publications if you embed it. So we're just about to announce work on the completion of annotation capability in EPUB, which adds the third major publishing format to the capability set. So regardless now of whether you publish your documents primarily in HTML, PDF or EPUB or all three, you can now enable annotation for your users in those formats. And here's the interesting thing. Not only can you enable annotation, but if you publish the same document in a variety of formats, there's a kind of architecture of document equivalents behind that that enables folks to annotate in a PDF version and have those annotations also appear in a canonical HTML version, for example. Users who make annotations in a PDF that they've downloaded to their computer that has the same fingerprint as the canonical PDF on your website, those annotations will also find each other because they're hooked together behind the scenes using a PDF fingerprinting technique that allows PDFs to know or it allows hypothesis to know that the same PDF is being annotated multiple places. So there's kind of a rich array of different ways that that documents can be annotated in different locations and in different formats. The other thing that's sort of included in this easy step of getting annotation up and running on your on your platform is behind hypothesis, there's a full blown API. So even without doing any more technical work on your side, other than that, you know, making sure that there's that one line of code in your system. There's an API that, you know, if you have technical resources and you want to do things that go beyond that embedding, you can orchestrate different kinds of calls to that API and do a variety of different things to annotations programmatically behind the scenes. So if you wanted to take steps beyond what the basic service delivers, the API is sitting there waiting for you to use as well. And so that's, you know, that that is the kind of quick overview of the rich array of basic annotation capabilities that are delivered to you. If you just add that single line of code to your property. So I'm going to hand the baton back to Heather, and she's going to talk about taking integration a step further and some of the more customized things that you can do. I think you might be muted, Heather. Thanks, Nate. Yeah, so as Nate mentioned, because we are open source and permissively licensed, you can go ahead and, you know, take significant action on your own part. But if you want something a little bit more custom, or if you are not entirely comfortable taking, you know, those steps on your own, we're happy to help you. Can you go to the next slide, Nate? Sure. So with the customize and supported implementation, you get everything that Nate already explained as a part of the basic implementation, but will help you do the integration on your platform. We have a very simple pricing model that's based on the number of documents that you publish in a year. And there is a volume discount. So the more pages you deploy the client across the cheaper that it gets. If you're, if you wish, we can also hook up to your account system so that your users do not have to create a separate account. And you know, the single sign on is handled and annotation happens seamlessly. A lot of publishers have asked us to create for them those layers that Nate mentioned, a publisher branded and moderated layer. So it's clear which is the authoritative layer for the publication. There's a number of UI customizations that we can make. And we have a program to ensure successful training and rollout. We also offer support and open source maintenance. Let's go a little bit deeper. So the publisher groups, as I mentioned, they are customized to meet your brand. You can decide as a publisher who will be creating annotations and who will be able to see them. So for example, if you want to use annotation to create additional content, whether that's on by your authors, whether that's passing along reviewer comments, or invited experts, you could limit the annotations to that group, but it would be visible to the public. Or if you're really more interested in a post publication conversation layer, you can set up one that anyone can enjoy can join and create annotations of moderation capabilities, certainly possible. And you can choose how the client will be visible on your screen. For example, if you would if you want a button to appear that lets folks know that annotation capabilities are possible, and they click the button and that opens the client, that's one possibility, or the client can be open with the annotations visible by defaults. All of that is completely in your hands. We offer a number of UI customizations so that you can fit the sidebar best to your platform. That includes options and colors and borders, typefaces, how wide you want the sidebar to open to in case it's not covering up your content, for example. Nate mentioned the visibility of highlights. We also have a number of options for calls to action, so how you would let your users know, again, that annotation is possible on the page. Next slide. I think the most important thing to note is we don't expect you to do this entirely on your own. If you do deploy hypothesis yourselves, we're also happy to help you with a roll out and ongoing collaboration. And certainly, we want you to be successful and achieve the goals that you set out from the beginning, so we always talk with our publishers about what they're trying to achieve. We can put together trainings for your internal staff. For example, if the journal editors are not clear on why annotation might be of interest to users, then certainly that cannot be communicated to authors and other external stakeholders. So we can do some internal trainings and record those for you, as well as end user oriented trainings, again, materials that can be available via your site as well as ours to help people get started. We can work with you to talk about how best to engage the folks who will be the key annotators on your content. We can tell you success stories that have happened with other platforms, techniques like getting authors to annotate their own work, invited experts to seed the conversation, for example. And we're happy to work with you on a coordinated program, both on the roll out and subsequent launch materials blog posts. We'd love to talk to you about the possibility of presenting together at upcoming industry events. And as annotation exists on your platform for a little bit longer, we'd love to explore with you unique case studies and maybe put together some white papers that we can in turn share with other communities. Nate, would you like to take this one? You're muted, Nate. So one of the one of the sort of background activities that hypothesis does with our collaboration partners when we're working together closely is we basically become like your support provider the way that you would with a typical commercial vendor and provide all that kind of functional and technical support, not only for your team, whether they're technical or editorial, but also for your end users. So it becomes a kind of help desk service then for you so that you don't have to have your support team train up in all the nuances of annotation. Behind the scenes hypothesis is always maintaining this open source code base. And there's a link here that that will share out to a deeper technical dive for those of you who are, you know, more technical and want to understand a little bit more about the architecture behind it. But so as an entity, we're stewarding the open source licensing, so all the contributions for that, making sure that the open source contributions that are made by various developers are properly attributed and licensed on maintaining that code base for security issues. And, you know, as technology advances, it needs a kind of care and feeding and then advancing development on it. So when we roll out new capabilities, they are added to that code base and become available to a wider array of folks. And so for instance, this publisher group capability that Heather was talking about is a relatively new capability that is now part of the open source code base. And it does need some extra work in order to be enabled for folks. It doesn't it's not part of the default package, but it is there as something that that can be used by everyone. We're also part of the the group that works in general on standards and operability for annotation. So, you know, part of our nonprofit mission is not just to serve the hypothesis annotation community, but also to move forward work on annotation in general for for everyone. And so we were we were definitely part of that group that worked collaboratively to establish the W3C standards on annotation and we continue to work in those fields to advance annotation across the board with with other folks. And we do that really in the context of a wider community. So many of you may already be aware of or even members of the annotating all knowledge coalition, which is a kind of community group that we pulled together of now I think it's over 60 right Heather over 70 over 70 organizations that have come together. And I can show you some of those are if you're more if you're interested in more detail around advancing they come together around advancing annotation as a as a general practice and technology. And once a year we hold an I annotate conference, usually in the spring in the May time frame, where we bring together people not only from publishing but from other fields like education, journalism and research science and scholarship, who are all working on annotation in various ways to kind of have a have a deeper community experience in a live live environment. Just a small plug. Heather will be in Berlin at the force 2017 conference on that's coming up. What are the dates for that, Heather? So the the force conference is the 25th through 27th. We're holding a face to face meeting for the annotating on knowledge coalition on the 24th of October. So if you want more information on that, we can we can provide that as well. We'd love to see you, especially if you've got a use case that you want to present. Great. And so there are other things that we do across the community. There's really vibrant things going on now in a sort of news credibility arena. And there's a variety of different organizations that have sparked up around that pesky problem that we're involved in as well. And so there are other examples. But the annotating on knowledge coalition is really the kind of community group that that we work with in order to kind of develop the publishing and scholarly annotation agenda, if you will. So we'd love to see any of you who are going to be at 417 to also be a part of that annotating on knowledge meeting. And that's really going to be an interesting conversation focused on the fair principles for annotation and data in scholarly publishing. So that's that's the end of our presentation. And so we wanted to move to questions and answers. I've got one question queued up here in the queue that someone's asked that will address. But if you in the course of this presentation have come up with another question and you just like to ask it via text, you can do that either in the chat or the question and answer tool and zoom and we'll address it. If you would like to have a little bit deeper conversation. So for example, you've got a particular publishing platform or scenario that you'd like to talk about in more detail. We can actually promote you to status where you have audio capabilities and can can be part of a conversation. So we're getting a couple questions queued up now and I'll address them and then I invite Heather to speak to them if that's if that's the right thing to do, which often will be. So one of the first questions that we had was about we mentioned that there are bots or robots or machines annotating in hypothesis platform. And so could we explain that more and maybe give an example. Did you want to take that one Heather? Sure, probably the largest example and there are numerous incidents out there is one of our staff members, Mary and Marton, is a neuroscientist and about I think about 125 of the neuroscience journals use things called RRIDs, research reference IDs. And these are particularly important for folks who need to reproduce experiments. They may need to know a specific stem cell line for say a mouse that they're using or where a particular reagent was purchased. So these RRIDs are typed into the papers and there's an external database that you can go and look them up. What the folks at UCSD have developed together with Mary Ann is an annotation robot called Cybot, which when they load up the papers and the browser it automatically looks for these RRIDs and then it actually pops the resolution from the database up in the form of an annotation card on the side. It's got all the information on that RRID. It's also got a tag so you can explore which other papers have referenced that same RRID. So in this instance the annotation capability is almost incidental. It's the way that the information is being retrieved and displayed. We've also had conversations with other publishers who have entities embedded in their publications and these may well be linked to an external database but wouldn't it be great to have the opportunity to have the information from that external database appear on your page so your users could see it without navigating away from the content and we'd love to explore other use cases along those lines. Another really interesting case similar to Cybot came up recently in conversation with one of the publishers who's deploying Hypothesis. So there's a kind of collaboration in non-profit organization called Refigure that is focused on identifying when figures or diagrams or pictures are used in scientific literature in more than one place. So it's a little bit like the Cybot RRID question is you know is this resource in this case a picture a figure or a diagram being used in multiple scholarly works and so we're now in a kind of preliminary conversation about the idea of having the ability for an annotation layer to let you know if any figures or pictures in the scholarly work that you're reading are also used in other scholarly works and what those are. So it's another way to use the annotation layer to sew together scholarly works kind of across the whole work. So there's a couple of other questions coming up. Folks have asked if we're going to share the slides and yes we will when you registered for the webinar you submitted your email and so we'll email you a link to the slides so that you can share them as well as to a recording for the webinar as a whole. So we will definitely do that and you'll get that in your email. It will also be posted on our website in a blog format similar to the blog page that you probably visited when you registered. There's a question too about from Beata about can different formats of content be related by DOI so that annotations made on the HTML version would be displayed on the PDF and vice versa and yes I glossed over this a little bit. Did you want to go into more detail about that Heather or? Sure I mean this so this is already happening you know in many publisher websites when I when I go to do demos an annotation will that's made on the HTML will appear on the PDF and one of the ways that we relate documents is via citation DOI tag. Another way Nate had in the slide is the is there is the rel canonical rel tag to show that one URL is equivalent is equivalent documented another URL and there's a couple of other ways you know that we can relate documents as well. If for some reason your particular website the annotations made on the HTML do not appear on the PDF usually we can look you know really quickly at the metadata and kind of make a determination as to why that's not happening usually it will happen without any additional work to be done on the publisher side but sometimes you need to nose around a little bit but certainly yeah we're excited about that capability. Hey is this an opportunity to mention the crossref collaboration as well. I'm sure we're in conversations with crossref to determine what particular types of do is for example of what types of annotations might be useful to assign a DOI to in a related conversation we're also speaking with the folks at at orchid to see if folks might be able to indicate that they want particular annotations to connect with their orchid profile so DOIs is one way that that that can happen all of the annotations that are made in hypothesis that are in the public layer so visible to anyone are being included in the crossrefs event data project so those annotations will be indexed by google and surfaceable and discoverable so it's a great additional way for users to find your content if annotations have been made on that. Right okay um another question um we got actually a couple of them now so um keep them coming this is a great conversation um so uh and i'll take this one heather um a user had asked if i'm sorry an attendee had asked that the users are annotating on a publisher's website could they download the pdf with the annotations and so um here's one of the uh sort of interesting conceptual things that that took me a while to get through my own my own had um before i could really understand it the annotations are not embedded in the document they're served uh to the document because the annotations are related to that document's unique identifier whether that be a url a doi a pdf fingerprint or whatever it is and so it's not as if the annotations are embedded in the document and need to be downloaded with a pdf version it's rather that if you download a pdf that has been annotated that has a specific fingerprint um that uh and you open that pdf in a browser environment connected to the web then a hypothesis can uh look through its database of annotations and find any that are related to that pdf in its unique fingerprint so um it's not it's the the annotations don't travel with the document they are hooked to the document by some kind of unique identifier and that's what allows um a pdf that's being worked on in one user's environment to have uh contact with annotations that might be being made on that same pdf even though it's in use on another user's computer uh in a different environment as long as that pdf has the same unique identifier in it yeah one um you know sort of additional thing to add to that we have had publishers who have um said that it might be useful uh to offer um readers the opportunity to download a pdf that um has annotations included um so with our api if that's something that was important to you depending upon how you serve up your pds on your site that it may well be possible for you to do that with just a little bit of of work for example we have peer review integrations um underway um one of them is with ejournal press and in in addition to making peer reviewer comments available to authors um via the annotations on top of the document they have enabled the annotations to be uh presented together you know with pdf so there's a lot of options and we'd be happy to talk with you about how that might be possible if you think that that's a use case that would be well received by your readers yeah just to point out um heather's email there is on the screen and so she's certainly uh the best first point of contact for any kind of conversation that will go beyond this webinar uh so another question that's come up is if we could talk a little bit more about the different kinds of groups and the permissions that are associated with them do you want to take a stab at that heather yeah so um you know first when we talk to publishers we we try to figure out what uh you know they want to achieve with groups i mentioned uh briefly that some publishers see annotations as additional content and they want to limit the creation of annotations to um you know folks who are you know credentialed with the document authors for example or um only the the publisher staff so we do have um you know permissions that we can provide um that will you know fulfill those purposes as well as um different levels of uh accessibility in terms of who can create an annotation whether it's it's read whether they can only read them or whether they can reply whether they need to log into your website to reply you know mechanisms for joining a group um in the peer reviewer context for example um there are multiple roles that need to be represented um whether someone is uh is the editor uh reviewer one reviewer two um if it's a if it's a blind interview you know and the author and so different um roles can be assigned to meet that uh flow um so you know it's it's a there for each of the private groups for example that you can make on hypothesis now the person who creates the group serves as the admin for the group can moderate the group for the publisher group um publishers designate moderator to take care of um you know any problematic you know annotations that that come up so it is um it is very granular and you know we can work out something that will meet your needs yeah and i think the uh the the sort of general takeaway from that is the idea that um you know each group basically has its own annotation layer if we go back to that metaphor of annotations living on layers on top of documents and so the configuration of those groups is very flexible as uh how there was pointing out about who can write to that layer and who can read that layer or see that layer and what kind of roles they have so the idea is not so much to have um you know only these set kinds of groups but to be able to enable various kinds of configurations of groups that have different kinds of permissions depending on the need that a publisher might have uh so um i will take this one uh so have um implementers normally embedded hypothesis with their entire portfolio or have some made it available on just a portion and do we support trials so um so technically this is uh anything is possible technically right because if we go back to the simple integration it's about whether or not that single line of code appears on a particular web page for example um to have the client enabled and so if one wanted to make annotation available and only a single um say publication on your site it would be easy enough to do as long as you could insert that code only on that single page some of the plugins have the capability to um deliver the client granularly in that way like i know for instance the wordpress plugin has some controls that allow you to decide um where on your on your platform you want that delivered so it's certainly possible to deploy the client in only specific environments um you know you might just choose a single article a single journal um depending on a single book depending on what it is that you're doing so it's entirely possible and it really comes down to um you know what the details of actually getting the client code into your platform would look like um so uh so and in the sense of supporting trials well the basic implementation implementation that we're talking about right is um is completely free uh and you can go you can walk away from this webinar and implement it yourself uh later today if you want um if you have that that kind of access to your platform to do that um so uh you know there's a way to start a trial if you will of of the basic service without doing anything more than than just walking away with the documentation that you'll receive an email from this from this webinar um the the concept you know doing a trial of the more kind of robust customized and supported um sort of model that that hypothesis is offering is is a different question and i'll see what Heather has to say about that yeah um talk talk to me uh you know send me a message about that you know um effectively as Nate mentioned because you can deploy hypothesis over just a small portion of your content and because our prices are based on um you know the number of documents is employed deployed across um you know it's a really affordable way uh to to get started um and we have got some some offers out there with some of the platform hosts you know some of you may have heard where you can try you know for a certain number of months and and decide whether they want to keep it or not so i'd say reach out to me and let's talk about a specific circumstance and maybe that's a good way to segue here because someone had asked in what our general pricing model is for that um uh customized and supported uh model uh so if you want to speak about that generally and then how people uh can kind of talk with you more directly about um specific pricing for their publications yeah i saw that there was a question in the in the chat about if you had a thousand publications um annually you know approximate what it would cost i did look this up for someone um earlier in the week who asked about the the thousand uh document mark um and as my recollection was it was about 3700 um you know i'd have to double check that so uh you know don't hold me to it off the top of my head but um you know it's designed so that smaller publishers can participate um larger publishers who just want to try things out and and either different types of publications or or certain journals where there may be a desire express free annotation you know can do that so um we're happy to work with you and find something that meets your budget yeah and the costs are relatively low anyway and those costs are annual uh right it's an annual support and subscription agreement great so we have uh just kind of um happy to take more questions but we have just kind of one uh group of questions here left that are related um so have we ever thought about giving pub lawns to annotators the score point system to reward reward reviewers so that's something you've uh you've heard about heather yeah i mean we've we've talked with publishers um particularly in in the area of how to determine success with annotations one way to determine success might be for example number of annotations made similarly we've talked with alt metric about including annotations out as an alt metric you know what does the number of annotations on a piece of content uh you know show about it so um you know it is something that you know we'd be interested in exploring further we're also working with some some groups to actually try to look into the content of annotations a document may have a lot of annotations to say that are responding negatively to the to the content um so can you make a kind of sentiment analysis of annotations um so i think um you know we'd like to try out uh anything that um that makes sense and and kind of see where it goes that's the one of the advantages of being a startup and you know being open source and community driven so we're we're out of questions in the queue certainly um we're happy to stick around and talk more um i noticed a couple of people have dropped off um but if anyone else has a question we've got one more uh uh is hypothesis financially sustainable and can we share something about our finances so hypothesis is grant funded it's been around for about six years so far um some of our funders are the Mellon Foundation, Omidyar Network, Shuttleworth, Sloan, Helmsley um so we're we're well uh you know well taken care of in that regard we did make a decision last year to transition to um be revenue supported um so that's something that our early publisher partners and education partners which will be the topic of another webinar um you know are working with us um and so yeah we're going to be around for a long time yeah and the other thing to say there so right so we just talked about pricing right so that our financial sustainability model is built on the idea of um you know offering real value to partners uh in exchange for uh financial contributions that keep the non-profit open source project um uh kind of sustainable and but the other point about this is that unlike some sort of commercial startup operation that um you know could kind of lose its financial stability and go away um if we think about the exit strategy that hypothesis offers by uh our entire uh code base and all of the documentation that are related to it are completely open source so let's say even in the worst-case scenario where the organization of hypothesis itself went away um all the resources and assets that hypothesis had worked to develop would still exist and be publicly available for continuation in a variety of different ways right a commercial entity could take them up and move them forward uh a publisher could could you know bring all this work in-house uh and and do it themselves so the um the possibility the open sourceness of it just to be clear oh yeah no it's not possible to make it not open source but because it is open source um hypothesis as an ongoing entity doesn't need to persist in order for the technology to persist yeah but i should say um you know some folks have asked us about the business model given that you can deploy hypothesis yourself and not even tell us um and so we usually say take wordpress as an example 20% of the content on the web um is deployed on on wordpress and it's free to use but a very small percentage um of entities would like a more customer enterprise version of wordpress and that small percentage of the larger pie supports a company with more than 700 employees so that's the model that we're working towards yeah and the point is is um you know our primary mission is to advance annotation so the sustainability of the organization it only needs to happen to the degree that it can enable us to advance annotation uh technology and practices overall and so we're not we're not in a position where we need to look for the kind of profit that a for-profit uh entity would need in order to um be appealing to investors so that that enables us to have um a lower threshold for sustainability um so a couple of other questions just on the open source points though has anyone forked the code in the way that we're talking about and I think the answer to that is it's a clear yes there are organizations out there that have um that are using the code and they may have forked it and are using it in ways that uh it's because it's permissively licensed they don't have to report back uh their forks unless they want to um so they can kind of take the code and run so to speak and uh go you know work in their own sort of cul-de-sac of code and continue to absorb new innovations that come through the open source channel um they're not required to share back what they do because of the permissive licensing um so there are organizations that have done that I don't have a ready example at mind maybe Heather does um I don't have one right at hand but I know that it has happened when when folks do you approach us and ask about forking the code we always try to discourage that because of course subsequent developments they need to go back and you know pursue those separately and you know they wouldn't be supported by our main code base so in order to take advantage of the continual development and the community development the code we we discourage it but certainly um it happens um I see there's another question are there open source contributors outside our paid staff too many to count if you want there's there's some slack channels um you know that you can join and that's where a lot of the developers um you know bring their their contributions and their questions and it's just a really vibrant community uh and and maybe Nate when you um include the slides we can put information on how they could join those those public discussion channels so they can really see what's going on in the wider sense yeah and I was just going to mention um one of the greatest examples I think uh recently of that kind of um you know multiple um multiple folks participating in the open source development is the partnership that's recently uh kind of come to fruition around bringing annotation into EPUBs uh so that actually involved um partners including a scholarly press a university uh a software company that's been devoting its itself to EPUB technologies and a foundation um the nonprofit foundation that's also focused on EPUB technologies and so there's a constellation of folks oh and an additional open source project as well that makes it an open source EPUB reader um EPUB JS and so there was like you know you know five different participants um several of them contributing developers to a common effort um and so I'm just going to throw into the chat here a link to our the developers page on our website which kind of gives you access to all the code base the different community technical communities and Slack channel that Heather was talking about and things like that so and just one caveat about the developer Slack channel um we are just about to transition that to a new Slack environment that has unlimited uh space for users and channels so that's just about to get a little bit more robust the other thing that I would invite people to do um is uh we had spoken about um the annotating all knowledge uh coalition and so if you're a publisher and you're not already a part of annotating all knowledge um I'm going to share the link for it here in the chat as well and we'll make sure that will be a publisher so if you're not a publisher I'm sorry joining you may join as well oops sorry I I just shared the same link again that wasn't really helpful was it it's free to join um we just ask a couple questions about you know your your kind of commitment to to annotation we have we ask you to collaborate with others um and and preferably do that annotation in open source um interoperable um standards based way um so that others can benefit but we do have um uh commercial entities in the group that are not open source so those um joining requirements are you know flexible and I'll just point out that the annotating all knowledge coalition a k as we call it also has its own kind of slack community environment which is also free to join and that's a great place for a lot of this collaboration but technical and non-technical happens uh so I just put a link into uh where you can join that slack if you kind of want to continue the conversation um in the broader annotation community uh so we've run out of questions again and we're actually getting close to the top of the hour so we don't want to keep anyone if you want to get on with your day again if anyone has an additional question uh Matt uh saying that um slack is full um so that other slack channel will be the place to participate yeah Matt if you've you've hit exactly on the problem of why we're creating this additional slack environment so um uh and that's um it's it's coming out soon right yeah and part of the reason is we had uh we had uh it tied to a slack environment where each user you know has an annual fee and there are too many people to sustain that so we're moving it to a slack environment where there's no fees per user uh we'll send out the information on the new slack channel when we send the webinar slides and recording so exactly should be ready probably Monday at the latest well thanks everybody for joining this is the second in our series and we look forward to perhaps seeing you at in future webinars and maybe meeting you in person at an upcoming event