 Great. Thanks so much Nate and thanks everyone for joining us today for the latest in our series of implementing hypothesis for publishers A little bit about how I plan to offer the webinar today First, I'll just say a little bit about hypothesis and add a little bit more detail about how it works I'll talk about how you can integrate hypothesis with your website either on your own or together with us I'll talk about one of our latest releases publisher groups And how that works and then I'm going to do a little demo of Some of the groups that are actually live now so you can actually explore that out in the wild and then We'll have a little bit of time at the end Hopefully, I don't plan to speak too long for for Q&A So if you've not heard of hypothesis before I'm sure many of you have we are a nonprofit Open-source annotation technology company We've been around for several years now. You can see some of our funders represented there across the bottom of the screen With a lot of consolidation happening in the publisher and vendor space We think it's really important that for hypothesis to serve as an independent voice For users that we cannot be acquired So that we're not beholden to shareholders We work with our community stakeholders to advance Annotation across the web oops Sorry a little fast there. We work with the W3C To have annotation approved as a web standard and that happened about 18 months ago So what does this mean to have annotation approved as a web standard? Well If there are we believe that a healthy annotation ecosystem should have many players If many all annotation clients build in accordance with the standard Annotations that I make using one annotation client should be able to interact with annotations that Nate makes even if he uses a different client In the same way that we can email each other today, even though we use different email clients In the future annotation will likely be built into browsers So just like you tell your browser what your preferred search engine is today You'll be able to indicate to your browser which annotation client you're using and you shouldn't really have to touch it again We recently Celebrated 3.9 million annotations and we expect across the four million mark next week So stay tuned for that. You'll see that our usage goes up and down In this really currently aligns with the academic year We have a lot of students in the education space who are using annotation as part of Classroom assignments if anybody on the call is interested in hearing more about how we're working with education In our LMS integration ask me during the Q&A and either I or Nate can can fill you in on how that goes You'll see just by the the the different colors represented here on the chart about 20 percent of annotations are made In the public channel about 20 percent are completely private And then a lot of the annotation activity actually happens in collaboration groups We're eager to see how this mix might shift now that we have the publisher group functionality out in the wild So how does hypothesis work? Hypothesis annotation happens on the version of record So it keeps Readers it keeps researchers authors and the like on your site keeps them returning to the site to view Annotations that they've made there can be multiple conversations going on on one document All the same time there could be some public annotations conversations between researchers happening there There could be a class working out on the same document in a private group. You may have invited experts to add peer review or expert commentary and and other such groups and All of that can be can be toggled by the end user depending on what they've come to the document to do They can listen in on different groups So There's a couple of pieces to the hypothesis architecture One of those is the client. That's the little bit that pops out in your browser from typically the right-hand side of the screen And it's where you make the annotations and where you interact with them and then those annotations are authenticated to the server Where they're stored. So when you land on a document on the web A call goes out to the server and it says are there any annotations that this user should be able to see that would include of course Annotations that I've made myself Public annotations and any annotations made in a group that I'm a part of Hypothesis was built with the idea in mind that Organizations who are interested in running their own annotation server should be able to do that So we foresee a future where Users will be able to access their annotations Even though they may be on the back end stored on multiple servers Recently MDP I did launch their own annotation server. So those of you who are interested in maybe pursuing that We can also talk a little bit more about that with you So what is integrating hypothesis look like so there's a basic implementation We are an open source company our code base is available If there's no cost to that it's a very straightforward integration includes all of the primary annotation capabilities I'm told that it really doesn't take that long. You wouldn't even need to tell us about it We would like if you told us about it because we'd love to be able to help you be successful But that's how the basic in integration works Here is just an example of the JavaScript that you would drop into your website in order to make the tool visible Why would you want to do this? Well right now? Researchers and end-users can bring hypothesis to any site on the web But you may want to facilitate and raise awareness of the tool and you can certainly do that quite readily We also have plugins and integration available for other types of services. I mentioned the LMS integration that's coming Canvas and other LTI compliant LMS is this is very important because students can use Their student accounts for single sign-on. We can integrate with instructor grade books and the like There are accounts for Drupal, Omica, OJS, which I'll show you an integration with OJS in just a bit WordPress which of course powers a significant amount of content on the web And we also work with all of the the major platform hosts here as well as some publishers who serve as Platform hosts for smaller publishers We're going to be sharing these slides so the links in here will be clickable to you And I've provided a link here in this slide where you can see more about hypothesis integrations and tools You can also make Configurations for hypothesis. This is just an example. It's a little bit more JavaScript than just the one line that I showed you But for example, if you wanted highlights to be off by default You could actually do that in JavaScript I've got a slide coming up in a bit with some of the other configuration options and there's a link here to the full configurations For every user and every group we do provide an annotation Dashboard you can use that dashboard to browse or search for users individual tags URLs different groups and we just recently announced Wildcard search. So now it's even easier for publishers who are interested in seeing what types of annotations have been made on on their domain or on specific Path on their domain. You can you can do that. We're happy to tell you a little bit more about that as well So with hypothesis, of course, you can you can annotate on any of the major digital formats As well as data if you can view it in the browser and you can select it Then you can annotate it and one of the great things about the tool is the document equivalence So this means that a conversation happening on the HTML will carry over to the PDF and the e-pub it also means that For example Publishers who have content on multiple locations on the web, you maybe have it on your website a PubMed Central You might have it in an aggregator like EBSCO Again a conversation can span all of those locations PDFs that might be In institutional repositories or the like again, we look for in certain metadata tags PDF fingerprints and the like so that you can ensure that there's one conversation you won't miss out just because You're on one format or one location and someone else is working on it elsewhere We also have a very robust API and we think this is really a critical part of our mission You can do many many things with it in terms of reading annotations searching them creating them updating deleting them You can even now as part of the work that we're doing for the education space Create groups and sort users individual groups. So that is a is a is a big step forward As a company that's working towards, you know annotation more broadly We think this is really important that users should be in control of their data Organizations that implement hypothesis should be able to get their annotations out if they want to repurpose them for text and data mining or Display them, you know in a feed and another part of the browser You can certainly do that if you want to take them out of one annotation tool and put them into another We've done experiments across other tools and this works quite well So publisher groups just let me tell you a little bit about what publisher groups are Up until a couple of years ago a lot of the annotation activity as I mentioned was happening with students and individual researchers Certainly publishers were keeping an eye on what was happening in the space Eli approached us and they basically said hey, you know, we think this is a great tool But there are some things that we believe, you know, we would like to have in place as a publisher We think other publishers would like and they generously Worked with us to develop these features. So for publisher groups. This is something that we work with you You can't do the full publisher group set up without us, but we're happy to work with you on it We use a document based pricing We want to make sure that publishers of all sizes can actually participate and use Hypothesis so this it scales the more documents you put in the cheaper it is per document We use the amount of content that you add in a year as a proxy for publisher size We found that this is a little bit better than using a per journal fee because Some journals in the humanities and social sciences might add a dozen articles in a year Well, some articles in the science that hard sciences might might add, you know, five thousand So we look at how many you add per year or how many book chapters or entire books You want to deploy across and we just use that to to gauge your publisher size You can still go back and deploy hypothesis to volume one issue one or to your earliest copyright year The great one of the great things about the tools that works backwards as well as forward if you have your own account system Though a lot of users are are already working with we can integrate with that few single sign-on and OOP We've got a couple different types of publisher groups Which I will show you and working with us enables you to have unlimited groups of different configurations Open groups that anyone can join world readable on your page and world writable As well as restricted groups that maybe you have for a specific purpose Where you control who will be able to annotate to those groups, but everyone who lands on your page will be able to see those annotations customization customer support open-source maintenance so we can ensure that we can keep improving the code base and the community that's working on hypothesis can benefits from those improvements and Really one of the important things that Nate and I work on and talk about all the time is each publisher You know is is selecting annotation for a specific purpose. So what does that success look like? What have we determined around best practices? What kinds of training and outreach? What types of activities you can do to encourage annotation on your site? So let me go out of my presentation here and Actually show you some publisher groups So I mentioned elife here is an elife article and You can see if for those of you who use hypothesis yourself the elife integration looks a little bit different And elife launched this beautiful new platform shortly before annotation went live and they really wanted to have Annotation fit in with their page and we believe, you know publishers should be able to customize the site So that's one of the things that elife supported the elife integration Connects to elife accounts as I mentioned as a possibility. So anyone can participate in this group They just need to make a profile on elife Have your orchid handy if you want to do that and experiment with it You see at the top of the annotation pane the elife branding another feature that we developed for elife is Moderation flag so that publishers who host their own publisher groups can moderate annotations that appear there I will point out that we do have a moderation flag in the hypothesis public channel. We take care of that ourselves But in this case if I were to click the flag and email to go to the designated Moderator at elife to be able to review those annotations I know that elife also uses the the API so they can monitor in real time Annotations that are made across their site So they can take a look at them Some of the ways that elife has promoted annotation are authors updating their articles Certainly we see interaction with with end users and this article as you can tell by the bright red banner has a correction So I like to show this one because the elife actually added more information in the form of an annotation card as to what Precisely have been corrected in this case. It was a missing citation here. So it's a it's a great use to show you So again, this is an open group Then we have publishers you have More specific annotation needs in mind when they come to us And for them we offer restricted groups So the American Diabetes Association every January they publish an update to the standards of medical care and diabetes And they wanted to have a mechanism to add Updates without waiting for the next year to come around. So we created this restricted group It's again, it's visible to anyone who comes to the site The the sidebar is open by default. So everyone will see these updates And the only folks who can actually contribute annotations here are the staff of the American Diabetes Association that oversees these We think they did an amazing job with this integration They really treated each annotation as a first-class research object So you can see the date that the annotation was originally published You can see the date that the annotation was approved and they've provided a suggested citation as well as some helpful tags The links here go to other items within the publication in some cases external sites And others and you can see if I scroll down here that they've even included a glycemic table there Now the American Diabetes integration uses hypothesis accounts in the back end. So in addition to the group you also get The dashboard or activity page for that. So this is a where a place where readers can actually Look at all of the annotations that have been made across the domain. This could also be across a given journal It could be across a book It's completely up to the publisher and folks can go in and actually see what other annotations are there Visit those annotations in context and explore them that way. So this This was our first restricted group that was launched this past spring Another example of a restricted group is a project that we did together with Cambridge University Press And Syracuse University's qualitative data repository This is a project that is called ati or for annotation for transparent inquiry And it's designed to provide transparency around citations in the social science to help the authors of those publications Just provide more information And some of it because of funder mandates others because maybe space constraints kept information out of the publication so you can see if you scroll down the authors have been able to add these detailed notes around Text that might just be you know one line in the text and in one citation Information about their sources their methodology and the like if the original information came from another language authors could for example put Translations in here. You'll see in this second example. There have been other sources in in russian That the authors have used There's a link back to the data As well as some other citations The it happened that about a dozen of the articles that were worked on in the original workshop With qdr were across cambridge publications. So we launched this group with cambridge There are other articles with about five or six other publishers. So we're in the process of making those annotations visible on top of the content on those publisher platforms Again because this uses hypothesis accounts in the back end There's access to a group activity page Where you can see all of the articles that have been worked on as part of the project And you can go in and see those articles and the like So we thought it was a really amazing use case and we're really excited that this workshop continues this fall across What it will now in effect be preprints so that the annotations that the authors add around their sources will be able to inform peer review Speaking of peer review. I just want to show you one more example of a publisher group This is an interdisciplinary journal called murmurations that we've been working with and this is hosted on the pkp pkp version of ojas platform and the This journal is is is really focused and centered around open peer review So they've made for each article. They have what's in effect a restricted group Where the author the editor and the reviewers can participate in the group Have a conversation on the manuscript We scroll down here a little bit. We can see how the how the replies look and then Once the conversation is set. It's there. It's world readable for folks who come to the journal And we're exploring how we can expand this type of open peer review Perhaps with with other interested publishers So these are just a few examples of of publisher groups in the wild, but we're happy to tell you more about any of these Let me just go back Into my presentation almost done Let's see here So Just wanted to tell you a little bit more detail about what comes with the publisher groups as i've mentioned that is the paid service Currently you can customize a number of things here You can see, you know colors borders type bases Highlights calls to action And you can also customize not on this slide, but the behavior Of the sidebar so you can decide whether you want to open by default or close by default You can control the width, for example We want it to really fit Into your site so that it looks, you know belongs there We want to work together as i mentioned in an engagement strategy This usually a conversation starts even before An agreement might be in place You know, what what are your problems that you're trying to solve through annotation What types of assistance we can give you From our side and what we're learning from all of our partners and we're happy to work together You know with you on promoting The capability that the capability has been added to your platform. We'd love to work together with you in webinars Conference panels and to put together case studies and white papers on how you are using annotation Part of the collaboration is of course support and the open source maintenance fee There's a lot of work that our engineering team Puts in to regularly improve and maintain The service It's something that you know, we're focused on The end user and and what their needs are all the time We're very strong believers in standards as I mentioned in interoperability for the future of annotation tools And we heavily support the community around annotation We do We started in 2015 A coalition called the annotating all knowledge coalition, which is free to join. Um, it currently numbers more than 70 publishers platform hosts technology companies and also universities And every year we host The largest conference in the world that's dedicated to annotation Coming up in the spring. It may be on the east coast this year. I've heard a rumor But it brings together folks from all of the different verticals who are using annotation many many different annotation Tool providers and we have a lot of unconferencing time in workshop sessions Where you can dig in deeply as well as a as a hack day So if you want to learn more about that, don't hesitate to contact us there Um, I just want to mention that we offer, um, you know full analytics So if increasing engagement and learning more about that engagement is is one of your needs around Embedding annotation, um, you know, we certainly can provide you a lot of detail for every annotation That's made that's publicly viewable You'll be able to see who made it when it was made on what document what the selection was and what that particular user had to say For things that are private or part of private groups. We can still give you, um information You can see when an annotation was made and on which document and which part of the document So it's still a valuable metric, um to to look at, uh in engagement and attention Um, one of the things I really didn't talk about today because it's not connected directly to publisher groups is automated entity annotation For example in, uh, I think about 125 journals in the neuroscience space They use for reproduced reproducibility purposes research resource identifiers And so we have a group out of uc san diego that created an account called cybot You can see it here in the little in the legend here the purple and when um, there are our ideas located in a paper Um that resolved, uh, two external databases the cybot account automatically looks for those and brings them up in form of annotation cards So when we're showing publishers their annotations, they do have publications, um in that, uh, discipline It's quite likely that you have cybot annotations over your content that you might want to make visible to users But you can also see the breakdown here If there's uh, if there are groups, um, we can show you, um, what the breakdown is in the activity between private and group annotations and now that we have the The publisher group functionality, you know, we'll be able to provide even more detail across that We can give you information on the number of users a number of monthly actives a number of documents You know really as Nate likes to say we can probably give you information on everything Just let us know what's going to be most useful to you. We'll work with you on that Um, I just wanted to close, um, you know with a quick, um slide It's impossible to keep these things up to date, but these are some of our partners that we're working with Um, uh, university of california press, which just announced is not on here yet Neither is mdpi. So we'll have to be updating the slide Shortly, but you can see, um, you know a wide array of different partners across the humanities across the sciences both books and journals around the world that we're working with and We'd be very honored if you'd consider Joining us and adding your name to this list That is all that I have in terms of prepared slides, but i'm happy to take any questions Hey, heather. Yeah, we've got a couple of questions that have come up in the chat already. So, um, kim has Asked if we have an example of a site that's restricted in the sense that a reader submits a comment And then the comments reviewed by the site editor and released or not released depending on its content Yeah, we have had, um Requests for that. Um, we call that uh in our internal internal terminology pre-moderation Um, right now that the moderation capabilities I showed are our post publication moderation, um, we are looking at, um, doing that doing something in that space, um in 2019 So if that's a particular, um use case, um, that you'd like to explore, you know, let me know and we can talk about it further I mentioned that you can utilize the api and you can utilize the The group activity page to see real-time, um, annotation happen So our publishers, uh, who have groups with post publication moderation do frequently use Those mechanisms to see what's happening on the site And they can, you know, review those annotations and if there's a if there's a problem with them They can flag them and take care of them right away. We haven't, um, noticed, uh, a We've there's barely been any instances even in the hypothesis public channel Where annotations have had to be taken down We know as awareness spreads of the tool we we certainly, you know, expect that to happen We know that in some disciplines it's a larger concern than others But, um, again, you know, we want to reduce the amount of friction that there is for users to get started in annotation and We're happy to give, um References from publishers using the post publication moderation if you're interested to find out How that works for them and whether they feel that's sufficient Great. Um, and then also in a completely different direction from craig. Um, he notes that, uh, It seems like hypothesis is optimized for desktop use and is wondering how it works in smaller devices Yeah, so I do use, um, hypothesis on my phone. I have a, uh, an iphone Six s it's not very glamorous. My kids all have better phones than me Um, so part of it depends on your comfort level with the size of your screen It definitely works. I'd say an ipad mini or an ipad. Um, it works beautifully. Um, we do have, um, some new Developments, um, you know that that we're thinking about in terms of how to make that mobile Experience, um, you know more more adaptable and and work more smoothly Um, and we'd love to hear your feedback on that but I do use it myself Uh, and I'm happy to say that as long as you have a modern phone Uh, you can definitely take advantage of hypothesis Yes, and I'll just say that um, I also use it on mobile and I do find that, um You know the reading experience of annotations is possible on a smartphone Fairly comfortably, but just due to the screen real estate. It's a little bit harder to also make annotations And so a tablet, uh, you know moving up to at least the tablet size screen space helps with that quite a bit The students they're so adept though. They can probably make those annotations like a like a charm Yeah, maybe they have more nibble fingers than I do Uh, so other questions folks, um I uh shared your email Address is also up there on screen heather for people who are interested in making a more direct connection especially around references, um For the moderation or other issues. Um, so I've asked folks to get in contact directly Yeah, we also have a lot of information, um available on our website, um, which is As hypothesis at the publishing page as well as the we have a developer's page as well Which has a lot of information on documentation for the for the api We've got some, uh, annotation Initiation technology embedding best practices there. We've got 10 questions You may want to ask yourself if you're selecting an invitation provider I have a five minute demo from a researcher perspective Um, that's there, uh, so lots more that you can find out You