 I think it's time to get started and let me welcome everybody and thank you for joining us. I'm Cliff Lynch, the director of CNI, and you've found your way to one of the project briefings for our Spring 2020 virtual member meeting. I want to note that this is one of a small number of additional project briefings which we added after we made the decision to move to a virtual meeting and we called for and selected a small group of additional project briefings that were specifically addressing aspects of the current crisis. We'll have two talks today, one by Lisa Hinchliffe and the other by Christine Wolfeisenberg. After we hear from the two of them, we will take questions. There's a Q&A button at the bottom of your screen and feel free to queue up questions at any point as they occur to you during the presentation. Diane Goldenberg Hart from CNI will pop back up at the end of the session and will moderate the Q&A. With that, I'm really looking forward to hearing about this. We were joking just before we started that back in the old days you don't spin up a large-scale project like this in zero time typically and welcome to the new normal. I'm also really fascinated to hear this because I've had a relatively close-up view of some of the attempt to understand this response specifically within the ARL community which is actually a very small and very special community within a much broader universe of academic libraries. I'm really interested to hear what our speakers have learned about the map of that broader response. With that, thank you all for joining us. A very special thanks to Lisa and Christine for being willing to not only spin up a project like this in no time but to report on it in almost no time as well. Over to you Lisa. Great and thank you Cliff and thanks to everyone who's joining us here today. It's unusual as Cliff said that we would be spinning up a project much less be presenting on it but I think this is the CNI way right that what we value especially about CNI is is our cutting edge often view of these things so we're cutting edge for sure these days. The presentation today is about our project which is academic library response to COVID-19 and we're particularly going to be focusing on this whole idea of designing and managing real-time data collection and dissemination. Through this project we have been using the hashtag COVID library and so we'd welcome for you to include that hash if you are tweeting about this session because you will then become part of the Twitter scraping project that is also going on related to this work. Christine is going to be advancing the slide so I want to also share with you in case you are a multitasker the portal for this project is at this convenient URL of tinyurl.com slash COVID library where you can see the breadth and range of activities that we have underway that we'll be reporting on here today. So just a quick overview of this project it is a real-time view into the evolving strategies that U.S. academic libraries deployed in spring of 2020 which really at this point means in March or April of 2020 and by real-time I want to emphasize that we were collecting responses continuously and still continue to do so via the survey but not only we were collecting the data in real-time we were disseminating it in real-time and so as soon as the first library submitted data there was a data dashboard where people could begin to see what the results are. So in addition to this real-time collection on libraries we've also been collecting data on the status of classes and the status of residents and at this point we believe we have the largest data set as well on the status of institutions as far as classes and residential facilities in addition to library policies and services. We've also done some immediate analysis so there's disseminating the data on dashboards there's immediate analysis and then we'll talk about our long-term analysis as well. So we're going to review how did we get to this how do we manage this because you know Christine's in New Jersey and I'm in Illinois all the ways we've communicated the results and what we've learned. The impact of this project is best that we can assess so far and where we see potentially taking it for next steps. So survey development and deployment this was a 10-hour development process from idea to collecting our first data so this is the tweet that started it all as we say which was Christine asking if anyone was collecting how academic libraries were responding. Christine had been working with Brian Alexander on a Google doc spreadsheet that was attempting to capture what institutions were doing as far as classes and I think I have no doubt that's what made her thinking but we are also starting to see already within 24 hours of institutions shutting down that libraries were starting to say what are you doing what are you doing does anyone know right this is immediately what we want is information from our community of practice to inform our strategies. So Christine and I got on the phone about 20 minutes later and we started work so Christine next slide we got on the phone and I said we could do this and this is the fun part of the story where Christine said yeah I think we're going to have this you know in the field maybe by early next week and I said we have to do this today it has to be out tonight and you know this decision to deploy rapidly has some really important implications for this kind of project but it was clear to me as a practitioner in academic libraries that five days later was going to be five days too late and so we needed to really get going on this but also if we were going to collect data we learned some lessons from other projects that were already spinning up and honestly some of them that were crashing so Brian Alexander's Google doc usually Google docs are great for crowdsourcing content not great when thousands of people are trying to use it at once and an immediate point in time. So here's some of the design strategies we had in thinking about what kind of survey data we would be doing keeping it short and focused people needed to be able to fill out this survey quickly everyone was incredibly busy I think it's even hard to remember quite how intense and urgent everything felt on March 11 12 and 13th. We also knew we wanted to embed unique identifiers so that data would be collected in a way where we can analyze it and we all know that if you ask people to put in their institution name it's amazing how many different versions of its name institutions have. Fortunately in the United States we have the iPads and ID for every institution and librarians are great about metadata so we could ask them please go get your iPads ID put that in and so we could have a unique identifier in each response set. We knew we wanted fixed answer questions for immediate analysis so if you really want to disseminate the data back to the field you need to do it in a way that can be visualized because once you get over 10 responses qualitative analysis is no longer on the fly possible in a way that's going to be really helpful. We did however give the option of other repeatedly throughout the survey and of course those while then available in text form were not immediately analyzed onto the analyzed onto the charts. We also realized that we wanted to allow retaking because it was already the case that a decision that was being made on Tuesday a new decision was being made on Wednesday and that was part what the stressing Brian's spreadsheet and some of the other pieces is because they didn't have a way to account for the fact that things were changing. So we accounted for this by saying you can take the survey as many times as you want and that's turned out to be really valuable because it's why we can actually keep the survey open and we're going to be able to track libraries reopening with the same survey instrument because we allowed for the retaking and then as I said we wanted to disseminate results immediately. So how did we get there? We had kind of two steps in our process which was conceptualization and library community input and feedback. So in the process of designing the survey conveniently I was supposed to be traveling that day to a conference and so rather than being on airplanes and in airports I was consulting with Christine and developing the survey while she would go to meetings and then between her meetings we would get back on the phone and confirm that we were ready to take the next step. So obviously we have general knowledge of core user services and key issues. I work in an academic library. I've worked in one for more than 25 years. Christine leads up the Ithaca SNR surveys work. We know a lot about what goes on in academic libraries but people have asked us well why didn't you cover public libraries and special libraries and partially it's because the issues are differently but partially it's also that question of expertise and we knew what to ask this particular community and we knew that this community wanted to hear from other people in that academic library community. We did a very rapid literature review where I consulted the literature on library response to crises and disruptions. Fortunately or not it's actually relatively small literature and the other thing I quickly realized is that most of that literature is talking about how you are disrupted in place and you relocate your library so you have a fire so then you move the library to the student union or you have a flood and you only have certain service points open. That is not what we were doing in a pandemic. Everything was closing so there was no changing the library to another place and so that impacted our design as well and then we drafted basic survey questions based on partially the great Ithaca SNR surveys that are out there so we already knew some of the ways to format these questions. Later that afternoon then we actually did two rounds of feedback from the user community. We first put out a Google doc with our questions and the responses with the opportunity for people to be able to comment on it and we asked them to do self-paced cognitive walk-throughs where they would go through it and see if they could answer it. They could annotate and write us comments in the margins and then we also asked them to direct message us back on Twitter is how we were doing most of this work and then once we programmed it into Qualtrics which is our platform that we're using we solicited some pre-testers and we tried we were going to have like two hours of pre-testing. I tweeted it out and within 20 minutes we had twice as many pre-testers as we needed so I just also think that that tells us the degree to which the community was really hungry for this because they they really helped us do this rapid design process. So at this point you might be saying how did you actually pull this together so let's talk a little bit about managing it collaboratively and what that took. Key practices here holding regular check-ins. Christine and I were checking in with each other almost continuously especially the first week of running this. We we also had the great fortune that Ithaca SNR was able to spin up a guest account for me on their Slack instance and so I currently I'm slacking along with Christine and her colleagues in a special area there so that we could use the same practices that the Ithaca SNR always uses and could plug me into those but we also have Twitter and phones. Yeah we've done a lot of different communication mechanisms. We really had to also be explicit about committing to decisions so in the you'd always need to do this when you're developing a project but we had to really do it fast when you're doing this in 10 hours of development of have we decided this and are we ready to move on and being both committing to the decision but then also moving on from it and not revisiting it. Acting independently became therefore possible because we were so in touch with where we were thinking what we were thinking what we committed to that if we through the process got a media interview request or somebody seeking information in many cases we were either able to consult immediately or we knew and could be confident that we could act independently of each other in a way that would be in concert with us. We also thought it was really important that throughout this you'll hear that we incorporated other perspectives so we got the two sets of feedback from the community we had in every case where we wrote an analysis we were fortunate to have Christine's colleagues at Ithaca SNR provide essentially a quasi peer review for us like does this make sense can you understand this can you comment on it and help us strengthen our analysis and then we also just really had to seek the support of each other and others Ithaca SNR obviously but we also had a large group of people on Twitter that helped amplify the call for people to submit responses and so our willingness to say to other people we need your help was a really important part of this as well. Great thanks Lisa so I think I'm gonna gonna take it over from here for a little while to talk a little bit about both how we communicated the results and and actually what the results were we've been kind of talking talking about the process we'll see what some of the some of the outputs were we'll talk a little bit about how we've you know tracked the impact and then we'll talk about next steps and then we'll open for for Q&A so um as as Lisa mentioned you know getting getting the data out there in in real time was was one of the most important principles of of this of this project and in a in a minute or two I will provide examples of each of these that I'll just talk through really quickly so we started out initially with just one real-time data dashboard which I'll I'll show you in a minute which had results broken out by here are the institutions that were entering the responses for a first time and here are the institutions that are entering updates started out with just one and I'll say what happened to that in a second we published written analyses 24 hours after results were collected after the next 48 hours after that and then the 10 day changes that we were able to log from initial entry to an update and again to just emphasize really what Lisa said earlier it was you know really important that we weren't overriding the data when an institution gave us an update we're going to be able to do even more in-depth analysis later on to see how things changed over time not just in the aggregate but within individual institutions and how long it takes to move from step one to step two to step three approximately we also as as Lisa mentioned we were frequently tweeting out key findings key graphs linking it all to the COVID library hashtag spoke with with a number of media contacts the Chronicle library journal inside higher ed I think I think those are the three the main three and then as I mentioned what started out as one data dashboard grew quite a bit as you'll see in a second so there were a number of individual questions that were tweeted out and organizations that came to us asking you know what is this part of the sector look like or I wonder what's going on with the libraries that have closed or just the libraries that are actually still open and so each time if it was um you know worth if it was worth pulling together that dashboard we not only did it for that individual person but we also then made it available at this tiny URL so that everyone can now can now use it so we're going to go to the the tiny URL now um so it's tiny URL.com slash COVID library hopefully pretty pretty easy to to remember here so just to to walk through the the webpage a little bit here um some basically information about about the survey itself obviously a link out to the survey so that people can continue to fill it out or fill it out perhaps for the for the first time so this is how how folks can do that and as Lisa mentioned it starts out with you know please go look up your iPads code please look up your iPads name and um you know there's some some cleaning of the data that needs to happen later on but by and large uh this has worked actually pretty pretty phenomenally and so the survey the survey goes from from there we also in addition to just the the link to the survey itself we have all of these dashboards and results that we've been been talking about here so the first the first dashboard um of all libraries as as the surveys are submitted which is the case for all of these they're all automatically updated in in real time is here uh we'll see what the current the current total is um let me minimize my zoom my zoom view uh we're up to about 847 uh institutions represented in the in the dashboard that's what we're seeing in the first row here um 590 times there's been an update logged for for some of the institutions that have participated in the survey and this is going to be an outlier that I'll throw out but some institutions have come back half a dozen times to log updates like every time there is some little change in policy or service model they'll come back and that's that's fantastic I think more so on average we're seeing more like one or two updates um but yeah if it'll be so fantastic we've done done some analysis already of the changes over time but that will be a really really robust part of the data set to dig into more and so here we have we have responses to to all of the questions that were in the survey with the exception of at the end of the survey we had a kind of a contact section where someone could leave their name their email address really was only for us to be able to follow up to ask them to log an update but not really for for public for public view so we've got mostly closed closed-ended responses as Lisa mentioned we also have um we have some open-ended uh responses here so we asked a question for example about you know what's the status of your of your policy on employees working remotely we have a follow-up question about how that policy affects different employee groups we also have an open-ended question asking folks to link out to websites where they might have information for library users on policies and procedures and so this is all all available here and this represents all of the institutions um in the data set and then of course we have a number of dashboards that are for parts of the parts of the data set so we have libraries at non-residential institutions which for our purposes is meant to be kind of a proxy for community colleges it's not a perfect one-to-one match but but quite close actually we have dashboards for for ARL institutions in the U.S. Hottie Trust academic library members in the U.S. and then a number of other other dashboards that are based on the status of libraries being open or closed in terms of their buildings and then a subset of that for ARL institutions as well. I'll just highlight a couple of other things on on this page so Lisa and I were were frequently for a while there tweeting out data graphs and one thing that's really I this is kind of an aside but one thing that was really interesting and and challenging at times was to be able to put out a tweet that was adequately capturing exactly what that graph meant and so that that was a really interesting challenge I'll explain why in a in a second so here's here's one of those those tweets about what the status of library buildings looked like over over time and so this you know I want to want to say one thing here which is the importance of why we needed to launch the survey when we did if we had as I suggested waited in a couple of days you know we would have missed this whole point of time when the the majority of responses were that libraries were open usual hours and so you can see how it trends kind of from that being the the predominant state to some kind of middle state where some are open some are open modified hours some are closed all together and then it trending towards towards entirely being being closed and one of the things that was interesting about you know tweeting out graphs like this where you don't have a whole long narrative explanation is that for example here the the dates that are here are actually when responses were logged and not necessarily when the action was taken from the from the library so from a from a communications perspective that was that was really really an interesting thing to to try to address there's a lot of other stuff to dig into here all kinds of tweets we have our media coverage as that as that occurred other tweets that we sent along the way and then other other library data collection efforts so from public libraries in the u.s. law libraries rare book libraries aero specifically and then those outside of the u.s. so canada the uk australia and and europe if you have something that you're working on that would fit into this kind of category we are probably not as frequently as we as we once were but we are still updating this there's a dash four that we added just earlier this week or over over the weekend it is it is something that is still still evolving as the survey evolves as we continue to get additional additional requests so i'm going to head back to back to our slides here i think you actually went over the fact that there is a category there with all the links to the analysis that we wrote oh sure yeah so this this links out to all of the blog posts that we wrote along along the way the first 24 hours the next 48 hours the first 10 days of responses and then the the backstory which is kind of kind of a version of what this talk has been has been built out of about what we what we've learned about working collaboratively together um yeah so i'm going to head back to to the slides here so i've showed you the different kinds of kinds of outputs how we've organized the information but what i haven't really talked about actually is is what we what we found in the results and so i'll go over some of the high level findings as you'll hear in a second there still is so much more to to dig into um so the the first is just that the campus practices and policies really waterfalled to the library which is that um it wasn't always the case that an institution decided to move instruction online and at the same time the libraries decided to close their buildings and that all services went went remote as well and so there was often a period of time where there was a little bit of a lag in between the first action the second action um it also wasn't that all of the you know if it was a multi library multi location library system it wasn't that all of the changes happened at once there was a certain sequencing of of events that happened um so as you as you saw in the the visualization that we that we tweeted out um libraries moved from being open to partially open to closed actually quite quite rapidly um there's a really quick pivot to um digital reference digital instruction um obviously there for for many institutions this was already a part of the service model that just needed to be made a little bit more large scale more robust um probably needed to to change in some ways but there was at least some some basis for it and so those those really quickly um spun up into into into services in that format and then by necessity the the remote work policies changed um so the the share of um of libraries that made changes to who could could work remotely and how that could be done changed very very quickly which which makes sense most institutions uh once library the library building was closed reported no or very limited access to print resources we know that there still are some libraries that are that are open in some kind of a limited fashion but by and large um that um that became limited very very quickly and we didn't see any major changes really or very many to um to tech lending practices and and Lisa and I have talked and it's it's entirely possible for example that this was a case where the um where the IT office or department took over and started lending lending out equipment um you know if the physical library was closed and not circulating anything um it doesn't seem that seem that um tech resources were were being lent so in terms of of tracking impact so Lisa and I have a very fortunate we're very fortunate to have a very long google doc running um of all of the uh the things that we could capture about how impactful this project was and so we haven't you know systematically tracked or analyzed this in any way but um these kinds of testimonials really uh you know kept kept us going in the first week or two when I think this was probably most of what we were doing in our in our free time and uh you know really heard from people about the ways that they were using the results for um for both advocacy so so trying to move their library and in most cases towards closing physical locations and um and also for for planning purposes right so we we can't claim that uh the results in the survey represent best practices but they they are the practices that leaders you know across the country were were implementing at a certain point in time so they can at least be used as um a benchmark or or a set of set of guiding practices against which one can can compare and then last we're just going to talk about some some next steps and future plans so I'll start out here and then and then hand things over to you Lisa so I've got this big question at the top here how long to collect uh the the data for is the the biggest the biggest question um honestly and and we've been giving the kind of the same kind of line for a while now which is as long as it's useful and so it still seems to be useful that we're we're collecting these data um as Lisa said the great thing about the the instrument is that we are asking for the current status of policies and services at a moment in time and so we could it's entirely possible for us to continue using this instrument we might want to add in a couple of additional questions but we could continue using this into the fall as institutions start to to open back up or or change their um their services within the library at least so um you know probably still to be to be determined on how long to collect but we you know it's still it's still open we'll have the URL back up for you in a second if you haven't yet logged a response um so that's that's something we're still uh you know we still see see value in that um so after after some period of time of data collection there's there's still a number of additional steps that we that we can take here um as Lisa mentioned we tried to tried to keep the the responses as closed-ended in terms of the options as possible so we could feed it back out um in a live live format um but there are many many open-ended responses as you saw in the dashboard um not only in those two questions at the end but also in um all kinds of other responses throughout the survey that for many of them probably need to be actually recoded to an existing category and perhaps have just a little bit more detail than what we were asking for we also can be pulling in all kinds of additional data and honestly this list we have two two parts listed here this list could probably go on go on forever so we will want to pull in additional data from from iPads on the sector of the institutions probably geographical region um a number a number of other other variables certainly that will want to pull in to be able to actually um disaggregate and stratify by different different parts of the sector we'll also want to um to gather supplemental data so a timeline of statements from library associations or or perhaps from states that issued issued mandates related to their library and to see how how the decisions lined up against that and the kind of effect that that took place Lisa do you want to talk about the last the last couple here sure so in addition I mentioned at the beginning that if you tweet with hashtag COVID library you end up in a Twitter scraped uh uh tweet set um this is not something that Christine nor I had the ability to um do at the beginning of this project nor in the middle of this project if we feel we could learn how to do tweet scraping but it turns out there's a number of people who do this as a matter of course and it is an amazing Twitter library community so um a number of people just added the COVID library hashtag into their Twitter scraping thing so out there are some data sets that we'll be able to to draw upon and a couple of people also um it grabbed every tweet that was either to or from me or Christine for 10 days so we can look at the dialogue that the community was having with us as the PIs on this project during those early days because I I know people were giving us advice and asking us to do things I honestly it's a little bit like any kind of stress moment I could not I could not bring those details out of my head right now so I'm looking forward to actually going back and reading that dialogue um so that's going to be important too for contextualizing the data about sort of an on the ground what was going on at least in that conversation um we we do want to look systematically about how the survey results were utilized while we have these anecdotal responses to us on Twitter or through Facebook messaging or any other number of emails we feel that there's an opportunity here to learn about the ways people use real time data in decision making so hopefully we are not going to need real time data in a pandemic ever again um I feel like I have developed a very niche expertise that I also hope is never necessary but there are things we could learn from this about what kind of data is useful in real time um you know did we make a mistake by giving people the option to say other should we have just only given closed-ended responses and then made the questions optional if you couldn't answer like did that create confusion or was it helpful so I have some questions about that but I do think would be helpful in other kinds of real time decision making processes um and then I think we also can extract some implications for future crisis response in sort of an organizational response to crisis although we don't typically have global crises happening we do know there are times when for example in cases of large natural disasters where entire cities are wiped out that you're not going to be able to do a pop-up library or in the cases of a war or some sort of other destruction and so there are implications here I think for organizational crisis response um including one that we don't have on a slide here but that I personally am very interested in that early on we saw libraries reporting whoever was filling up the survey was reporting that one of the strategies that was being used was regular communication with the staff now I will admit that I was a little surprised at that not being a a more utilized strategy right even early on I thought surely I mean it seems easy right regularly communicate with the staff but what's interesting is as libraries started to report closing that strategy stopped drop started dropping in the percentage of people responding that they were using that strategy I feel that probably they were getting more emails and the like but somehow psychologically it didn't feel like regular communication and so this is a me with a hypothesis or a research question here of what is regular communication like what does that mean when we say regularly communicate I mean we often hear people say I wish there was better communication what does that look like and what does that particularly look like in crises um and we this is like a very fascinating sort of very small piece in here of people saying that there was a strategy being used that then wasn't being used and yet our observation is objectively more communication or more messaging was happening so you have more messaging anecdotally but you have this other sort of trend in the data that says people were not feeling it I guess and so we really all right I've gone on too long about that but I'm just fascinated by the hat and I and I think that has implications for even just regular operations when we say we have regular communications do people feel that that's what's happening so there's so many things that are here I think the other thing if I could just say one of the the amazing things about this survey that I I take some pride in I guess I would say with Christina as well this survey you know it's not uncommon to field a survey and have a bunch of people write to you and say they don't understand the questions or I think we got three queries about what did a question mean so um part of it's because it's short and simple and these were very focused but I think it's also that testing process that we did um but it's really stood up to um to users taking it in a way and then people seeming to really understand the results so as Christine said sometimes when we tweeted out those like that particular tweet and chart she showed I think we spent about an hour getting that tweet right to accurate not misleading um in 280 characters plus an image so all right I think our next slide say questions and comments so oh and ps please continue filling out the survey um great yeah so I think we'll leave our contact information up here in case folks have to have to be somewhere else but um definitely happy to stick around for another you know I think we've got some some time for for questions for a little while and I think there are some so I'll let um Diane maybe okay question definitely some questions and great plug there at the end Lisa keep filling out that survey folks and um and thank you to Lisa and Christine for that great talk fascinating really to hear about your process all the things you discovered and uncovered along the way and undoubtedly will continue to do so as you dig into the data that you've collected and are continuing to collect just amazing work um so with that I will go straight to some of our comments and I think it's interesting that really what what is on people's mind is you know where do we go from here and so um the first two comments slash questions relate to that it's I'll read them both back to back because I think they relate so Boas writes uh first of all this was very useful uh thank you um and very useful as we are considering how to approach the situation in the coming weeks and when we hope to begin to reverse the situation I assume that you will develop a new set of criteria such as libraries that opened and had to close again and for what extent of time it'll be wonderful to have a way to have an accurate read of when such actions occurred and who is responsible for answering the survey and he notes we had several people possibly answering on our behalf also maybe some ways to reflect on challenges such as changes to staffing or the library resourcing also I'm particularly curious about the ways by which libraries will address their approach to the wider community outside the campus and perhaps related to that future looking is a comment from Rebecca who writes this is amazing work I think it will continue to be incredibly useful especially as things start opening up slowly and cautiously to see how libraries are making that transition back and what new policies are in place to protect people staff and visitors and regular of course is very subjective so a lot to think about there I hope it was okay that I that I bundled those but I think they're related yeah so I think one of the things that because we designed the survey for retaking so um libraries can take the same survey reporting on these same factors and their answers will just change from so for example um my campus went from the libraries are open as regular to we have limited but we're still open like some library locations have closed but not all two we're completely closed um what I understand as our campus intends to do if you will a soft reopen so then I would expect that we'll have a soft reopen in the library so we'll go back to some are open but not all before we ever go back to all are open and so what will change then which I think is what is the new set of criteria it's really the new set of like the kinds of data people will be interested in us reporting out so when we do say like a three month analysis of you know first response middle response to end response we'll probably see some sort of swing so it's more in the analysis um so again it's the instrument itself is actually robust enough to handle reopening interesting and I guess the the other thing that I'll add yes it was entirely possible for multiple people from the same institution to be to be reporting one thing that's um again really nice about the data not being overwritten is that when no changes occurred between multiple steps we can kind of uh you know not not ignore them but we can consider you know the first state and the last state of the of the library recognizing that things may have been um you know entered by by different individuals um as far as the um changes to staffing and resourcing I think actually would be kind of inappropriate for a survey like this that's the kind of thing that I imagine we would need to to go to um you know someone in a leadership position to do so so at at the Gassner we're going to be fielding a um a survey of library directors uh later this summer and to the fall to get at some of those those issues that um probably those those individuals would be the only one position to to answer um from it from a certain from a certain kind of perspective about um what what ended up being changed and I'll I'll just say you know anecdotally from from conversations that we've been having I think I think there's still still a lot of uncertainties so to have anyone you know speculate now about what that's going to look like even though you know of course of course there is speculating going on and and um you know responsibly there's all kinds of modeling going on right now I think there's just still um there's still so much work to do and um you know see how what enrollment looks like in the fall what state funding looks like in the fall all of all of that so if I can say um I'm gonna share something about something just put out by Christine's organization today but I put a URL into the chat um Kimberly Lutz and Roger Schoenfeld apparently I learned from the summary um have been running some roundtables with library directors at four-year institutions um and this is a more qualitative uh summary look at what those discussions sort of say as far as what library leaders are facing um which I think it's a little bit more to the kinds of things that Rebecca was asking about the and kind of reinforces Christine's comment that um the kinds of questions we might have for individuals of how are you thinking about these things are not the kinds of things we would collect on a survey about an organization or institution um if I may add because I've been asked a couple times like how did you get IRB so fast for your survey one thing that's very important is to recognize that the survey Christine and I did was about institutions and so it is not human subjects research when you start asking people if we if I were involved in a project where I started asking library directors how they are personally thinking about strategy that would be considered human subjects research at my institution and so it would need an IRB I mean of course Ithaca is not an university so the the particular parameters there are different but as a faculty member um that's something I would have to be really attentive to so um we didn't have a whole lot of things that we would have asked on our survey that were personal because we weren't asking about the person who was filling it out we just wanted to know about the library as an organization or an institution sure very important distinction thanks for for bringing that up Lisa very important okay so we've um so Rebecca says uh very helpful thanks and Boaz also happy he's very happy to hear that there is going to be this additional survey um so I just want to bring to everyone's attention that we do have the capacity with this tool to unmute attendees if you would like to make a comment live or ask a question live just raise your hand and I can turn on your microphone we're happy to do that and we have more time for questions if you want to um type them into the Q&A box I'd be happy to read them aloud and Lisa and Christine can share their answers with us and it looks like we have somebody who would like to speak it looks like it looks like it's Boaz so Boaz um I'm going to unmute you okay you can go ahead and talk now Boaz go ahead hi I'm Lisa and Christine this is Boaz I'm the university librarian here in Lehigh very exciting and thank you for the presentation I definitely used the data and as I said you know I'm kind of looking forward to learn more about the next steps so one idea maybe and that relates to what I think Lisa you were saying about real-time data is to think how do we mobilize the information in a timely manner so like for example if we knew that there is a crisis happening in a certain area of the world then we could mobilize library resources and expertise to deal with that crisis so for example if there is a regime change and you know we need to capture internet activities in a certain area maybe there is a way for us to mobilize our community to address that there are already pockets of such activities but I don't think they're coordinated in such a way that really bring all of us to that type of action so I wondered what you think about it I mean you're right hopefully pandemics like that are not going to happen quite often but there will be other things that we can drive the community to do thank you so I would just say that there is so I happen to have a colleague here at the University of Illinois in the library Lila Mustafa Hussein Mustafa who has actually one of her areas of expertise is cultural heritage protection recovery etc in conflict zones and so there is actually a pretty good community of people that in particularly in areas of the worlds that are having you know militarized conflict that that look at these issues pretty seriously I think we have seen also cases like in Puerto Rico again one of my colleagues who's now moved to another institution but Miriam with Puerto Rico you know there was an immediate response from the preservation community because the primary issue that they were dealing with there was the fact that their collections were wet in a very humid tropical environment and so how are they going to you know capture preserve clean so I guess one thing I would say that I think is borne out in our in the fact that people were looking for this data is that as a community we tend to turn to each other as a community and we use existing networks which I think in part goes to Cliff's opening comment about having you know an eye on this from the ARL perspective but what about these other communities which is is in part why you see that we now have that non-residential dashboard because that was from the achieving the dream which is a community college organization wanting to understand better what was happening with community colleges we have the Hathi Trust members for that same reason because there was a desire so if there were a liberal arts college consortium that wanted a dashboard that they have a membership list they just need to get in touch with Christine and I and we have a way of getting you a spreadsheet where you mark off your members and then we by which I mean Christine codes in your iPads numbers and then we push up a dashboard for you so we just need some sort of organization that's interested in sort of a membership based approach to that so we can do that as well. That's great that really interesting thank you Boaz for bringing that up and I see now that you had written that in the chat I apologize for not having read that aloud interesting. It's Cliff I'm I don't see anything else queued right away so let me ask a question and I'm not I'm not real sure that you can shed a lot of light on this but I'd love any light you could shed on this. As you probably know we have in the preceding couple of weeks done a series of roundtables on research continuity looking at how research was kind of shut down and the extent to which it was shut down and how people are thinking about bringing it back. Now that's a bigger institutional issue than libraries in the sense that things like physical labs are implicated in here field work but it's actually easy to forget the substantial role that libraries play in research continuity in many disciplines and some of those disciplines aren't fully satisfied by electronic resources that we have available. So in trying to understand that we asked we asked some questions about how the libraries were supporting that and how they did it at various stages of the process. One of the things we learned was that there are a lot of different definitions of closed. They all basically you know have in common closed to the public but there are some libraries that are closed but what that actually means is they have a skeleton staff that comes in as necessary to do a little digitization or page a few books for faculty and you know graduate PhD students in their last throes of getting their thesis out. So it's actually kind of hard to interpret closed and particularly what you did where you're trying to really be able to aggregate responses makes it hard to capture that nuance but as you went through this data collection process and all the communications with people did you pick up a sense of what closed means to different institutions and could you share what you learned about that a little bit. So I think Christine hopefully has seen the message I sent her asking if she would please bring up because we actually asked more than one question about things being closed cliff for this very reason and so if we go to the tiny URL website and then look at the survey results I particularly um yeah so all libraries let's do all libraries as submitted libraries so yeah that one Christine. So the first one um that I would have us look at is that we asked about general public access to facilities separate from campus access facilities but then specifically we asked about access to print materials which was q8. Right so here's you know this the status of the library being open to the to the general public as opposed to us just asking um about what the what you know the status of the library building being being open or not um you said q11 Lisa uh q um no keep going the one that says the print collection oh yeah sorry q sorry q14 so this is one where we also realize I mean really when we say closed and we're talking about access to the collection we really we don't necessarily mean is the building open even because the building could be open and you don't have access to the physical collection that's even possible so if we arrow down so we can see the actual responses on this one not the chart you can see that we we had people indicate like partially as like could you also get them via delivery but you could come on site but it was all staff mediated um it's all staff mediated but you can't come into the building it's at a different pickup site or it's only via delivery or the final being all access to print materials have been discontinued so we really tried to push it this a little bit with this question um and so not just assuming that if the building closed you don't have access to the print collection and vice versa that even if the building's open you would automatically have access to the print collection now in the kind of live dashboards we have here cliff you're only going to see this data you know in each question answered but obviously behind the scenes we have the ability to cross tab the status of say is the building open with what's happening with the collections access um and of course we can look at this very same response specifically for ARL libraries we can look at it specifically for hadi trust libraries um and so you are absolutely correct that open and closed are actually a lot of different things and we don't have everything I think you're asking about here like can you get it scanned or what have you but we have we have more than is the building open or closed yeah and I guess I'll I'll maybe add two things I mean I think as you know uh Clef you mentioned you know closed specifically Lisa you mentioned open like I think a lot of people are talking now obviously about the the fall and and being open for the fall and what that means and that carries a lot of different definitions as well about you know the what the future of the the institutions are going to look like I maybe will also just um you know selfishly give a little plug to something else that we're that we're working on that Lisa actually ended up providing really good good feedback on as a kind of a tester for the development of it is um so my team is is working on rolling out we just announced um yeah yesterday today is Thursday um we just announced yesterday the availability of a of a faculty survey that we're offering at institutions um we know that a lot of institutions have um probably at this point um you know touch base with their students to see how they're doing um probably less emphasis on on faculty and Cliff to your point about what's going on on the research end I don't know that I've seen any instruments really that are that are covering that so we have we have a new instrument that's that's available now um focusing on institutional communications uh faculty as as instructors and faculty as as researchers we know obviously that a lot of research that was intended to be conducted this this semester uh was um you know paused or cut off we we felt that at at Ithaca SNR there were a number of studies that we we had to suspend or or delay um until the fall or perhaps indefinitely at this point so um definitely definitely important to get the you know the faculty perspective on on what the the impact of all of this has been not just on on their teaching but on their their research responsibilities as well we did hear at the round tables a report from one institution I can't identify the institution that had done some surveying of their faculty basically asking um how how severely has your research been disrupted um and tried to look at the results by uh discipline um and we really could do with a lot more of that at scale I think yeah and to understand exactly what was disrupted right if you if you already had your data collected prior to this period of time what kind of analysis could you do at home do you have the right program on your on your device and if you didn't have data collected already uh you know depending on the type of research probably not much that you could could do this semester unless it was related to to the pandemic yeah I mean one thing well one thing that's really clear though from their responses and other anecdotal stuff is that it's exceedingly um uneven by discipline of course um you know there are there are some disciplines where it's all about lab access um some it really is anyway um we we should have report a report on that out sometime in may um great if I can add one other thing you will notice that for example 67 of the first responses here in 61 of the updated responses people chose other and then they specified so there's actually quite a bit of open-ended text here and I wouldn't be surprised Cliff so if you're really interested you can go to this page and actually if Christine arrows down you can see that you can actually download it says download legacy csv that's a call tricks naming thing it just means you'll get a the csa csv file of the responses where you will see people put in things like oh we're scanning on demand or something um this is a case where probably for analysis you would want this coded back up into the to a category we had but people were wanting to share more than what we had in the category so there might be some things there that you would be interested in especially on the updated responses I suspect fascinating thank you so much for pointing that out um I uh that that really helps a lot thank you yeah thank you that was really interesting um and I just want to remind everyone that we're still here chatting with you if any attendees who are still there we're slightly beyond the end of the webinar time but if you're still here and you'd like to chat with Christine or Lisa please raise your hand and I can turn on your microphone but I think what I'll do now is again thank you Lisa and Christine for coming to see an eye to talk about this really compelling work which we'll be watching very closely and thanks to all of our attendees