 And that is looking good and so let's jump into this and we'll wrap it up here with Iowa State Project. Okay, so just a quick thing about Iowa State we're located in Iowa. We have around 32,000 students give or take. And we are a land grant institution here in the state of Iowa. Our project team included myself as the project administrator. We have our assessment librarian Linda Anderson who's now retired. So this wasn't the project that pushed her over the edge but she is off enjoying retirement now but she got she helped us get started. Katie one pole. We work here with Iowa State with with a assessment consultant Martha killer do and so she advised us on our project. We had great support from our library leadership team, including our Dean Hillary sale. And, of course, the RL support team to Margaret Kevin and Kevin all did a great job supporting our project. Our project was focused on our use here of our state of the ACRL project outcome tool set. And so we see the ACRL toolkit as being a really simple to use product. And so we wanted to understand better can that kind of a tool be used in a meaningful and actionable way in a library. And another overarching goal of our project was just to produce more awareness of the ACRL project outcome survey toolkit, which was really just emerging for academic libraries about the same time that the ACRL request for proposals came back back in the 2017 2018 time frame. So if you I think many of you are probably familiar with project outcome but it has a set of simple to use survey templates across seven different domains. In our case, we were focusing in on the space domain related to study rooms and the Iowa State University library. A project outcome survey has they all have the same basic components, they ask questions related to outcomes related to students knowledge, confidence, any kind of behavior change and awareness they have about library resources. And then they have a couple open ended questions at the end, asking what did they like most about a particular service, and what can a library do to improve that kind of a service. We thought this matter, because we know that libraries collect a lot of quantitative data about their programs and services, but a lot of times they're not really focusing on outcomes related to the services that they provide. And that is what project outcome is sort of geared towards. And we felt that measuring outcomes can provide libraries with new ways to demonstrate benefits of library spaces beyond just gate counts and other use in that usage metrics. So objectives of our project were, we wanted to again explore what kind of outcome trends and findings we can observe over the course of the project timeline, which for us we started using project outcome surveys I think they go back into the 2019 time frame, and we did surveys regularly throughout the course of the project, up into last fall. So we've included all that data into our our LiF project data set. And we wanted to share information with other ARL libraries about our project and hopefully to maybe encourage them to also use project outcome surveys. So we loaded that data into the project outcome database and once we do that, we can compare ourselves with other ARL libraries and see how we're doing against the project outcome benchmarks. So our process was that each semester we do a set of project outcome surveys. We do one related to library study rooms. We are using Qualtrics here for our project. Project outcome does have a built-in survey tool, but by using Qualtrics we had some advantages here that we could send our survey to identified email list or respondents and then send automatic reminders just the ones that hadn't completed the survey. There were some other features of Qualtrics that we like, not to say that the project outcome surveys couldn't be used successfully. We just chose to use Qualtrics for our project. So we collected the data each semester. We put that into a data set and then at the end of a project we were able to analyze the data, looking at any kinds of trends that emerged over the course of our project. And just, you know, seeing what kind of feedback we got related to our study rooms here at the Iowa State University Library. So the project outcome data was pretty simple. It was just basically we were able to look at some key performance indicators related to trends and average scores. And also we were able to look at response rate and thanks to funding from the ARL project, we were able to offer an incentive to some of our surveys and we were able to collect some information about response rates related to the surveys that we did with incentives compared to surveys that we did without incentives. And not to be, I'm sure it's not a surprise to anyone that we did find an increased response rate on the surveys that we ran when we were offering an incentive for participants to complete the survey. Just a quick couple of charts. So here's a screenshot of the project outcome data dashboard. So if you go to the extent of loading your data into the project outcome database, it will generate reports for you showing not only your own results but also giving you data about other comparison groups. In this screenshot you'll see at the top it says doctoral university. So in this case I can compare myself to other libraries like mine. Who knows, maybe someday we can add a group into project outcome that would be related to ARL libraries and see how the data compares across our group. There's a lot of charts here in the data in the slideshow but here's just an example of some of the data that we produced. Again, pretty simple. This is just showing across the different project outcome outcomes, what our mean scores were. This is on a scale of five. So five would be the maximum you can see that our scores are, you know, well above four. So our respondents, you know, we're pretty positive when it came to how they responded to the project outcome questions, which is a good thing. It was good to see that there were some good outcomes coming from the use of study rooms and Iowa State Library. We're also able to segregate the data in different ways. We were to match up our data set with things like student gender, their student type in terms of undergraduate graduate, are they freshmen, sophomores, etc. What college do they belong to. We also can look at pre COVID versus post COVID. Okay, you may not say that we're in post COVID yet, but I think you know what I mean there. And then also we can look at the incentives that we offered and see what the response rates might look like, or any and also the responses compared to the results we got back from those incentive versus non incentive surveys. So here's another example of a chart. This one is showing the data desegregated by class rank. So I know that the chart is small and you can't read it. It's just mainly to show the artifact that we have this kind of data available to us to take a look at. If we look at our project outcome data. Here's a bar chart showing some data related to our response rates and you can see on the left. Those are the response rates when we had an incentive. And on the right side, those are the response rates when we did not offer the incentive. So you can see, we got a pretty good boost in our responses when we did offer an incentive to do the survey. Okay, so we found that there was value to doing project outcome surveys. We actually were able to use data from our project outcome surveys to build a case for getting additional study rooms into the university into the Iowa State Library. Here's an example of some pictures of some of the new study rooms we built based on information. This was early on. Based on data we collected early in the process back in 2019-2020, but we were able to add some additional study rooms based in part on information we got back from the project outcome work. We had some limitations. Our data is based on a convenience sample. So it's just based on students that reserve a study room. And we only collect the data at the midpoint of the semester. So a student that may have used the room early in the semester may not remember much about their experience. We probably would like to get our surveys done more closely to when the student actually uses the room. The project outcome work is really pretty simple. You can use the ACRL project outcome toolkit to get started. It's all free. We use Qualtrics but you don't need to. You can use the surveys built into the toolkit. And the time to do this was pretty minimal. I would estimate less than 10 hours a semester to set up and run the project outcome surveys. For future work, we want to continue to incorporate our project outcome work into our annual system report. We're going to work to automate the survey process to make it closer to when the student actually uses the room. And right now we can see a student that reserves the room but we don't really know how many other friends and colleagues joined them. So we may modify our reservation process to get more information about how many students are actually using our rooms. Okay, so that wraps up my presentation on our use of project outcomes. Thank you.