 on behalf of TechSoup, we would like to welcome you to this webinar today. As many of you know, TechSoup is a nonprofit 501C Free, just like your organization, but our mission includes supporting nonprofits working with technology to make this a more equitable planet. And we do this by hosting a catalog of technology products priced specifically for nonprofits from major tech brands. And one of those brands here with us today is Questimpro. We're fortunate to have Christine Welcher, she's the US director for nonprofits at academic institutions at Quest Pro, and she brought some friends along. They're going to tell us how nonprofits are using surveys and data collections to make smarter, more informed decisions, which they turn into equitable goals. My name is Aretha Simon, I'm the webinar producer here. I'm just gonna show you how you can engage in the chat room. We are recording this. You'll get this replay within four to eight hours. If you would like to ask a question, feel free to type in the Q&A. I know a lot of you still type in the chat. We have plenty of people that will be here to answer your questions. If you learned something cool today, why don't you share it with us on social media at TechSoup. And as always, when we have our webinars, we would like you to be courteous to everybody. I'm gonna go ahead and turn this over to Christine. Welcome to all of you ladies. Emma, Nancy, Christine and Joe. I'm gonna turn it over to you. Thanks so much for being here. Thank you, Aretha. Thank you for having us. And thank you to TechSoup for being such an awesome partner with QuestionPro. As Aretha said, I work for QuestionPro and my job is to work with nonprofits and educational institutions in the United States. And so today I am joined by three wonderful organizations that are doing amazing work. So first we have Emma Nolan, who is from the Ark of Pennsylvania. And I'll let her introduce herself in just a second. Then we have Nancy Shirley. She works with Dream Partnerships. And Joe Crawford, who works with Arizona Adaptive Sports, Water Sports, sorry. So, Emma, do you wanna go first? I'll let you take over. Yep, thanks so much, Christine. I'm gonna go ahead and share my screen and just introduce the organization. All right, so as Christine said, my name is Emma Nolan. I work for the Ark of Pennsylvania. I am the manager of health initiatives. And just to give us a pretty broad overview of what the Ark of Pennsylvania does, we promote human rights of people with intellectual and developmental disabilities and actively support their full inclusion and participation in the community throughout their lifetimes. But what I do personally is work on healthcare initiatives and public health for the intellectual and developmental disability community. So currently we're working on statewide efforts, which include investigating, educating and reporting on challenges and solutions that Pennsylvania's disability community and its diverse populations, such as the intersection of rural communities and racial and ethnic minority groups have in accessing appropriate information and help during the COVID-19 pandemic and how all of this intertwines with healthcare access and the ability to receive quality healthcare services. So that's all I have for my little quick introduction into the Ark of Pennsylvania, but I am excited to be able to answer any of your questions later on after introductions about QuestionPro and about data collection. Wonderful, thank you so much. Nancy, would you like to go next? Here we go. Sorry about that. A little delay and get myself on mute and video here. So my name is Nancy Shirley. I am the Executive Administrator for Dream Partnership. Dream started out like many other disability organizations from a parent, our founder, Donna Parton, had a daughter, has a daughter, Demi, who was graduating from high school and Demi saw all of her other, the students around her applying for college and she approached her mom and she's like, where am I going to college, mom? And Donna was like, well, I don't know, Demi, let's find out. So investigating Pennsylvania, there was one program throughout the state for students with intellectual disabilities. So that's how Dream came to be. So Dream Partnership, basically the mission of Dream Partnership is to develop scholarship and post-secondary education opportunities which lead to independent living and employment for students with intellectual disabilities throughout Pennsylvania. Our mission is that Dream Partnership's leadership and post-secondary education programs will empower individuals of all abilities to work, live and contribute to a better society. So you'll see on the picture there, that's Donna on the left-hand side and Demi in the blue shirt. So Dream Partnership was established in October of 2012. We're a nonprofit organization, which means that we write around grants, we do not get any federal or state funding at this point. We provide technical assistance to colleges to start programs for students with intellectual disabilities. In addition to that, we fund those programs to get started. We also provide scholarship opportunities to the students who attend those programs. Those students that are attending our programs do not usually qualify for other scholarship opportunities. And so far we've granted over 234 scholarships totaling over $967,000. Outcomes for students, basically is employment and independent living. You'll see on the picture here, we've got Bruno and Nigel, the three gentlemen there are graduates from Arcadia University program, and they've actually started their own DJ business. And that's one of our fundraisers. They come every year and they provide the music for us. So 10 years ago, like I said, there was only one program, Temple University, throughout the last 10 years, we have expanded and developed 11 programs throughout the state. There's a nice list for you. I won't go through that. We also provide scholarships to the students that attend those programs. And last year, we were able to expand our network to include other programs that we haven't funded, but actually exist throughout Pennsylvania. So we were able to expand our program to include Gwen and Mercy University and St. Joseph's University as well and grant scholarships to those students. So there you see lots of pictures of our scholarship awardees. And I also wanna say that having students with intellectual disabilities on campus is life-changing for those students, but it's also life-changing for the students around them, their peer mentors, the teachers. It's enabling the students that don't have disabilities to see the capabilities of those individuals. And they're gonna be the next employers. They're gonna be the advocates for those individuals in the workplace. So that's really the point is to have all of the students, regardless of disability, to learn together and hopefully be employed. So there's internship programs available at these programs. There's job shadowing in addition to that. There's resume building, soft skills building, the students audit classes and they can attend any classes that are interested, interests to them. So that's my little spoiler about dream partnership and we're in Camp Hill, Pennsylvania. Thanks, Christine. Thank you so much, Nancy. And now from Pennsylvania, we're gonna go all the way down to Arizona. Joe, take it away. Joe, you on mute if you're speaking. There we go. How's that? Give me just one second. Perfect. Okay. Let me go straight to sharing my screen and share. So we are an adaptive water sports program and we serve children and adults with disabilities ages three and up and all different disabilities. Our base is of course in Arizona and we provide adaptive water sports for people with spinal cord injury, brain injury, stroke, Parkinson's. We have an ALS day, a kids day, amputee day. So it's really come a long way and many of our lakes, specifically one is very wheelchair accessible. So we have for your list to help people get in and out of the water because as you know, access to recreation is a huge challenge. So what we do is we break barriers across the board and what another part of our ministry is to bring families back together. Sometimes after a person sustains an injury or is born with one, they go to therapy and the rest of the family goes to the gym and our program brings everyone together. So here's a mom with her kids all going tubing and she has a spinal cord injury. So that's another part of the fun things that we get to do. This is adaptive water skiing. We take people with significant types of mobility issues where they can't lift their arms up or then they can't stand, but they can sit and ski and it's very exciting and it's also breaking barriers and attacking some of those sphere components to have after you have an injury and you don't wanna get hurt again. So we're super excited about doing some of those types of things. This year we've served over 350 athletes around the state of Arizona, at least plus their family members. This wake surfing is huge. I don't know if you guys are involved in water sports in your area, but like I said, we do an amputee day and wake surfing is huge. So there's some wake surfing and then the big thing now is seated wake surfing. So again, breaking barriers, getting that adaptive equipment out to these athletes and so they can have some fun. There's some wakeboarding that we do. And for folks who aren't able to walk long distances, it's amazing how they can continue to wakeboard. And so we also do that for the blind and visually impaired as well. We do kayaking around the state of Arizona. Again, for all disabilities in some of those rural areas where folks wouldn't have the opportunity to come down to our home lake. So we received a trailer last year. Now we go to Lake Havasu, Lake Powell, Swarov Lake, so we're hitting more people with disabilities around the state of Arizona. And that's ultimately our goal is to get more and more people out and active. What we know is that 70% of the people who come out to our programs initiate doing something new with their life. And that could be driving, asking somebody out on a date, taking a college class, looking at a new career. And then of course we do boating and fishing. So that in a nutshell is what we do. And then we have the most amazing volunteers that are out there. And we've had volunteers that have been with us for almost 25 years. So when people come, they like to stick around. And then of course training the new generation of young volunteers who have a lot more energy. So we're super grateful for all of that. That was awesome, I love the pictures. Thank you. So yes, thank you ladies. We just wanted to kind of give you all a background on these organizations. So you kind of understand when we're talking about collecting data, how they might be using it and things like that. So without any further ado, we're gonna just kind of jump right in. Just a couple of things. One, yes, this is about data collection and how nonprofits are using data and insights to plan for the future. And these organizations are kind of in all different experience levels of collecting data. Some are just starting. Some have been doing it for a while. So please feel free to share your questions in the chat box or the Q&A. We'll be monitoring both of them. And I just have some basic questions to kind of get the ball rolling here. So I'll be the moderator facilitator and I'll ask some questions. And then I will just leave it up to Emma, Nancy, and Joe to answer as they will. So the first one is pretty basic. Why did you start collecting surveys? Why did you feel the need that you needed to have this kind of data to track and how are you using it basically? So who would like to start? I can start us out. So at the Arc of Pennsylvania, we're currently working on an initiative where we're gathering information and data from statewide participants. So we're doing some focus groups and some individual interviews, but we wanted to also have a format online with that online survey to reach as many people as possible and really ask those questions that are important to our data collection surrounding healthcare disparities for people with disabilities and have it as accessible as possible for a wide range of people. I'll hop in there. I also work with Emma at the Arc of Pennsylvania as a consultant as well. So we started in addition to the data collection piece of it, the Arc was also using question pro for surveys that actually started out after we had a conference. So we had the advocacy and policy day conference and what would normally happen is they would eat or they would snail mail an actual paper survey to find out how the attendees enjoyed the different sessions that we had, things like that. So that's kind of where it started for me. I just went out basically and looked, what kind of survey software is out there. And that's how I stumbled upon question pro, which was so easy to use, the free version is amazing. It gives you so much information. I mean, we had started to utilize our website for that type of survey, which was great to collect data. However, it didn't give us the analytics. So we had to manually calculate everything and question pro does that for you. So we've used it in many, many different ways, strategic planning, surveys of the chapters to find out what their demographics is like, racial demographics. We've used it for training, post-training evaluations. I use it for dream partnership. Every year we do a survey of the college programs, which asks what type of, how many people do you have? What type of programs are you running? Do you have residential programs? How many students graduated? How many students have graduated and have work? How many internships? Things like that. So it's great to be able to collect that type of data and go from year to year to see the difference between the programs and to get the counts too. So when I apply for a grant, that information is invaluable that I can go back and I can say, we've graduated this many people this year and this percentage is working. Excellent. Cho, you actually just started with us recently. Do you have anything you wanna share? You know what? We are very excited about it. We're as much as we've been doing the program for years, it's been under different umbrellas. So for us, we had just hit our fourth year mark and we really need to start collecting the data of pre and post, you know, with the many of our athletes, it's their very first time and quality of life is a huge issue as I'm sure we're all sitting here recognizing that. And so for us to be able to really measure not just your quality of life, but your health and all those disparities that we've talked about and access and what keeps you from being active, you know, and how can we help you overcome those barriers? Then that helps us with the grant writing and that's the goal there and also us from a service line too much in one day. Is it just enough? How are we doing serving our consumers and their families? You know, and is this a blessing or are there times where it's more of a hardship to get there or was just kind of understanding what we can do to better serve our amazing athletes who come with all ages. The other piece that we do is the educational component. So many people think that if you have a disability, you know, they're only gonna do adaptive water sports if you're a young person. Our oldest athlete is 88. So we really, you know, when you look at grants, it's for the aging, you know? And Sidenote, I'm 54. I'm just about ready to get in that world, you know? So anyway, that's kind of where we're at to hit those bigger areas that sometimes are overlooked because there isn't a quantitative, yes, when you're over 55, when you're over 65, you still play and you should. That's what we're doing. Excellent, excellent. And so kind of along the lines, we have a couple of questions coming in from the Q&A. Someone has asked, what avenues have you found to get responses from your community? Have there been more effective ways that you've been able to get people to answer your questions? I know some of you mentioned something about, you know, like pre and post programs that usually works, but are there other ways that you've been able to get responses? For us, I think survey response rate is always a big issue. I think anyone who's collecting data has to think of that going into it. But having more like individualized emails sent out to people with the link to your survey, posting it on as many social media platforms as your organization has, I know we utilize Facebook, we have an Instagram, we have a Twitter. So just really reaching out to as many people as possible and make it as accessible as possible as well. We have our survey available in English as well as Spanish. So really just taking that extra step to make it as accessible for as many people as possible will really increase your survey response and it will be appreciated by the communities you're trying to reach. Yeah, great points, Emma. Thank you. And I know that we've worked with you, especially with the Arc of Pennsylvania and trying to make it as accessible as possible for everyone to take. So I can speak a little bit to that in the work that Emma and I are doing with at the Arc of Pennsylvania with the Department of Health. One of our initiatives is to track disparities and to get input. And we've been able to utilize question pros specifically throughout our Zoom meetings. So we schedule Zoom meetings with individuals, we do listening sessions with them to get information and feedback and we utilize it during the meeting. So we actually use the format, the question pro format to go through the questions that we're asking them and ask participants to fill it out while we're zooming. And at least if they're not able to do it while we're in the meeting, then they're familiar with it so they can go back in a later time and complete it then. And we've had a pretty good success rate, response success rate doing that as well. And some of the features that we've used when we do breakout sessions in some of these larger meetings is video. So Emma will go through and video herself speaking to a specific question, giving some background information that you can embed right into the survey and we play the video and then go right into the answer. So that's a really nice feature that we've been able to utilize, especially when you're depending on who your audience is, video sometimes gets across a little bit better than a long document does. Great. And then kind of along those lines as well, we've had a couple of questions about, how do you develop a survey so that you're not putting too much stress on the participants? So how do you make it more engaging? How do you make it maybe more fun? Obviously the video is one way. Do you all have any other examples? I think starting out with maybe an easier question, not going right into it, kind of having an introduction paragraph or a couple of bullets of what you're looking for in terms of responses for the survey and then making it a little personalized, ask them their name if that's the sort of information you're looking to collect, what region they're from in your state, again, if that's relevant to your data collection. And then we use a lot of qualitative methods. So we'll ask a broad question and then we insert that paragraph answer format. So they're able to type in what exactly they wanna say and it allows the data collection to be a lot more personalized. And I think it helps people really elaborate on what they wanna say in a survey. And that also makes it a little bit less intimidating because they can say as little or as much as they want to. Great, Joe, do you have anything you wanna add? No, I'm just really kind of getting you to all these different opportunities but I am learning a ton from Emma and Nancy. So, excellent, excellent. Well, that's what this is for. So another, go ahead. I can jump in real quick that QuestionPro has a great rating system too that does the smiley face to the frowny face and that makes it really easy for individuals just to kind of choose their mood versus dislike and agree, totally agree. That type of thing, the smiley face is nice. They do up thumbs, down thumbs. Those types of options within the program are really nice to use. It's different than most just yes, no kind of, questions. Christine, you're on mute. Hi, I'm on mute, there we go. Rick actually asked a question earlier about CMRs or CRMs. This isn't exactly about that but are you using any specific software to keep track of your participants and your clients? Really, we're just using QuestionPro. I mean, you can export the information into Excel and each survey is unique. It can be unique depending on what type of information you're getting and the program makes it really easy to export. So you can export the information into a PDF, a Word document, a PowerPoint presentation. They give you the graphs that they do it. The program does so much. The analytics is amazing. So right now in neither Dream Partnership nor the Arc of Pennsylvania, do we have it tied to a CRM system? We pretty much just utilize QuestionPro as the database. Great, that's good to hear. It's working well for you. Kind of along the same lines with the secreting surveys. We have a question. Has anyone on here used multiple languages in a survey? Go ahead. They're just asking how easy is it? Was it able to, like, I suppose then once you get the answers back, how were you able to interpret all of that? We had ours available in English and Spanish and it was pretty simple on that part. We do have a translator that we work with for larger documents, but this was pretty easy to translate and understand what was going on in those data collections. But I know Nancy, you had a little bit more information about the translation services that we used. Yes, so I will say the multiple language is really nice because you literally say which languages do you want this to be interpreted into? And it does the automatic interpretation and then when the person brings it up, the very first question is what language do you want to use? So they get to choose Spanish or English in our option. Now I will say that when they answer in Spanish, the answers are in Spanish. So we were able to use other translation services. We utilize Microsoft 365 and on the online version of Word, you can have there's translation available. So we were able just to copy, I believe Excel does as well, has that translation for you. So you're able to either copy it or just export it into Excel and then do the translation there. And it translated it well enough that we were able to get the idea of what that person is saying. And then we have a couple of questions just about the platform in general. So I'll just kind of quickly answer those. There are templates. So when you get started, when you first go on and create your first survey, there'll be a question, do you want to start from scratch or do you want to use one of our templates and you just click on that and there's a dropdown for a whole bunch of different industries and I guess topics of the survey. So you can go into any of those templates and kind of look around to get ideas per questions. You can edit any of those questions and answers to fit more with your organization. So yes, that's available. Is the website mobile? Yes, we do have mobile keys. So with every user, even with the free one, we have one mobile device key that comes with it. So you can sync it to a tablet or your phone or something like that. And then you can go out and collect data without Wi-Fi and then come home or back to the office and sync it at the end when you do have Wi-Fi again. So that works out really well for people, especially if they're doing any kind of community functions, booths at fairs, things like that. I don't know, has anyone used the mobile? Not yet? No, it's there and we do have people using it but it's not, I think more people would like to use it. They just haven't quite figured out how to use it yet. And then I guess the next question is, so survey design, you all are asking questions, you've been doing surveys. How did you kind of come up with how to design a good survey? Are there resources that you've been able to find online or in other places? I think just going into it with the background of what you're looking to get out of this survey will help you a lot in the design and the question formats that you wanna use. As I said before, we really collect more qualitative data and more like life experiences type of answers we're looking for from our participants. So it's really helpful to like before you even begin the survey, knowing what type of data you're looking to collect. And then the question pro website really is helpful in the design of your actual survey itself. And it can show you like what each question type will give you in terms of like data analysis. So that was really helpful when trying to figure out the format that best worked for us. Yeah, I think the first stage of any survey is to write it down, just brainstorm, okay, what information do we wanna get and then go from there. Question pro also has the option for the logic. So if like say I have a, you know, I like or dislike something is the question and the person indicates dislike, well, you can have the logic question to say, okay, if this person answers this way then give them the option to do this. So it would be like an open-ended question like, okay, why did you answer the question that way? Which I think is really helpful, but I agree with Emma 100% it's, you really have to think about what type of information you wanna get. Open-ended questions are great if you're asking somebody to relay the story but if you're asking them, you know, how do you feel about something or a yes or no question? Sometimes those are easier. So you wanna try to design the survey to give you the information that you need versus an open-ended question. Cause if you do an open-ended question, your Emma can attest to this, you're sifting through all of that information, having to code it where if you have a yes or no question, it's really easy or if you have a ranking question or dislike like or I agree with or I disagree. Those type of questions are a lot easier to see the value of, okay, so, you know, out of 180% of the people chose this or said this or agreed with this statement. So I think it's important to format it in a way that the system is doing all the work that you're not manually going through and sifting through paragraphs of information trying to rank or trying to code things and group things together manually. Let the system do what you need it to do. And also when you design it, you wanna make sure that you're gathering the information that you could use maybe later. So if you're putting it out to a group, it may not be necessary in that context to know what county they're from or what state they're from or what zip code they're from, but you may be able to utilize that information later for a different purpose. So getting that information upfront is much easier than going back and trying to ask somebody to do another survey which includes that information. So to kind of think ahead of, okay, how am I gonna use this information? Can I use it in a different way maybe for something else? And then, you know, having them answer those questions upfront is much easier to get the data upfront than it is to go back and get it. Great, great answers. Okay, I'm just gonna keep going with the Q and A because we actually have a lot of questions coming through. This is kind of a, I'm gonna put these two together as sort of a two-parter. One, the first one is what information have you found is most useful when you're writing grants? And then kind of in that same vein, how are you using the data that you are collecting to enhance your strategy, to work on donor relations, probably for grants as well. Kind of a two-parter, but I'll just throw it out there for whoever wants to take it. I'm sorry, can you repeat the first question that you said? Hold on. So the first one is what kind of information are you finding is most useful when you're applying for grants, if you have applied for grants? And then in that, when you're getting this data back, how are you using it then? Are you using it in a strategic way to make decisions about your organization, where you're gonna go? Are you using it to help in donor relations? Are you using it for grants? Things like that. Got it, thank you. So it really helps us in terms of like thinking about your methodology before you're even thinking about a grant or if you're working on some deliverables or strategies, really looking at your methodology and what you're going to be doing with your data analysis and how that informs your decisions. I know for us, we're working right now on some solutions work pertaining to healthcare barriers for people with disabilities and that will inform the Pennsylvania Department of Health as well as other stakeholders across the state. So it's really helpful to be able to keep all of our information in one place and to be able to analyze it as much as possible to really see what themes and what subjects pertaining to solutions are rising to the surface and really gaining traction. So it definitely helps us in terms of strategies moving forward with our grant work. Right. Yeah, we've been able to utilize a lot of that, the information to support the work that we're doing for grants. Emma's been able to analyze a lot of the data because a lot of the information is quantitative having to go through and manually report through people's stories and to code that so that we can create a report for barriers and work in solutions, things like that. For surveys, we do surveys for all different types of reasons. So you can utilize like we used it for our strategic plan. So we're getting ready to go back to, okay, we're a year later, let's see where we are with that plan. So you can use them as progress reports basically, pre, post-test type of thing. I utilize it for dream partnership with our employment numbers and then also how many students were serving each year, the programs that we started serve each year. I mean, that's really helpful to be able to go back to that information and justify what we're doing as far as grant work goes. I think the pre and post type surveys, like the demographics of employees within the chapters. Okay, well, we took that last year, let's see where we are again this year and to utilize the information that way. And I know Emma touched on having the information all in one place. Question Pro makes it really easy to just copy a survey and modify it and to be able to import information as well. Emma did some of that when we have individuals that we called and went through the paper survey and then we were able to upload that information into the database so that it's all in one spot. That was really, really helpful. You can utilize that as well, just walking through somebody on the phone using your paper copy and literally doing it on Question Pro and filling it out for them. Like that's another way to complete surveys as well. So it all depends on what type of information you're looking for, what the situation is. It is really easy to do multiple surveys without reinventing the wheel. Thank you. And Joe, I know you mentioned some funding and working with some grants. How are you using or how have you used surveys in the past, even maybe if it hasn't been with Question Pro? So what we have done in the past is like I had mentioned earlier about their quality of life and how that changes. And then we'd like to measure how long does it take you to get out there from your injury stroke or whatever to get out to start playing again. So that's another area we'd like to cover just for our own, not necessarily for grant opportunities but because I think most people recognize that but the other piece too from our standpoint is to hit more people around our state and really kind of go towards those guys and just sometimes you think that there's a need there and sometimes there isn't. And that's what we need to find out is there really a need in these different parts of the state or are there two people? Is it worth it for two? Well, to us it is worth it for two. And then how you write that in a grant to let people know that those two count just as much as the others, the other 300 that we serve. So that's I think gonna be the fun part about the survey is really kind of reaching those guys out there to get them active. I think that'll be the blessing of the survey in general. And you mentioned sometimes you ask questions that are just for your internal knowledge. Are you then using those answers to make decisions about like how you structure programming in the future or I think you kind of touched on where are you gonna have expanding your services? But... Well, and even to that point too, Christine, like what types of services when we go there do you want? And then are we reaching all those people in that area? How can we better reach them? And then the other part too is what do they want just because we have these seven water sports programs doesn't mean they wanna do all those. Sometimes it's amazing. You think, well, we bring everybody in, they're like, well, I just really wanna go fishing. You know what I mean? So trying to find out what they want and what their barriers are and making sure that we have the right of equipment and then making sure that all of our staff, our volunteers are trained for whatever their needs are because we pull into other lakes that are just not accessible at all. And we know how to overcome those and get people in wheelchairs on the sand. We have portable sidewalks. I mean, just knowing the equipment that you need to get and that's important too because every lake is so different and every adaptation is different too. So to make sure we have that wherever we pull in the driveway. Yeah, I'm sure it takes a lot of organization and planning upfront for some of these expeditions that you go on. And I guess kind of to the point that when I asked the question, if you've used other surveys, software besides question pro, I can close my ears or whatever. But I mean, feel free to tell people how they compared or what you liked better, that kind of thing. Go ahead. So I've utilized, sorry, Christine, is there something else? I'm just gonna ask if anyone actually had. Go ahead. I've utilized SurveyMonkey, Google Forms and QuestionPro and then more quantitatively, I've done like our studio, SPSS, if anyone's familiar with like biostatistic software and each I think offers different things depending on again what your organization is looking to collect and what type of data analytics is necessary for whatever grant or project your organization is aiming to work on. I will say QuestionPro and SurveyMonkey are kind of similar in their setup, like the format of the questions and the type of questions you can input, but the analytics is a little bit more advanced on QuestionPro and it just allows you to really dive deeper into the data and separate it out and really focus on some individual responses. I just like not to really sell QuestionPro, but I definitely think those analytics are a little bit more advanced on this platform. Yeah, I agree. I know the question came in about the Google Forms versus QuestionPro, the analytics is the answer to that. I mean, it's amazing that you can just, get the information and they give you the charts and you can do a pie chart, you can see a line chart, you can see a bar graph, just the options of what the analytics look like and Emma in the project that we do based on the health disparities was able to, we're collecting data from different, from across the states, but then also specifically to counties. So Emma was able to have all the information for the entire county, but then also break it into separate groups. And, oh, another thing, the word clouds. We love the word clouds. That's an amazing feature and you don't have to work at it, it does it itself, it's phenomenal, but to be able to have the entire dataset, but then also be able to break it up into different regions was very helpful in the project that we are working on so that we can actually see the difference between the regions because as Joe said, you may have, you may think that you have the answers, but for one region it might work fine, but then another region, they may need something totally different. So it's interesting to be able to separate out the different segments and see the data based on region, which does make a difference, especially here in Pennsylvania, urban and a lot of rural counties. So the rural needs are a lot different than the urban needs are. Great, thank you. And kind of along those lines, you are working with some sensitive information, I'm sure all of your organizations deal with people, different levels of medical needs and things like that. So how do you address confidentiality? How have you kind of worked that in and how you use the program or if you've thought about that in any way and had to deal with it? So I know something that we do is always state that their name will never be attached to their answer. And that's pretty just set in stone across most data collections. You always wanna make sure that your participants know that even if you do use the information that they provide, it's never gonna go back to their name. None of their identifying information is going to be released with their data that they are inputting into the system. That's a really important step in confidentiality and maintaining that relationship with your respondents. But other than that, I think it's pretty set in stone like the confidentiality agreement and it's pretty secure in the data collection and just all those confidentiality. Great. And also all of you are working with differently-abled people and so we've had a few questions come through on the chat and Q&A about accessibility. So we do have accessibility. We are 508 compliant, but have you actually used it yourselves yet? I personally haven't used it myself. I know we work really hard and to make sure everything's in plain language. So in easily understood by as many people as possible. And then a lot of our respondents do utilize screen readers. So I'm sure it, I think it has been tested for our organization. I think Nancy can speak a little bit further on to that. Yeah. So the assistive technology that most people would use would be the screen reader or voice to command, you know, voice to word. It is functional. We love the video option, which would give, you know, video and then also sound. So rather than reading it, you hear somebody saying it. And I know that question pro, at least in the research, the research level does have the capability to record answers as well. I know we were talking about that, you know, initially when we looked at the research model, which is pretty interesting and exciting for our demographic. Unfortunately, the limit, the time limit per recording was a little bit too short for our demographic. So, but there are definitely, it's definitely accessible on different levels. Yeah, there's actually, so when you're setting up your survey, when you go into designs, there's actually a theme that's called accessibility. And when you click on that, it turns everything into black and white so that you don't have to worry about like color blindness, for example. And then anytime you add a graphic or a logo, anything like that, you'll see a little person pop up that reminds you that you need to put in alt text for screen readers, things like that. So, yeah, some of that stuff is already built in and we'll help you with it. But those, that theme especially is what our accessibility team has been working with. And we actually have like a whole department that's been working with that to try to make surveys more equitable and for everyone, for people to design them and use them and as well as participants when they're taking them. Let's see, I think. So, I think we have like two more questions on here. If I'm missing any questions, please just put them back in because I've obviously missed them. Demos are demos available. Yes, I will put my information in the chat and you feel free to reach out to us. And then I will also put in the link to TechSoup because they have a great offer with us. You can get two licenses, I think for $97 for a year. So that works out really well. And then let's see, what is, what was that other question I just went past it? Okay, panel, could you please give us any advice regarding like general education that you went through to create surveys, developing methodology for your survey projects? I don't know, did you have some training before you took this job or are you just kind of learning it on the fly? So I definitely utilized that demo service that Christine was just talking about. It was very helpful in giving you like a really good introduction to the features that QuestionPro offers and the analytics you can perform within that. But besides that, I mean, training, I didn't come into this role knowing QuestionPro, the format at all. So it was really new to me, but there's so many features on their website that guide you like step by step of what you should be doing for your survey. And it really helps to, again, just know what type of questions you are looking to get, whether that be quantitative or qualitative data and what type of answers your organization is looking for before trying to set up your survey. So that's my word of advice for survey formats. I concur totally with Emma. I did not have any kind of background for surveying. I, again, I was looking for something other than our website to use for a survey link. I came across QuestionPro, so easy to use. You just really just choose the type of question that you want. It's easy for the analytics on the background. I love, or on the back end, I love the idea that you can just export to Word or PDF or PowerPoint presentation. And it gives you all that analytics. It gives you the graphs. Like in my case, the respondents are all, they all receive their own individual number, their own identification number. So for the programs, the colleges, in a Word document, I'm able to export all of that. And then the answers come in as respondent number, blah, blah, blah, respondent number, blah, blah, blah. And in a Word, I can just say, OK, find this and replace it with Temple University. And it makes it really easy to utilize, to copy and paste it. It's super, super user-friendly. It does not take a lot to get started. You know, I'd like to add to that since this is the new part for us as we're continuing to build and grow. I was on the phone yesterday with support, you know, on the live chat and the support system has just been amazing. So it's really nice to know that you can just go directly and get assistance right now, you know, while you're working on some stuff. So that I was really appreciated about that. That's good to hear. Our team works hard at that. And we do have people all over the world. Our offices are all over the world. So even when you email like one of our general emails, someone is always answering, someone's always live on the chat. So it might be a bot like the very first question just so they get you to the right team. But there's always somebody behind the scenes checking on that and monitoring it. So even at two in the morning, when you're trying to do something for the next day, we have someone there that can help you. So we're pretty much done with, we're coming up to the end of the hour. So I just really quickly, the last thing I just kind of want to throw out to each of you if you could just take a couple of seconds. You know, what is the best advice that you have for organizations who are just starting some sort of a data collection program? I think my biggest advice is to not be intimidated. A lot of times the words like data collection and data analytics can have a lot of anxiety behind them and it can be a daunting task to really try and reach a large number of people and make sure that your questions are relevant to your study and are asking this right thing in the right way. So I think just doing as much research on your own about the format that you're looking to do and the methodology that you're looking to do for your project or your grant is really important. And talking to as many people as possible as well attending webinars like this is the first step in really learning the application that you're looking to purchase or utilize and getting as much information as possible before making your survey. I have to agree with Emma again. And really just formatting it, the design is important as far as formatting it into questions that are easy to answer and that you'll get information on the backend and the analytics, so yes or no question. Something that is very specific. Try to stay away from the open-ended questions if possible but if you also need that information, certainly utilize it and there are ways to work that into the analytics as well. But really the design upfront, brainstorm with people, find out exactly what type of information you really wanna get and then just go from there. The program itself is so easy to use and I love the feature to be able to edit the link as well. So your survey link can be changed to whatever you need it to be. So you can include staff survey in the link or the Arc of PA listening session in the link. You can make it unique to what your survey is. You know, the only thing I would add is taking your time while you're writing the survey, recognizing that time is our most precious commodity and it's very valuable. And so take your time when you're making the survey, you're asking your consumers to take their time to make their programs better, your program better. So I would just say, you know, we're always in such a hurry. I don't know if I'm just speaking on just myself, you know, overseeing an organization but just take your time and then that way you benefit their time as well. So everybody gets blessed right there. Thank you so much everyone for joining me and for my wonderful co-host here today. It was great. I got to learn more about all of your organizations too, which is always kind of fun for me anyway. Because sometimes I only see the business side of things or the questions or, you know, how to do a certain thing. So it's fun to get to know you a little bit more. And thank you again, TechSoup for having us. I don't know, Aretha, do you have any last things you need to say? No, I'm gonna say thank you. This was amazing. Emma, Joe, Nancy, Christine, thank you so much. You all have a great day. Thanks everyone. Thanks for taking your time. Bye everybody.