 Hello, Peter. I see you're in here. Can you hear me? Okay. Oh, yes. Can you hear me? I can Okay, good This is Chris Powell. Oh, okay. Hi Nice to see you Chris. I mean start the video there Excellent. I guess I got a turn on my video camera now. Don't I? Fine. I was nice I'll join that How's my sound sound? Perfect. Okay, good. Of course, you know a lot of us, particularly me who have never done any online teaching are really Wondering how even to get started and which platforms to even consider Yeah, I think you got the email from Chris Sandvig today, Justina Yes, I've been talking and it's like, well, do you use Zoom? Do you use Screen-O-Matic? Do you use Canvas? Microsoft Teams It's a lot to learn in a short amount of time. So is there anybody at the university who can go over like strengths weaknesses of each one to tell us where they're appropriate and which would be best And we're doing a lot of stuff right now. Yeah, I can imagine And so that's something that we are doing and I expect Probably in the next day or so we'll arrange some additional Zoom and Teams delivered Options for everybody HR just today sent out a message saying that Trainings should not happen in person so Okay, that's the the latest clamping down and so We'll be doing just like we've been doing this week with Teams meetings and Zoom meetings will be Offering more of those and that's a really good Point Peter is to have a session on Which tool is right for you? Right either Delivering a web conference, which would be synchronous at the same time kind of experience versus recording Right So and we are also balancing, you know none your Our people our clients um aren't always available at the same time. So yeah Sometimes it's worthwhile to record our own kind of presentation since if it would be just sharing This is how you do it and here's some options. That's a kind of thing that can be recorded and shared and And then we can follow up with specific custom Okay So we're we're figuring all of that out. Okay. Well, we appreciate that Yeah Um, we're not a huge Office so we're doing your best So canvas doesn't really have the capability of a zoom or is Microsoft actually does it actually every canvas course has zoom integrated within it. It just needs to be brought out of the Included in the navigation menu and we have enough zoom pro licenses for most all of ww faculty to be able to schedule meetings within your canvas course And to schedule them ahead of time too, which could be helpful for proactive Work when the time comes if you need to be able to have class In a remote standpoint. Okay, chris. Oh Chris. Um, also, we have a big blue button. I know a number of faculty have already been asking about how to use big blue button That's already built in so there's no necessarily For those of the faculty that are unaware of big blue button. It is a tool within canvas that also provides remote Remote meeting chats and screen sharing capabilities alongside of zoom Uh, some differences. Well, I I suppose we can talk about that later on But I believe that this webinar is based on best practices for online quizzes and exams right justina Correct. Yeah And so we'd be happy to have another conversation about the merits of zoom versus big blue button And another conversation. Oh, okay So we have a few other people tuning in Uh And I expect to see Kevin joining us soon. So we've got a few more minutes I'm going to send him the link to make sure he's got it More campus alerts travel travel Yeah, travel's been suspended Yeah temporarily Justina you're really out of focus. Is there any Any way to fix that? That's how you were the other day. Yeah. Yeah Band with issues anybody else seeing that does it does justina look out of focus? Nope. No Michael maybe it's just me then. Sorry All right. Yeah, I think um, there's something interesting about your computer. Are you in your office, michael? I am. Yes. And do you use wi-fi? No, I'm connected to wired Everybody else looks everybody else looks clear, but justina looks fuzzy Strange Okay, I think Kevin's joined us. Kevin has joined us. So Uh, say that again You're mute. You're muted Uh, give me a second. Okay. There you go Well, I guess I don't need my headphone man Nope, you sound good. All right, cool. But you don't look as Usual full motion as you are That's because I'm at home and the light's crappy and I might be eating popcorn in between so Sounds like good idea Yeah, there's some benefits to um web conferencing. Yeah You can have your pajamas on from the waist down Um, you have to watch out for the cat the dog and the children but uh, okay so, uh I am sharing oops Yeah, uh Our presentation and so shall we get started kevin? Yes, well, I think we have a couple of minutes, but yes, we can start. Oh, yeah, we do have a couple minutes Actually four and then we'll And we'll do it Okay, so from this view, I can't see or maybe tell me how I should I thought I was able I could see the chat window at the same time, but i'm not seeing it Hang on I can see the chat window and uh for everyone else in the room. I'm happy to uh to moderate questions silently In the background. Well, uh kevin and justina are are presenting today. I know right Also, are you planning to record this session for others as you begin? Okay, so at the top of the hour if you want to go ahead and record that'd be great I need to share So we're checking this out just a second. Um click manage participants Okay, so that would allow the green chat. I'm also monitoring the chat if you click share Uh and pick off what you want As we get started also, I know we have only a limited number amount of time We have an hour to present a lot of details And so um what we can do is if you have questions as we go along feel free to post them into the chat room And we'll cover those in the last 20 minutes or so of the presentation Otherwise, uh kevin and justina feel free to go ahead present for the next 40 minutes And I'll be trying to field these questions in the chat room as we go right Sounds great Okay, so uh any other questions before we get going are you recording justina? No, can someone else uh do that because some of my controls are gone since i'm sharing my screen Okay, i'm recording I will get out of email though So I don't hear all that noise Okay, so It is four o'clock excuse me. I'm justina brown and kevin and chris and I Are your part of your team of support for this exciting transition So we work in the teaching learning and technology office of h us and we collaborate with others as well including michael wilder who's here today and Andrew and lauren who are on the screen work in outreach and continuing education Kurt pavia used to be in outreach and continuing education works as a learning tech in western libraries And so we've all done a lot of work together. We teach the blended online learning workshops every winter So these are all people you can call upon if you can get through to us for help. Well, certainly right now Of course, yeah, we'll talk about how to get to canvas help at the end. Hmm. All right, so uh designing quizzes and we're going to just quickly go over a few things about strategies for setting up online quizzes and Let kevin take it for a little bit. Alrighty, so um, so canvas has a built-in quiz tool inside of it The quiz tool gives you four options. You can do practice quizzes. You can do graded quizzes Uh, graded surveys and ungraded surveys the ungraded surveys anonymous to a point Because you can actually make an ungraded survey and then Change it to a graded survey or a graded quiz and everybody's name comes back So if you're looking for truly truly anonymous, we have other we have other options for something like that So essentially you can build your quizzes in canvas through the quiz tool Quizzes are considered if they're graded. They're considered assignments. And of course, they'll have a due date and such like that You have a variety of question types that you can use such as multiple choice true and false fill in the blank of matching number order essay questions Um, the ones that are most obvious are multiple choice, uh, true false fill in the blank Matching all of those we get graded automatically because you go in and you can put in the You can put in the correct answers and then canvas will automatically grade it You also have the ability to add feedback on any of the correct and incorrect answers So if it's the kind of thing you want students to know well if they pick this answer and it's correct I give them some feedback if they pick this answer and it's incorrect I might want to let them know why because it might be something that you think well They might choose that and I want them to know why they chose it and why it's wrong or why it's right So you have multiple, um Choices of questions you have to remember that the grading for the survey just by default is one point per question That can be changed A lot of people don't realize that they think of a quiz like my quiz is worth 100 points The points are tied to the questions in campus. So you do need to do a little bit of figure and realizing All right, it's 10 questions or it's 100 questions or 50 questions and then figure the points like that now that can be You can moderate that a little bit if you decide if you're going to do things like weighted grades, which we won't really talk about right now, but it is a way to sort of work around that Point values are tied. Like I said, there are no optional questions and of course, there's no extra credit There are ways to do some of these things which are not completely supported but As it stands right now, those are not officially in there So one of the nice things about quizzes, however is fudge points So I get this question a lot people say, well, you know, I made this question But I start to realize after a while that maybe it was worded kind of oddly or maybe I want to give them I want to give them some credit for it because I think I could see why they made that answer When you grade the quiz, so there'll be automatic grading And then there's of course the stuff that you'll grade like essay questions and stuff like that You can access every quiz even if it's a all multiple choice and it's been graded by canvas You can go into speed grader and access the graded version of it At the bottom of speed grades are greater. There's this thing called fudge points Fudge points applies to the entire quiz But you can in fact go in and say, oh, you know what these two questions I could see why they answered them Maybe I worded them a little off so you can fudge the points and give them a few extra on their quiz You could also actually just go into the grade book and add a couple of points that way But it's nice to have it there in the grader where you're looking at it and you're thinking at it about that one time One of the other nice things about campus now It does work primarily it works only with multiple choice true and false and multiple answer questions But you do have some regrade options and I was just working with the faculty the other day One we're doing when they did the they did a particular quiz and they realized, you know I chose the wrong answer for that Yeah, it was b and it was supposed to be and I wasn't thinking about it. Everybody's already taken the quiz Well, regrade allows you to go in and have canvas automatically either award points Martin regardless of what the answer was award points only for the correct one Give everybody full credit whether they got it right or wrong or just Don't worry about it. Just update and don't worry about any regrading So the way regrading works is you have to go into the question and actually chain make a change to the answer It actually doesn't have to be the right answer either just choose anything Any change will then trigger this regrade the screen you see in front of you. That'll pop up and in a light choose Okay, here's what I want to do with it Go take it away. Justina. Okay All right for accessibility There are Often accommodations that are needed to be made for students whether you're in a face-to-face class or if you are Online so for students, it's actually quite easy Or you know, it's set up nicely in canvas to allow this You can moderate a quiz to extend time for Everybody in the class say there was some kind of glitch and you wanted to just extend the time or date For everyone or you can do it for individuals. So maybe there's two or three people in a class that need to have double the time So you can extend the time you can extend the number of attempts that they get as well And that happened, you know, if you get the person says Everything blew up and I lost my access and I can't do it again Then you can give them an extra attempt to try the quiz again The more controls you put on a quiz and the first initial design The more of these kind of things you might end up having to do Hey Justina May I jump in for a second for a little bit of a On the ground demonstration So I've received a number of requests from faculty who have quizzes online With canvas that receive an email from the DAC Saying this student or these students need to have Whatever extra attempt to fill in the time it is I often refer faculty to Moderate this quiz inside their canvas quiz It's okay if I share a screen right now Justina because I have a direct example for this Sure Cool I'm going to stop your screen sharing for a little bit and I'm going to go to a super tough quiz right now as an example So as we can see With this super tough quiz it must be published So in a lot of cases if a quiz is uh in development and Not published for students to see this moderate this quiz right here shall not show up But once this happens once you publish a quiz and click moderate this quiz I have a test student currently in My class whatever student you receive if it's one you can click just the checkbox next to the name Or if it's two Students in your roster you can change and add additional time or attempts for these students by clicking that Little link down at the bottom and then therefore if your quiz is set to 60 minutes Of time for the quiz you can add one and a half times Which would mean 30 extra minutes or if some students get An additional attempt you can add another one attempt and so what happens is after you hit save there'll be a little bit of a Confirmation in your moderate quiz screen as teacher that these students get extra minutes on the attempt Do note, uh, there are students perspective will not see any additional Notification if Regular students not getting accommodations will have 60 minutes. That's all they'll see for their time But the students you add additional time to you will see 90 minutes Hopefully this helps add a little bit of perspective from a teacher standpoint justina. I'll I give the screen sharing back to you okay I will grab it back and Give me just a second to find my way Actually, let me jump in with that Okay There we go share Okay, so we have covered moderating quizzes to address accessibility Um, and this is a you don't need to play this because that's exactly what chris just got it was covered Okay, great. We'll be sharing this No, it was even better So this is part of the Recording and our materials will have this two minute video that kevin created to go over that very thing And and also if I may interrupt yet again I happened to post an announcement in canvas for all teachers with that exact video embedded in The announcement, uh, you at least from march 11th through march 20th If you go to your dashboard in canvas, you'll see this video two minutes click on it It'll play immediately and you get another review of what I just blabbed about. Thank you And then in addition we've got these two extra resources Well, one is a canvas guide of which there are many online canvas guides that are very useful and then we have an atos Well, kevin created a self-enroll canvas course. That means if you hit this link It will ask you to join the course You'll be joined as a student and then you'll be able to go through a kind of self-paced class on accessibility top tips kind of things for faculty and it includes quizzes Yes Okay, respond us. I think we might have a Chris you want to kind of take this? Absolutely. So, uh If you have a multiple multiple choice Quiz that you would like to be able to Provide for your students. Let's just say you're dealing with 50 or 75 questions multiple choice or true false You could spend a lot of time going into the quiz question area in canvas and redoing the work that you've done or if you were to Send me your friendly neighborhood canvas admin a properly formatted word document And i'll talk about properly formatted in a second. I have some software On my computer With respond this that I can convert a properly formatted word document into a canvas quiz So, uh, and so if it's sorry with uh, you justina can I share the screen again? Sure So we have a link in a number of areas Uh But just to give y'all an example in this case uh, if you have a Word document that just simply has one Without any headers or anything like that. This gives you some examples of what proper formatting would look like You'd want to put an asterisk next to the correct answer and Do keep in mind that you know having an answer such as b and d For that also can be Possible as well. However hold that thought As we continue on with this explanation. This is an example of what my software would really appreciate For formatting a document from there I'm able to do the conversion and as your canvas admin. I can drop a quiz into your course Unpublished so therefore your students don't see it and therefore they would be able you would be able to review the questions Uh adjust the parameters of your quiz and then deploy it and hopefully this could save you a great deal of time um I think one thing to keep in mind as we talk about quiz strategies. There is one option I'm not sure if we're going to talk about this Uh in this webinar and forgive me if I steal thunder But if you were to click shuffle answers which randomize the uh sequence of the correct where the correct answer is located If you use a correct answer of b and d for example Uh, the answers will be shuffled and therefore b and d may not necessarily be the correct answer If the shuffle answers box is checked. So, uh, hopefully that's the case So pretty much uh example formatted documentation. We've got links to this. Uh, it's online and jocina feel free to share your Presentation again, please Okay, we'll do Coming right up Share Hey, we're getting good at this now We are all right So the next thing is test integrity and that's usually the first thing people say well right after How do we do this? um, and how do we set it up people say oh, how do we keep our our information from um getting out there or how do we keep students from cheating and uh, the short answer is you don't so if you Don't want your test To be stolen. Don't put it online. Uh, but at the same time there are some things you can do so uh, some controls can be placed in on Canvas quizzes that did steal your thunder. I'm sorry. There's a shuffle answer That's okay. It's good to say it in different ways because that's also a different context um and so These are some options that you can set in canvas and I again, I'm going to hand this over to kevin You go over So yeah, so when you when you credit a test or when you create a quiz in canvas You do have quite a bit of fine-grained control over The the testing environment that the students see so as you're going to see things like shuffling answers time limit multiple attempts Do you want the students to see their response? Do you want the questions locked after they see them? Do you want to show one question in time or all the questions? So one of the nice things is you get to pick and choose What they see and to to a great to a pretty significant degree what they see and how much they see um We pop on to the next screen Um, actually before we do that, can I mention something please? Sure. Uh, the shuffle answers I got this question today or we got that this question today um Shuffling answers does mix up the answers, which is great. Uh, so That it's not always in the order that you designed it in So if you made the first quest the first answer the correct answer for every item in your quiz You don't want that to be the case. So shuffle answers will mix them up However, if you've got all of the above or none of the above or a and b That's going to be a big mess So definitely you have to have that in mind when you write your quiz your quiz If you plan to shuffle answers don't use questions like that Otherwise you'll have to manually put the questions in the order you want them to be in right So there may be people who are wondering about the canvas quiz setup as far as shuffling answers and designating the Correct question. May I jump in briefly to share my we got that coming? Oh, well, all right. I'm a thunder stealer. I'll be quiet All right. All right. We got it Okay so You have a couple of things to you've got the ability to control access to the quiz and and change it by Students by time by date You can even use groups in canvas and sections to say I'm going to sign this quiz to this section at this time and be available from this time until that's time It'll automatically close at a certain time You can also manually open the quiz that you've shut down for everybody Let's say you've got I don't know. Let's say somebody calls in and said, you know I was skiing and it broke my leg and I couldn't get into school or whatever, you know Internet died you can actually do one-offs and do what's known as a quiz restriction Give them an access code so you can reopen the quiz for somebody Give a password sent on the password so only they can access um If you could hop to the next one to the continuation of this And that's what chris was going to start talking about is you also have the ability To not only randomize the answers but to randomize the questions themselves So randomizing the questions comes in a couple of different forms um, you can create what's known as a question bank and with what chris was talking about with uh respondis not only can replace a file or a quiz in canvass Via, you know word file that we've processed that's been formatted, right? But we can also put it in there as a question bank So what a question bank would work is you could have multiple question banks attached to a a class Then you go into canvass and when you're making your you're making your questions You can say well, I want some question groups and you can attach a bank to each group So you can say I want My hard questions I'm going to have a group of hard questions and I want this bank attached to it And I want it to pull 10 questions out of there and I got medium questions They pull five out of there and easy questions that pull 10 out of there So then it'll randomly pull from those banks You can also simply use just the question banks if you've already if you've gone through and you put them in there Let's say you got 100 questions and you decided a later point You know, I don't really need all hundred questions But I'd like to you I like all of them in a certain way. Maybe I just want to use 50 of them You could use just a group Drag you could drag and drop the questions in the quiz drag and drop them into different groups And then just the group without the question bank will also both randomize And then you can tell it pick X amount of questions out of this group So it's a fairly robust system for creating random question combinations On top of that you can when it says find questions you can look for other question banks So if you've used question banks For some other quiz or in other classes, you have the ability to track them down And they can be imported into a class. They can be imported from one class to another So for instance, if you were doing a cumulative test, you could pull a few questions from previous quizzes That way Is that right? Yeah, as a matter of fact what I did work for For the accessibility you give a lengthy accessibility class the way that works is after each section We have a simple quiz to test people's knowledge. There's I think two questions in each quiz Then at the very end I've got A set of question I got a question bank with all of those quizzes added into that to that question bank And then I have a group and it says pick, you know I have actually different groups for different categories and it says pick one from here one from here one from there So it builds a 10 question quiz Out of the 20 or 25 that we have originally in all the other quizzes And builds a whole new quiz based on all the questions we've used throughout throughout the rest of the class That's an example of it done. It's actually quite simple Now one thing you do have to remember is when you import your content from one class to another because I've actually done this Got to remember to import your question banks too because if you don't you'll just have a great big blank quiz And if you have any blank quizzes like that Feel free to email canvas health at ww.edu. We're more than happy to help in this process. Yeah Okay So this is brand new But we in the face of what's happening right now. We're able to get a pilot in place with a third-party product called honor lock that is online proctoring and Chris you want to say anything about it? I'd be happy to So honor lock is integrated into ww canvas As of actually 11 o'clock this morning So we are getting familiar with the functionality because we recognize the need as we are in an era of remote learning and remote assessment This will help as far as Trying to keep things all fair and square. So in order to do this, I'm actually going to is it okay if I Kind of share I'm going to ask that at this point honor lock is still being discussed as an approved product And that we're just in a piloting stage. And so I'm going to discourage actually going ahead and and And trying to to roll this out at this point because it really is not something that's been approved And so if you want to go ahead and hold on that, it's great that faculty know that this is Something in the works, but it isn't something finalized and really isn't ready for prime time at the moment What I do is we actually definitely need to do testing, which is uh, what we're talking about here but we would love to see how it works and and uh Hopefully we can have it Uh in a more finalized version for use spring term Assuming we would need to continue with online Quizzes some people would like to do them anyway, uh, whether we have Excited about it and they are very excited about it. Some of them. Okay. That's the way of putting it. Yes That's actually a direct quote from someone I talked to you today. They're very excited Okay, so A different way to think about test integrity is is conceptual really rethinking what the quiz is for are you? Really testing their knowledge in a in that kind of summative checking everything they know away or can this be more of a A learning experience, you know working them making them go through all the material again and pulling out their ideas Certainly if you have written answers short answer short essay answer types that's A way to do it big classes. That's not a very useful Way to set up a quiz if you've got hundreds of students and you've got a grade all of those one by one But you could write fewer more difficult questions and expect students to use To use their text or other resources and really kind of grapple with some things and come up with responses maybe In aim for questions that are using the cognitive processes, you know blooms taxonomy understanding applying analyze and evaluate things that are a little more complex Taking a concept that they have to apply to a novel novel situation And Don't use same in person. Don't use your same in-person exam. I didn't add that Back up. Oh, yeah. Yeah. Yeah. Okay. I'm understanding the words now. Don't use your same in-person exam, right? What you do in person face-to-face? Is Often just not the same. It doesn't translate to online. So rethink it a little bit Um, and here's some ideas. I've I've come across lately that are interesting You could use a zoom session if you're going to have a synchronous at the same time Exam where everyone has from 12 to 130 to take an exam Even though they're at all their different locations You could set up at the same time a zoom session And you could use that to field questions for everyone you could have private Chat open so that you could have one-on-one answering of questions during the exam And you could ask them to turn on their webcams if they have them And that would be one way to kind of check to see that that's the person taking the exam And then this is It seems silly, but you could just ask them not to cheat and there's some research behind this actually That if you have students sign an honor pledge and you can make the first question on your quiz A question like that that I fill in the blank promise about to cheat on this exam and that what that means is I won't do this that or the other Um That they are less likely to actually cheat. So it's worth a shot. Okay uh Questions from the audience So at this time you'll have to enable your mic if you'd like to talk um and I'm going to I'm going to show you one more slide and then I'm going to stop sharing my screen so that I can see my tools This is what I wanted before we get to q&a. I just wanted to make sure you know Canvas help at ww.edu chris. You want to tell them with how great that is? It's it's it's great. It's really great. It's a wonderful uh, no This is the shared email inbox that uh, we I we monitor They're during this unique time of the state of affairs. There are a number of people monitoring canvas help And should you have any issues about your campus course requests for help this will be A really great way to be able to get your issues addressed as quickly as possible The beautiful thing is, you know, you're always welcome to email me See powell at ww.edu or chris stop powell at ww.edu But in case I get hit by a truck And or have to be on a not checking email for a while Canvas help is monitored by a number of people. And so this is a great way during this time to get Some information taken care of And then the other resource we want to direct you to if you haven't seen it is the keep teaching Checklist for temporary remote teaching We are trying to put everything that we are generating and adding and as information changes We're trying to update this page. So that's the place to kind of funnel yourself to to get the latest information and And check check back frequently because we are putting stuff up all the time Yes In fact, I have a document that will that will be basically this Slide presentation but with lots of guides and extra links that i'll be posting here soon And also, uh, we are attempting to record this zoom webinar And so we will attempt to Find out where we can have a shareable link for others to view this at a later date Yeah, i'm putting that in the cai ht us canvas course that this was linked our Zoom session today was leaked from so i'll put the recording there and i'll put the google doc there that i'm developing That's complimentary to the slides right okay now q&a And I will Stop my screen and just be us okay If you would like to chat Um Or ask a question you can type it in the chat area which is off to the right if you can't see it You might want to move your mouse around to the bottom And you'll see a button that says chat that will make the chat window appear Um, i'm going to say hello everyone Hopefully you can see that. Oh, yeah okay And what can we do for you or you can speak up and just um If you're talking and we're talking over you it means we can't hear you so, um, you might need to unmute Yourself and again, you can do that on the bottom left of your screen if you move your mouse way to the left on the bottom You'll see a mute. Um Uh, all right does Yeah, unmute button All right, peter did you want to say something? Well, yeah, can you hear me okay? Yeah So, uh, a couple of things you talked about these question banks Uh, so is that a special way to design your questions and save them as files within canvas? Is that what you're doing? essentially, yeah So so you can do it a couple ways you can manually make a question bank If you're just sitting there with a lot of time on your hand and you want to just go in and manually Write each question up you can do that Or you could go the the route of doing it in a Text format sending it to chris and we put it in through respondus into canvas But yeah, you're essentially creating a reference file that gets attached to a particular class So you let's say you're teaching class a and you've got a bunch of questions You're going to use a quiz you can put them in there as question banks So you could put them in once they're in Next year you teach the same class and you want to reuse those question banks Right when you import the content from one canvas class to another one of the options is question banks to bring them over Okay, yeah, but they are very very handy Yeah, I would think so Another thing I was wondering about was can you alter the timing of each question? Given some are going to be more complex than others Oh, oh, oh, no because they're not timed by the question. They're time the entire um quiz is timed Oh, okay. So as long as you allow them enough time what you estimate will take each question. Yeah. Yeah, okay Yeah So someone said is it possible to give a multiple choice question and then ask students? Oh, okay. So I just had this with a math class the other day. No Sorry, sorry for the short answer there. Unfortunately You'd have to break it into two questions. You'd have to basically say given the multiple choice and follow up with a question Give me the given the rationale for the for question Your previous question. So it would be cool. It'd be cool to have a two-part question like that But currently that's not something that's supported in canvas There are can I go ahead? I want to jump in after you're done. Oh, I was just going to say there's uh, there are some new Quizzing tools coming up that are they're not ready yet. They're in beta and we're looking at them And that doesn't that does involve a whole bunch of sort of new question options Um, you know, there's even a lot I know that one of them is going to be where you can click on an object for hot spots and that could be the answer But that's not fully done yet And it's what's certainly not be ready to roll out and that may be one of those options. I don't know Go ahead Chris So we've been talking a lot about in the quiz room about multiple choice or true false questions. There may be uh essay question type uh responses and just to give you an idea of what you might encounter if you Have an all multiple choice or an all true false quiz in which you provide the correct answer to canvas After a student completes taking the quiz they would canvas or grade them automatically based on what the correct answer is If you include a short answer or an essay question in your quiz You as teacher will have to grade the each uh essay question manually Right, uh, via via speed grader. And so therefore students may not receive immediate notification of the quizzes There will be some work on your part, but just to give you a little bit of a difference between How this can be immediate results and taking some time Uh, when the time comes we can talk about if you want to Uh hide grades from the high grade results from your students. That's another aspect of Canvas that I slash we would be more than happy to discuss with you all about as far as You want to take your time to be thoughtful in how you grade the essay questions from a quiz We can we can help guide you along the way. Yeah, I was going to bring that up I'm a funder stealer. So, you know, that's okay I'll just add to it. It's that they're in canvas. You have the ability to To hide the the grades of any assignment including quizzes And you have the ability to set that up Ahead of time so you can say all my quizzes the grades will be hidden until I choose to release them Somebody had a question. I often add timelines or pictures as part of the prompt for the questions Oh, yeah, it's very easy to do So if you've gone into canvas at all you're going to notice they're the rich text formatted page Whether it's an assignment a page or discussion allows you to add graphics It allows you to link to videos all that sort of stuff That's the same that same is true of questions because the questions are essentially At the top of each question is that same rich formatted text Area Um, I work a lot with the art department who's got obviously pictures of paintings and stuff in there The math department I just worked with they had, you know, lots of formulas Well pictures of formulas and stuff where they had students identify the parts. So yeah, that's actually quite quite easy to do Hey, uh, Kevin, I can I've got a quiz up right now with the in the rich text editor Yeah, so I'm going to share that real quick There it is Yeah No, you see it. I see it totally. No, we see it Okay, uh, so yeah, these are the this is the interface. I just had uh, I just now did new question and Here is where you would type the question answer me this and then um Here is where the correct answer is I can change the correct answer to be a different answer So the little green arrow is the choice of there, but what you asked was about in pictures and then Here is the icon the little mountain with the sun or moon Over it you click that embed image and you get some choices. You can select an image from the web You can select an image that you've already uploaded or you can upload it right now in the upload with the upload button Uh, so something that's in your course files or you can just go find something on flicker if you think that flicker has something you want so Those are the that's the way to insert an image Uh, she said a timeline too. I'm not sure if that's a different kind of image or if that's something different Is there clarification there? Oh, I would think a timeline as long as it's graphic in some nature Um, yeah, the math ones that I was looking at they were just jpegs of timelines Same thing with youtube videos or Media you can add Oh, that's not the youtube one. This is Adding media. Oh, that's media that you're pulling directly off of you can record media from canvass in there. Oh, right in portafile. Yeah Here wait, here's youtube. Yeah, the one says youtube on it. So they're yeah, thank you. I'm sorry You didn't mean to sound like that So you can search youtube for a video and Yeah, excuse me and Uh, then you can add it embed it right on the on the screen. So that can be part of your question stem actually Um, somebody actually typed in the the chat Raelyn Schwartz said a good work workaround for hiding Is to have the test student take the test Then once you do that there's also in the menu in the grade book to just hide hide the grades But that doesn't work unless there's there's something there. So yeah, that's that's terrific Uh, the other thing I was gonna point out Is no, you know forgot it just left my head So don't remind me if I could jump in along those lines about kind of seeing what the what a quiz could look like They just need to can uh, do you have a quiz that you might be able to bring up about the preview button? Um, yeah, that's a good idea as a teacher. Uh creating A Okay, so that there's a blue button down there of what justina screen says it says take the survey again Uh, there if you create a quiz as teacher of the course, you will see a preview Button this will kind of give you an idea of what your students will see Uh from all the questions you set up whether it be from a question bank or something else like that Also, too, there's the test student which allows you to take it like a student So remember the preview you're still an instructor So it's not 100% but it is chris is right. It's a great way to look at chris You can take it As a test student the problem with that is quiz has to be published So on certain occasions people will say well, I want uh, I want to not publish it yet But I want to see what a student sees Well an option for that is to contact us if you have a sandbox course It's even easier We can import that quiz into a sandbox and you can publish it there take it Make sure it's see how it works every test student take it and then that gives you a way to say Okay, now I know it's going to look like and then you can go ahead and publish it in your class Just to review that emails canvas help at www.edu if you haven't memorized it by now Oh, I've memorized it And so another thing when you start thinking about adding images and graph or videos and things to a quiz You can start to think of the online quiz tool As something you can manipulate for other purposes So you might you might be able to set up a quiz, but it's really a tutorial And so you're you're stepping students through some information and having them kind of check their knowledge on the way And then it's less of a high stakes graded thing But more of a a practice tool or a way to do homework So there's a quiz in the chat there's a question from michelle It says some of my students have had difficulty in seeing the comments and feedback On individual questions after after I've corrected the quiz. How can I direct them to find those? Um, I guess the question, uh, michelle is are you are you putting the comments in speed grader and that little comments field to the to the right If you're putting it in there That comments field is really sort of um Think of it like a chat. It's a little sort of Not correctly named, but think of it as a chat back and forth between you and the students um They'll get notified of those they should get notified those through whatever email preference they have set up in canvas Uh, but that does bring up an interesting question By default people's email preference for canvas is uh by default it's set up as uh your western user your western email Um, as we all know Not every student uses their western email. I from the classes. I've taught a good many of them like yeah, I'd ever check that So they're not seeing it because those those comments are going there if they're not if they're not checking that they don't see them So one thing I used to do at the beginning of of a class they used to tell people I'm going to use these specific features These are going to typically Notify you through whatever that email preference is if you don't use that That's fine. You know, if you know if you're going to use the google then go in or or whatever other You know iCloud or something like that go into canvas and change those email preferences to go to whatever email address you check Don't just leave it dangling there and with an email address you don't check because Communication in canvas whether it's the announcements whether it's uh the messaging or anything like that Um, that's part of that thing that breaks down Uh, I like to I like to follow up on that with you Kevin. Sure. Um, a couple of these last couple questions coming in uh So If you were to add your comments or feedback to a student's uh quiz or something like that There's a very small view feedback link Uh that students will see in their grades section Simon says Pretty, please send me an email with a course and or a quiz and or a student that you would like to Uh, you know that you've given feedback to I can masquerade as that your friendly neighborhood campus Have and I can masquerade and see what screens the students can see and I can take a screenshot of their perspective And I can send you an email with that screenshot I've I've had a number of uh positive responses from faculty when they say So-and-so student can't see my comments or feedback on this assignment or quiz. Can you help me out? Send us that uh a little specific information and I can blur out all the sensitive information just in case But I can give you that student perspective on where they need to Click on because it's a very small view feedback link in there. A lot of students miss that it's there Yeah, uh, yeah, I like to I like to uh show, you know, of course in a face to face class I like to show students Where to go to find the feedback any kind of document that I give feedback on In canvas, I usually try to teach the students how to see the feedback because it's a lot of work to do all that Feedback and you don't want them to miss it. So you could do the same with the screenshots. Um, there's also Help documentation that you can link to in your own instructions saying watch for feedback. Here's how to see it So Michelle asks I put comments directly under the quizzes. I've man-integrated short answers. How do the students see those? I guess I'm question like where on where are you putting those? That could uh No, no, we'll have to need that view feedback thing. Once again, uh, it's gonna be tough for us to replicate Uh in this webinar how that can be. Uh, I would love an opportunity to give you a personalized view of what that looks like Uh, just give me some specifics. Yeah, if you want to send us to you want to send us a quiz We have the ability to actually go into the quiz as a student That's one of the admin, you know presuming an admin if you have a particular one in mind You could just say hey, here's one where somebody said they couldn't see it We can actually go in as that student look at it and say, okay, it's right here Send you back a screenshot blur out all the pertinent stuff arrow. We love to use arrows red arrows, especially right there That's where it is. I'm really good at screenshots. By the way. Oh, yeah Uh canvasshelp at www.edu. Oh, yeah, there you go. There you go. That's it, Michelle All right Yeah, canvasshelp gets all three of us. Okay Uh, any other questions? No If if I may be bold and daring in this webinar that uh, we are completely formal and uh, and uh, button up about um If anyone can uh provide some feedback in the chat or speak up, uh, how to what did you think about this webinar with zoom as far as a Uh, as far as a remote webinar solution, how was this experience for you and the information that was presented? And what other things would you like to see us do? Yeah Because gosh, we have loads of time on our hands right now. So hey I'm kind of curious also if there were faculty who are who came today with the uh, the the desire to know just the step by step process of how to create a A quiz or an assessment by hand We kind of went through that very quickly and so just out of curiosity for next time Should we do a walkthrough on how to just build? quizzes and and putting in quiz questions and just A complete walkthrough on how to add the parameters for that test just kind of curious Is anybody here would have would have benefited from that type of presentation today? Yeah, that would have been helpful I mean, I think a lot of it is going in and actually doing it But maybe seeing it demonstrated would have laid the groundwork for how to go about and do an actual quiz Um, okay, cool Thank you, peter Raylan Schwartz asked Rumor going around and not enough zoom licenses. We need to move to a microsoft platform egad There are we have we got a bunch of new zoom licenses. So you should be good Just just to be able to uh You know talk about that Our wonderful h us software services manager nancy larson was able to get an additional bulk Costco size mayonnaise bucket jar of licenses for zoom pro account popcorn 10. That's the one popcorn 10 We have a great deal of zoom pro accounts, which means if you were to We have one for you. You can auto set one up for yourself in a canvas course email software services a to a software services nancy can hook you up or email one of us because Little known fact, there's one of the three of us is actually another zoom admin here on campus and might be able to hook you up Who might that be All right, thank you for the comments about Telling the public would be a great help because the faculty are freaking out about oh the zoom licenses Um Yes, and we are actually on a on a world-win tour speaking to faculty groups justina and chris myself I think we've already spoken to 70 different 70 different faculty at three different groups. We have two more set up Uh tomorrow and monday. Yeah, we are actually out and about spreading the word. Yeah And I think we're on the verge of setting up a couple more of these zoom type delivery For anyone who can come So more to come. Uh, we did a couple of sessions via teams We like the control Setting a little bit better with zoom. Um, there's no way to mute people and teams. So it got a little messy but So We will be Messaging more information soon Especially with the options for web conferencing the options for recording lectures Those things are coming. Yep and Ben I Beny ben I uh set a webinar on using canvas conferences for online lectures would be nice I tried up a lost animation on the upload of power points Yes, indeed. And that is something we are focusing on quite a bit right now So we will not only do one of those. Uh, we are also willing to go out and talk to faculty groups Show what we know. Yeah We're and and also on top of that I guess the other side of it is If there's a specific need that you have or that a group of faculty have You can actually contact us and we'll make you a step by step guide We'll we'll create whatever resources you need Even if it's not us in person or you're like, well, maybe I don't need you to come here But I sure would like something to refer to We'll figure out whatever's going to work for you. We'll we'll take care of you And I said this at the beginning, but not everyone was here HR just this afternoon sent out a message saying that In-person trainings are no more. Oh, that's right. So we are Able to do zoom and teams and Record our online, you know record information and put it online for people. So Let us know what you need and trust me We have a bunch of things in the works that are almost ready to share and we'll keep adding those to the keep teaching page I really want to say something like you're gonna be real happy about this Oh, you're gonna love it. It's gonna be butter Yeah We got you But are you going to do where like someone like me who's not done much online? And i'm trying to wrestle with which platform do I use? Sure So What platform are you referring to? Well, like, I mean zoom versus screenomatic versus Teams those seem to be the three that everybody's evaluating Well, yeah, they all kind of do different things. So screenestimatics really for screen capturing like If you're going to sit around and do your lectures and post them online That's something like screencast-o-matic is a good choice if you're doing One-on-one conferencing that kind of thing then zoom is probably a better choice We have We we love to work with you I actually worked with someone this morning in a zoom conference talking about the different online tools And what would be best for that person? I don't know justina and chris have both done exactly the same thing like you know customizing it a bit to understanding what you need and You know trying to come up with solutions that will work for you Oftentimes you may have a butter knife to be able to do butter, but you wouldn't necessarily do that to Cut a steak. We have steak knives for that. So one tool will be very helpful for another And along these lines as we're talking about which tool to use. Oh, by the way Should we be in a case? Coming in the near future where we aren't Where we need to be able to meet remotely Consider using zoom as a place to Host your office hours. You have a two hour office hour window on thursdays from 10 to 12 Well, if you create a zoom meeting You it will create a nine digit id number In which you can send an announcement or put on some type of Communicate in your canvas course for your students a lot of students have the zoom app on their mobile device There's also another feature of zoom called a waiting room in which If a whole lot of students come in you can pick one have your Office hours conference with them and therefore when that's done they leave you pick off another one to come into your zoom meeting You have a two hour block available to you. This is a great way Should you be in a comfortable environment like kevin's residence? To be able to have your office hours often this could be used for inclement weather, but in this case How to do virtually office hours, I guess i'm yes, so Zoom could be a great option for that. Yeah A comment says we're working on how to do biology labs online. Any help would be great Yeah, just give us a just give us a holler either canvas help or i'm i'm dixie k at wwdu Justina's uh j brown, right? Correct. Yep, and i'm c powell And christa c powell just hit up any one of us and we are more than more than welcome to dive into whatever Whatever you got going we'll we'll figure it out And we are on the docket to be at the biology department meeting at four o'clock on monday monday. Yeah For the biology person he's ready because we're gonna be there We respond well to chocolate. Yeah. Yeah. Yeah, we're gonna apply us chocolate and tobacco. Those are the best I know tobacco go straight to my thighs. I don't know what's going on. There you go. Yeah All right. Anyway, michael wilder just posted some simulations for science that it could be interesting too. So, uh Let's uh, we'll keep sharing everything we get together And put a link from the keep teaching page. Yep. Thank you everybody for coming by Yeah, thank you. All right. Good luck