 Hi everyone can everyone hear me okay if you can just write something quickly into the chat pane Okay, good This is I guess the third or maybe the fourth editor training we've had over the last few weeks And this one is about Moodle As you know Moodle is our assessment engine, so we it's actually a bigger more Robust learning management system, but we only use the assessment engine piece of it As you know the rest of our courses are entirely open access So you can just click on over to any of our any of the courses And you don't even need to log in if you don't want to but to take the final exam you need to log into Moodle so as you know Moodle requires more careful editing and formatting in order to be uploaded Properly there isn't a sort of shortcut to uploading any Moodle exams to Moodle by putting it into a TXT format and then Devin can just upload that whole file and all the questions get imported So that's an amazing time-saver, which is why we're so picky about how all the exam questions are Formatted so I just wanted to Kind of set all set that stage so that Devin Who among many other things? Handles most of the uploads of all exams to Moodle So he can kind of walk you through The different aspects of formatting that matter and then show you what the back end of Moodle looks like and I see that We have Steve sitting in and Steve is one of our Senior Mechanical engineering consultants and so I think that Steve is sitting in and and Angie I see that Angie's there too who's one of our senior political science consultants Because we also said that we could show them some of the different question types That we might be able to create in Moodle for a special project. So sorry if my introduction has been a little bit scattered, but Once again, I just want to introduce Devin and I don't know Devin. Do you want to take it from here? Okay, can you guys hear me? All right. So once again, I'm gonna walk you through just like I did with course uploads You know what we look for on the word document for an exam And then how that looks in the actual uploading process just so that you guys are aware of the little things that might cause Upload to not work properly and might cause, you know a little bit of extra work in the management of questions and in the Moodle Platform, so let me share my screen So Let's get the word document. All right, so I pulled up this example Like when it gets through the editing process and when we finalize and when we're ready to upload So you notice this one has the learning outcomes that are tied to it this one looks properly formatted and numbered question and Then all of the answer choices As such So the first thing that I do or somebody one of the research assistants does to get it Upload ready is to actually script the learning outcomes and we'll create a different exam With just the questions and the answers without the learning outcomes Because we take that and then we get it in what Moodle refers to as a conform that which is just a text file We basically just the bare bones information of the question being the question the answer choices and the answer and so those Look like this So basically I just copy and paste the unit Each unit from the word document and take out the question number because Moodle doesn't need to know the question number Especially since we pull them randomly So what I look for is something like this where it just has a question question choices the answer choice and Just kind of value to just make sure that everything is formatted correctly and that there aren't any extra Enteres or spaces And then the other thing this is particularly I guess useful For those they should always be highlighted in yellow on the word document just so that I remember on the text file to go through and Delete that out because obviously we don't need that wording on the exam I just need to remember what question to go back through later on and add the image to which is also a pretty easy thing to do So essentially I make a text file for every single unit That looks like this and then I go to Moodle itself and let me just check make sure there are any questions at this point Okay So here I have a course page created for history's errors or two in Moodle I'll go to the questions section and First thing I would do is create categories for every single unit This just makes it so that When we randomize the exam I'm pulling questions from each Individual unit and the right number of questions rather than just from the whole exam That allows you to put more significance and weight on certain units if they have more questions So that we can pull more pull more questions, and you know make that a bigger part of the exam So once once we have all the units created in there Is where we import the questions And so standard multiple choice questions that we do are when we're able to upload them in this fashion We use this achin format, which is basically just this text format Moodle has different as you see there's all different types that we're allowed to do Moodle instructions tell you exactly how to format that in the document for upload Achin was the easiest for the types of exams that we're building so Choose that is choose where you want to upload those two and then you choose file and You would go through and upload them. These ones are already uploaded. So I'm not going to actually do that But what you would get once they're uploaded It would pull you to a screen That looks like this where you can review all the questions that were just put in so What happens every once in a while if something isn't formatted correctly on here is that it either won't put the question in or that it will put it in incorrectly and what the most common thing that happens is Well, if one question is formatted incorrectly, it will actually pull the question above or below it and use those answers In the answer choices, which you know, obviously is a problem So the important thing really is just making sure that every single question sticks to this format the one place where that sometimes messes up is in really long answers or really long questions that have Multiple paragraphs Once you actually put an enter so like for instance, if this question were to have another line of text right here Because there's an enter from there to there when I upload a question the only thing that's actually going to get put in is this part I don't know why it does that but there's also There's a difficulty there and writing the exam and signifying that on the word document because For formatting for many reasons and reading the exam you want that paragraph to be there So that's really just something that I have the research assistance of myself look at I Would go in and take that space out and then once the question is uploaded then I would go back in and reformat it So that's not a huge deal. That's something more internally that we deal with But that's just an example of how fickle moodle can be sometimes That just an extra paragraph will cause basically the whole question not to get uploaded So, let me ask stop see if anyone have any questions Yeah, Devin if you wouldn't mind muting your mic for a sec so I can respond Thanks We get terrible feedback when two microphones are on at the same time. So Tina. I just wanted to answer this quickly Sometimes we do have you guys review questions that are just built directly in moodle we have you review them in moodle because That's really the easiest way to see what's been built and there's no easy export function for moodle so in cases where a course for example mathematics a lot of them require a lot of special formatting and a lot of our Mathematics consultants tend to be a little bit more tech savvy and more Confident and using what's called latex which is a type of a formatting language so they can just plug the symbols and Equations right into moodle So if a course requires that high level of attention and detail to formatting in moodle And the consultant feels willing to take it on we'll say okay, we're going to give you administrative access To moodle and they'll build the exam directly in there And in those cases we will have you go into moodle into the back end and read through each question We'll often have you put together a list of editing action items or an editing checklist In a separate word file. It's just easier to edit that way. It's too hard If there's no way to leave a comment and in moodle. So We'll have you come up with a list separately Send that over to the consultant have them make the changes then you can go in and confirm that they've been done So the short answer teen is that yes, you will in some occasions still be required to log into moodle to review exams But for the vast majority of the time, uh, it's just as easy easy to have the exam built in word It's much easier for editing purposes And the other thing is most of our consultants just don't have the tech savvyness To build an exam in moodle Um, so that's kind of the answer there and then I see Tina says I usually make sure there's one space after the letter, but it looks like two when that example does that matter And devon you'll have to confirm this but I believe that there should only be one space Okay, good. So tina. Yeah, good catch. There should only be one space Um, the text file makes it looks like look like two Um Okay, and I also want to point out one other thing before devon moves on is that um He had indicated that when he gets a draft the first thing they do is take out the learning outcomes and take out the numbers So I'm sure that some of you are wondering well, why do we even do that to begin with that? And it's really because we need to have some version of the exam That's complete that shows outcome alignment that's numbered So it's much more manipulable and much easier to work with in the event that in the very likely event that We need to go back in and change and edit things Outside of moodle and this happens a lot through peer review. It can also happen We just seem to you know in some of our math exams. We need to put them through a couple rounds of of you know peer editing so It's much easier for everyone if we have one version of the course Exam that has all the outcomes listed and all of the numbers Just available. So those are still necessary pieces. We just take those out for upload purposes Um, I just want to clarify that All right devon you can start back up again if you have anything else to add Yeah, okay. Um, yeah, there's a couple other things I was going to show just uh, you touched on the point that some of the exams We're actually going to have the editors go through And edit via moodle itself So as you can see from this view right here, it's kind of difficult to do that. It can only view one question at the time You click on the little thing you can view it You can edit it through moodle. Um, so there's Couple better ways that we figured out to allow editors to do this And it's basically by exporting the entire exam So if you are an editor and by the way, all the I believe all the editors Well, some of the new ones might still need access but uh have admin access in moodle So you can basically do anything that I can do on moodle So one of the things that you can do is export a final exam To an html format, which I found is easiest one to view everything So to do that you would want to do the entire final exam. So you get every single question Um, and then you export those questions to a file So take just a couple of seconds try that again. Okay, here we go So what we essentially get is an html file That you can open up and can have all the questions the problem with this is And don't worry about this part. This doesn't actually show up on the exam That's just the short name of the question. So if you were searching for it You could find it that way. Um, so this Like I said, unfortunately, it doesn't give you let you show whether or not the answers are correct in there But at least it can show you whether or not the questions were formatted properly And had all the question and answer choices The other problem with this is as gen mentioned, most of the exams that you would be doing this for are math exams and latex or special characters so actually Those in a different way and I'll show you an example course for that And this is another way that you'll be able to review exams if we need you to so For instance, let's say math 241 so with this The problem with All of you could always preview or review a final exam as the student would take it But the problem with that is since we randomize the questions and are only using half of the questions The preview that you get would only give you some Small a small sample of what all the questions are so that's not extremely useful for editing purposes So what I did it was start creating actual review versions of all of these types of exams which Are hidden to anyone who's not an admin So the consultants who create them are admins the editors are admins And you kind of see that it's a great out version. So basically this review version is every single question So when you preview that You can see everything I also set them so that You can just hit submit without answering any of the questions and then It will also give you Any feedback and tell you which ones are correct So you can really edit it off of this to make sure that things are working properly So I found that this is useful. This is kind of how we're having our peer reviewers go through all of these kind of difficulty constructed exams for review purposes and I'll also show you how you can actually build these questions real quick And actually let me check see Any questions at this point? Okay, so Steve will have a lot of experience and so with this aspect of it, but if you were going to actually create the question Let's go back to the course And actually Steve you might use I'm in google chrome right now. And so this I'll show you for example They were creating a multiple choice question basically This will give you all the information that when we use the text file For the ache and upload this gets automatically filled in based on those formatting standards, but Text files don't support latex So when if we would upload that it would just be kind of a jumbled mess in here And we'd have to edit every question anyways. So for that reason it just makes more sense to build the questions directly in here so Google chrome for some reason doesn't have the wizzy wig editor box So you can't do some of the special characters But you can still do latex through chrome just by using the latex formula So for instance, if you were going to build a question that had a special character in special formulas You would have to use like dollar signs and then the special latex code And that would translate it to a latex image For with the special characters So it's a little bit more time consuming because you have to do that for every single question And every single answer choice and you have to insert that in each and every one of them Which is I don't know if that's part of the reason we'll have it It seems like some of the math exams that have those are not 100 questions, but a little bit shorter Some of it also just because those questions are more complex take longer to answer I can also show you in here real quickly if If we were going to upload an image There would be image files associated to that course and right here It would give me the option to basically a little pull down just like this with every image that is uploaded to a course And We can attach that to a file or to the question Actually, I'm going to open up Firefox just to show you what it looks like in there as well That gives you a little bit more Editing features, which are kind of helpful for some of these Okay, so here this actually has the full editing box that you can rather than have to write the code in for For example, italics or bold which you can do through html code on google chrome You can just actually use the box here, which is pretty useful. The other useful thing is If you have a question, so for instance, we just got chem 204 final exam Which has each question or a lot of the questions have like four images in it Whereas on this side, you can only put one image through a question Through this we can attach we can use the editor box to upload and attach multiple images to The body of the question by putting that code basically directly into the question text So that's pretty useful kind of gives us a little bit more range the problem with The firefox fox is that for some reason The text the font is different than when it's done in chrome the default Chrome font is a little bit smaller And so it makes some of our you can kind of notice which questions which exams have been built through firefox just by the text On the actual questions and it's just a question itself to answer choices. Don't get messed up, which is also strange Let me stop again for a second to see if anybody has any questions No, but uh devon it might be helpful for Sarah um, and maybe i'm not sure if ken's ever edited anything in Moodle before if before we finish you're going to show them again This is the procedure for logging in and accessing an exam I know that it's such a wonky moodle is so clunky. So it might be helpful to just Slowly show them you log in here. Then you go here or whatever. Yeah, of course So a couple ways you can do it. So let me log out. Oh and steve Answer your question quickly That export button Let's see if I can show you the steps for getting to that So you would go to say count engineering 102 and you export that by going through the questions link Rather than the actual exam link And then you would export it through here and then you would choose. So if you wanted to review your entire final exam Uh, you would make sure that you do the category that has the other ones. So for this It would be final exam and would have all the various questions over this one looks a little bit weird I'm not sure what these tiers are I think that's because it appeared to you But you can set which questions you want to be exported And does that answer your question or have you gone through it that way to look for that before? As far as editing individual questions. Yes, I can show you how to do that real quick So let me log out and then I'll log out So you would go to the home page Um Log in with your regular account information Okay, so if you are going to edit an individual Questions or exams, uh, there's two ways to do that. You can You're going to go question by question and you want to be able to review every single question Then you go to this administration sidebar Uh, if there was sometimes it might be closed you would have to open that up And then you go to the individual questions and then You can limit it by the categories. Um, if you're just doing a particular unit at a time, then you could go Say thanks to student one Probably generally helpful to sort by age If it was uploaded through Aiken then the sort by age Will actually make sure that the questions are Here should be displaying, you know starting with question one and moving down so You can compare it to whatever word document if there was a word document That's a little bit easier for comparison sake And then to edit it you would click the little pencil And all the information would be put in here. So Question text. This is the important part right here. This is what actually shows up on the exam The question name is really more just for searching Through moodle for a particular question And then the answer choices are so this is essentially choice one choice two choice three Is a b and c The answers always go in here You set whether or not it's the correct answer through this if it's so Pretty much all of our molded choice questions just have one correct answer So that would get set to be a hundred percent all the other ones would always be set at none And then it does allow for you to put either general feedback. So general feedback would be Whatever question you pick Once you answer it it will give you some feedback on that question choice specific feedback would be so For instance, if you if the consultant wanted to say why each of the particular wrong answers was wrong You could put that in there and then why the correct answers were correct. You could put that there as well So that's so that like I say would be fairly time consuming way to edit having to search through every single question There other way if you Are working off of so sometimes when we have consultants or a student take a final exam and they'll have some questions about it We need to be able to kind of Edit the specific exam that they're giving us so they'll send us a link to their result and we can do that and I can Actually show you That real quick So if you go to results This is probably less important from an editor standpoint. This is more something that we would do ourselves When we're fixing questions that might have had errors But typically a student would be able to when they Take their they take their exam They you know are given a summary review of how they did And so the questions for them the numbers for them are different than what the numbers would be for different students And so let's get randomly selected But we can at least see how they were numbered So if they were to email us and say, you know, I just took this exam question two seemed to be marked incorrectly we can go through and See what their question two was and edit it right directly through there Because that has happened a couple of times where The question either the answer choices weren't correct or there was just there's some mistake Sometimes it happened through the uploading procedure Sometimes it's just a question that wasn't written correctly But the nice thing is we can edit it directly through here And that will fix it for all students. So even if it's question three for this person Once we've edited it that question will be edited for the future tests that are taken as well. Um, and we can also Correct their grades if We're if we're editing it because the question was wrong and they got it wrong because of our mistake Then we can fix those through here Then is anything else you want me to go through or does anyone else have any questions? I don't have anything in particular, but I do want to drive home. I know for those of you who are just looking at Moodle for the first time It looks terrifying and I I think it's one of the most strangely designed learning management systems because Content lives like all over the place. Um, it's not organized in like a hierarchical kind of way But I promise once you get in there and you'll be whizzing through it like Devin was it's just you need to know to go log in Look for the course you want then go over to the left hand side and click on questions for the final exam It's kind of a wonky setup, but it it will it will definitely become less confusing once you spend some time with it Um, erin asked this terminal punctuation the answers matter Um, it doesn't matter from an upload perspective, but I think that um I don't know. I've seen it done both ways and honestly I personally feel as long as it's consistent within the exam. It it isn't a huge issue for me I tend to prefer when obviously when it's a complete the sentence It should have a period at the end if it's just pick which term best You know describes this and there's a list of five individual terms I don't think those need periods um You know, I I don't feel particularly strongly either way just as long as it's consistent within your exam And Steve Um, I don't think you need permissions that Devin you don't need any special permission to see the export feature You should have all the same functionalities that Devin does Yeah, you should I said here as an admin Steve, which is what I'm said at as well So you should be able to see that if you don't then I can try to walk you through the steps again the email Um, but yeah, it's through the questions part and not through the actual exam part. Oh That's right. I forgot Yeah, Devin if you want to continue to kind of explain to Steve or maybe we can follow up with an email for him um Are there any other questions that in the rest of you have they want to type into the chat? Pain before we close up shop for today Okay, perfect. Well, um, as always, you're happy to answer any questions that people have via email I know Aaron this week sent me a couple things related to course upload formatting. Um, I'm happy to answer those if you are happening to Edit an exam something comes up that I might have missed on or this you need a refresher Feel free to email me anytime and I'll be happy to answer those questions Yeah, and just a reminder, um for the editors and on this on this webinar We're going to be doing another editor training next week and this one Um, we'll be I think answering more general questions Tina had asked me a series of of questions and asked whether we could kind of go over them as a group So, um, I think we'll do just another sort of all hands forum type Um session and I know some people have been interested in seeing a sample Another, you know an flc being added or another kind of editing type editing focused Um Training so let me know if that would be helpful and we can set up some other ones in the coming weeks Okay, sarah. I see that original content editing. Okay Okay, well then I will follow up with a length the next training I will I think it will be instead of next monday at 11. It will be tuesday at 11. So Uh, just let me know if that won't work for you I will be making and I have been making all these available off, you know afterwards offline. So Um, it shouldn't be a problem if you have to miss one But okay, I I think steve is still typing something but if the rest of you are Have had your fill you're welcome to leave and I'll talk to you guys soon Okay, devon, maybe we should um, I'll float looped all three of us in afterwards in an email And then if we need to get back on here and walk steve through it again separately, we can do that Yeah, that sounds okay Um, all right, then we'll just well, I guess steve can't hear us but I'll just email steve and we'll loop in together So thanks again and talk to you guys soon. Bye