 So my name is Mary Pugh and I'm an associate professor of mathematics at the University of Toronto and I've been using CrowdMark for teaching a second year service course on differential equations to mechanical and industrial engineers. At the beginning there were about 325 students and now we're down to about 305 and there are seven TAs and we have about five or six of them involved in marking exams. I like that the TAs don't have to alphabetize papers that TAs don't have to add up numbers and put them on the front page that TAs don't have to enter marks into Excel grade sheets because TAs don't come to graduate school to do low-level clerical work and it also is a great source for errors. I like that TAs don't have to exchange plastic bags full of exams which slows things down. I like that we don't have to worry about exams getting lost. I like that they can grade wherever they want whenever they want because TAs have their own hours and should be able to keep their own hours. Some courses, some large courses, they just say everybody will grade from 9 until they're done on this Saturday and well, if you've got a life that might not work for you, but CrowdMark will work with every life. I like that TAs don't have to flip pages to get to question number five. I like that I can look at something if a TA flags it, so if a TA is grading something and doesn't know what to make of a certain answer, they can flag it and I can easily find that question. I like that there's a button you can press when everything's graded and the students just get a link to a PDF file with their graded exam. So students get their exams. We don't spend tutorial time returning exams. Students get their exams back more quickly because again, there are no plastic bags full of exams being swapped around between TAs. I like that students can just email me with regrade requests which forces them to actually put together a coherent argument and not just sort of rely on my feeling awkward when they come to my office. You assign a TA a certain number of hours to get a job done and you never know whether they have spent more time or less time doing that job. Sometimes TAs will spend 20 hours doing something that they're paid for 20 hours for 10 hours and they don't have the stomach to go to the professor and say well actually I spent twice as much time doing this and certainly if they spent five hours doing something that they were paid for 10 hours that's also something that you're not going to hear about. When I did survey that my TA is they were perfectly happy with the crowd mark experience. So if I couldn't use crowd mark anymore, I would be bummed but you know life goes on but it would be a pity because I would have you know gotten to drive in a nice car for a while and then had to go back to driving in a beater. So one thing that I like about crowd mark is that the graders never see the front page of a paper. They do not know whether a paper is written by a man or a woman whether it's written by a South Asian or Chinese or a pure wool Canadian. It diminishes biases. You can have biases based on handwriting. You can have biases based on sloppiness or neatness but it you can't be affected by whether or not this is the paper from that annoying guy in your tutorial who reads the newspaper and so I think it's it makes things fairer. So my hope is with something like crowd mark is that the TA's will get faster and faster at it which will then allow me to use the TA hours for things that they're actually better suited for and so if I have a good TA for 52 hours if I could have them for 30 hours of face-to-face time that's much better than having them for only 15 hours of face-to-face time with the students. And so my hope is that with a tool like crowd mark that I would have the same number of TA hours but then I could deploy the TA hours for face-to-face interactions with students more than for grading and that would be better for the students and it would be better for the TA's because that's part of professional training is learning how to communicate with students.