 Thank you very much. My name is Thomas Korner. I work for the ETH Zurich in Switzerland, and I'm happy to start our presentation First of all From the initiate initiators it was kind of four years ago something where look at him I and Nowadays mark as well are thinking about what do we need to have to him to have a proper online assessment system? What are the the main pain points and how we could Stand together and make this thing happen because it's it we all knew it. It's too huge for one single institution so we thought about what can we do to collaboratively work together to make this thing happened and what we became is I think one of the biggest collaboration between Institutions to make Moodle better In the meantime, we are Around 20 universities institutions schools Which contributed in one or the other way to this ongoing project started with 4.0 If you installed it all the quiz bank improvements, you probably have seen we are now in the midst of 4.1 which will see you see later on and there are some future plans if You go if you have these kind of ideas you probably should ask yourself what who can Contribute what so seek for people who are good in UX seek for developers who are capable to really do the stuff But also think about project management and stuff like that because these projects in this size We're talking now take more than just let's go into coding and Make something happen On the other hand what we experience is this great opportunity to learn something so for some of the developers it was this best opportunity to work together with Tim Hunt as a long-time Maintainer of the quiz module and learn from the best When it comes to money You have to ask yourself and then later on to sell to all the possible contributors What what do I gain if I give money? so we decided that There is this kind of early insight shows so our contributors know Way ahead what will be there and how it will look like and they do have some Influence on the roadmap so there are some basic democratic decisions on what we do first or what do we postpone? but additionally this kind of connection between these contributors which are Working on other projects as well. And so you get connected Interconnected with with other ideas and other members of the community yeah acknowledgement praise for sure and There's this one additional thing which we all feel sometimes when it comes to Moodle We do we do the right thing. We do something for the world We do something for the people who cannot afford or attend to Other paid software for example and Probably what is interesting for you and they start with the bottom of this slide Believe in your dreams never give up when this idea came up between and also three we ask ourselves Is this really doable? Can we three from three universities in Europe really do this thing? We believed in that and used every connection. We had Moodle users association conferences personal relationships and Well simply brought up the topic again and again and again and again And finally we could find a smaller crowd a bigger crowd and now we are very happy at this point of time We have the most contributors who are joining so starting with Very Regulated amount of money we can afford things Now we come to a point where we really can be think bigger and bigger and bigger because there are a lot of A lot of institutions are joining us and believe in what we achieved. So it is kind of if you're successful Even in small part then some others begin to believe in you and you can do even better things and more things Yeah, I think that's from my side and I'm happy to give the mic to Tim Thank You Thomas Yeah, if you could The so what's gonna happen next is well in a minute Saffat is actually going to show you what we've built But He's about to show you a lot of stuff very quickly So I give you two chances to take it in before Saffat shows you this so Saffat from Catalyst is the lead developer Who has headed the team who's actually built all this stuff? I'm Tim Hunt from the open University I worked with Thomas and Luca to sort of help Specify what it is we were going to do But before we get into what it is so I'm going to give you a quick summary of what we've done then Saffat's going to show you But before I won't get into that. I just wanted to look back a little bit Because the quiz has been in Moodle almost from the start and The way it has grown over the years into the highly sort of powerful system It is today is just one step at a time and I feel what we're doing now is just taking The next one or two steps along what has already been a very long road And I hope will be a road that continues far into the future And I'm not going to go through this in detail I just want to pick out one word from here over the years One of the things we've done is introduced types of plug-in and there was a brilliant talk this morning from immaculata Who was using the quiz access rule plug-ins in a way? I just never even occurred to me So it's a great feature of Moodle that you can do things in plug-ins And if you make it possible to do things in plug-ins people will come up with things you never even imagined so That is in fact one of the things we have done in the new version of the question bank Everything in the question bank is now done with plug-ins So that's all the standard features we have today, but who knows what question bank plug-ins will get in future Now we've opened it up to any developer who wants to have a go So everything's plug-ins. That's lots of controls for the flexibility for the future The other really big change that landed in Moodle 4 So if you've got Moodle 4, you've got this already was it tracks every version of edge of every question as you edit it And that gives you for like for exams where you really care about this stuff Which version of which question is used in each exam if you don't care about that you don't have to worry about it And another really important thing when you're looking in the question bank It will show you for each question all the places that question is used and it will also give you a summary of the Statistics for how well that worked. So if you're managing big question bank, that's that's really really useful and various other small useful improvements that Safa will show you and You know originally we nightly thought we'd get all this done for Moodle 4 But of course it didn't work out like that. So there's more coming in Moodle 4 1 Quite a lot of this is going through integration now fingers Cross the HQ accept it all the two big changes there We've got big in at the moment the ability to search and find the questions you want in the question bank is very limited That's becoming much much more flexible And it's not just finding questions to find them in the question bank that same flexibility will be available when you add questions randomly to the quiz and also At the moment it's kind of fixed that every course in Moodle has a question bank whether you want it or not But there is only one in future question banks are going to be a configurable activity So if you want to question banks to keep your exam questions separate from your practice questions You'll be able to have that if you don't need a question bank at all in this course You won't need to add one and again. There are some small improvements, but now let's give as much time as possible to Safa to do the demo Thank you Thank you very much team Hi, everyone. I'm akm Safa Shaheen from catalyst idea Australia I just want to thank everyone contributed to this project my team peer reviewers integrators We would never reach this point without everyone's contribution so Before starting my demo, I'll be showing you a little bit of differentiated demo with two different sides where we actually what we actually have in 4.0 And also we I'm gonna be giving you a quick demo of what's the near future? So with near future. I mean 4.1. What amazing things you're gonna get again in 4.1 So I'll just stop and start showing my screen here and I believe Yeah So dear Moodle us Let me welcome you to the new generation of quiz and cushion bank as you can see if you're aware of the older versions of the cushion bank There's a huge difference and huge amount of features added just to start with the new generation Whatever you can see in this page is actually a plug-in and whatever is not a plug-in yet Is going to be a plug-in in 4.1. That means whatever columns you can see question actions Status versions whatever bulk actions you have in the bottom So you can if you can select multiple cushions go to the bottom and do bulk action plug-in if you look at the top We have some navigation node which actually includes the base question bank categories import export. These are also Plug-ins as well and another groundbreaking changes We did with the question bank is actually we introduced Versioning which I'm going to be telling to you shortly But let's start with how this plug-ins will actually help you use the cushion bank from a whole different level on The very right of my screen you can see the usage column Which actually gives you a very good idea when you click that number and that number actually shows you how many places Is getting used in so the moment I click it it will open up a quick model I'll just click it Which actually gives you a very nice view of the preview of the question itself and shows you which activity It's used which cause that activity is in and actually how many attempts you have for that specific activity So it kind of gives you a at a glance information of where it's used And you can always click them and go to the activity directly without going to going through the different Navigations of your course and whatever All right, so if I close them then you have three static ticks column Which actually gives you a very good idea of how your question is performing Does it need to be reviewed? Does it need to be changed? Does it need checking and stuff like that and also Just after that you have a column saying review All right, so the moment I tell you every single column is a plug-in you start thinking Yes, if I need any custom data or if I need to do something with the question bank you build a plug-in It's correct. Not correct. If you need a custom data in your question bank We have introduced custom fills in question So now you can actually have any sort of custom data in your question without having to build anything You just use the question custom fills plug-in create a custom field add those data and those data will be straight away available in your question like that review column and The best thing is we're using core custom fills API That means the moment you have any feature added to the core custom fills API It will be straight away available in your question bank All right, so as I say the biggest groundbreaking changes we did with versioning just let me show you how it works So in this page you can see the version version one some of them are version six That means it's actually showing you the latest version That means the moment you go to edit a question and Change anything like make any changes add something delete something whatever you do It actually creates a version without affecting the previous one And we have built a plug-in called history where you can very quickly go and see the breakdown of the versions how specific versions performing if there is anything you need to check on any specific versions stuffs like that and also with Versioning we have introduced status for questions. So for example, let's say you just created a question You don't want that question added to crease or you don't want anyone else to use that question You can very easily put your question to draft mood and just keep walking on it without making any changes and also to take you to another level of collaboration we have comments plug-in where Users or teachers can come together comment on different versions of the cushions Collaborate with each other which actually helps you to improve your questions in a very much collaborative space without having to Manually talking to each other All right, and now if I quickly show you something more interesting so With those new plugins you can see you have a lot of columns and of course going forward There will be more and more columns it will get bigger you might start thinking I don't need all those columns Or maybe I don't need all the columns in this way I want it differently for example maybe for you comments column might be the most important one We have got you covered so we have a plug-in called column sort order Which actually helps you to sort your columns according to your business rules or preference so that you can actually sort them Whatever important to you so if you have a very nice drag-and-drop view you can drag-and-drop and sort them And I'll be showing you another groundbreaking change which is coming in future. You will have user configurable view I believe I have covered everything in 4.0 But another thing is as I said with a continuity of 4.0 We have upgraded some bits in 4.1 and let me welcome you to the bits we did in 4.1 So the groundbreaking changes happens in 4.1 is everything becomes an activity as team already explained rather than having Different different question categories and stuff so you can actually manage it like an activity You can differentiate your question banks according to your preference and the moment you go to the question bank You will see There is a new filterable object so at the top of this screen you will see a new advanced filtering So you might be aware of the participants filter if you go to a course and roll You can see the nice little filterable filterable view and you have the users So we actually took that part out of co-user Made it a proper API and use it inside question banks So you have advanced filtering inside question bank and that's not all It's nothing. It's it's it's nothing that it just filter any specific things You can actually have your filterable objects from plug-in So for example if you build a plug-in you can have your filterable object inside that plug-in and those filterable options will be Available here for example if I click add condition and you can see those options here So status tag last Tuesday modified by any plug-in can have their own filterable objects There it's very easy to implement the moment you add it to your plug-in. It will be available to you in the question bank and Also, as I said, we have some groundbreaking changes with the question bank view We have user configurable view you might think why I have very little columns In my 4.1 side and the reason is the moment you click edit mode You have a user configurable view where you can enable or disable specific columns according to your preference inside this page and also You can make it bigger smaller. You can drag and drop and also you can pin them and it's user specific so if you have five different teachers in your course every teacher can have their own preference and also and If any point you think I don't like my view anymore You can click the reset button and it will take you to the original state where you just started All right So let's go back to the quiz a little bit because whatever changes we're doing in question bank Actually to make quiz a bit of place for everyone. So with the versioning Increase so if I go to this 4.0 side and I go to calls and let's go to a Quiz With a versioning increase the moment you add a question you can actually specify which version you want to use So let's see you have six different versions. You can actually specify which version you want to use you You want to use the latest version you want to use version one version two or if you think I want to use the always I want to use the latest version. So if you're continuously updating your questions You can always select the always latest from the drop-down which will Specifically pick up the always latest ready version from your question bank for that specific question. All right So when I say we're gonna we are introducing Filtering advanced filtering in 4.1 is just not for the view The biggest part of this change was actually in the quiz We have added this filter advance filtering in random questions So if I go to my quiz Let's say this random question quiz and I go to questions And I try to add a random question You can see I have this advanced filtering options inside random questions So you can actually set specific filters or like according to your preference How you want the random question algorithm to pick up a question you can go up to any kind of complex filtering You want so according to you the filters you set random question will pick up that question from your question bank and Just to give you some more ideas is just not UI level or just visible changes We're doing we're doing huge amount of behind the API changes We want to make sure developers have the best experience while using the question bank API We want to include more and more developers coming to build more and more Cuban plug-in and make it a better place for everyone So please if you have any questions, I'm here in the catalytic booth Let me know and of course if you have any question later, I'm just an email away. Thank you very much Luca would you like to say something? Yeah, a few more points because it doesn't stop here We are thinking about what could be still be done in the next versions and will for two Things ideas that are around are why shouldn't be able to use Rubik's in grading essay questions or Comment in essay questions so that Students get the comments as you can in the Simon activities. So in line comments in their answers Even beyond we have some ideas that could be Ordering the adding the ordering questions maybe to Moodle core or or add recording of audio and video By default and many more questions and ideas the journey so to say is not over You have seen that we have some contributors and some are here in the room Thank you very much for your contributions if you yourself would like to contribute It's about the more the mirror the more contribution we have the more The more features we are able to include So maybe your institution has a fund for Quality assurance. I mean good questions and good quiz is quality assurance or you have a fund for digitization digitalization to do digital transformation Something like that a digital quiz is a digitalization project If you know something if you might have some funds, please let yourself be heard Contribute and share also ideas these ideas are just steps to the future possible Prospectives we're not taking them down already. It's not fixed. So please let yourself be heard and Let yourself be heard now. We are really keen to hear your questions Thank you So if you have any questions raise your hand we'll push a mic your way for this group Thank you for the beautiful features. I think a question for Sava Can you name a label not just have version 1 version 2? I imagine I will not really remember what's in version 1 version 5 Is it possible? Can I take this one? Sorry and Not up. I happened to see this yesterday and demonstration where it was about the Translation how amos works and this is actually a string in Amos. So you will be able to amend that V Bracket with the variable a and just put in Version or whatever you want in your language and so it's the customizing is work like that. Oh, you don't mean that. Okay, sorry Yeah, you mean you want to make it flexible that you can name your version into I don't know Not yet implemented I would say Yeah, there is a way you can do that All right, so if you don't want to have the version column You can turn it off with the new so with the 4.1 changes You can turn it off by default as a site admin and you can actually use custom fields You can use custom field and name label. Whatever you can want to do there If you have a set you can just use a checkbox drop down or custom text doesn't matter You can very easily use that and have it labeled Firstly, I want to thank you all for taking the quiz to a lot higher level. It's great things coming up I'm very excited about it and what I wanted was that it's the Changing from the question bank to an activity does that Will that solve the terrible problem of all the questions from question bank being Imported from one quiz to another whether you like it or not Yes, so that was that Yes, so that was the biggest that was the biggest problem We tried to solve with mod cube bank is actually optimized the backup and restore So when you back up a quiz it actually includes what's in use not the whole thing. So yes It is actually solving. So I believe the two trackers. I don't remember the names of the trackers But there are very two old trackers which are actually Solved or partly solved by these changes It's not entirely Entely I would say it's not entirely solving the problem, but it's I would say 80% Problem at some point. So if you back up a quiz it actually adds what do you want not the whole question If you have one million questions in it Thank you very much Thank you for that question by the way, I was wondering if there's a way to filter the question bank through keywords and or Question numbers, especially when you get an error message that says there's a There's a there's a problem with such and such question and they gave they give you the number of the question And I've never found a way to find that number in the question deck. I Think we haven't got that exact thing yet Because we're showing you which quizzes it's in but not the question number within that quiz Which is slightly tricky when you've got random questions It's not a simple thing, but but maybe maybe or it is a simple thing We should have it there and we should have it searchable So no we haven't thought about yet, but that's a good idea And it's the kind of thing you can do with the new plugins. So yeah keywords I don't think we've done that yet again No reason not to other than just time to develop these things. So Yep another good idea. Thank you Why haven't we done keyword search? Oh, did we oh, maybe maybe we've done it and I don't realize sorry Wait wait and see what we actually released in Moodle for one that also search conditions can be plug-in So if we haven't managed to do it someone could do it But that's one that's a plug-in that should be part of the standard release for sure Just an addition and feel free to contact us join us and In the group and we can think about using the existing environment to develop that How hard it is for a teacher to share its question bank with the student We I was about to answer that question then you put the word student on the end Were you at the previous talk by my colleague Chris about student quiz? I mean that's one way to make a whole pool of questions available to students I mean Chris was talking about students creating the questions But you can preload it with questions you've created and you don't need to give the students permission to create more But also the new the new activity gives you more control Over who who can share which questions? Because just like you know generally in a course you might have a teacher But you might within one particular forum give another person the teacher role just in that forum so they can moderate that forum Without being teacher in the whole course once question bank is an activity If you want someone to have access to your questions to be able to use them but not edit them You could give them non-editing teacher rights just in that question bank And then they can share your questions or if you want them to be able to contribute to your question bank You can get them editing teacher rights in that and question bank