 So, we are from the Excelsis Assessment X-Block team and they are my group mates, Agnivesh and Treya. Before going to our objective, just imagine a scenario in which there is one accounting teacher and thousands of students are enrolled in his course. So after the examination, just imagine the situation when he has to check all the thousands copies of that student. It is somewhat a more hectic process for him, right? So our X-Block comes into the scenario in this situation. Our objective is to build an X-Block which can autograde Excel sheets. So and the purpose, our main purpose is to simplify the checking of balance sheets in accounting question and why we are autograding, we are autograding the sheets by just comparing the cells of the Excel sheets. So it can be extended to any type of questions which involve cell companies on Excel sheets which is having text data, not music or anything else like videos. So the scope is the future of the platform means many students can enroll in the course. So we have configured our storage to two types like Unix and S3 and we are doing the automatic grading and we are also exporting the grades to Open edX platform which teachers also can see. So moving to the demonstration. Before we start our demonstration, I would just like to tell you how the Excel sheets should look like, like how the teacher should make the Excel sheets. Now say the teacher wants a student to fill answers in this particular cell. So what he will do is, he will fill the cell with the marks for that particular question and enclose it with angular brackets. By doing this, like when the student will open and see it, the student will understand that he has to fill answers in this particular cell. For example, like in the previous slide, in this particular cell, 20 was enclosed in angular brackets. So in this slide, like in the file that will be uploaded by the student, the student will fill 30,000 which is the answer in this particular cell. Now moving on to the demonstration. Is bracket 20, bracket 20, bracket 20 are the marks? Yes. For that particular cell? Like the teacher has mentioned it in the instructions that the cells in which a particular number is enclosed within angular brackets, the student will have to remove all the contents of that particular cell and fill in his answer. Yeah. Yeah, he has to replace the angular brackets and in the empty cell he has to fill in his answer. That is the marks. Yeah, that is the marks. This is the corresponding mark for that cell. Sir, should we show the teacher's perspective or does the student? Sir, if you want you can show from the beginning only. Do you want to see the teacher's view, then you can show you the teacher's view, like how the teacher fills in the answers and everything. Why the teacher will see anything? No, like... There is no teacher's view, correct? Sir, there is teacher's view because he will uploading the question. Yeah, uploading the question, that is okay. Yeah. So uploading the question is just one extension. Yeah, with that he can put a... Okay. How does the teacher upload the answer to you? Yes sir, like in the teacher's view, he has to upload two files. Yeah, this is the question paper. This is the question right over here and this is the place where the student answers the file. And the teacher also uploads the solution view for the correct answers. Yeah, only looking at the bracket, where is the answer? These are the two files that the teacher uploads. Yeah. No sir, like for the comparison, only those... Yeah. It only considers the angular bracket fields. Question and solution. The correct solution. Yeah. Sir, because... So that's up to the teacher. Sir, like how can we know the correct answer? Like the teacher should know the correct answers. No, but as he said, the teacher by mistake removes one line. So you know that he has filled the wrong answer, no? Sir, while checking the question means the answer sheet of the student, the teacher knows that what is the correct answer. The teacher is not checking the answer sheet of the student. You are checking. Yeah, but I am considering the general process. I am considering the general process, what is happening. Forget the general process, I am just asking you a question that your teacher has made a mistake in giving you the answer sheet. Sir, but that is teacher's mistake. But why are you supposed to catch it? Teacher's mistake or what? You are going to punish the student for teacher's mistake. So teacher have to again upload his question file. But how will he know that he has made a mistake? Sir, like we can't know the answers, right? Sir, how will we know the answers? Of course you know what the answer is. You know what the answer is and you are lazy. See, I expect people to think and you are still not thinking. Sir, suppose a question file is uploaded. And answer file is uploaded, correct? Answer file is uploaded. So what the teacher is uploading a question file, how the system will know what is the corresponding right answer file for that particular question file. How does our system is... Tell me, how will the system know that teacher has made a mistake? Tell me, that is the question I am asking. There is no way to know it. Of course there is a way to know it. For that we should have all the answer files of all type of questions in the world. Why? Only this type of question. Sir, because... No. Like at 10 and 5 you said. Is the answer the same or not? Teacher has supplied answer to that, no? Yeah. He is not giving all questions, all files and you match. That is nothing, right? No. He is giving one question like Excel sheet. And answer sheet for that Excel. Yes. And you are telling me you don't know whether that answer sheet is correct or not. But still you are able to grade hundreds of students. Sir basically... Because we are assuming that that answer sheet is correct. But you can't check whether that answer sheet is correct. We are checking on the basis of what? Sir like different things can happen in this particular balance sheet. Like this is quite predictable. Say under non-current assets if the teacher fills in like all the options. And then like in that particular case inside some like for some cells the answer will be blank, right? So if the teacher by mistake leaves the cell blank then there is no way to know whether he has started correcting or not. This is very interesting. So basically you are not even checking whether all the bracket 20 okay in the answer have been supplied. Why are you not checking that? Sir because in certain cases the cells can be blank. The bracket 20 is in the answer file. There are only the samples. Correct. But come on. The bracket 10, bracket 10, take 10. Those are the only cells you are going to check. All other cells you are ignoring that you answered him. Correct. Yes. Correct. Now those cells you can't even check whether teacher answer has got those cells filled. Sir the answer could be a blank. The answer could be a blank. For example let's consider this question itself. What do you do with the student? The student has to submit a blank too. Either a blank or a zero. Sir for example, let's say there will be premises, furniture and vehicles written over here. The student can clearly understand that he has to... No it's okay. We will leave that. That's a minor thing. That is not correct at all. Okay. So that the student does not directly... So you added this new complication that the answer can be blank. Okay. Solution is blank. Correct. I think then it is okay. Yeah. Okay. Basically... Yeah, because we are just... Actually the... Actually, the problem is again, I am saying that the problem is laziness, okay, but I am sure the problem is laziness because there is no reason, okay, for the teacher to supply two things, okay, there absolutely no reason, you are adding the complication. I understand, no, no, forget your inventory, I am not worried about accounting, I am not worried about anything, I am talking about excel sheet which says, okay, again as I talked to you about that other fellow, chess fellow, it is only a block. So, you are talking about excel sheet which has got certain cells, okay, which are supposed to have bracket, some number bracket, that number is treated by you as the marks for those cells, okay. Now, you are saying that the correct answer for that cell, okay, is to be submitted somewhere else, why it cannot be submitted in the same thing? Because this will be shown to the student. Correct, that is why I said laziness, okay, why cannot you generate what is to be shown to the student? Sir, how will we know if that cell is a part of the question or part of the solution? Because your thing is that bracket 10 bracket, then I am supposed to give an answer, it can be blank, okay. So, remove that and then show it to the student, no, because you are writing software, no. So, in this particular case, I will write bracket 10 bracket, 30,000, you remove 30,000 and give it to the student. Sir, then the student would know for which cell he gets, how much? So, bracket 10 you keep, what I am saying is, in the same cell, in the whatever answer, whatever you are asking the teacher to give, okay, you are asking him to give two things in the cell. You can put bracket 10, bracket question mark, question mark, it is your business, you are specifying, okay. So, you can say in the same cell, you have to give the marks and you give the answer, I will remove the answer and give it to the student. It is as simple as that, then my problem is solved, okay. So, you cannot ask him to give two things and if there is a mismatch, all 100 students are wrong and then I have to do a repeat, are you allowing a repeat? Good, regrading, regrading. The teacher can set a number of reattempts you can take care of. Attempts, no, regrading, I made a mistake, all my students have got zero, I made a mistake, I will give a second model answer, are you allowing that? He can re-upload the question and answer the question. The student has already answered, no? No, that won't be allowed. Correct, revaluation, my model answer, I am doing IIT these days. Question number 4, 4 questions are wrong, give me the mark, I don't want to give the mark, I will re-correct it. Regrade, you are not allowing regrade, because of mistake I have made in answer some missions, you should have done that, but that's okay. It's good, I like it, okay. Sir, we are allowing the teacher to test his upload first, before he publishes it to the students. How will I test? He can again download his question file what he has uploaded, and then he can publish. Sir, in the ideal scenario, if somebody submit the ideal answer, we should be getting a full mark. Correct, but that is what I was trying to ask you, that you can check whether the answer is correct, by submitting the teacher, re-evaluating the teacher's answer. Okay, but you will always get unread, even if I made a mistake. Okay, my problem was answer sheet me, I mistake, I make one column up and out, that doesn't solve me, because you are allowing blank. Yes. Okay, so I got a problem, that's why I said you should have question and answer, correct, but that's okay. Fine, and finally you are giving one answer to these guys. Student gets to have a number of set of more attempts at this question, one of the parameters. No, no, that is fine, that is fine, so good, I think you have completed what you set out to do, one problem only in the requirement, that's okay, fine. This is fixable within like two hours. Here, I think you should do that, okay, don't take two files, take only one file, okay, and if you are doing bracket, actually, bracket, bracket and question mark question mark, whatever two things hash, hash, whatever you want to do, answer will be within that. Okay, remove that hash, hash portion and then give the answer sheet to the student, okay, that's it. Basically, you take the answer sheet and generate the question paper yourself, okay. Okay, so that would be best, okay, if you can do that. I think we can configure anything. Yes. So, that is covered, yeah. In the place where if I change one number somewhere, you know, the whole thing will replace the answer sheet. Yeah. So, is it covered? Yeah, it is covered. Sir, because we are taking... So, instead of 30,000, I write equal to that cell, you will mark it correctly. How do we address... Addressing formula files, that is why it is... You have two files, yeah. Suppose you have one single file. Okay. And the solution that you have given you. So, how do you define marks, comma... How will I address that? Okay. In the cell, we can have the marks within quotation and we can have a comma, after that we can have the solution. For a formula for a cell. If the teacher uploads a formula, that can be done in the method he suggests. Sir, we can provide a dictionary type question. One place will be a hash table like. One will be indexing with, done through formula and then the corresponding values will be his answers. So, for example, if a student answer... So, instead of that 49,000, I write a formula equal to sum of those three. You will mark me correct. Yeah. Presently we mark that correct. Like, in the... You have to mark me correct. Yeah. Because the answer is 49,000. Yeah. You don't expect me to use a calculator. I can use Excel formulae. Sure. Okay. And it will still be correct. Yeah. The answer should be correct in any way you... Excel formulae. Yeah. So, that 30,000 can be equal to that cell. Yeah. It will still be marked correct. Yeah, sure. Sir, if the teacher wants to upload a formula for a cell, that can be done in the method he suggests. No, I don't want to upload any formula for a cell. Okay. I think that's fine. Yeah. Other ways to do it, but that's okay. Sir, for a scalability purpose, we have... So, you are going to do this much simpler. Good work. Sir, do we go... Yeah, other ways to do it. Okay. And you will faithfully retain all the teachers think of that right, read protection and write protection. Only these cells are visible and all that business. Yes, sir. If I do it properly. Yes, sir. Okay. You will faithfully work with it. Yes. Okay. So, when a teacher uploads something which does not mean that all that should be bracket, bracket everything else is green color and only bracket, bracket is shown as white like the income tax thing which you don't fill, but which I fill. Okay. These cells to be filled are white color. I don't... Can't do anything else with anybody else. Okay. If I do that, okay, then that is fine. Yeah. It will work. Yes. The income tax will be fine then. We will be able to do it. And sir, except that also, we can also... Okay. Go. Okay. Go. Okay.