 సిన ంటోలునంప్వ్సినార్ నంరలుసియెండి గాస్త్లాలురికా. సిసివిన్సిలాలోలురి సందిలులాందిమర్ సందిహాసికడలర్పనానర్. system for peers for the peers, where peers evaluate each other on the basis of some qualitative behavior and some quantitative data. So, what peer evaluation system includes, it includes a self-regulating body, evaluation by people of similar competition, here it is important to elaborate that they are of similar competition. So, they understand what other peers are doing well or not as per their comparison and third one is the self-regulated learning by evaluating a evaluation of others work. So, it happens then when you are evaluating others work then as a comparative level you will have understanding of whether I have done well or not. So, it will direct you a self-learning essence also and fourth one is equal grading as per hard work done in team-based learning. It happens then in team-based learning tutor or expert is not familiar or known to whatever the peers have done in among the group inside a group who has done what work it is not clear by the final submission or assignment. So, it helps in it is known to peers who has done how much work. So, it will help them to evaluate each other in as per their hard work and then it comes to what is the advantages of peer evaluation system. So, peer evaluation system when there is a large number of students so this evaluation system works well because in normal traditional evaluation system when the class strength is more than 1000 or in lakhs students. So, it is not possible for traditional evaluation system to evaluate all students. So, this peer evaluation system will work there and second advantage is that is the motivation towards performing better. It helps then when you are evaluating others work you will be motivated as we have said earlier that while evaluating others work you will come to know as a comparison level that who is doing what and how much your work is differed from others. So, it will motivate you towards performing better, better understanding of same topic while evaluating others. This could be the second advantage that when you are solving a problem you will have a single approach you will follow a single approach, but when you will evaluate work also you will come to know about the 2 or 3 approaches for the same problem. So, you will come to know about the better understanding of the same problem. Third one is the possibility of improvement in evaluation system and technique. It happens then when you implement the actual implementation of this peer evaluation system then there will come some suggestion, there will come some improvement in evaluation system. How better could be the evaluation system? It will be the some rise result or conclusion of that peer evaluation system and there are also some disadvantages that first one is the biasing. Biasing is like if you are evaluating to your friends. So, obviously you will give him marks, maximum marks or more marks than others. So, this could be the disadvantages of this biasing. Second one is the in terms of some learning. If your peers have given you some feedback. So, it happens then you will not there will be a notion of ignorance or carelessness towards the feedback and comment that your peers have given because you will have a understanding or you will have a feeling that he is of my competence or he is lower than my learning and all those things. So, that is why you will think that whatever feedback or comment he has given is not fit or up to your marks. So, and third disadvantages that could be the disbelief on accuracy of system. So, it happens that this evaluation system peer evaluation system what will be the final grade. Students will have a notion of disbelief that they will not agree or they will have a notion of disbelief towards the final grade that peer evaluation system has given and fourth one could be the disadvantages that would that is disbelief on accuracy of evaluator's judgment. So, if a poor student or a lower grade student who is going to evaluate means top student of the class or the maximum marks gainer student of the class. So, that student will if lower grade student gives low marks then that top student will not have a belief or this type of disbelief will exist everywhere in peer evaluation system and now comes to whatever the what are the other evaluation system that exist. So, first one is the expert evaluation system. So, expert evaluation system is a traditional evaluation system where there is a tutor who assigns quizzes and assignment to the whole class and who evaluates himself for all the quizzes all the assignments. So, whatever the this also this evaluation system has also some advantages that are the marks final marks that are given by the professor or tutor a student will accept it as their final grade. Second one is the feedback if a tutor gives a professor gives some feedback to a student they will definitely take it serious and things to improve on those whatever the feedback the professor has given. This evaluation system has also some drawbacks like it cannot be applicable to a large class as we have said that this is applicable expert or traditional evaluation system is applicable to a fixed number of in a or in a limit of number of students in a class. Second evaluation system that is a self evaluation system. So, self evaluation system is a system where students evaluate to himself on the basis of seeing the work of others how the others have done and then he evaluates to himself. So, a notion of self learning comes that you are seeing that yes others have done this approach this approach this approach. So, my approach is how much compare comparative to others approach. So, he will give him marks and this have also one disadvantage that student most of the students will undermark to their submission or their work because you as a professor as a tutor it may be thing that you will not be well known how much work a student has done how much work he how much hours he has given to a particular quiz or some submission or assignment. But sorry, but when you are evaluating to yourself you know very well that how much work you have done whether your approach is fit up to the expectation of assignment or quiz. So, it comes the result that you will undermark yourself. Third comes the peer evaluation system. So, obviously we are presenting here to peer evaluation system. So, as we have told that peer evaluation system is a system where peers as people of same competition similar competition will evaluate to each other. So, this has advantage that it is applicable in a mass of students and it has also drawback one drawback that I have told you that is biasing. Third fourth come that auto evaluation system. So, auto evaluation system is a type of machine checking or software checking. So, it happens that software will check only for particular format or it is applicable basically to a multiple choice question not for a theoretical question or textual question. So, this could be the drawback of this evaluation system. Then what are the procedure for peer evaluation system? So, I have mentioned basically there are three procedure. First is make the group then implement the peer evaluation system and on the basis of some marks or if there is some discrimination then you should normalize the marks by peers to each other. So, these are basically three procedure. So, in group formation there comes two things first one is the random second one is the initial group. So, in random group formation what happens if you have a 1000 students and you want four groups. So, put 250, 250, 250 students in each group and that is the that will be the random basis there will not be any criteria for a student to being in a particular group. And second approach is that is the initial quiz. In initial quiz a tutor before starting a course or it could be the initial phase. So, if teacher can take a quiz or assignment and on and then it can be evaluated by the either by the tutor or professor or by the student and on the basis of marks that student have got get. So, on the basis of their marks they will be distributed among groups. So, the range of marks could be for a group like 4 to 6 if there is a quiz of ten marks then 4 to 6 in a one group 6 to 8 in a one group 8 to 10 in a one group 1 to 4 in a one group. Second phase that comes in a peer evaluation system is the peer evaluation. So, now you have divided students in a group now comes the actual implementation. So, for take each student one student and select one peer for evaluation from each group it could be his own group or and others one student from others group. So, like we have four groups. So, we take one student and take one student from each group for as his evaluator. So, one student is evaluated by four peer if there are four groups fourth comes the third phase that comes in peer evaluation system that is a normalization. So, it happens that student will some student will mark very less to others student some will give good marks to others student. So, you will have to normalize those marks. So, there are four three or four steps towards this first one is a individual effort rating it is the sum of all the mark that one peers have got from their evaluators. Second one is the average effort rating average effort rating is the total marks that all the peers have gone divided by total number of students first one third one is the individual weighing factor it is the you what individual effort rating divided by average effort rating it is the individual weighing factor fourth comes the bias factor it is said that when individual weighing factor is in the range from 998 to 1.02 around this is in a given enough paper. So, if the bias factor is in this range then we will it is a normalize marking, but if it is not beyond this then we will multiply each student by this bias factor one upon bias factor. So, this is the procedure for normalization then comes guidelines what could be the guidelines for peer evaluation system. So, this is the first one is the setting expectation. So, each teacher should be given weightage each student should be his marks should be given weightage. So, these are expectation. So, that peer evaluation system can be implemented to the extent second one is the logic periodic formative assessments. So, it does not mean that throughout the semester you take only one or two peer evaluation phase take in a regular basis around after one week or two week or three week one evaluation should be there. So, it will help students to learn and also to make the some improvement in the existing evaluation system. Third one is the preparing learner for the feedback. So, what how you should give a feedback. So, it is a skill. So, it should be learned it is a student should be given some preparation for giving feedback what points you should note down for giving someone some feedback. Fourth one is the customizing a process. So, customizing a process is means for different different situation the peer evaluation system should be different different. So, we should keep on customizing our evaluation system as per the requirement. Now comes some comparison level assessment evaluation there is a peer self and tutor assessment. So, what is this. So, it is a well extracted knowledge where student or peer evaluates to other to self and moreover it is he is also evaluated by the tutor. So, whatever the final marks he get know. So, he will be he will have a notion of self learnings he will become active learner towards because he is also evaluating to himself and also to peers. And it is a collaborating learning where teachers are playing their role students are playing role of student as well as of evaluator and there is there comes internal motivation also. So, you will be motivated towards performing better because you have seen others work and you will also you have also evaluated to your work. So, this will help you to improve yourself also. And for third problems can that is the problems in peer evaluation system as we have discussed that there is a notion of reliability. Reliability means whether the marks you have gone you have got it is reliable means existing peer evaluation system whatever the marks you are graded is it reliable or not. Second comes the fairness. Fairness means students marks should be given on the basis of work here not on the basis of how that person is personal behavior of personal opinion should not come in peer evaluation system. And third one is the predictive validity. Predictive validity in the sense like if you have given some students low marks. So, in the future if a tutor for does a cross checking. So, that students should have should also have this low marks otherwise it may be the case that it is the peer evaluation system is not working well. So, if you have rejected someone he should be rejected further also. So, this is the predictive validity of peer evaluation system. There are also some other issues like group formation as we have told you that what should be the basis and how the groups will evaluate to each other and validation of group formation whether you have the groups are valid you have made a valid group or not. So, there comes a suggestion like you should keep on on the basis of after each evaluation you should again form a group it should not be the case that for a whole semester you made a group and that is all controlling bias factor it could be the other issue. Fourth one is the verification and validation of evaluation system. So, whether you have your evaluation system is valid or not on the basis of learning on the basis of students improvement on the basis of tutors agreement all those factors should also be talked also be talked about and there comes extension of where it could this peer evaluation system as a extension of this peer evaluation system it could be used in a blended MOOCs model. Blended MOOCs model is a model where online courses. So, role of teacher is from giving lectures only this role is taken by the MOOCs MOOCs is a massive online open courses. So, the courses will be delivered by someone else, but the role of teacher that is mostly ability of teacher is increased like he will be more engaged in learning giving tutorials solving problems with the student and giving them suggestions how to do means only one role is taken off that is the giving lectures the tutor the teacher will not give lectures, but he will have to follow the lectures whatever the given by the MOOCs and the problems and if he will have to keep on checking whether students are working well towards these problems or not. One benefit in that this blended MOOCs model is that the final grade that is given by this MOOCs model should be accepted by their final grade of those students who have taken part in these MOOCs courses and how the evaluation system will work in blended MOOCs model. So, in blended MOOCs model we will have at the top level we will have the MOOCs team who will offer courses at the second level there will be colleges number of colleges who will be participating in this MOOCs model and they will be accepting the fact that the final grade whatever the MOOCs will offer that will be the final grade of their students of those students in those respective colleges. So, each college will have number of branches and in each branch there will be number of students. So, how the peer evaluation system will work in this model like I have thought that in each college there will be number of branches. So, when the MOOCs offer any assignment or any project. So, each college will select a number of project he will select number of project and he will distribute those projects like see where like see one college had taken four project P1, P2, P3, P4 and there are number four branches P1, P2, P3, P4. So, he will offer four project to each branch and in each branch there will be a number of students like in CS branch there are 52 to 62 students. So, that 52 to 60 students batch will be distributed in four groups according to number of project for large group. So, like if there are 60 students so will distribute in four groups of 15, 15 students and among this large group there will be 3 to 4 subgroups also like in 15 students batch will have 3 to 4 groups. So, each groups will be given each small group will be given same project and the large groups will be given different different project like there are four large group four projects. So, each project is given to a one large group and one large group inside a one large group the same project is distributed to three small groups. So, when in three small groups will select the top project by this three small groups and inside the group each student will evaluate to himself then among the three small group each small group will evaluate to themselves then they will select top project. So, from each large group there will come top project each top project from each large group there will be different different branches also. So, from each branch for a single project like we have P1 project is given to large group L1 in branch B1 project P1 is given to large group L1 in branch B2 P1 project is given to branch B3 and large group L1. So, for each project these will take the final top project and so from each branches including all branches there will be also a peer evaluation among branches and they will select top project. So, four top project will be taken by the colleges. So, from each college they will have also such type of projects four projects four projects four projects then for each project that project is taken by so many colleges. So, whatever the colleges will have taken taken that project they will evaluate then again to this project top projects and will select for each project will select top project among the projects distributed among colleges. So, we will have a number of top projects among all the colleges. So, and then we will find evaluate at MOOCs level. So, this is the extension of peer evaluation system in MOOCs model and forth comes whatever the conclusion. So, peer evaluation system is effective in a large class it is a conclusion it is obvious conclusion there should be some anonymity at some level. So, that is why in blended MOOCs model we have included physical intervention of tutor or peers. So, that we can have a control over the this biasing or where there is a biasing or not. So, there should be a in physical intervention that is why this blended MOOCs model could be the future work for this peer evaluation system.