 So I would like to say a warm and heartily welcome to all the participants. This is EDEN, European Distance Learning Week, which we organized for the third time. This webinar is recorded, so you will get the link afterwards, and it will also be published at our information channels. This year, from EDEN, proudly hosting the third year of the European Distance Learning Week, EDL week, in cooperation with the United States Distance Learning Association, USDLA, who also have their National Distance Learning Week this week. So it is in collaboration with them, and there are also some parallel EDEN events. We have already had webinars since Monday, and maybe some of you attended those as well, and you will have access to all the webinars afterwards after this week. We have had very interesting presentations for the whole week, which really are in the cutting edge of our field in open and online topics for innovations in design to open education research and as for today as about quality. My name is Eva Ocean-Ilsson, and I am your moderator for today. I am also in the EDEN in the Security Committee. I'm also in the EDEN Fellow Council, and I'm EDEN Fellow myself. I'm also chair of the EDEN Special Interest Group on Quality Enhancement and Labor Learning, which also is one of the topics for today. So we have today two presentations, and now we come back to that. First, some practical things. If you don't already have done it, please mark on the map where you are from, and please introduce yourself in the chat. During the webinar, we have some calls for you, because we are interested to collaborate with you and to hear your opinions about what we are talking about today. And those of you who have registered will also receive a badge that you have taken part in this webinar, and the cards are recorded. Wait for some minutes while you pace yourself on the map. The description of this webinar is about that the learning landscape looks so completely different from today than it just did five years ago. And the way that learners are learning is changing the matter of day. Today, learning is available from anywhere, everywhere, and to any kind of device. Formal and informal learning are more and more merged. And in the context of globalization and knowledge economy, the quality of higher education is increasingly regarded as particularly important for national economic development and competitiveness. That's why high quality and relevant higher education equips students with their knowledge skills and core transferable competencies to succeed after graduation, within a high quality learning environment which recognizes and supports good learning and teaching. That is the background where we host this webinar for today. It was recently, very, very new, ANCA has published their considerations for quality assurance of e-learning provision. That is one of our main topics for today's webinar and how it is applicable for all forms of e-learning and how learning with ICD, digital devices, digital components, digital digitization as such can be used for better learning possibilities. It will also be presented how it can be applicable into higher education quality assurance provision and their systems. Besides that concept, also the Tesla project will be discussed. The Tesla is a project funded by the European Commission and it is about standards for integration into a different learning environment which will be developed to reduce the current restriction of time and fiscal spaces in teaching and learning which open up opportunities for learners with physical or mental disabilities as well as respecting social and cultural differences. Thirdly, the EDAN Special Interest Group on Technology-Enabled Learning and Quality Enhancement will be presented. The Special Interest Group aims to advocate for improving the quality agenda in education. So this topic very much problematized and enhanced about if we need to have a new quality agenda in education. So thanks for being here. You will all have possibilities to first of all answer our polls. I see that that is ongoing. Of course we are interested where you are and what you know about this kind of issues which will be discussed today. And you have also of course possibilities to ask questions. The questions will be addressed in the end of each presentation and I will keep an eye on it on the chat. So please just write your questions in the chat and the issues will be discussed. So again, a warm welcome to everyone and we get started. The topic is about considerations for quality assurance of e-learning provision. And the presenters are Dr. Stella Hrtegas-Hitaku from HQ in Catalonia in Spain. And besides, Esther was also the coordinator for the anchor work on the considerations for quality assurance of e-learning provision. And that's why we are so happy to have Esther here together with us today. I know she was just recently, I think it was last week in Kazakhstan, discussing about the same topic and she is almost all over the places at conferences and at her last some weeks ago in Denmark. And then it is really a topic which is very very high on the agenda today. And then myself, I am from Iran as I told you but I am also from the Swedish Association for Distance Education where I am the vice president and I am also doing a lot of work for ICB. ICB is the International Council for Open and Distance Learning and I do a lot of work on OER and on quality for them. I will also be your moderator for today besides presenting the sick child on quality enhancements. So Esther will talk to you about the consideration for quality assurance of e-learning from ANCAC and that is just published and it is available on the net. And I am sure here on this slide I have put the links on the image as such and Esther will also talk to you about the PESLA project. And I myself will talk about the e-learning and sick on talent quality enhancement and here is also the link. We have a special webpage at the e-learning webpage for this special e-learning school. And as you see those two polls which I have asked you to fill in we want to know if you know about this special interest group and if you want to learn more about it. And I see that 50% of you know about it and 100% would like to know more about it. So hopefully you will like to have some more insights after today but you are also welcome to talk more with us and to be involved with the sick. I will tell you how. So first of all I just put this definition from Commonwealth of Learning so we are on the same kind of page. What to tell is about. It is about aiming, it aims to focus on increasing ourselves to quality teaching and learning by supporting policy formulations and innovation in the application of ICT in education and the development of ICT skills. And I think it is a very wide concept. And as was said earlier the educational landscape is totally changing nowadays due to the increased digitisation. So that is the reason why this topic is of high priority. And also this is the daily use. I mean using digital devices, using internet, using audio, video, radio, TV from internet is daily based for everyone today. And how can that be integrated into education? So why does it matter? Because the use of tele can facilitate and promote educational access, equity, quality around the world which also are the main SDG goals from the United Nations and UNESCO. And it was publicly implemented in 2013. And that is not many years until now. So it has very much to do with the SDG goals. Education for all. There are some challenges as the educational landscape is changing. There are global demands. They are changing demography. There are societies needs, life of learning, life of learning, ongoing learning, maybe more. Size concept is used more and more. There is need of upscaling and rescaling because the labour market is changing. And that is also why tele can really be used widely. There are changing labour market, increased digitisation as I said, technical development make that like the fourth industrial revolution that we change the way we learn to change the way we work. We change the way we connect to people. It changed the way we relate to each other. It changed the way we communicate to each other. So it more or less changed every kind of what we are doing in daily life. You can see from the other sectors like the film and the music and banking and the hotels and not least the latest taxi movement with Uber. Everything is changing. There are more learning on demands. Learners, students take control over their own learning and they have other needs that maybe are among the office from the higher education institutions or from the educational institutions. There are needs for just for me and just in time learning. So that's why tele matters and that's why quality in e-learning and tele matters. You need to have another kind of quality agenda. So this is about just to advocate a way for renewing the quality agenda in education. Of course we don't have all the answers yet because then it could be easy but there are a lot of challenges and together we can work it out to renew the quality agenda and that's why we would like to present this take here and that we also need your support and your contributions. Of course it is an open interest group. It started in 2017 and we had during the annual conference in Jönköping it happened to be in Sweden and I'm leading this group and we had each of the days for the conference we had topics on the talent quality enhancement and you can see the topics here in the bullet points. About rationale about renewing the quality agenda about quality on micromessor and macro level about leadership. Because leadership is also an issue which really have to be reconsidered with working on the changing quality agenda. Did the slides become smaller now? There it is, thank you. So what we actually have started to do is that we are... Yes, that's right. We are working both for internal Eden community practices among our members, for our members with our members to create a lively and vibrant open platform on audacious quality and tell to have a meeting place we have a web page so far and we have also plans to do something more to have blog posts to have an interesting topics like this webinar for example. We also see that we have an external agenda that we can be a place which allows Eden progressively to be involved and to be in the forefront changing the quality agenda. That we can be a partner for national, European and international actors and organizations and networks. So the issue is very much how can we create opportunities to become visible both internal but also external and how to make use of all our members in Eden before everyone more or less are working at their home institutions home organizations, home countries on this kind of issues and together we can be strong enough to do something very good. So the idea is to be some kind of think tank for quality issues in collaboration with organizations with professionals to be some kind of place where we can raise questions and have a community where we can communicate existing projects for example initiatives like to promote this consideration from quality on anchor it's on the web already and also to be a network of networks there are many networks around in Europe and international and also at national level working in those areas and Eden can also be a hub for the Eden's especially interest group in town. But also as I said to be policy and advocacy orientated. For example when European Union or Commission are raising calls when they are having white papers or blueprints or whatever we can react on those. So far since 2017 we have started with a smaller core group from the beginning it was we from the Eden Eastie like Santa Cristina Softix who was also here today and Maria Nicklaus from the European University in the UK and Irina Bolonga-Vichier from our president Antonio Antonella-Porsche from Eden now and the previous president Antonio Texera for Eden and then later we have grown to be some more people who have an interest in this issue. Today for example Daniel Ehlers is also in the Eastie and you can see the members here and we would like to invite you if you have an interest in this topic just contact us and go to a larger group we can do more together. So first what we do mean by quality of course it is both on compliance and consumer protection it is about enhancement and about process and it is about reputation. In 2015 I myself together with some colleagues we did a review on quality models on behalf of ICDE and we reviewed and we searched over 40 plus up to that there are some models which are more norm based like accreditation and there are some which are more process based like self-evolution benchmarking or maybe somewhere in between so it depends what you mean when you are talking about quality it is norm based accreditation is a process based like self-evolution and what you would like to achieve. Most of the quality models although they came from different countries all over the world although they had different kind of purposes more or less they were expressed in different kind of concepts or words but most of them had those three aspects it was about management about strategic planning and development it was about products about the course and curriculum it was about services and curriculum support and then of course there was the learner and the learner in the middle and the learners maybe have different kind of quality issues like transparency, like flexibility like interactivity like presence, like trust etc etc and now that Esther we talk very much more about this because considerations cover those aspects we also came to the conclusion that maybe there are no needs to develop so many different kind of quality models but there are some general principles they should be multi-faceted they should use rather large areas from different kind of angle so not just to study for example the LMS as such or the course as such but also to study other kind of dimensions which have an impact dynamic and flexible to also integrate new issues like we are, although that are not so much new any longer they should be maybe mainstreamed so each individual person who are involved can make it to their own they should be representative like to take the stakeholders dimensions into consideration and of course they should be multifunctional to serve like a roadmap for quality enhancement so this was a very very brief description what we are doing in our sake and if you have an interest I would like to let you know more please just be in contact with us and I see that many of you would like to do so from the part so in case you have some questions right now you're welcome to address that now, otherwise we take it in the end yes, sorry sorry we have one poll now in the end that's right so I have one question in your opinion what would you see that Eden Sigtel will prioritize in the coming year so if you have some ideas just please some words or sentences no rush to write something for the moment so we maybe can come back to this poll and when we have the others as well well hello to everybody can you hear me yes that's fine thank you very much that's fine Esther so now I would like I think there are some echo I would like to introduce and give the floor to you Esther from AQR in Catalonia in Spain and also from the European Association for Quality Assurance in Higher Education the ENCA and as I said in the introduction the topic you will speak about both the first one but also Tesla is a very very high topic on the agenda around the word I will say I presented it to you where in Denmark for the ADTU conference two weeks ago and I think you have a rather heavy schedule and now you are we are so happy that you are here together with us so please if you have some questions the way for Esther please write in the chat and we have we have some questions to you in the end okay thank you very much thank you for your kind introduction and for the invitation we are very pleased and to works here as you have already said the result of the working group at ENQR and also the Tesla project I hope you you will enjoy and I also apologize with my camera because I don't know how to fix it to have a better quality and not to big head okay so I apologize for this okay anyway let's go ahead for the presentation so how I have organized this presentation as you can see in this slide I will begin with a general introduction to the quality assurance and the learning afterwards I will focus on the main findings from the work coming from the working group of ENQR that it's focused on quality assurance of the learning perspective provision sorry from the internal and external perspective then I would like to draw your attention to the assessment element and finally I would like to share with you some main conclusions well so as you know nowadays we are living in the digital age and this can be explained through two main reasons the globalization and the easy access to internet those two elements have impacted in the universities themselves but also in the teaching and learning process nowadays there are some reports that show this scenario shift as for example the EADTU report the European Association and Distance Teaching University which analyzes the change in pedagogical landscape and this report has been recently published and other reports as for example this one carried out by the European University Association published in 2015 which shows that the vast majority of high education institutions are offering or are planning to offer online or blended programs nonetheless there are other reports that shows that quality assurance of such provision has been given far less consideration as this one for example carried out by EUA in 2014 so within this framework ENQA the European Network for Quality Assurance Agencies decided to launch a working group in order to work on a set of considerations for quality assurance of the learning provision taking as a reference the European standards and guidelines this working group was composed by different quality assurance agencies who volunteered to work on this topic as you can see in this slide and the working group began to work in November 2016 and has recently published a report in ENQA website as Eva has already said but before going into the main elements included in the report from this quality assurance perspective I would like to share with you some general ideas from the quality assurance and e-learning point of view as you know quality assurance is one of the action lines of the Bologna Declaration since the beginning in 1999 and as a consequence of Bologna implementation the European standards and guidelines the ESC were defined and adopted by the ministries I'm not going to go to all the details of the Bologna process but I would like to highlight some of the relevant elements that I consider that are really important from in this presentation for the learning the first idea is that these standards and guidelines are generic so they provide a framework and common basis for national and institutional activities in the sense that they apply to a higher education offer in the European higher education area regardless of the mode of study or place of delivery and here we include the e-learning that's all type of e-learning should be considered as well as all phases included in the learning process for example daily assessment so the European standards and guidelines were the backbone of this work it was agreed that ESC are equally applicable to all modes of teaching and learning but there was a necessity for an appropriate interpretation for using them so that was the work that we carried out at this working group so we were reinventing the wheel we were focusing on this appropriate interpretation from the internal and external perspective in the sense some recommendations were given to quality students agencies in order to improve their review procedures while higher education institutions should know how to adapt their internal quality students system in order to guarantee the teaching and learning process which are the most challenging the standards so if you see the European standards and guidelines from the internal quality assurance point of view we've got 10 different standards and I'm going to focus only on a few of them the most challenging one and those are the ones marked with an asterisk so from the first standard policy for quality assurance the policy of an institution should include the e-learning strategy this should be embedded in the overall strategy of the institution and institutions should think if the quality assurance strategy should be adapted from the e-learning perspective the policies also should grant access and ensure participation of students with special educational needs and the institution should be aware of the development of new policies at national and international level this is the case of the new GDPR directed from the European Commission which is related to the ethical and legal considerations as stakeholders involvement it's another important point as you know this involvement could be a challenge due to the lack of an on-campus presence so this means that the institution maybe should have to do or adopt new strategies in order to warranty the participation of all the stakeholders the student centre learning taking an assessment this is a really important standard this standard supports the use of flexible learning paths, different modes of delivery a variety of pedagogical methods and giving a sense of autonomy to each student so this means that digitizing the content alone doesn't lead to a successful educational setting so this institution should design an educational model in order to warranty student achievement of learning outcomes the institution should pay attention to the assessment in order to have measures to warranty the authentication and authorship of the assignments, exams etc it should it is recommended that the institution organizes online discussion groups in order to warranty the interaction in between student to student teaching to students and also another important element is the learning materials and obviously it should be appropriately updated so let's move to the next standard and I'm going to focus on the recognition element the academic recognition should be assured and it should be the same level of recognition by professional bodies and employers as an on campus program and if qualifications are offered sorry if qualifications offered by the institution are warranty the high education system can help to stop fraud or diplomats teaching staff is a crucial element the institution should define the structure the profile and the role of teaching staff because we have realized and we have seen that there are different teaching staff who are participating in e-learning provision teachers teaching staff should be skilled and well supported in relation with the pedagogical and technological requirements and there could be a bigger complexity when we talk about the coordination of teaching activities as there are different teacher roles in doing this role ok so let's move to the next standard which is learning resources and student support and I'm going to focus right now in the learning resources especially in the virtual learning environment which should be interoperable and robust and it should ensure accessibility of learning materials and the assessment the library is another important element and virtual learning should be well organized if the program includes this type of resources student support is one of the core elements of these standards this is really important the student support should cover elements as tutoring, pedagogical technological and administrative related needs it should be adapted to the e-learning environment and if an institution warranties the student support the retention rate the success rate and the satisfaction of students could be improved virtual mobility of students and academics is another element that we should take into consideration and the final standard is information management this means that there could be data and indicators derived and as specific from the e-learning so let's move to the external quality assurance standards here you can see the list included in the European Stambles and Guidelines and once again I'm going to focus only on those standards which are marked with an asterisk the first one is related to designing methodologies field for workforce obviously quality assurance agencies should take in consideration the particularities included in part one included in the internal quality assurance those elements that we have already commented the agencies should organize flexible processes in order to include new modes of teaching and learning this means that quality assurance agencies should be flexible but also innovative in their and when designing their review procedures there could be a specific criteria indicators, guidelines or frameworks the next step is implementation process here we are going to focus on two main elements the self-assessment report and the site visit when talking about the self-assessment report it is important that this document includes a clear explanation of the pedagogical model and the virtual learning environment and it should be recommended to provide access and navigation to the BLE during the site visit there will be an intense examination of the technological infrastructure and there will be an interview with all the stakeholders in this case we have to take into account that there could be a wider range of teaching staff roles this means that the agenda can be longer and this means that we have to pay attention to all the stakeholders participating in the teaching and learning process the last standard is peer review experts so agencies needs experts with experience in the learning blended learning and it should be trained specifically in this provision now let's focus on the assessment why it is important the assessment the assessment is extremely linked to the academic integrity and trust that's really important for higher education system because there's a need to resolve the gap in the current online evaluation system because there's no European framework on the assessment so that's why Tesla was prepared and it was funded by the European Commission in an horizon 2020 call the main aim of this project is to combine and develop an assessment system which ensures learners' authentication and authorship in online and blended learning environment while avoiding the time and physical space limitation imposed by face-to-face examination what is really important from this project is that we have adopted different perspectives so it covers the teaching and learning processes the quality assurance aspects the privacy and the ethical issues and obviously the technical requirements and the technological development so this project is composed of 18 partners coming from universities quality assurance bodies research centers and enterprises and what is also really interesting to explain are the development of instruments in Tesla project Tesla system we can distinguish three main groups of instruments depending on the functionality and the typology of the instruments the first group is related to document analysis related to the analysis of written material it's linked to the authorship and the instruments are the pleasure reams tool which analyzes written material and detect similarities and also the forensic analysis the analysis of the written style of the user the second group is biometrics related to the authentication and intent identifies the user based on the user based on physical characteristics and which are the instruments of biometrics are pleasure recognition web recognition, kid's drop dynamics and the last group is related to security techniques related to the confidence and we are working with timestamp and digital signature if you want to have more information on how the system is working I highly recommend you to go to Tesla website and watch some videos that are very specific and explain how the system works so focusing on the quality assurance elements for E-assessment the three quality assurance bodies working in Tesla which are Encore, Ecanine and Calunia we have defined 8 standards with indicators and evidences nowadays we have some final results of the pilotings I haven't go into details of how the methodology is being applied in the project in the project we work with pilots we have defined three different stages of pilot the difference is that the development of technologies were done during the pilot and also the sample of the students were increasing in this sense we can say that we began with 600 students and we finished with more than 10,000 students in the third pilot so after we finish the third pilot we have applied and studied how those standards are complied by the different high education institutions participating in the pilot and I would like to share some of these findings in the first standard which is related to policies, structures, processes and resources for quality assurance of E-assessment we have observed some scenarios where E-assessment is permitted and other scenarios when E-assessment is forbidden by law or by the role of the university and in overall all high education institutions have well defined policies and processes for quality assurance procedures nonetheless traditional universities who are which are in the transition from face to face education to online education should develop a specific policies on E-learning and E-assessment and when doing this transition when the development developing of these quality assurance elements the quality assurance unit should be involved from the assessment of learning we have observed a diversity of assessment methods applied in the higher education institutions this diversity also applied to the when assessing the students with a special educational needs and the chosen assessment methods are aligned with the learning outcomes in relation with the student support this is one of the important elements and we have good practices and in general all high education institutions have well established support mechanism to meet all students needs on the other hand teaching staff should be trained on the innovation of pedagogical practices and should receive technical training also teaching staff should be provided with updated information, guidelines and well defined procedures to deal with the academic integrity so this standard is an area for improvement in general for all institutions participating in the project and finally I would like to highlight the standard learning analytics and all institutions agreed on the potentiality and value of having information management system in place for the improvement of learning processes but on the other hand we observe a lack or a need to enhance an information management system for the systematic collection of data related to the quality assurance of the assessment so those are the main conclusions from the application of those standards and having the third pilot finished so which are the main conclusions we can say from the Tesla project and quality assurance perspective that any assessment system like Tesla can contribute to provide confidence to fully online and blended provision and it can improve the perception and development of the assessment processes and also it can contribute to reduce the number of diploma meals or with low reputation and in overall which are the conclusions I would like to share with you the first idea is that high education institutions are adopting new pedagogies very quickly while quality assurance agencies lack behind in terms of giving special considerations to eLearning and was working group demonstrate that ESG the European standards and guidelines are fully applicable to eLearning provision and this work provides a common understanding for high education situations and quality assurance agencies innovation project as Tesla can contribute to provide more confidence to high education system to the society and now maybe we are in the transition to let's say to education 4.0 and the question is that are the quality assurance agencies ready for this transition and thank you very much for your attention and now I think it's turn for I am not quite sure if it's turn for the questions or for the poll Eva if you can help me please yes first of all thank you so much Esther for this very very very good presentation both the considerations for eLearning and about the Tesla project and I think you gave very very good insights and thoughts for thinking so before we take our questions we will give the floor to the audience if they have any kind of questions either to Esther or maybe to me as well so please write in the chat while while people are thinking I would like to start with one reflection or question and I think you really pointed to a very very important issue and that is the need of eLearning and pedagogical considerations of this kind of things moving to eLearning, blended learning etc etc and it's often in case it is handled at institution it's often at the pedagogical centres and among the teachers and they have to live their own kind of life but you really pointed with both the presentations the need for quality assurance agencies and quality assurance centres even at institutions to deal with those kind of questions and then I think that's really really important because I mean there are some kind of spin-off effects as long as quality assurance agencies I used to say myself as long as quality assurance agencies are not asking universities for providing sort of information on this kind of task universities are not dealing with it as long as universities are not dealing with it or asking you faculties about it faculties don't care and that goes the whole way down to the teachers and to the students so I think you really pointed to a very very important issue and I would like to maybe to what people are thinking if you can say something more about this your thoughts during the project journey so to say how to really make this mainstream within an organisation because there are so many centres or units involved in it like you said the pedagogical centres, the teachers the quality assurance centres I mean it is very much about interdisciplinary work nowadays for quality and that was all that pointed to as well in our study about quality models it is you need to have a holistic perspective can you maybe say something more about that and how to implement that this is really interesting question and I have to say that I can only talk about quality assurance point of view and from my experience when assessing the open university in Catalonia because you know that we thought about the scenario in our country so we can work with really really sorry there is a lot of noise ok now it is better thank you so yeah you are right there are different elements and factors influencing on the pedagogical model and I think it is the responsibility of the university of the institution to organise in the best way this is the autonomy and they have to decide how they want to organise so then they have to answer to some standards that we prepare for assessing them even from program perspective or institutional review I would say this I mean the problem we have got about quality assurance is that our procedures in some context weren't so clear to be analysed by the experts and to help institutions to improve and this is my point of view I think we are like drivers and we want to enhance the system but I would leave the institution for the autonomy and decide which is the best way to organise themselves thank you Ester persons of writing so maybe another question from my side in the meanwhile I think it was also very good that you stressed that I mean one point of view there are special considerations for e-learning provision but on the other hand it is very well covered already in the European standard of guidelines you maybe just have to add some extra considerations or extra reflections or extra benchmarks so why is it so difficult to integrate quality consideration into mainstream, into quality standards and guidelines I mean not the standards and guidelines but the quality assurance standards quite often we have had by now we have had e-learning like left-handed pipeline but it needs to be integrated and by your considerations by ANKIA it is built on SDG it is one of the same people in many ways so why is it so difficult for institutions to do it yeah, you are right I think that depends on the context once again depends on the country the agency as a group as a working group as I have already said we have reinvented the wheel it was a work based on some reports really good reports that we have got on the field during some of the agencies because there are some agencies that we have got some experience evaluating and assessing online institutions and online programs so maybe the difficulty was to focus on the core elements and the really important things and make them clear this is as a group I could say this if I have to say something on how to implement those considerations in their procedures I can talk about my context, the Catalan and the Spanish one and I have to say that we have already done some steps forward and for example in Catalonia in the example accreditation programs we have got, we have specified the vast majority are the most important elements that are already included in those considerations so we can say that in Spain and in Catalonia we have already done this work but it's not the same in all the countries I have to say but as far as I know and after presenting this report in the General Assembly I have some inputs that the agencies are going to work on this and they are going to prepare some terms of reference or they are going to fine-tune their reviews in order to include the e-learning perspective so I think that those are really good news we have a question here from Monica quality assurance in e-learning education is not a joke quality is not abstract, it is a reality university autonomy is not a justification for not complying the quality assurance at the minimum with quiet level so what do you say about that do you see the question in the chat trying to read once again, sorry take your time yeah, you are right I totally agree it's not a joke, it's a reality and the autonomy is not a justification of course I'm not quite sure if I was clear with my answer before I was talking about more in how the university is organizing in order to design the pedagogical model and if the question is more related on how the institution should comply with the standards I totally agree this is a responsibility of the institution and they have to fulfill and comply the requirements it is important to bear in mind that all quality assurance agencies work within the framework of the european standards and guidelines and then each agency prepare their review methodologies that it could be an institutional program level it could be a mixed of all there are a lot of types and those standards the quality assurance standard can be a little bit different from one top context to another one but all of them at the end should fulfill the european standards and guidelines this is the basis and of course the quality is a responsibility of the university and it should be covered by them this is not an excuse to provide any e-learning or not they should provide equally quality if we are talking about e-learning provision or traditional education this is Therese Byrd I know the UK e-learning context to some extent but I don't know about the rest of Europe so may I ask are e-learning programs generally assessed by exams or by essays or other ways if we do exam are you learning how do we make sure the person submitting the exam is cheating the question is about how to ensure that they are not cheating I assume that this is more related to Tesla project what is going to be really interesting at the end of Tesla project is that there will be like a set of different e-assessment models that will be recommended to use with different tools this means that one of the basis of the Tesla project was the flexibility so this means flexibility for pedagogical models flexibility for the e-assessment including essays including test including programming including other things so there will be a matrix with a relationship analyzing which is the method you are using and which is the recommended instrument because the flexibility is also for the instrument it is clear that there are some assessments for example if you have an oral exam you are not going to receive a board instrument so there will be recommendations in this way but of course there is the academic freedom and the teacher should know about which is the best assessment methods in order to assess the learning outcomes etc etc I see that the Colise is writing something I will ask you in the meanwhile I know I am working a lot about quality myself I am also a quality reviewer and I was recently at UNESCO conference for quality assurance agencies and one of the outcomes from that conference it was held in Geneva in the Europe and the outcome was that quality assurance agencies I mean the staff there they are not ready for e-learning yet and this is one of the main issues I mean we do a lot of work for teachers academics the people who are working on quality assurance agencies are not ready yet so how to deal with that ok I think that I think that sorry I think that we are on the way and we are doing some trainings I think that depends once again on the context it helps so much for example in Catalonia we've got a really good scenario because we've got an open university so this means that we have learned a lot for assessing them there are other contexts that maybe they don't have distance or fully online universities and they don't have so many experience but they have to be trained there has been some actions for example in co-organize a seminar where new staff hired by agencies were trained and this work was explained there and there was a workshop explaining and working with those considerations so I think that agencies we are taking care of this and we are going to be ready some of the agencies we are more ready than others of course but we will be there very soon I think that the first step it has been done with this document and then of course we have to do more actions sounds really promising thank you so much for that I see that Carlos was more or less touching on the same kind of issue that there need to be natural bodies or agencies dealing with this not just to leave it to the educational providers yes I think maybe it's time now to ask the audience of some of the questions you have prepared we have two questions for you still there are possibilities to write in the poll also about the the sake talent quality enhancement it is still there so can you say something about the questions Esther? if I may I would like to not to influence too much on what they have already explained before but for us it will be very useful to know which is your opinion from your opinion which are the most challenging standard from the internal and external perspective and your opinion is really important for us because we want to do further work and we want to focus on some of these standards I don't know if we can begin to comment something or do we have to wait a little bit more well I think it's clear that from the external point of view most of you think that design methodologies fit for purpose is one of the most challenging ones for quality assurance agencies and for the internal perspective it seems that we've got four standards that are equally voted so we've got no three of them, sorry student centre learning teaching and assessment student admission, progression, recognition and certification and teaching staff isn't it? yeah I don't know if we have any questions if someone can share something in the chat Eva, is it possible to we have still time we have signed this webinar so there are time for discussion so please if you would like to maybe it's even possible to get the mic if you would like to raise a question because we are not so so many still here or maybe you can kind of questions before Esther is it more or less the same as the answers you used to get or some of them yes for example from quality assurance perspective, the external perspective for us we would say peer review experts to have a pool of experts really trained and prepared for for the evaluation and for understanding the pedagogical model and everything is one of the key elements and this is something that worries a lot to us and this is more or less the feeling and the consensus we've got in the working group for designing methodologies for people purpose I think that we can do it of course we have to understand the model but for us it's more challenging to have the experts or enough experts because I have already said nowadays we can say that they are not let's say fully traditional universities so our institution offering only face to face programs there are very few right now and I'm talking about my context okay so for us we have to have this experts from the internal quality assurance point of view we normally we agree that student center learning teaching and assessment is a really important and challenging standard not only for e-learning but also for traditional education recognition is also important and teaching staff but they put also a high like the student support because this is something really important and well we have realized that universities with a tradition of offering online or distance education they are really well prepared to provide the proper student support but universities that are new in the sector is universities or institutions new in the sector offering online programs or traditional universities which are offering new online or blended programs especially focusing online sorry they've got some difficulties on having a proper student support but yeah what it has already appeared here is our thoughts too okay thank you so much I'm wondering are there any other questions from the audience and I'm wondering are there any questions from you Esther to us besides those you have raised so far for me it's fine I'm really happy with having these results of those two questions so thank you we are well in time we have one last question for you in the audience just waiting for that one so from Eden's side we are very keen to know what your takeaways from today's webinar we can get some feedback and to do some follow up as well I hold you for too long because now that you are busy with other kind of duties as well this afternoon so if you have something to write we are very happy for that but in case you haven't it's fine also anyway I would like to thank you so much for taking your time to being with us this afternoon talking about so important issues as quality consideration in e-learning provision it is a really really hard topic as we have been discussing for one and a half hour by now that the landscape is changing in education and there are other kind of demands and we need to have some kind of other kind of quality agenda to move forward and we are very happy to do that together with all of you and all of us who are interested in this area in different kind of ways together we can do a lot this webinar is recorded and you will have the link afterwards and it will also be provided from Eden for all the webinars for the week we are continuing with webinars this afternoon already so if you are like to continue you are most welcome to do so then we also have a webinar for tomorrow so please register if you have an interest and we are really really happy that you have joined us for Eden UP in this last learning week thank you so much and yes I see we have some answers very very good quality assurance must be respected also in e-learning too I'm happy to see the references to the paper I appreciate that quality assurance agencies are working on the way you will have the slides of course and my slides and also at ASTIS you have some more links and I'm sure it's for you as well ASTIS you are welcome to use the slides and to use the information we have provided for you so with that I will let me see if Antonia is saying thanks it's a new perspective in this theme for me very good thank you for the comment Antonia so with this last words I would thank you all so much for joining us and I would like to thank you so much ASTIS for being with us this afternoon for sharing your experiences and competences in the field and after you have coordinated this very very important work so I think we all have to bear it forward wherever we are working thank you very much so have a nice afternoon and a nice rest of the week thank you so much