 Thanks a lot sir and welcome to the second joint webinar core Eiffel and open air to celebrate Open Access Week and the topic of equity and inclusion. So today we will talk about equity and inclusion in open science policies and if you missed our Wednesday webinar on equity and inclusion in community on infrastructures for open science recordings of that webinar are already available on the webinar page here and we'll also post the link on YouTube but today we will talk about policies and many of us are drafting eyes institutional or national open science policies now and for me it's been a challenge to make sure that equity and inclusion are not only nice words that we use but they really embed it in the policies and they really implement it and that's why I have a pleasure to introduce two wonderful speakers today so one of them is Dr. Yuan and I wouldn't even try to pronounce his family name sorry about that and Dr. Yuan will talk about research assessment reform in China which started this year and it erudits the five only and it's really big and we're all looking forward to the results because I think it's a game changer and another excellent speaker today is Lydia Chevich and she works at the Ministry of Science in Montenegro and Montenegro is a small European country which introduced an excellent program of implementation of open science principles in the country very recently and sorry to say that but it's you don't really need to be a large country like China to step in and make changes in the way research and research assessment works in your country so we'll have two examples which are very recent very interesting and of course an inspiration for us was a French national plan for open science that specifically includes equity and diversity in open access to publications for example as you can see here on this slide rewarding from their policies that they are changing the way research assessment is done adhering to San Francisco Declaration of Research Assessment they encourage use of open citations using initiative open citation they have strong call to see a call for open science and bibliodiversity and it's a part of their policy to develop less concentrated publishing environments and adhere to the principles of open and ethical publishing and open access and they have a special open science fund to support diverse scholarly communication activities if there are similar examples of policies in your countries that include equity and diversity here please add them in a chart because we would like to collect them and we'd like to come up with some model voting how they could be embedded in the new policies and now we're now the word the floor is yours Dr. Johan thanks a lot for joining us I share my screen yes please okay can you see my screen yes yes we can see it good afternoon and thanks for iran introduction and I am Yuan Yunpeng you can call me Yuan and I'm from the National Science Library of the Chinese Academy of Science we call the CS it is my honor to invite you to introduce the new research assessments waveforms in China you're dedicating the five only in science and technology measurements this work is by professor Liu professor Zeng Zeng is in this meeting and me I will introduce is from three parts the first is the background and the second is the related policy in the related policy I will introduce some main point of the policy and some typical measures in China the last one is the effort of our library the first one the first one is the background in November 2018 the ministry the ministry of science and technology we call the most the human resource and social security ministry China Chinese Academy of Science we call the CS and the Chinese Academy of Engineering we called the CAE began to clean up only academic papers only professional titles only education background only awards and therefore the scientific research institutions began to eradicate the only academic papers only challenges title only professional titles only education background only award in research assessments here in after we refer to the five only it means that the reduced assessment activities based on these indicators why we and why the reform comes about the first reason is that China's scientific research system and talent team has been basically sung and look at this picture we can see the number of SL papers of China have increased a lot therefore the scientific research assessments and should be changed accordingly the second reason is that the current assessments have some bad effects for example you take SCR as the main assessment index is harmful the development of domestic journals I think in this this many countries have these problems and secondly is the current assessment system make many research pay much attention to the number of academic papers ignoring the quality and the thirdly is the we say in selection the challenges with the title is not benefit to the selection of the young talented and the take people as the main assessment is not benefit to the diversity of scientific research achievement the so the next path is the related policies of the five only the earliest related policy is guiding opening on promoting the reform of talent assessment mechanism by classification issued by the general office of the commerce party of China central committee and the general office of the state council is the top top top top organization in China and in and in 2018 President Xi Jinping said at the meeting of academic CAE and CS they face as the class classified assessment system based on the quality contribution and performance of scientific and technical innovation we all established and in July in 2018 the state council gave the opening on deepening reform of project assessments talent assessments and organization assessments and in September 2018 at the national education conference presenting President Xi Jinping called for with a lot of efforts to overcome non-standing problem that folks only on academic goals advanced degrees diplomas titles next in November 2018 most issued a notice on special actions of cleaning up only papers only titles only academic qualifications and only awards and the and in April 2019 Qinghua University is a famous school in our country if some often need on perfecting the academic assessment systems and in August 2019 according the only academic and only contribution the natural science foundation of China we called ASFC put forward four assessment criteria about innovation in talent project assessments and in in February 2020 most most put forward some measures to uh break the only paper they said it gave the some opening on standard in the use of related index of SCR papers and in April 2020 again programs ensued a notice to only papers and in May 2020 Fujian Fujili province and Jiangsu province issued the notice for the only papers and in July the the the MOE gave the guideline on deepening the reform of the professional title system for teachers and in I mean in in August the MOE gave the disability assessment system in quality and using universities and promoting the modernization of education government system all in all in all we can see the government of China has made a decision to reform the scientific assessment assessments presented here the general office most MOE in ASFC CAE CS and some university and some province have put forward some policies and measures to to the five only after reading the policy and count word frequency we find the main example of this reform is the falling points the is yours representative representative people and the classification assessments and use the asset index correctly and you and the peer review in science and technology assessments and pay attention to the research integrity as for the representative assessment system for example to assessments the national national price and the young and the middle age the latest the number of representative works should not exceed five and the innovation team in key area the number should not exceed 10 as for the classification assessments we can see the the policies give an easy order according to the correct correctives and this policy with a poem excuse me with this possibilities of challenges and the population and combine the communists particularity and the performance and the development development partial quality and quality assessment assessments to its time companies the scientific and reasonable criteria for evaluating talents we give the explain the bill that for the basic research the assessments so focus on the innovation level and the scientific value of the people and the download does not take related to the index of asset papers for the applied research and technological innovation the key point of assessment is actual contribution to solving the key technical problems and the actual effects and the new technology new products and a new process work rather than the people as a single assessment basis for the service of national defense the academic people is generally not regarded as an assessment index for the discipline and school assessments suggest that we use the right right assessments of subject and schools for the as for the asset papers and we don't not take the related index of asset papers as the direct basis of professional title assessments and the talent and the organization assessment and the project assessments for the peer review we can which is mentioned many times in this policy documents the recent and recent the peer review we all carried out an international review would be introduced for the basic research for the basic research to give peer related to peer academic assessments and strengths international peer review for the applied research and technological developments highlight the market assessment by user market its plus and other relevant third party assessment for the philosophy and social science emphasis on peer recognition and social benefits the last one is is the the last the main points is the research integrity we focus on the more moderated assessments assessments index and other both advocating integrity and integrated systems and its exist mechanism next I will introduce typical measures about uh in the five only is the analysis the general ways of analysis this and they probably they give four new devisions of innovation has been used in the new rollers for talents projects evolutions evaluations the first one is the method logic innovation the second is the key scientific evidence then the third is the theoretical combination of social needs and the and the last one is the discipline development they use they use there are four indicators to to to uh assessments the talents projects the and the last part is the effort of the our library natural science library Chinese academy of science activity at the work is open access and pay attention to the positive information of open science on scientific research even assessments for example we expand templates open access papers on uh one one stop one stop discover discovery platform go away which integrates more than one thousand seven hundred old journals and we also hold the China open access promotion week in october 20 and 21 we hold the 90th it's also online professor Liu gave the keynote speak in the all offline the meeting here is the first first first speech and the professor them also gave a speech on on this on this meeting beyond that we had to pay much attention on the research of the center metrics for example in 2004 our college being young steam the timeless jcr sub division table which covered 18 18 major disciplines and our college show to learn has done some works on even even evaluate and analysis analysis the cited contents of paper with the full full with the full text and i and my college these year ones did some works on the additive on the this plus relationships to improve the is improve the peer review and that is all my introduction thank you for your relation and your comments is welcome thanks a lot doctor you that was excellent and i wish every country had this kind of policy that's excellent so we have some questions already and comments and they are in q and a functionality so i'll i'll read them to you the way that they're written so there was a question about possibilities of opening science to everyone especially students and that was when you started talking so i think with what you showed later on go open access open access journals portal and there are also repository portals in china and we could add some links in a chat to that so china promotes open access publishing and also promotes open access repository so i guess that question yeah and then efforts of national science library are here so i guess that's covered and then a comment and question from dr fernanda bagel and she is a chair of unesco open science committee and under her leadership a very strong and equitable open science recommendations have been released in a draft form and i hope they will be adopted next year so she's writing i find that the concerns that boosted the china reform are present in latin america where we are trying to promote transformation and research assessment systems also greetings from mandosa argentina and then her question english writing was reinforced by the five only is chinese as an academic language an issue in discussion currently do you address the language of publication in your discussions i and i can i see the because it's the english writing by only so what what about publications in in in mandarin do you do you encourage researchers to write in english or in in mandarin i i think in i mean in chinese the we use the five five only for the for this phenomenon um it's the all the all the academic papers the in the in chinese and in the english language we also in we also do in the the five only thank you then biliana kazanovich from university of belgrade is writing moving out from the impact factors cost more since the relation based on the impact factor is very cheap easy and unfair the reviewer work cost much more in money but also in working hours does national science library have some estimation on the costs do you expand the teams of academics for reviewing yes yes maybe i asked my colleague uh professor to give this give some comments for this yeah i'm promoting her as a panelist so she should be able to speak shortly if she unmute her mic hello yes we can hear you thank you and do you mean we whether we come to the cost yes cost to to evaluate how much evaluation will cost now because you have expert reviews will it be more expensive for you now mm-hmm oh you you mean the cost about the evaluation oh sorry i'm not quite sure about the answer uh uh i think uh at the present we we we were uh when we evaluate the projects we often uh we often use uh peer review we often we often evaluate the project by peer review we think that is expensive but we we do not count the cost and when in chinese academy of science uh when we evaluate the institutions performance performance we encourage the uh we encourage the institute to invite the uh international experts to evaluate uh it is expensive but we think it is uh very useful sorry i i don't know yeah we do not we do not count the cost i think perhaps the headquarter of the cast we will we will think about this question thank you for your answer i think i think you answered it that it's it's it's more expensive but it's it's important thank you so much and then there is a comment from riva from slavic university of gaza publications in other languages except english are unfortunately invisible people address usually their communities needs and problems in their language however such research works are not considered for promotion in local universities and i guess that's what china is doing now that they're changing that and they are looking at the impact that this paper makes so that was rather a comment thank you so much so if if there are any other questions we'll come back to them after lidia's presentation and uh now i'm very happy to give the floor to lidia to talk about open science policy developments in montenegro because for me that's one of the success stories served this year in addition to china thanks a lot and over to you lidia thank you rima thank you first off for the opportunity once again to take part in this event and to share our policy in this way it is also to us it is one of the success stories that we achieved this year uh so uh i would like to start so actually uh to start off the program of implementation open science principle is a strategic document that among other things defines the plan of our activities in that open science in the forthcoming two two-year period so firstly i'd like to say a few words about the development process so the program was created by a working group composed of representatives of the ministry of science and the representative of university of montenegro as we immediately saw the importance of involving a member of academia in the process also we worked with an external expert whose knowledge and guidance were of particular importance for this entire process so in this process we also carried out consultations with main research institutions and stakeholders in the country this was also very important as it allowed us to identify their perception of the matter and challenges they have faced in terms of practicing open science it also helped us a lot to better shape and improve the overall document uh so after extensive work the program was sent to the government and finally adopted in June 2020 uh for us this was an important milestone although it is just the first stage of fully aligning uh the Montenegro research ecosystem with open science principles in the european research area uh now the vision of Montenegro has set out in the program is that all research activities should be based on open science principles this implies that they should benefit the society as a whole and that public funding directed at research activities ought to be spent efficiently and transparently so uh it is clear that the objective that everyone is trying to achieve is to make every step of the scientific process visible and accessible and to make it available to both scientific and wider community however in reality we see that the scientific knowledge production is much more closed fragmented and isolated from social problems than it is expected uh the reasons for this can be manifold uh these are some only some of the examples for example uh scientific practice becomes locked in the pursuit of individual success because scientists compete to reach their priorities and therefore much of their knowledge is not disseminated also researchers are motivated to write their research toward towards areas topics and methods that would be widely widely cited so this not not this does not necessarily coincide with societal needs also scientific policies oriented towards commercialization of scientific knowledge increasing the local scientific knowledge uh as for the situation in Montenegro we found that there were no adopted policies or recommendations at least related to open site open access practicing nor has this been required by the research funders so far so this means that the implementation of these principles is up to individual researchers there have there have been however some initiatives both from the Ministry of Science and from the University of Montenegro for example years a few years back since few years back the Ministry of Science has been co-financing the publication of papers by Montenegro researchers in open access journals and also supporting the publication of open access scientific journals indexed in the directory of open access journals as for University of Montenegro they signed the Berlin Declaration on Open Access in October 2018 they also created a digital archive of the university which includes an open electronic database of doctoral dissertations defended at University of Montenegro so analyzing this situation has led us to define the primary aspects of open science that are to be further developed in Montenegro these include open access to scientific publication open access to research data and these two are the inevitable part of the research process but in addition to that also open access to research infrastructures having in mind having in mind the importance of availability of research infrastructures for the overall overall research process so considering the limited number of activities in this area in order to change research culture and to achieve greater efficiency in introducing the obligations of practicing open science principles we found it necessary to apply a phased approach so to gradually develop the necessary framework including technical, organizational, regulatory and other aspects this also implies inevitable awareness raising of all stakeholders about the importance of open science so what does this specifically mean for the three aspects that we define in terms of open access to scientific publications the first step would imply creating a national repository for publications that would be a single point of access to overall national research results as well as devising adequate rules for its use that will apply to all stakeholders taking part in the research process once this infrastructure is established and rules are prescribed the practice of green open access will become mandatory which means that all publications that result from publicly funded research will have to be deposited in national repository and be made available for reading, downloading, printing etc in the meantime until this national repository is built in order to immediately start strengthening the open science culture in terms of this aspect it will be recommended that publications resulting from publicly funded research are stored in well-known international repositories in accordance with the principles of green open access the approach the approach is similar for open research data so it implies establishing a national repository for storing data and adopting the relevant rules for its use and once this infrastructure is established all data will have to be stored in the national repository so here again up to that point it will be recommended that all research data are stored in one of the existing repositories as for open research infrastructure the first place would involve the creation of national digital registry for research infrastructures or joining one of the existing stable international platforms also it is necessary necessary to clearly define the rules of access and use of research infrastructure in accordance with the modalities and purposes of the access that is to say that access is focused on either either on research or education achieving market benefits and so on so this registry that will be either form or that will be joined by us will initially contain information on the infrastructure and scientific research institutions holding them as well as on the services that they would provide in accordance with the national roadmap for research infrastructure so here I should clarify that the national roadmap for research infrastructure is actually the result of extensive work on recording the research infrastructure that is available at national level this was done with a view to better defining the priorities and sources of funding the research infrastructure but also to consider the opportunities to share the infrastructure in order to create better possibilities and better environment for researchers nationally the new round so we had actually two rounds of mapping research infrastructure and the new round is expected to be carried out in 2021 one very important issue that we had in mind when we were drafting the program is the necessity of introducing changes in assessment practices in terms of acknowledging open science activities and including this matrix in the distribution of funding evaluation of project proposals and results so in order to promote practice of open science principles we found it necessary to introduce criteria for assessment and rewarding researchers who follow open access principles in their careers in this regard key activities include additional acknowledgement of publications published according to open access principle in the assessment of research work at different levels integrating research data management openness and fair principles into the process of assessment and evaluation of research at different levels promotion of researchers to practice open science principles acknowledging the practice of open science principles during the research recruitment procedures evaluation of project proposals evaluation of institutions and awarding research rewards so this is one of the most important parts as it will boost the motivation both for researchers and for institutions and it will also be a solution to some of the problems mentioned in the in the beginning the final important activity or the one that goes simultaneously with all of the mentioned ones refers to awareness raising of all open access open science stakeholders this this actually requires comprehensive organization and awareness raising of awareness raising activities but also necessary actions at sectoral levels so it is important for example for researchers to be aware of benefits of open science or benefits that it can bring them and they should acquire new knowledges and skills through continuous training starting from the beginning and support also support they they should have support to their disciplines throughout their career this also means that higher education institutions should include topics related to open science in their curricula which we will do our do our best to impact you know that in order to immediately start building the solid basis and incorporating this practice in the research process so to to sum up the program has set four operational goals through which we will create a solid basis for the implementation of open science principles in Montenegro and these are improving legislative framework that enables the application of open science principles establishing national infrastructure for open science to improve research and innovation activities enhancing the implementation of open science principles to improve excellence and relevance on scientific research activities developing human capital through education and promotion of open science principles to strengthen competitiveness in the field of research so by achieving this we will significantly improve the research culture in Montenegro and we are truly determined to do so thank you thanks a lot Lydia that was excellent sorry I saw more questions I'm just trying to I think one of them was answered already thank you so there are there is a question and a comment Beliana Kazanovich is writing congratulations to Montenegro the plan seems to be very promissable what is the timeline for establishing national repositories and who are the main stakeholders in this process okay so the plan is actually to finish this up to 2022 so we have two years to cover all of these activities it is a bit demanding especially considering all of the activities other activities that need to be completed and the main stakeholders would be institutions funders research funders of course researchers are always those who are the beneficiaries of this process thanks there is also a question from Hannah Janetskova do your researchers have to deposit in a national repository if they already have an institutional repository but I guess it's not the case right you you don't have institutional repositories and we decided not not to set up two types you you'll just go with one national right yes the goal is the goal is to cover to put everything in national repository everything that results actually everything that results from publicly funded research to put everything in national repository as for institutional repository there is one institutional repository I mentioned for doctoral dissertations at University of Montenegro but still after we complete this all research that is funded through either partially or in full which is funded through national funds will have to be deposited in this new national repository thank you and Ravia is writing very interesting book it's really a success story we're planning for a similar national roadmap with a ministry of higher education and Palestine for 21-24 hope we can collaborate on this issue in the future certainly we are here you can contact us for any our for any experience that we have or advice that we can share thank you very much and there are lots of thanks to to all the speakers in the chat as well so I don't think I missed any questions sir if you want to ask your question while speaking you could also raise your hand or if you could add a comment sir and thank you once again to our excellent speakers thank you just checking whether any new questions or comments arrived we'll make slides and recording available and we'll also add links to policy documents there is already a link to Montenegro program on the webinar page and like I said it's I think it's it's a modal document for any country walking on the policy any questions comments reflections so maybe I can thank you for joining today and I can also say that it's not the only joint webinar we plan with core in open air we will also have another webinar in November towards the end of November on open science policy developments in India because there are also very interesting discussions going on around national law on science technology and innovation and how to include equity diversity in that policy document so we'll have a colleague from India joining and sharing their work and thank you once again to all the colleagues at the National Science Library Chinese Academy of Sciences so it's always great to see colleagues and friends and thanks a million leader for joining us today and for rescheduling your your meetings any other last minute sorts reflections I guess hi it's Kathleen from core I'd also like to thank our colleagues from China and Montenegro for their great presentations and I'm wondering how we can share this information more widely I mean we've had this webinar today but I think it would be interesting to have both of these policies more visible with policymakers in other countries so they they can learn from your the the interesting policies that you're adopting that are taking a different direction so I'd be interested in in your thoughts about how to get the word out whether we can just collect the policies and post them or we could try to have more policy discussions in the future well maybe if we could highlight sir some clauses related to equity and diversity in policies because what really striked me in Montenegro document that there is a very strong wording describing current research assessment system and scholarly communication and how it doesn't favor researching other languages researchers from other countries so this kind of statements and examples are I think really useful and I don't know maybe we could have something like I know highlights from the policy as I don't know model wording that others could include and I don't know about China whether whether there are any plans to translate your policies in English I guess not because these are large policy documents okay I don't know the the language you mentioned for what do you mean the language we do not publish English paper or we publish the paper in Chinese yeah what we said that sir you have very good policies but they are in in your language so we can't read them I mean even Montenegro policies also in Montenegro and then in in English but there is an English translation in your case there is no English translation of your policies but I think you covered in your slides very well what those policies address so if we could make your slides available the policy if not have the official translation we translate by our colleagues so the language is not perfect for the policies so I was suggesting a patient open air with policy samples yeah we can discuss that it could be open air it could be core could be Eiffel but I think we're in agreement that it would be important to start collecting these examples and share with others thank you so much I would just add of course which is maybe it is implied so whatever additional questions you may have regarding our policy or the process of making it for later on in the stage of implementation even about that we remain at your disposal for anything so you can contact us we can provide our examples of our practice so you can count on that thank you so much we'll be in touch because there is a lot of interest and Raja was suggesting ambassador translation but I guess it's hard if these are official policy documents you can't really rely on volunteer translation and so thanks a lot once again and happy last day of the open access week and let's hope that this open access week will continue longer than just this week