 Welcome everybody to the webinar on a road market for energy, technology and the budget data. Co-organized by the International Energy Agency and Mission Innovation. I represent the International Energy Agency that work in the Energy Data Center on data. First of all, I would like to thank Mission Innovation. We have a very nice collaboration, consolidated joint activities in the space of innovation to really, as an objective, build a joint community for innovation. And clearly this also includes data work. We, in fact, have a collaboration on joint data collection for LB&B data with Mission Innovation, in particular in this phase. I'll give a quick overview from the International Energy Agency, but really we are very much emphasizing the importance of innovation to reach energy transitions and climate objectives. If you take our flagship report, 9 to 0 roadmap by 2050, there is a strong message on the importance of increasing clean energy innovation. Both for the deployment of the technologies that are available and also to increase the use of the technologies that are not yet on the market. So the AASD estimates that about half the technologies needed to reach a net zero are still in the development phase. So clean energy innovation needs to accelerate rapidly and governments need to put up the LB&B research development and demonstration and deployment at the core of energy policy and climate policy. But at the IAEA, the foundation of the policy work, we clearly have a solid work on data and the focus today will be on data. The IAEA itself has its own work on innovation tracking. For example, we are going to publish soon a tracking clean energy progress report to assess the status of critical energy technologies and give recommendations on how to really get on track for the long-term climate goals. But in the domain of innovation data, one of the key areas we mentioned to our members is really tracking investment on public research development and demonstration budgets for different energy technologies. Clearly, even public and private are both essential, but we focus in our member requirements on the public budget. In fact, we do have a DIA consolidated data collection on energy technologies at B&B. We have a unit, the data base, I would say in the world. We plan cities to go back to 1974 and the next three years will be on May 3. And we thank actually the work of many experts in the world. Many are here today will speak and participate in the webinar because it's thanks to the national work that we can feed our international database. But through this work, we have realized how maybe the different experts in different countries don't find the workforce easier straightforward. So we embarked on this project, trying to see what can we do to help maybe depending on this understanding of country level, what strategies are needed to be put in place to address the different type of challenges. What are the difficulties in the institutional arrangement in the legal framework, in the technicalities of the data collection, in the classifications. So different countries have different approaches, but we kind of wanted to consult as many of you as possible and synthesize the information in the form of a guidance to define a national roadmap. It's a document that is available on the web now. It was released last fall and we are here to promote its use today and to explain how it can be used both as a tool to assess the status of a country reporting compared to a sort of ideal framework across all its different blocks that we mentioned. But also as a guidance document, we prove different ideas of establish a new data collection. So we're addressing both beginners and more advanced data providers. Of course IEA will be very happy to work with any of you to improve the data together and using this tool. And so we're looking for this webinar and the continued collaboration with IEA. I would like to thank in particular Susie Le France, the IEA, and Ingrid of course for that. That's our reorganization of this event. And I wish you a fruitful experience. Thank you. Thank you, Roberta. I'd like to give the floor to Ingrid from the European Commission in relation to criteria that will give some introductory words as well. Thank you very much, Susie and Roberta. Hi everyone. It is actually an absolute pleasure to be joining the IEA's webinar today on tracking public energy R&D investment. So my name is Ingrid Amoroskaita-Bull. I am the Mission Innovation Insights Module Manager and I come from the Joint Research Centre of European Commission. Exchanging experience and practices when it comes to public R&D data collection is undoubtedly very important and we can clearly see that from our own line of work. So in the Insights Module we focus on tracking clean energy innovation using data on really various indicators such as private and public investments, patents, venture capital investments, standards, levelized cost of electricity, total installed capacity really among other indicators. All of these come from the GRC and my partner organizations IEA and also IRENA. So I want to share with you a very recent example from our last workshop that took place on 22nd of March in Rio de Janeiro as part of the MI Senior Officials Annual Gathering. We presented the Insights Module plans for the upcoming year focusing on particular, on our main deliverable, which is Energy Innovation Metrics Hub. This hub will be like a platform in a form of a dashboard collating information on the already mentioned indicators but also others that will be categorized per MI mission topic area. So such as Hydrogen, Green Powered Future Mission, Shipping and so on. And to collect feedback on such proposal of ours, we have therefore produced a short online survey to mission innovation members that was prior to the event where we asked them which indicators would they find the most useful for their governments to have included into the hub that we will be collaboratively producing. The top five answers in the precise order were public R&D investments, cost of technology, demonstration projects, technology performance and private R&D investments. So today we're discussing the number one public R&D investments which is something that MI countries surely feel a great need to track. One of the key discussion points during our event was that solid data on public investments helps to make informed policy decisions on energy research. It helps to assess the performance of research programs already in place and to design also new funding schemes. I think as most of you know perhaps already, MI countries report on their public R&D investments to the IEA in order to make the process easier and better aligned and also to avoid a duplicative effort. Even those MI countries that are non-IEA members report via a simplified version of the IEA questionnaire. And we're tracking this from the MI's perspective as all of my members have actually in the second phase of MI agreed to sustain or increase their public R&D investments. And during the event we have also heard from Brazil about their experience on reporting to the IEA. They were the first non-IEA now association country to actually do it and one of the key points that was raised was also the knowledge sharing with other MI countries in this process and really learning from the experience of others that perhaps had already more established data collection processes already in place. And indeed collecting, validating and disseminating these data is a really complex process just as the roadmap report very thoroughly explains. Also like what Roberta just mentioned, countries are on very different journeys like Austria collects energy R&D data since 1974. Meantime we have Lithuania that started in 2020 and now has run with three data collection cycles. This is why it is absolutely essential to have these opportunities to really best learn from the experience of other countries through the reports like these and well events like these. So on that note I really look forward to hearing the presentations from national experts on their countries' experiences and perspectives. And I believe I hand back to Roberta. No, thank you. Because the main person here is Susi who is nice to me. I hand back to Susi. And she will actually explain what we are talking about with this new document, the guide to design a roadmap for energy technology, our D&E budgets. And so actually I'm leaving the floor to Susi for this presentation that will be the opening of the framework and then we'll have a presentation from country experts. Thank you, Roberta. My presentation. So yeah, thank you Roberta. Thank you, Rita. So yeah, my name is Susi. I'm an energy data officer in the innovation and indicators on innovation and indicators in the energy data centre at the IAEA. So here I'll be going through what we do at the IAEA in terms of energy R&D data and how we try to support countries in their thoughts through the publication of a roadmap that Roberta mentioned. So this road back to tracking public investments in energy research. So the first question that we might want to ask ourselves before we look at all of this is why are we here today basically? Why we make all this effort to collect this data and why we collect public energy R&D data. There are several reasons, but maybe the first one is to support the design, the evaluation and the adjustments of public policies related to energy, innovation, or both of them at the same time. This data allows to identify gaps and opportunities in current investments and define new priorities. If, for example, hydrogen is a national priority in a country, assessing if the amount of existing R&D investments is enough and let's show them maybe more efforts are needed in the data. It's also possible to use those data to evaluate existing programs. For example, the defined objectives that have been decided at the beginning have been fulfilled during the program. It's also allowed to benchmark countries against each other providing though there is the same methodology and definitions used, which is what we're here for as well to make sure that all the data is comparable between countries. It's also got useful for the private sector and their own energy innovation strategies because the public sector has the possibility to maybe invest in more nationless market-ready technologies that the private sector can't. So for all this reason, as Roberto mentioned before, EIS has been collecting this data from its members' national administration for a number of years. So that we publish twice a year and we'll get the new version in about a month on our website. So what do we have in this database? We have research, development and demonstration budgets funded by national governments and state and enterprises. So all of this can be disaggregated between R&D and demonstration and between governments and SOEs. It goes from 1974 to present day, so when the next relief will have even 2023 data from some of the countries. It covers all the 31 IEA member countries as well as Brazil and the European Union. And we are always looking to support any other country that wants to collect this data to expand the coverage of the database. So it covers in terms of technology, it covers quite a high number of technologies in seven main groups of technologies which are energy efficiency, fossil fuels, lane fleet CCS, renewable, nuclear, hydrogen and fuel cells, other power and storage and cross-continental research as well. And then those group of technologies can be integrated into like three levels further. So for example, under renewable, you'll find like solar energy which in turn would have this big between solar PV and solar thermal as well. So you can see here preliminary results from the next release in May. As I mentioned, most of the work is not done by us at the IEA. It's done by the countries, so we're very grateful for all the effort that you're putting in collecting this data. It doesn't go without its challenge. Of course, that can be such as like when how to start collecting this data when it's not currently the case, how to identify possible improvements in the existing data connections, how to expand the coverage, improve the technology desegregation. One quite big challenge as well is how to maintain data quality year on year taking into account that there might be like resources or high staff turnover. And of course as well ensuring that the metadata is at the level of the data. So based on all this challenge that we heard from the country through like workshop that we had on discussion we had with them we identified that there was maybe a lack of like a missing tool in terms of support because we give support in terms of methodology but we didn't have the mental hope to have the countries actually collect this data and this is where like the roadmap came from. So based on this necessity for knowledge and experience sharing we started this roadmap project. It was a product of discussions between countries so you can see the countries that participated in the project and we're very grateful to them as well at the other countries that might not participate in the rebuttal we have helped us identify these issues over the years. So the result is basically a description of the variety of country approaches to set up and maintain a public energy energy data collection system and this is intending that both like a guide for both the countries not currently collecting this data but also countries with more advanced systems that collect strengthening some of the areas. So the report is structured as you can see. So we try to make it in different parts to make it clearer and help countries focus on certain areas at one time. So it's with like six main components that we identified are like internal separations into different parts. So how first maybe like the first thing to look at is like the purpose why are we collecting this data? What do we want to achieve in the end? What are we going to need? So this is where you will the country should probably like different clear objectives to end up with a world structured and defined data collection system. Then there is like the institution arrangements. This is where like the country might want to look at like how to set up the framework. So who's going to be coordinating the data collection? What resources are going to be used? Then you want to look at what the innovation landscape looks like. So among the partners and the data sources who's funding performing energy RGND then create the network model working levels of who are going to be the contact point in each of the institution and so on. Then you get to the phase where like you will do the actual data collection, processing and validation. Here you might want to start by assessing if there is data already available that you can be building upon. Then you want to define the data collection and the classification as well as the validation of the data. Then maybe in parallel of this the data management and technology which is where you are going to look more at the IT tools. What are you going to use in terms of software really for the technical parts? And if you want to use maybe like ARs or more advanced way of classifying the data for example. Then of course in the end you are going to do a dissemination of the data because all the work that's been done before if the data is not properly disseminated it's not going to show the re-value of the work that's been done. So here you might want to look at how they are going to share the data itself, the data sets and also how they are going to communicate the finding through analysis to the important stakeholders. And of course the continuous components of this data collection where you want to establish something that is going to work year on year and that's going to be improved. For example, do mark partners like step of the institution arrangement. You will want to do that every year because you don't want to miss new vectors from what appears over the years. So this was the main part of the reports. But we also like publish country annexes, as you see with the report. So for each country based on the discussions that we had with them, this interview that we conducted, we defined some sort of like a mini report with the same structure applied to the country where we described more in details how they do like their data collection. So it also goes through like the institution arrangement, the collection classification and validation process, the data management and technology and data dissemination. So this is why even if you want to have more concrete examples you can look at. So the first component that I mentioned, so the purpose in each of this section we look at what the country needs to consider in the data collection system and the key question that might want to ask themselves. So for example looking at the purpose of the data collection it's really important to define like the specifics of the desired output from the beginning so to end up with a well-constructed system and a final process that is appropriate to the users. Here for example countries can ask themselves like what are the national needs for this data collection process, what are the requirements of the different innovations they called what governments we want to look at, what experts we want to look at so you define your process well and also what are the data you want to collect. So a good example of countries that really set up like clear objective was Brazil when in 2018 there was a lot of ambitious projects to improve the process of collecting and compiling energy and energy data but the main objective was to guide public policies and fill gaps so this was a way to end up with the process that is quite good now. So then when looking at the institutional arrangements one of the key elements will be first like who will coordinate the data collection and what sources are available then you will want to ask yourself like who funds and perform the public energy energy in the country to see all the actors that you need to be in contact with and also who will be the key contacts for the collection and validation and all the relevant institutions and so you can maintain and ensure like a good working relationship but also a good like high level relationship. Austria is an example where like the ministry like responsible to the IA to submit the data decided to outsource externalize the data collection through a tender so it's now being done since I think about like 15 years by the Austrian energy agency so this is an example where the ministry decided to delegate the work to experts on the subjects. Then we're looking at the process so data collection and processing and validation some example of questions so what I say like those are just the example of like key question but it's also it's of course there's like a lot more questions and you can find more details in the roadmap of course but some example of key question is like is there for example an existing data collection process that already exists and that could be built upon not started from scratch where would be the best means to collect the data so this could be to service to the funding organization or performing organization or this could be through a database that might include like project data or that institution would use to the data. It's also good to look at how can the data be checked for consistency in a currency at the end of the data collection so an example is this is Switzerland so the Federal Office of Energy the one responsible for this data collection and they set up a quite like exhausted like a process with a very good coverage in the end where they use both existing project databases but they also complement them with surveys to research organizations and they also use secondary data sources to complete the data. Then in terms of data management and technology so here it's very technical and it's often parallel with the previous phase like here you will look at what actual IT tools you're going to be using to collect the data should you be using AI for example to classify the data in a better way or what type of software you're going to use to store the data so here it's very in terms of a technical term because maybe you're currently using Excel files to gather the data from the institution and then like sending everything in an aggregated way for example for yourself as well but maybe you want to look at if the data is going to be more efficient of course depending on the country and their situation in Estonia for example the data calculation is fully done through a database and then like categorize the projects based on keywords that are related to energy. Then finally when you get to the data dissemination quite important part as well this is where you will look at how can the data be effectively communicated so this could be to ministry and audience actors for example who will need maybe detailed information in one technology in particular where you will want to look at very disaggregated data or if you want to talk to the public maybe you're going to want to share more aggregated data more high level to give an idea of the priorities in the country so you want to know the target audiences to adapt or you share the data. A good question to ask yourself as well is how can the data be published in open access so to make everything you connect fully available to the public which is usually good for transparency in which case you will need to be even more careful about the metadata that you published with the data to to make sure everything is transparent. Canada is an example of countries that publish each year sorry an energy book done by the natural sources Canada where they give the overview of the status of energy in Canada and it includes all of the indicators include the energy audience so you can include this roadmap is really for a tool for countries to internally asset the data collection system it should be the basis for discussions with the country and how they can improve and set up the data collection and would be very happy to collaborate with any interested country to assess the status of the data collection system if it started or not and you can use this roadmap as a basis so please don't hesitate to express your interest and you'll find like the the idea like you can contact us at rdndf.org yes so if you have any questions during during the if you have any questions during all of this presentation so this goes during like the presentation if you have any question about the presentation I did or even the presentation nature is from the country please don't hesitate to the Q&A section now would like before I give the floor to to Ireland I would like to share with you a mentee question though I don't know if you're all familiar with it but this is a way also to give some interactivity to this so so if you go to this website so mentee.com and you follow the and you write the code that is written in the next to the to the address of the website I will share the link as well in the chat so you will be able to see this we would like to ask you as the countries collecting data what are the main challenges that you that you think that you encounter when collecting public energy and the data so we probably is it the coordination with the founding institution if it's categorization of the project and data and technologies is it the lack of staff resources the lack of high level engagement or the lack of clarity in the definition themselves or any other so if you think those are not the main challenge please don't hesitate to share in the chat as well so I will share the link in the chats in the meantime I would like to give the floor to to Irene Ward who is program executive in research development and demonstration at the Sustainable Energy Authority of Ireland so the floor is yours Irene Thank you Susie and we're delighted to be here today to share our experiences in data collection in Ireland so I'll just share my screen and hopefully everyone can see that okay so Sustainable Energy Authority Ireland are the responsible data collection in Ireland and that's in public in public or D&D investment and so I'll be presenting today on a number of items so I'll introduce the D&D funding program I look at the National Energy Research Funders Forum then give an overview of energy research in terms of data collection data management and dissemination and then finally our National Energy Research Database so SEAI is Ireland's National Sustainable Energy Authority and we are an agency under the Department of the Environment, Climate and Communications of the Government of Ireland we're at the heart of delivering Ireland's energy revolution and we're driving the replacement of fossil fuel usage in all sectors across our society and we work with government, homeowners, businesses and communities to create a cleaner energy future and research is the heart of our strategy and so the we lead and coordinate energy research supports in Ireland so we do that by running a National Energy or D&D funding program we're involved in strategic research partnerships we also coordinate research on a national and international basis we run an annual energy research and policy conference we are the contracting party for the IEA TCPs and so we have Irish representatives on nine TCPs currently and we're also the Horizon Europe contact point for energy and so in 2022 we set up a National Energy Research funders forum and this was to establish a National Strategic Energy Research Coordination Group to accelerate transformational and impactful energy research in Ireland so the main aims were coordination and collaboration between energy funding providers in Ireland to identify emerging energy policy needs and any gaps to exchange information and also to aid in the data collection process for IEA and others and also to look at European and international energy research activities so the forum members that inform our data collection are listed here so we're funded by the Department of Environment, Climate and Communications but we also work with our Department for Agriculture, Food and the Marine we work with the Department of Transport the Marine Institute Geological Survey Ireland Environmental Protection Agency Enterprise Ireland Met, Erin, Irish Research Council, Science Foundation Ireland and also Housing Local Government and Heritage and Further Education and Higher Education which incorporates research, innovation and science and so our data collection we implemented a new process in 2019 and we backdated that to data we held from 2014 so we circulate an Excel questionnaire which is different to the IEA questionnaire and that goes to our primary relevant funders who are public bodies we collect project level data including the title, abstract, start and end dates, the funding amount the funding agency or if there's any co-funding lead organisation and lead researcher and the maximum amount of funding is that which was awarded at the award stage but it may, expenditure may be different during the project and so for multi-annual projects we take the total budget and divide it by the number of years that the project is running in and then the the data providers classify the IEA to a two digit level and then SCAI classify that to a more detailed level we do all of the validation checking for duplication in year and between years or with co-funders and then we use that to compile our IEA or DD questionnaire on an annual basis and we then have a national energy research database this is a centralized location for energy research in Ireland it provides information on current and past energy research projects and it also helps to encourage collaboration and communication between researchers so there's a you can search by category you can search by keyword and it's linked from our data and sites website on our SCAI page and so the main users of our database are those involved in energy research policy makers industry other interested stakeholders and they can find out more about ongoing research projects and search for possible future research partners or collaborators but also for data providers and it's an open database with project level data and again it's there's a link to it and today it's very interesting to come along here other people's presentations and we will hopefully maybe improve our systems or perhaps learn about other models and maybe recording private energy or TD investment in Ireland as we record public data at present and that's the end of my presentation so thank you. Thank you very much Harry it's very useful indeed to see your point of view as well it's actually quite interesting as well to see that we hear that more and more people asking also about private sector data at the country level and we know that it's quite different way usually to do this it's more like survey based and less individual for each organization and it's a whole other project as well but we see more and more interest in this as well on to the public and public sector data and we're also looking to improve to improve on this on our side as well. Thank you very much so we can see the results so I don't know if anyone has any question or don't hesitate I don't see any for now but later we can of course share the questions in terms of our question as I asked you before that it's mainly coordinating with the RGND funding institution that it's the main challenge that you seem to see most then a little bit of the other categorization of project data and technology where we might be able to have probably a little bit more of the idea so thank you all for this input it's quite useful for us as well then I would like to ask you another question so what sort of support do you think the IAEA would you need to help in your data collection so would it be like more bilateral meeting on methodology, more experience sharing with other countries directly with your colleagues in other countries maybe better documentation and actual online trainings and any other ideas of course so please share in the chat so as I said before you can go to menti.com to reply in the code there and I will also share the link so now I would like to and we'll look at the results after our next presentation so now I would like to to invite our colleagues from the Netherlands to present us this Gasper Varends Stef Nieuwele and Michel van der Bond who are advisors at the Dutch Enterprise Agency so yes the floor is yours thanks a lot Susie for giving us the word and well for hosting this really nice presentation we'd like to share indeed the experiences with other countries and we'll see what you all do well today three people are presenting it's Stef, Stef you see her in the middle and next to me Stef is on master with pie charts of course we have Gasper Gasper is logged in via a different login account Gasper is always sharp at this magnifying glass seeking for differences in our data and we Michel van der Bond that likes to point to data well we are from the Reichstings for Unternehmen in the Netherlands and that's briefly translated to the Dutch Enterprise Agency and today we would like to share you some info about what the Dutch energy innovation portfolio team is and who participates how we monitor and which ground principles we maintain and how we innovate research and develop for your data you can think for example about machine learning but also our technology list well it's maybe nice to show you a little bit how it goes we have lots of gatherings, we are colleagues and yeah we like to have some fun next to of course talking about our data who is in our team, Sabine Lenkijk Stef Knibbler Jan Lansman, Cosper Barenz Jan Boman and myself now in essence what we do we monitor energy innovation instruments and we do that for the Dutch Enterprise Agency so here are some examples from reports we make and for example we have an instrument report that's very important for policy making from the other end we make lots of senki diagrams what you see on the right side and for example you can see here how the money is going to the different institutions we find that also very interesting to see okay where do we have the plug in place so where is more governance necessary, where is more need and where is more linkages in certain types of innovations other examples are for example a web based project database, it looks a little bit similar to what Irene showed in this database you can basically search what kind of projects we are funding where they are happening during in the country and also what is the status so for example is there energy research in solar panels or is it more in nuclear fusion that is also super cool to watch there and of course we make lots of fax sheets we would now like to give the word to Cosper thank you Michael yeah Michael showed some examples of what we do with our data and in order to do this we have certain basic principles for our monitoring we capture once from the source and we make use of the source data the source data is in our case most of the time the project plan we further enrich this source data with other sources like the budget item external data such as company information from the Chamber of Commons or SBI codes and metadata such as the EI classification what kind of product it is and what kind of process it is and we get it it is all in one application and Fiat is what we don't make use of several Excel's but we make use of one application which allows us to with one click we make multiple reports yeah there are four perspectives on our data in our data model where we get gather information on the on the left top is the programming instruments these are the governmental climate policy policy programs and innovation teams on the left bottom is innovation this is the state of the art technology the products and social innovations and as I said earlier we label then also the innovations on the category so that we can also report on that on the right top the finance this is the budget item of the project and on the right bottom entrepreneurship which type of entrepreneurship there is like companies organization and research institutes and by getting this four perspectives in our data model we are able to report on the very specific items and now Stefan will tell a little bit more about how we innovate with with our data yeah so we are starting now to use machine learning in the what we did the last 10 years because we've been labeling our projects with project plans on the ACA for many years and another team who was categorized in machine learning asked us to use this data that we have been gathering over the years as a training data set so they are trying to make a model that learns from the project summary and based on the project summaries allocates into the right category the ACA 3 when this is finished we will check this on quality so we will check manually if it is able to categorize projects in the right way and probably in a year or two we might have more machine learning based categorization but in the meantime we still do it ourselves and that's also very important because that improves also future machine learning tools that are based on our classification right now yeah next slide and we are also trying to label on technology specific cases like screenshots right here is from the EAA and it's a poster depicting different technology in very many levels in different categories this is useful for inspiration but not for classification as it is very widespread in certain categories and other categories are not specified and also some names appear on a fifth level which that also appear on the second level so well it is very handy for getting inspiration in what types of technology there are it's not a good classification and we are struggling with this because we get questions from ministry in what types of electrolyzers for example we have that the EAA manual is not helping with these type of questions and we do realize it's very difficult to make a good classification system because there is always a grey area is this technology or is this technology but this is something we are looking into also looking into other countries what they are doing but we cannot find anything so I am very curious how the EAA is thinking about this part of classification so this is things we are looking into right now and yeah that was for now the presentation and if there are any questions let us know I am not right now I think we will see thank you very much thank you very much friends from the lens I guess first step and Mikael it's very much appreciated so yeah we don't have any questions for now it is very interesting to this part on the more technical side it's hard to make it a lot more efficient through machine learning which is not very widespread for now I think for most of the countries it's still very based on excel and manual categorization so it's good to see what direction countries could attend to so we had a question which maybe was more of a general question if you could give us your input on now which was about if we think so it's for us it's for you as well I think it would be useful to have more standards in tracking data so not on the definition side but more on the standards in tracking data so like the data collection processes are similar in countries so everyone is wondering if you had inputs for that so this question is for you in the Netherlands what are your requirements for these inputs it tends to be very difficult to get one type of standard for your data that's exactly where you're struggling with so what we try to find is like an application that can link all those different pillars that Kasper was presenting about to make with one click on the button multiple repetitions but even in organization it's already very difficult to get that done because you have different standards well name it click for you you have SAS Enterprise also we try to use all that kind of different applications but there is never an only pretend application that can do it at all and that makes it really difficult so also for the new countries if you want to make a data structure it's really important to start with that like what kind of data structure do you want to use and how do you connect all those different pillars with each other that is super difficult but that helps you so much in the long term if you have a solid data structure then you can also report much more easy and you don't have to do manual work like categorizing yourself and that's where the pilot of Steph can really help if you have AI that can link EAR categories that would save us a lot of time and also it will help you in categorizing it better yeah I would be very interested to hear from you Michael about how you get on with that yeah it would really help with the classification side and reporting side thank you very much yeah I can now show like what result we got from our second question which was to lose my mouth I'm very sorry towards the question who was about what support the IEA could give in terms of to support the data collection so the results showed that it was mainly experience sharing from other country from the screen what do you think was useful to give experience sharing with other countries so like we could of the selected countries in contact with each other so it could be with smaller discussions but also with more workshop I think would be useful I see I can see the online trainings as well which is something that we could give with more explanation on the definition the methodology the technologies and so on so it's very useful information for us this maybe one last question for you would be for the country so would you be interested in collaborating with the IEA so on the roadmap using the roadmap as a basis so you could say no it's not necessary of course yes to assess options for improvement but yes to establish all the new data collection system or like other of course please share anything else any other interest you have in the chat so the link is the same for the mentee so I could twice the same it's the same for both so you can reuse it it's a lot so now I now would like to leave the floor to our next and last country which is Czech Republic so we'll have Simon Merler from the Ministry of Industry and Trade that will be sharing their sharing their experience we'll share the presentation hello everyone I should mention yes so before we start sharing the presentation any minute English colleagues hello everyone so first I would like to thank the International Energy Agency for inviting me to comment on Czech approach towards public funding of research and innovation in energy and then I would like to underline that the Czech Republic remains committed to the common target reaching climate neutrality by identity and therefore support and increased emphasis on clean research and innovation projects so next slide very quickly firstly national energy research and innovation priorities institutional arrangements so as I said very quickly next slide yes next slide main strategy documents covering all relevant sectors are predominant additional research development policy and of course state state energy policy so you can see the list of our priorities so I won't tell them right now but can read very quickly and of course short and mid priorities are translated to our national program data which is for that in coming years we did that too and of priority are a lot of separate priorities if every level are directly for the Czech Republic next slide here you can see our national priorities which as I mentioned the most important state energy policy priority research central development next slide here you can see the list of relevant programs of technology agency which is our public agency as I mentioned the most important program is data which is specifically focused on applied research and development in energy but there are others that are involved and of course we are also involved in international cooperation Horizon 2020 but also Western fund research infrastructures and others next slide please the most important part of my presentation is focused on collecting research and innovation so publicly funded research and innovation projects can be searched in the Republic through our public databases and portals there are mainly two portals the most important for our work is Starforce portal based on individual code and project name basic information these projects can be found mainly as you know the amount of eligible cost and the amount of public support not every year but little amount basic information about an institution carrying the research project solution time program of complex project public tender number etc and each specific project has an individual that serves as a unique identifier in the Czech Republic research and innovation projects data are collected by the technology agency of the Czech Republic next slide these public databases are managed by the technology agency as I said and also by research development and innovation council the Ministry of Industry with the help of the technology agency of the Czech Republic which has direct access to background data such as eligible cost and public support search specific energy projects in the Czech Republic within the Starforce database they provide us with individual years as we know the sum of money of funding but we don't know specific years so they provide us with these data so these projects are supplemented by already search projects as the search was carried out in 2015 by occupying one of the US questionnaires and now every year we fill in the form of questionnaire for the international energy agency so that's the methodology of our work of collecting data next slide so the nation so as you can see our money going to research and innovation energy so as you know the Czech Republic as a member of the International Energy Agency is obliged to report selected statistical data in form of questionnaire and as I said before we try to fill in the form every year also I would like to mention that these collected data not only for purposes of international energy agency but also for our national strategic documents and this slide please as you can see development of funds for research and development in energy sector shows a great increase in public funds spent on energy projects since 1990s it's obvious that research and innovation of research and development in energy sector gaining political and social social importance for us for this reason some programs have been set up by the technology agency of the Czech Republic to support not only technological projects in general but also specifically research and development in energy sector the trend of growth in funds allocated to research and development in energy sector was markedly between 2014 and 2015 but it was only one year and since this year our occasion have been gradually increasing again reaching its peak in 2019 the largest share of funds in the category of nuclear efficient fusion can be noted that the Czech Republic historically focused on the research in nuclear energy and finally I would like to say collecting data there can be some possible distortions which due to human factors so because we do it manually we have no computers as our colleagues but we do it by ourselves so the first distortion would have been to classify the projects in the wrong category this should not affect the total amount of eligible costs in public support but could change the ratio between the different categories in the column another possible distortion is the assignment of project to energy projects especially in basic research for example because projects are always more of borderline nature or it is always being considered whether to include the projects in the list of the projects or not so that's the second distortion and the last distortion may be the fact that the support for research is currently concentrated on less specifically targeted programs so finding currently solved or recently completed projects can be relatively easier compared to projects that have been solved in the relatively distant past this may partially fall into question the ambiguous increase in spending on research the energy sector over time so that's all and I would like to conclude by stating the Czech Republic much updates and benefits from the diverse energy cooperation with international energy agencies so thank you for your attention thank you very much very much appreciated I think Czech Republic is quite a good example of a country that uses a very like database based data collection instead of surveys which is also a way to you do have a lot of work still on your side but it is a way to also simplify the data collection and make it more efficient and there's always something to consider depending on the country we compare with our technology agency which has always been collecting every year more detailed information so they share with us and there is no problem but as I mentioned we collect these data manually by project by project so it could be very complicated but it's the most practical way to collect for us because we need every project we just and we are interested in every project so we have a good overview what is happening and also but quantity is huge so as I said there can be some distortions but hopefully not so big yes yeah but thank you very much so I don't know but there is no question in particular for Sharon on the chat I think so then I would like to share the results as well as the last question that was hard for you which were would you be interested in collaborating with the IA on the roadmap specifically and we can see that yes thank you for not saying no we appreciate it but for all those countries that want to collaborate with us because we don't have the names please feel free to contact us so I will rewrite our RGND but also address them so we will be very happy to discuss this and have one on one meetings so we can go through and see where we can like the data collection can be improved so I don't know if there's any questions no so if we don't have any questions please feel free to please feel free oh we do have a question so yeah from Ali okay so this goes for all the countries even your data collection which type of data sources do you mostly use based on your experience and that is probably efficient sources so maybe you can start by answering give an answer to that so the data sources that we normally use are those provided by our partners in the National Energy Researcher Funders Forum so we use an Excel spreadsheet to collect data from our partners and we also input investments made by sustainable energy authority Ireland so then we collect within a centralized Excel spreadsheet but I was interested to hear what was happening in the Netherlands as well and in Casper in the Czech Republic so yeah I think we'll look at ways of maybe improving our data collection in the future thank you Irene maybe a colleague from the Netherlands and I hear you like to answer that is in the sense similar to what Arbeen said so indeed we for example the Dutch Research Council we are transferring data with it and most of the time you do that indeed with Excel that's a program that everybody knows it's easy but you have to have lots of what talks about what kind of standards do you want what kind of data you have to explain like this and this we need but most of the time indeed with Dutch agencies with the ministries etc also with sometimes customers that we do little surveys not that much because we try to make the most out of the original projects plans and that we get in PDF format and then we transport it to our system thank you Michele maybe Shimon I don't know I don't know if Shimon can hear us so the question was what's the main link data so yeah we can hear you yes as Michael said I fully agree with what has been said thank you very much so I see there's no additional questions so if you have like any questions in general maybe they can go to the countries or to us I forgot an email address you can contact us anytime you want for any support any question that you have either for us or for the country that presents today from the States and in the middle I'd like to give the closing words to Roberta thank you Suzy and thank you to all the speakers because they made it so useful for such a large community today discussion I think it's a great example of the importance of sharing experiences among the different in this case country experts where the situations are so different but where maybe we can also learn from each other and adopt a little bit more common approaches if useful and I think this is one of the main conclusions that sharing experiences is all the participants consensus that is a very important opportunity for support from organizations such as VIA and the mission innovation more international platforms and so we can commit to continue this type of collaborative approach and so I would like to thank the speakers and some of the others that were raised also raised particular attention including among the speakers I think the point of the application and that just as an example is there anything that in practice also could be shared more practically among the among camps so we can also look at this dimension in the future because we are also this opportunity is very important for us to understand what more we can do a different way we can do internationally to support your so precious work that you know is not always done with a full resources as needed so I also appreciate the request for online training that came through the Mantis thank you Susie for organizing the Mantis and it's a way of also involving some of the participants in the feedback and so we look maybe at this especially in this area this is not typically covered as an area in our sort of standard statistical training one point of that is actually not in today but it doesn't cover the FNB part so we need to consider how to take this request in account and you also take note of the nice volunteers so that anonymously still but we were looking at understanding who you are are appreciative of the opportunity to work with us on the following this tool for whatever either for establishing a data collection or for improving some areas based on the experience of others so we cannot together we are very very happy of hearing that this is the main objective also of this discussion today so I'm encouraging this five plus four people to get back to Susie with a really more clear request we'd be happy to get back to you also with a bilateral discussion so and and with that I think this was very fruitful discussion we hope that we made a little step forward in terms of helping the national work and ensure that this is a nice contribution in view of a really continued collaboration of this type we really take seriously the commitment on the opportunities of exchanges and collaboration also among experts in different countries this is really very useful so I would like to thank Susie the speakers and the participants for staying until the end so thank you very much and we continue working together thank you from the IEA thank you goodbye thank you very much thank you goodbye