 Thank you very much and thank you for coming to this session. Today, I will tell you how Open Data is used to mentor public procurement in Ukraine, which is my home country. And I'm really grateful to the organizers of Open Belgium for inviting me and hosting this session. And I hope that Ukrainian experience will be useful for Belgium and that you will learn something about the usage of Open Data in public procurement that you can use here in Belgium. So this number, 5 billion euros, this is the annual cost of corruption risk in public procurement in all EU countries together. And this problem remains a global issue. Public procurement is an area where corruption is very widespread in any country in the world. In Ukraine, this number is around 2 billion dollars. And our Ministry of Economy and Trade estimates that each year it's kind of difficult to get a very exact number, but in general it's higher than in average EU country. And here on this photo you can see the bridge which started, which development started 25 years ago in 1993. And it's still unfinished. And municipal budget is spending actually millions each year to support the bridge in this condition. And the citizens of Kyiv, they still cannot benefit from this piece of infrastructure. So in this sense it's understandable that Ukrainians in general are very concerned about corruption and bribery in the government. They see these kind of problems. And a recent service showed that actually our people are concerned more about corruption in the government than for example unemployment or inflation. Only the situation in the eastern part of the country where we have right now war concerns people more. And this data is actually corroborated by Corruption Perception Index which is an index run by Transparency International Secretariat. Last year we earned only 30 points which is a very low score for European region. For example, Belgium has 75 points. And this is the gap which cannot be closed like even in 10 year perspective. So with this situation in mind on the wave of revolution back in 2014 Ukrainian business and civil organisations started developing a new system for public procurement. An electronic system where everything would be accessible to anyone. And the system with which the control over how public money is spent would be in the hands of business and civil society. So in March 2014 this initiative has started and at first it was voluntary but then it was backed up by contributions from Ukrainian business. So they didn't have international donors at that time and basically nobody believed that it was some kind of initiative that would eventually turn into a country level procurement system. In several months the concept of the system was ready and project team was consolidated. And already in February 2015 we had MVP, Minimum Bible Product of Prozoro. Prozoro means transparent in Ukrainian. So we decided to name the system accordingly to the purpose it should serve. And around this time also the government and international donors they noticed the project and they started investing and started trying to conduct some kind of pilot study when we had the system we would procure some certain amount of goods and see if it works or not. So in April 2015 happened like very important event because until this point the system was a kind of civic initiative. And in April this project team they came to the Ministry of Economy and Trade and this is the ministry responsible for public procurement policy in Ukraine. So they created state enterprise Prozoro and project team became public officials working for this state enterprise. This way the system was institutionalized. After that they launched the pilot with Ministry of Defense at the first procure and these were exactly procurements for this military conflict in the east and the ministry was eager to try something new because they had a lot of problems getting these procurements on time. This pilot was successful and in December 2015 we had the new law passed in the parliament. It also is a separate story how it became possible because this law really changed the way public procurement is done in Ukraine. It integrated all these concepts of electronic system, its architecture, open data into the law on public procurement. And actually it happened just before New Year when the main topic was the budget for the next year and it became possible to pass this law while members of the parliament were occupied by more important issues. And after this law was passed in half a year the system became national. And right now above certain threshold all procurements have to be conducted only via preserve. So let's look at architecture of the system because it's like one of the main innovations that we created. First of all we have central database which is in the hands of the government and there they publish tender notices. This database has public API and we have a number of electronic platforms which used to be like five or six at the beginning. At the moment it's around 20 platforms who get these tender notices. So after the notice is published in central database it's automatically copied to each platform. And they can keep their own databases which are like the same with governmental one. And basically the role of these platforms is very similar to what Amazon or eBay are doing. So they just advertise tender notices, work with clients both with bidders and procurers and receive a fee from each successful purchase. We also have a separate kind of module for audit service who monitors procurement and they can access all the data via their own portal and basically as the system has public API anyone can build their own kind of instrument to access this data. So key results for last year which was the first complete year when preserve was functioning are the following. We had around 900,000 lots procured. This number does not include the lots that were just published but only the ones that were finished. And on these procurements we spent around 18 billion US dollars. Around 125,000 participants came to the standards and if we look at the statistics for only competitive procurements their participation is around 2.3 offers per tender and every savings around 8%. So coming to open data which is actually the topic of my talk. All open data in Rosora is machine readable, compliant with international standard OCDS and citizens can even follow auctions in real time. So we have a specific role in the system when a person gets a link to the tender if this person is not a participant and then can just watch how bidding process takes place. At the same time we have some things to improve in terms of open data and in this case I want to cite the study by DGVIST which is a project that compares open data on public procurement in European Union countries and they published the ideal list of variables that should be disclosed in machine readable format of public procurement. This list includes around 38-39 variables and basically though Ukraine was not included in the study we at TI Ukraine evaluated Rosora according to this list of variables and the result was that only 7 of them are not available or partially available in Rosora. These variables are mostly related to contract performance. We have some of them but we need to cover better the stage and also to beneficial owners and subcontractors of the bidders who participate in tendering processes. As the system has public API, a lot of tools can be built to analyze the data from the system and I will present you just a couple of them. So first of all we have business intelligence model and this module was given to us for free and it's available online so you can just go to the link bi.presoro.org and see all kinds of visualization of the statistics from the system. We also have professional business intelligence module where you actually can create new objects. It's not so nice, it's not so kind of graph and picture oriented but there you can choose like any sample from available variables and create your own study depending on what you need. This module is not available in free access but we have a certain number of free licenses given to us by Klik which is a company behind this analytics and we give these licenses to professional journalists to state audit service who actually need to monitor procurement like on a professional basis. Also we have monitoring portal dozoro and what we discovered is that prozoro is a kind of system which makes the data available but also we need a separate system to monitor how the tenders take place so in this portal dozoro anyone can leave their comment on tenders and basically discuss it with the public authorities. We have several of them participating on voluntary basis so they reply to comments via portal and we have a separate database for this portal where these problematic tenders they have all the fields which are available for normal tenders but also fields on violations and this way we are trying to build this collaboration between government and civic organizations working with this portal to discuss what happened in these tenders so the use of this portal by the government is not mandatory but you can find there, for example, templates of letters that you can send to governmental authorities and basically by law they have to respond to this kind of letter. We are also creating regional network of civic organizations who monitor public procurement because what we understood is that from Kyiv it's really difficult to kind of comprehend the problem in specific tender which happens in specific region. There might be some connection between the company who won this tender and some local oligarch, for example and local civic organizations they know better than we do what happened in this tender. So we educate in different regions such organizations and try to kind of raise the level of their professionals. Again key results from civic monitoring we have 44 risk indicators running automatically on tenders which start from 1 million dollars and 1 million in local currency. We have 24 civic organizations working via this portal and they sent around 500, 5000 appeals to controlling bodies reacting to around 10,000 complaints left by tender participants. Participants were like businesses who didn't manage to win the tender and in their opinion there was something wrong so they left their complaint and basically got reaction from civic organization monitoring this tender. And we also published two semi-annual monitoring reports where we developed new methodology to monitor public procurement with the use of open data and this methodology is a kind of integration of different approaches like from Hungary, from Armenia, from Paraguay these are like best practices of monitoring public procurement around the world. So we tried to take into account the data we have in Prozor because some data fields we also don't have something we need to improve and we applied the best practices to this data and I would like to finish with challenges that we face. So first of all some data fields in the system are completed by hand and this is just a catastrophe because when governmental officials get kind of a task to fill in certain data field everything might happen and for example we have data on contracts under threshold completed by officials who conducted a specific tender and sometimes they just write like phone number there instead of sum of money so in big data set it's not possible to detect where was this error and it's just not usable for analysis. Then we need to cover more on post-tender stage actually what happens after the contract was signed is this building kind of complete and working properly or is it like this bridge which I showed you in the beginning and then the analytical tools which were created from this public API at the moment they are not integrated so for example for risk indicators you go to one website for business intelligence model to another and this is something that we also need to improve and to make it available in one place. So thank you very much for your attention.