 Bon dia to Tom. Good morning everybody. Welcome to the first workshop of the Maria de Maes to program we have at the DETIC. For me, it's a pleasure to welcome all of you from different parts of the world. And this is, for me, it's a special moment because it's a it's a very important project for the DETIC. It's not a project, it's a program. In fact, it's a portfolio of projects today we will see a lot of the ongoing projects within the Maria de Maes to and for me it's only six months after starting the Maria Maes to having this this workshop with all this presentation. It's it's really a challenge because it's working progress. I think it's a good moment for providing any kind of feedback or synergies between among these projects or other future projects within this program and and for sure it's a it's a pleasure to to introduce this session. Before before the scientific director, Xavier Serra will give a longer explanation of the whole program. I would like just say one more thing. Today's this week is a really busy week at the DETIC. Yesterday we were joining a session with advisory board. We have an international advisory board with very excellent colleagues from from different international universities and we are in the process of continuous evaluation because this is part of our culture and this is very important in order to succeed not only in research, but also in teaching and in any of the activities that the DETIC is is hosting. So I'd like to thank to Elisa as the president of the advisory board for not only being here yesterday, but also today and I think that she will explain some of the research that she's doing at Purdue University and Alisson, which is also here as member of the advisory board and Nuriya that will arrive I think in a couple of minutes. So welcome all of you. I think that this will be a very fruitful session not only today, but also tomorrow with all these presentations the agenda is really crowd so that's all from my side. We'll come off you and please Xavier. Okay, well, I guess you all have the the the program. Hopefully we'll follow as it is. So I will start with a brief overview highlighting some aspects of what this Maria, the Maestro, the 3G program is. So it will do it from there. Okay. So good morning everyone. Maybe for the people that know me, you might be thinking what is this guy doing with this suit? And you're right. But I have to explain it. Three weeks ago, I was in an audience with the Spanish Kings that was having for all the Maria de Maestro, scientific directors and Severo Choa. So I had to buy a suit. So as and as a good Catalan, I cannot just leave it in the closet for the rest of its life. So I thought that it was a good occasion to make a little joke and wear it today. So and I guess I am the only one with that. So I guess it's okay, but for sure tomorrow we'll continue being in the closet maybe for the rest of its life. But anyway. So I don't want to go over the whole program. The website is quite complete and I think you can get a lot of information there. But let me just highlight a few things. First, this accreditation, which is the Maria de Maestro accreditation that is given by the Spanish Ministry of Economy and Competitiveness. It's a very recent initiative of the Ministry of the Maria de Maestro. This was the second year, basically. And there was also this other initiative of Severo Choa for much bigger centers. And of course, I believe it's a really great initiative because it allows us, as you will see, to leverage on a number of things that as a normal department is very hard to face and to really work on. So anyway, so of course, we are really happy and honored to be part of that. And we are the only engineering department in Spain that has such a distinction. So it's also kind of a responsibility for us to try to do the best we can with that. And I guess for most of you, and I was the first one, sincerely, I have to apologize. I didn't know who Maria de Maestro was until three years ago. She was an educator and a feminist, very active before the Civil War. She was born in the Basque country and then after the war, well, during the war, she left to Argentina. And she's known especially for promoting higher education initiatives for women. She established a residency for women in Madrid to sort of help women attend university. And so she was very active for a number of education initiatives, especially for women education. So it's great to have that name in this program. And what does this accreditation recognizes? Well, it recognizes a number of things. It recognizes the high level of competitiveness and impact of a research center or search sort of department like ours. It's an important aspect and related with what Mikhail was saying. It requires that the centers that get this accreditation are regularly assessed by external independent committees. This is something that we have. And it's a very important way to validate the kind of things that we do. Also, it recognizes the ability of the department to attract sort of researchers and faculty from around the world. And I think it's clear that we have been able to do that. And it, of course, aims that all these centers are really active at the international research arena and that these centers have collaborations with high level centers around the world. Also, an important part, and this is phrased in a special way, sort of, because of course this is one of the biggest, I would say, shortcomings or difficulties of Spanish research centers and I would say even European ones, the lack or the difficulty of doing tech transfer to the society. But at least these recognizes that we are working on that. It doesn't say that we have accomplished that, but it's interesting that it says that these centers are working on this. And finally, and this is the one that I will be focusing more, is the idea that we have a strategic program that aims at getting better, at really doing more competitive research. Sincerely, from our case, I would like to see this accreditation more of a recognition of potential than a recognition of accomplishment. I think our department is, I would say, quite a young department considering the normal universities in Spain. And it has a lot of potential to really doing very good in all these things. I think we still have quite a bit of room for improvement. And this is why this program, I believe, is a good tool for doing that. So I would see that we are a department with a lot of potential to accomplishing these things. And I hope with this program, we can really advance in that. So let me just say a few things first about the department. And for me, there are two numbers, very simple numbers that say quite a bit about our department. Our department has 37 permanent faculty members, these including the ICREA researchers. That's very little if you look at the departments of engineering departments, even in Spain, that's very little, especially if you compare it with the number of members of researchers. This also includes PhD students. So we have four hundred and fifteen researchers, faculty members that are not permanent, that are in tenure track or PhD students. And this says quite a bit because it basically says that 37 people which are basically the ones that we can feel comfortable in making decisions and applying for projects and applying for initiatives. We are able to support because most of these people are supported by external funding. We are able to support four hundred and fifteen people. And that's not common, I would say, especially in the Spanish department system. And also another, I would say, specificity of our department is that we are a department in ICT in information and communication technologies. But if you look at the research groups that are part of the department that we have grouped them in four different areas, it's quite diverse. We have a number of groups working, would say, more on the traditional computer science type of topics and that we call competition and intelligent systems. We have groups working in image, audio, video type of process, processing, signal processing, which sometimes is within ICT. But sometimes these are groups that are within other type of departments like electrical engineering or things like this. We have a group very much on like telecommunications type of things. So that's not, I would say, the computer science. So that's quite distinct. And in many, in many places, it would be even a completely different department. And even more, we have quite a large number of research and faculty and groups related with more biomedical engineering and computational biology. So that's that's also quite distinct. So with with the department like that, that basically we didn't design from start. One of the characteristics of the Spanish university system is that you don't have much control over sort of faculty hiring. And it goes through a number of processes. But basically it evolves in a kind of a bottom up passion. And that's what we have. We have an excellent team of people, but very diverse and clearly with very few permanent faculty, which is also a consequence of the last few years of crisis in Spain. So the the the challenge of when we started designing, OK, how can we design and a strategic program, even this reality? OK, and that's what we work together most of the faculty and for for quite a few months to prepare this application. And so at the end, well, the idea of this this type of funding is two million euros for four years, so 500,000 euros per year. And if you think of it, I mean, it may sound very a lot of money, but if you count it as what is the percentage of this funding compared with the running budget of the department is really very little. So that means that strictly speaking, you cannot do much. I mean, you can that we have to make sure that to use it very, very well and with a well with a clear objective. Otherwise, it basically dissolves in the whole budget of the department. I mean, it's it's a four year program. So again, this has a limitation. There are certain things that you cannot do. For example, one of the things that clearly you cannot do is you cannot impact on human resources. You cannot impact on faculty hiring. The the most important sort of activity that the department can can be part of in order to improve ourselves and develop some some research strategy is in the hiring because of how the ones you you hired faculty sincerely, there is not much you can do on sort of shaping up the the topics or shaping up certain aspects of the research strategy. So that means that with this type of funding, we cannot influence the the hiring of a faculty. So what can we do? Well, the the idea was, OK, let's work on strengthening the impact of our research. So we are not going to start new research. We are not going to find new faculty members and starting new initiatives that could be great to do. Let's see what we have and strengthen that, strengthen our potential. And of course, another fundamental thing and maybe most of you, the way funding, current funding for research works at the European level at the ministry level it makes not that easy, the collaboration between us, between the faculty of a department. So basically, most of us don't know what the neighbor is doing. And most of us do not collaborate with other faculty members. So this was a great opportunity to be able to promote synergies within the department, which is something that is hardly happening and hardly we have the tools to promote that. And finally, of course, it's a very diverse department, as I showed. But we have to define some clear research goals. And I guess it's not new for all of you that a clear trend nowadays in most research fields, and especially in ICT related, is related with data processing and big data that is called. So we decided to kind of define kind of a topic or a set of aspects to promote that we call them data driven knowledge extraction, which covers a big percentage of a lot of what we do. It doesn't cover everything. And of course, it doesn't cover everything of every group, but it's quite transversal and is a good way to try to bring in into the same place and to establish discussions and to promote initiatives in a sort of very transversal way. So these were kind of the goals that we aim. And in fact, the Maria de Maestuas, all these initiatives, they have a quite strict evaluation set of criteria that are going to happen basically when we finish. Well, they're going to happen in the middle of the project and at the end. And these are becoming the standard ways to evaluate research centers and also researchers. Of course, you can criticize those type of evaluations because it's not easy. I mean, it's not easy to do a kind of a quantitative, numerical evaluation of research. And many of us are criticizing heavily the way that we are evaluated. But that's what it is. And of course, I think it's getting better. And the Maria de Maestuas, I think the way it's evaluated is among the standard evaluation procedures that are around. So I believe in them. And so at the end, basically what we decided is, OK, our pragmatic goal of this funding is we have to succeed in renewing the accreditation. If we succeed in renewing the accreditation, it means that we're doing things well. If everything we're going to fund, we're going to support, we're going to promote, if it doesn't help us in achieving this pragmatic goal, well, maybe we're not going to fund it or we're not going to promote it. And for me, that's a very easy way to take decisions. And for. But so maybe you could say that it's too easy. But I think it works. We'll see. I mean, we're still six years into the six months into the project. But I think it's a very clear goal because, in fact, the criteria for which we define the evaluation was made by ourselves. It's kind of a self evaluation. So we define the criteria with which we want to be evaluated in four years. So then so it's our own impose type of criteria. OK, so what what are we doing? I'm not, as I say, I'm not going to go through everything. But let me just tell you, there is a few transversal actions that we are promoting with related with what I have been saying. And the the first one, I mean, if we want to work on data driven processing and research, well, there is no escape, but to improve our current computational infrastructure. So we need to collaborate with the university with the computer system sort of infrastructure and people supporting the computers and try to make sure that it supports the type of research that we want to do. And I have to say, just in a few months of the project, it has become evident that that's important. And of course, we push for this type of research. And then, of course, we realize that the current infrastructure is not up to what we are. So we need to really work a lot on that. Another very important aspect that we want to work, we are working on is the idea of reproducibility. And in fact, the keynote tomorrow by Victoria Stauden is very much on these. And I think it's a very, very important aspect that I would encourage you all to understand. It can be as complex as you want. And I think tomorrow we will realize the complexity of all these. But I mean, since we are starting from really low, I think there is a lot of things we can do to make it better. And I will just mention a few things about that. And there is other actions. I'm going to mention a little bit about that, too. There are other actions that we are doing, gender equality with a name like Maria Ernesto. There was no escape, but to really promote gender equality in ICT. We are really bad. Maybe this audience is not as bad as it could be. There is some women here. But in general, in ICT, the percentage of women is very small. And we definitely have to take initiatives to promote that. And I think a number of people in the department are taking good initiatives for that. And also a lot of these nowadays, if you go to any conference in all related fields, that deep learning is the topic that everyone is talking about. So we have a working group working on that. And that's also a good way to collaborate between different groups, different researchers working with different type of data, different type of goals, but sharing some methodologies like deep learning. And there is some more. If you want to look at the website, you will see some of that. So about the computational infrastructure, well, as I said, we definitely need to improve our current data hosting and computational infrastructure. I would say that no one would deny that that's an important thing. And of course, this discussion, it can be quite quite. It can go into many directions and it has gone in many directions in our department, whether we just need to go to outside hosting systems and go to Amazon or go to Google for that or whether to promote our own. But anyway, definitely we need to improve that. And we need to make it sustainable. OK, now we might have the Maria de Maestu and when some big European project comes, we are able to buy some hardware, but that's not always sustainable. So we have to find a way that we have a sort of a service and infrastructure that can be supported economically and also from a sort of support and service point of view and that is sustainable and it can leave with the peaks of funding that we might have in the future. And that researchers are very much aware of what they consume and that they are aware that that has a cost and of course this cost may be covered by the department, may be covered by Maria de Maestu, may be covered with specific projects, but it has to be covered by some source. And we have to make that transparent and make it so that everyone is aware of that. And it's clearly that in the last few months this would have been very much needed because of course everyone has started to take advantage of what we have and store a lot of data and ask for the cluster to compute many things and it has broken more than what we would have liked to. So anyway, so we definitely have to work on that. And this of course is not just a technical thing, it's a legal thing, it has a number of implications at the level of the university that are not easy to solve. And the same thing for this point, the idea is that a lot of the things that we want to do relate to collaborating with groups, collaborating with groups outside, even collaborating with companies outside. So we have to find a way that from a public institution we can use our infrastructure for these collaborations. And again, that's a thing that has to be thought and has to be established in a way that it becomes clear and there is no conflicts that can emerge or kinds of conflicts could result from that. So anyway, so this is course, we have started working on that and I think we have done some initial progress but there is a lot to go before we can really have a computing infrastructure, a service that supports the department, supports research and in an open way to the outside world. The next topic was reproducibility and when we started the project, well with Aurelio, we started to say okay, what do we have to do and the first thing you do is okay, let's look for best practices and in fact that's how we got Victoria's name very soon. And sincerely, we didn't find any, we didn't find any that we would say okay, this is a best practice in our field for reproducible research that basically we can copy. Many people talk about that but really there are no, let's say, perfect examples to follow. Maybe tomorrow Victoria will tell us a little bit more about but so we have to start and again, it's not an issue that is just a technical issue, it's not an issue that is just related to the researcher, it has many implications. So anyway, so we have tried to do that and of course the basic idea in our field is that the publication is not just an article and this we have to start thinking and making sure that we understand that. An article is just a very, a small part of what a publication is. In our field, a publication is the article plus the data that you use plus the software that you use. Of course there are exceptions and there are a number of researches or types of research that may be very theoretical and may not require data and software but I would say a lot of it is like that. So we have to think that when we publish something we have to publish this unit of article, data and software. And in the website of the Maria de Mesto we have tried to start when a new publication has been basically funded or supported through the Maria de Mesto to encourage that and to make sure that when you have a reference to an article you also include the link to the software repository linked to the data and of course in a way that is adequate. So we have to make sure that the articles are published in open repositories most of the funding agencies in Europe required that all our articles are in open repositories and in our field they are not established open repositories which in other fields is much more common and standard. So the university has its own sort of alternative for as an open repository for articles but that's still that which would be the simplest one still not a solved issue. And of course the data is even worse where to put the data and how to make sure that the data is accessible. Of course open most of the research we do is funded by public funding. Therefore it requires that everything we do is open is open source in the case of or with licenses that allow collaboration with researchers. And that's we are far from solving that in we have tried to solve it within let's say the research groups or within the department by supporting internal repositories but I think there is a lot to do there. And finally for the software I would say that's a fundamental aspect too in terms of infrastructure I think most of us use GitHub and that has been the solution for storing and maintaining software versions and collaborations but still one thing is that you actually put it there the other is that it's written in a way that someone can take that article can take that software and be able to reproduce their experiments and what you have done. And I believe again trying to look for that one single example of a paper that accomplishes this in a satisfactory way I have not yet been able to find. So if you know of some please let me know I think because that would be a good way to sort of use it as an example. There might be some I mean hopefully some of ours are getting close on that but of course if you really go deeply into that so there may be definitely problems. Okay then about the actual kind of research this data-driven research I'm not gonna talk much about that again our goal was not to define specific research projects or research sort of lines but more kind of a methodological kind of framework for caring research on data-driven knowledge extraction and that means to promote data gathering and structuring so to promote the idea that people can build data sets to help on that again with infrastructure to help development of tools that can be used to analyze this data and that again we can share and that is used by more than one researchers and with the idea that if you publish an article with an open data set with open software tools for sure that article will have a bigger impact and other researchers will be able to cite your work will be able to build on top of what you have done. And the other of course is about data modeling and interpretation so work on methods to use that type of data to develop knowledge extraction methods and of course every discipline has different ways to do that and you will hear today and tomorrow the different approaches that the different projects have done. So how did we go about supporting specific projects? So basically at the very beginning of the Maria Mestu in January we defined a process in which we were able to select a number of projects and the idea is that these projects had to be carried out by PhDs and postdocs of the department and supervised by a copy of the department which are then our project PI so we have a number of projects and what we wanted and again we basically wanted to give the responsibility to these project PI the responsibility that we acquired by getting the Maria Mestu project. So what does that mean? So it means that we said in the Maria Mestu that we would increase the impact of our research we have to do that. So that means that we want to support projects that are aligned with that. So we have to increase the number of impact of our publications and again with this idea that a publication is not just an article but is the article, dataset and software. As I said Maria Mestu at the end is not that much money it would be impossible to be able to support large projects with this. So if we want for this to be successful we have to make sure that this funding of Maria Mestu would be able to multiply and would be able to attract other type of funding that would allow to support these initiatives. So we want to make sure that the projects that we support are able to get other support so that they can actually do relevant research. And another important point is these research collaborations mainly internal but of course external. So we want to emphasize these collaboration among groups and you will see in the projects that will be presented that that's very much the case. I think one of the biggest contributions has been this starting of a number of collaborations within the department. And finally, and this is the one that still speaking we have not started putting so much emphasis we definitely need to do tech transfer and everyone talks about that but there's not that many success examples. We are, I mean, I think we are a department that is doing quite well comparing with what is our context but there is a lot to do and we have to innovate also and think of how to do it from our perspective. Okay, and then basically out of that many faculty people presented projects and I would say most of them if not all were basically supported. So we help basically we work closely with the different faculty members and many projects were chosen and supported and these are the ones that will be presented today and tomorrow so no need to explain that. I am getting close to the end so an important thing is okay, how do we manage such an initiative? Some, if you look at Maria de Maestu of programs and sort of centers how they have organized themselves and that's a nice thing by the ministry that they give you quite a bit of freedom of how you organize yourself and we decided with the department, with the head of the department that we wanted to not make this Maria de Maestu completely integrated into the department but be able to have some autonomy so that there are certain decisions that we have to take that if you are head of the department sincerely you cannot take because as head of the department you have to give support to everything and it's difficult to make decisions that discriminate or that make some differences among faculty, that's how our current system works. So that's why we decided okay, that's why I am not the head of the department, Michele is and I am the scientific director of the Maria de Maestu which in some other cases you would see that the head of the department is the same as the scientific director and then a very important aspect that we decided is to have and this is something that we always have been talking into the department, we need really a manager that does all the work that normally faculty we are okay doing research but we are not okay doing management things which may be in other parts of the world is not like this but in our part of the world is like this so faculty are not so much willing to take out a lot of management responsibilities so Aurelio was around, had been around for a while so he was the perfect person to take on the managing of the project so he's basically fully, he's the only person really fully dedicated to the project and that makes a huge difference because that means that we have someone really taking on the leadership and the goals of the project in a day-to-day fashion in the department and that's great. An important aspect of the Maria de Maestu is this idea of guarantors I don't know how to pronounce this name so well so the idea is that there has to be an internal let's say board of highly qualified researchers and there is a very strong criteria of who can be such a guarantor in terms of publications, et cetera so there are six plus, I guess one, two, three, four, five, six, three, guarantors whose basic goal is to supervise the progress and make sure that there is scientific quality in what we do, that's basically is to and this is a fundamental event for that hopefully many of them are here and they should be able to assess what we have done, what every group is doing and therefore then we can see that's the direction we want to take or we have to make some changes, et cetera, et cetera and another important, of course, part of the management are all the project PIs so we have all these projects many of these projects are jointly supervised by different PIs so at the end there are 22 PIs and we still have another call coming up so that means that a big percentage of the department is basically part of the Maria de Maestu you think that there are 37 faculty 22 are already within the Maria de Maestu and they are involved in specific projects and finally the advisory board that is the board of the department has a fundamental role here in telling us what are we doing, how bad are we doing or how good we're doing so we can take decisions of reorienting that currently we only have this more scientific advisory board that is the goal within Maria de Maestu to also have some members more on the industrial side so that we can see industrial initiatives to happen and so the idea would be that we would increase the advisory board with some industry people so that can help in that so what are the, of course, all what I mentioned most of it are still, of course, working progress so we just have a year within the four year program which, in fact, and as Miquel was mentioning I am really very happy to have seen so much already in these six months and I think we're doing quite well hopefully it won't decay so that means that we will do much more in the coming years but apart from the initiatives that already are said and that will be taking place and developing there is some important pending actions that I want to just mention one is that we'll have a second call for projects so the idea is after this workshop we will sit with the guarantors with the head of the department and see how it's going and see how much funding we have left and maybe define another call for some people that may want to join in and the biggest area that we haven't touched and the idea and the plan was to face that in the third year was more these exploitation initiatives and I guess I was just mentioning this for me this is one of the biggest shortcomings of Spanish universities even though I would say again we are among the few that are doing some good steps towards that but that is we are far from having a culture of entrepreneurship that would facilitate people that go through here undergrads, master students, PhDs, young faculty people and get the sort of the entrepreneur type of ideas and by entrepreneurship I don't just mean the typical spin off and starting a company entrepreneurship for me is a very broad concept which mainly means taking control of your career trying to find your own funding in one way or another and taking initiatives to be able to support your career by yourself not hoping to get a contract by a big university or a contract by a big research group but to be able to have your own initiative and start something that can help create a job for you or for other people and that's not that common sincerely most people they are just the ideal job after finishing an undergrad a master's, a PhD is okay let's apply for for some university position for some big research center position and of course as you are all aware the university positions are very scarce or not so they are really very few that come by so there is no way you can develop an academic career with the hope that you're gonna be a professor at the university I mean that's very bad for a student and also for the faculty I mean it's very bad for us to sort of implant that idea so do a very good PhD be the best because you will be able to have a sort of a faculty position in a good university that's not that feasible anymore I would say so we definitely have to open up the ways that people develop their careers and a fundamental concept is this entrepreneurship and then this idea that of course entrepreneurship and spin-off doesn't mean that someone finishes they have done a great paper on some technique and say okay start a spin-off out of that paper that doesn't happen that way either so we have to really incubate within the university initiatives that can help do that transition and that you cannot just find yourself outside in the street trying to find some venture capital or some support for some initiatives that is just a paper of your a few equations that show that you have done an amazing piece of work anyway so that's still to be done and I think that gonna create a good discussion among us to define that okay and basically to conclude I just want to emphasize some of the things that I mentioned clearly the Maria de Maes strategic program does not allow to define and develop a human resources strategy and maybe you could say that that's the most important aspect to even to have for a research policy or for a research strategy so this clearly has to be done by the department and even nowadays the departments don't have that much room for defining that but that's I think Maria de Maes who can help in sort of in some aspect of that that clearly we have to as a department take on this initiative and make sure that we have a human resources strategy that we can develop despite the context that we are in that doesn't facilitate doing that but even though we are not able to do that we're able to do quite a number of things and I think very interesting initiatives and for me a fundamental one is this idea of sharing a culture of quality research within the department as I said our department is very diverse people come from different disciplines from different research disciplines with criteria that are different and we normally do not collaborate because that's how funding is typically organized so with Maria de Maes to through these collaborations we are really trying to share some of these criteria for evaluation criteria for how to publish how to have an impact of our work that is very transversal to everyone and I think that's helping a lot to the department even though of course I said that we cannot really have a research strategy at the level of human resources we definitely can implement and define some policies research policies that can have quite a relevant impact despite the funding not being that large by being able to focus on a few things very complimentary to what the department what the context we are in I think we can really improve and develop some research initiatives that can have a big impact in our department and of course that's what time will say and maybe at the end of this workshop we will also learn a little more about that but I am very optimistic about being able to be successful in this type of thing and again related with what we mentioned maybe the most important one is this idea that research collaborations despite the fact that we all clearly research in our fields cannot be done in an isolation the context we are in doesn't facilitate that and with the Maria Mestu that's a great way to promote well to promote the idea that the department is a center in fact people that may know the history of our department and of many departments our department was not created with the idea of let's start a center with a goal with a set of faculty that will develop some clear initiatives our department came from a number of initiatives and there was a number of initiatives that created to support research and that has been changing through the years and now basically we are back to the department as the home of research the home of all of us that have to carry research and so the idea of considering that the department is a research center is a research center that has a Maria Mestu and that we need to collaborate in order to make it better so thank you very much that's all so maybe there is a time for a couple of questions but while Bart is setting up then we can is there any comment or question? Yes, yes. Okay, so thank you very much for this very clear and motivating introduction now I look forward even more to the years to come and one of the concepts which I like very much was the concept of the unit of publication so you said that it would consist of the article but also of the data and of the software and I would like to propose to even extend this by very detailed results let me explain what I mean by that because we start with some gigabyte of data and then we use our software and this cluster to produce some megabyte of results and then we condense these results down to some figures and we put them into our papers but people from the outside won't be able to reproduce these results because they don't have our cluster so I believe that when we publish our data we should also publish these very detailed results so I'm not referring to these figures but to the megabytes of results that we get and I believe this will even enhance the degree to which people then can reproduce our findings and compare their findings to what we found from that so that's an extension to what you already proposed Yeah, very good, thank you Any other comments?