 I think we can start. Well, hello everyone. Welcome to the 2021 our consortium members meeting. I'm Joe Rickert. Our consortium's the R studio director from the R consortium presently serving as chair. Today, we have Mark Hornick here, director of the R consortium from the Oracle Corporation. Samantha to it from our studio who has been chairing our inclusion diversity equity and accessibility working group. And behind the scenes we have Brian Warner and Elisa Trevino who are essential to making things run smoothly in the background. Not only for webinars but in for our day to day business. So let's get started the format here. Here's the agenda for today. We have a number of short preservation presentations and short videos, but we're hoping to make this as interactive as possible. You can see on the second slide there that we're trying to leave at least 30 minutes out of that 40 minute final session for open discussion. If the discussion happens earlier that's fine too. So what we'd like to accomplish today we'd like to first of all, tell you what we've been doing recently over the past year. And then to show you how we're organized and hopefully how we can. We'd like to get more people engaged in what we're doing. And we'd also like to make sure that we understand, you know, from our members if we're on the right track what you're thinking about the value you're getting from participating in the R consortium and we're just members only meeting and we just honestly want to engage and and and set our sights on being even better in 2022. So let me start. First off, I'll give a little bit of background on both the art consortium and, and some brief history of the milieu, you know the art ecosystem just to make sure we're all in the same same level of understanding here. Recently, we have had a number of companies join the consortium, you can see the members down there in the left hand side. I believe this is up to date. And we're very happy to have a whole bunch of new silver members. Our mission of course is to support the our foundation and the our community and we're all about building infrastructure and helping to ensure that ours around for a long time as a dependable open source project that we can all count on. Let me talk about the background here. So, our ecosystem, this is kind of like a high level schematic so first off, we have our becoming an open source project at around 1995. And then soon after we had the appearance of the our core group, the 20 or so people who are responsible for making direct commits to the our language and cram the central repository. Cran as you know is, it's essential to the our ecosystem there about 18,000 packages on our, it was a design of the our language design feature that the language itself would be kept small in additions would go through this package infrastructure you know people would add new capabilities and features to packages. And that the that decision was essential to the formation the very strong our community, a community. You know, a real community is something where people self identify, they have a way to contribute to the community and they have a way to have their contributions recognized and it's exactly what the package structure enables. Our foundation, the group that is responsible kind of owns the our language and is responsible for the decisions of how it develops. Now, we've got the dotted lines here because even from the very beginning are in its structure was never hierarchical, there is nobody in charge, there are several groups of contributors. As things developed, you see, it began as an academic effort, bio conductor, which is a repository and a project specialized for genomics spans academia and industry, I mean, it's the primary source of genetic analysis software used used almost everywhere. And then the our consortium comes along in 2015. So we've been here five years. Our focus is to help spread them. Our community to include members of industry and government. But there are many other significant contributing organizations which I represent here by the our open side project, which is primarily concerned with with doing really rigorous open science and reporting and building the tools to do that. So, that's the, the milieu that we that we work in the ecosystem is highly democratic people hold widely divergent opinions on how to do things and yet we're all in it to make progress together. So some quick facts about the consortium founded in 2015 were a nonprofit organized under the Linux foundation. Well, we take in our membership dues and we pay as much of it out directly into into the community as we can. We've awarded over $1.3 million worth in grants and support money for conferences and the likes since we've started and more than 50% of our income goes to the grants. We're organized this way. So we're the board of directors. We have the ISC the infrastructure steering committee it's responsible for all of the community awards, the top level projects and the working groups. So, top level projects are projects that are so important that we fund on a sustained basis and we allocate funding before we allocate funds for our grants program. The working groups are collaborative endeavors that you know open up to the entire community. So, they're mostly managed by, or at least chaperoned by members of the our consortium, but they're open to everybody and this has been, I think, remarkable vehicle collaboration and for growth of the our consortium. We have a marketing committee, which is there to promote the community. So, we'll talk about that later exactly how we do that. And since we have recently had so many companies pharma companies joining we have now a pharma oversight committee, which is responsible for kind of coordinating the activities and strategy of those working groups that are primarily concerned with the pharmaceutical industry. So, the organization is important because it shows how you can engage and at different levels. So, can you know the committees are open to members of the Arkansas to individuals whose companies are members of the art consortium, the working groups are open to everybody. So, here's a, here's a look at where our spending went in 2020. So you can see that directly 50% in in community support, and that we have community events, which is again money that goes to support conferences and user groups so that picks us over 50%. So much of the money that's allocated towards marketing is again directly promoting community activities. So now, what we'll do is, we're going to talk about some projects, the organization will be first in terms of what we call technical infrastructure and then we'll look at our social infrastructure so please you know if you'd like to ask a question of put it in chat, or I don't know whether we have a raise your hand feature kind of thing but whenever you'd like to interact. Let's make this as informal as possible. So the first one we have up here is a dbi. This is a project that we awarded and I'll ask Mark to say a few words about it. Sure, thanks Joe. So starting with the dbi this is you know ours native database interface and dbi is a package that supports ours native data database interface definition of providing a common interface across multiple database management systems. And you know we've highlighted a few of the systems that are represented here. Now dbi enables our users to have a more consistent way to interact with database software providers, for example defining a common way to connect to db messes create and run statements and get results. So according to the cram logs package. Thanks to Gabor Sardi dbi has been downloaded about two and a half million times since 2015. And the trend as you see here is for daily downloads is definitely going in the right direction. So it makes dbi one of the true success stories coming from funding from the our consortium. We've had four grants over four years, and we're definitely appreciative of the skills of Carol Mueller and Hadley Wickham and the rsig db. Next slide please. So another project, you know, the our consortium has made multi year commitment to develop ours a first choice for spatial analytics as well. Here starts with simple features of package SF, which uses the simple feature standards supported by the open geospatial consortium and the international organization for standardization to simplify analysis on modern geospatial data. The loan has had 23 million total downloads since 2016. And you see the downloads for this package over the past few years have grown dramatically downloads are reasonable proxy for package adoption, even sometimes of package quality because people are using it. The first project enables the processing of earth imagery data that's held on servers without the need to download it to local hard drives, and it's seen over 800,000 downloads. So there are many other projects, and if we just jump ahead to 2020, we have the DV interoperability for spatial objects and are, and this project has the goal to make it easier to add support for new database backs and back ends. And we recognize the contributions starting with the answer of Esma and the many team members that introduced SF stars and other projects highlighted here. Next slide please. This is a book by Dr. Paula morega she authored geospatial health data modeling and visual is visualizing with our in LA and shiny, and if you're not familiar with our in LA it's a package in our that does approximate Bayesian interface for latent Gaussian models. We're all are familiar with shiny. So from her university web page geospatial statistics plays a crucial role in solving challenging problems that arise in a variety of fields, such as epidemiology ecology and the environment. And so work such as these illustrate the synergies that are possible due to our, you know, here we have spatial and medical statistics visualization and interactive communication all coming together. So with that I'll turn it back to you Joe. Thank you. So here is a cluster of projects that we've been funding. Some of them for a long time, one that's very new. So the our hub package builder is a online package building system that can be used by anyone to build in our package. We are constantly improving it and there is current work is trying to get it so that we use exactly the same tests as cram. So this involves cooperating with cram. And little by little, we're building trust and able to have some influence in in presenting the views of the community and how you know we think repository should work. And if you look at them, the last one there repositories working group. We have a. This is an ex a new effort that's specifically aimed to look to looking at what ought repositories that are essential to the development of the art ecosystem look like in this new world. With modern technology and how how can we integrate with what's happening already with cram and other repositories without you know breaking anything and ensuring continuity and a solid technical development in the future. The middle bullet there the our validation hub is is an effort that was started in the pharmaceutical community community to validate our packages so we'll have a little video on that in a moment, but basically, you know here's a group of our users in the pharma companies who want to move off proprietary software, particularly sass and embrace open source software and they face all kinds of questions. The basic ones. We can trust open source so that has been working for about a year with the group has a working paint white paper, and also software, which I think Andy's going to talk about in this short film. So my name is Andy Nichols and I'm the lead from our consortium working group called the our validation hub. The our validation hub is a collaboration to support the adoption of our within a biopharmaceutical regulatory setting. Essentially what brings us together is that we will work in this pharmaceutical regulatory setting, and we are subject to good practice regulations. We want to use our but there's a lot of unknowns about what it is we need to do to both language like our to be compliant with the regulations. And then the main technical challenges are is not just the language of course it's an ecosystem with varying qualities you have things like the base language. There's tidy verse several other really really good practice, good packages, but you also have 15 to 20,000 packages on cram that follow varying degrees of good, good practice in their development. And that's where the challenge really lies in our industry. What we've done is we've pulled together the relevant regulations and our primary output so far has been a white paper, which is titled a risk based approach for assessing our package accuracy within a validated infrastructure. Essentially what that does is it explains how you might go about performing a virtual audit to reduce risk and be compliant. More recently we've been focused on the tools centered around an our practical risk metric, which in a nutshell collates the metrics that can be used to help perform a virtual audit. As a result of what we've done the several companies are now attempting to implement our white paper. And we've recently asked contributing organizations to share their experiences with a visa further refining the guidance that we put out. In future, we hope to extend our toolset and create an example framework that companies can use to further facilitate the process. Longer term, our aim is to reduce uncertainty and we want to see our become a mainstream language for regulatory work, but in doing so we're effectively defining creating standards we're saying, if you want your package to be used and cited for regulatory what we would like you to be doing. And if that further drives consistency across the package developer communities and that can only be a good thing. Thank you very much. So you can learn more about the our validation hub by going to the web page which is pharma r.org. Okay now the submissions working group. There's again a pharmaceutical oriented working group that is on the mission to be able to make all our submissions to the FDA through the gateway, and there is a pilot, a number of pilot projects going on right now to submit test submissions to the gateway so this is testing. Both the process of transmitting the, our submissions, doing it in a way that conforms with the FDA standards regulations and security features of the gateway, and is also in line with the FDA reviewers who will get these packages and have to unpack them and work with them. So what you can see here is a on the right hand side is just the notification that on November 22, the first submission went through the gateway so our first test submission we have a blog post about that down here which you can find on the our consortium blog site. And we'll let Ning Lang, who in this short video will explain what the group is all about. Hello everyone, this is Ning Lang from Roche did attack. This is Yilong Zhang from work. Today we will like to introduce the our consortium are submission working group. The our consortium are submission working group is focused on improving practices of our base clinical trial regulatory submission. To bring an experimental clinical product to market electronic submission of data computer programs and relevant documentation is required by health authority agencies from different countries. Those submissions have been mainly based on the SAS language in the past few years. The usage of open source languages, especially the our language has become very popular in the pharmaceutical industry and research institutions. Although the health authority accept submissions based on open source languages sponsors may be hesitant to conduct submissions using those languages due to a lack of working examples. Therefore, in over working group, we decided to provide submission examples based on the language. Those examples are public available on our consortium github page. So first pilot submission folks on providing submission to FDA using our analysis and reporting. Specifically, we aim at providing working examples, following easy to specification that include appropriate to our package. Our square for analysis, analysis data review guide and other required easy to components are provided. The first pilot submission has been successfully submitted to FDA through the electronic submission gateway. And it's currently under review. We will share more information after receiving feedback from FDA. It was a wonderful that the our submission working group brought together experts from different pharmaceutical companies and regulatory agencies. The main development work of the first pilot submission was close collaboration among Rush, Autorus and work. Last tremendous input from volunteers from traditional companies and several volunteers from FDA. For anyone who wants to join our consortium our submission working group. Please feel free to find more information on our consortium web page or our github organization. Thank you. Thank you. So we put out the blog post about this earlier this week. And you can see here some of the activity on Reddit for us this is like. This is about as close to viral as we've ever been this is kind of a lot of attention here. You can see we have almost 4k impressions and people are engaging with it. Same on LinkedIn. So we have over 5000 impressions there you can see the trend in our LinkedIn. Activity on the bottom. So this has been this is something that it's gotten a lot of attention worldwide. In fact, just yesterday the our government conference is going on in virtually but centered at DC and it was mentioned there about this submission so this is an effort. It brings a collaboration of pharmaceutical companies and but with the FDA so we have shown that we have a we're adding value with this concept of being a safe place and effective place to do collaborations. There's another working group that is really down in the weeds but it's about building tables that go into regulatory submissions and I am always delighted when I see the energy and excitement of the folks who are actually doing this so here we have a short video. I'd like to tell you about the our tables for regulatory submissions working group. First of all, introduction. My name is rich and I work at our studio PBC. I'm also a member of this working group. So I know a bit about what's been happening. I very much into creating solutions for table generation. And as it turns out, the farm industry has a strong need for adequate tabulation tooling for the regulatory submissions. That is exactly what this working group meets to discuss every six weeks. We identify needs, try to find common ground and propose actual work that will someday make the archivist and costly task of generating tables for submissions quite a bit easier and more efficient. Joseph Rickert, a colleague of mine at our studio and the art community ambassador for the art consortium, organizes and leads these meetings. If your role involves table generation and regulatory submissions for the farm industry, then you might want to join these meetings. If you do, you'll learn what your peers are doing, what they need and what will be developed in so far as table generation are packages is concerned. We encourage those with interest to contact Joe via email. After that initial email exchange, Joe adds the new member to the invitation list and sends a meeting invite through email. It's all impeccably organized. So thank you, Joe. We meet every six weeks and we use Zoom as a meeting of communication. We have a lot going on already, but there's still so much ground to cover. This is important work for an industry that develops a lot of tables. Any efficiency gains and better ways to do things are valuable for them. Thank you for listening. All right, so this, this group is making great technical progress for kind of words from rich, but all I do is show up at the meetings and make sure the video is running. And we have experts there who are really digging into the theoretical ideas of you know what constitutes a table and how it should be. And what should be structured in order to make the kinds of complicated tables that they use in pharma easy, easy to make, and that we can support them well in the R language. So, moving right along. We get to the social infrastructure. So, it's all about people and here Samantha please take it away. Thank you Jill. Thank you for having me here today. So I'm talking about the people part of the R consortium, which is the social infrastructure here. I'd say it's made up of four primary groups which I'll talk about a little bit in more detail. The first is the R user group program, the R consortium marketing committee, and the top level project the R consortium diversity and inclusion group, and lastly but not least our ladies which everyone knows and loves. A little bit more. And ultimately the goal of all of these groups and the social infrastructure in general is to promote our the R language around the world, and through as many channels as possible, and also to offer support to individuals and groups that may have barriers to being part of the global R community. So here's just a snapshot of the R on the rugs program the R user group program that Joe and the man of the hour today. He also helps to manage as well. So this is a screenshot from actually a community made app that helps to monitor the meetup API. And so the R user group program. It funds different user groups and small conferences throughout the world to cultivate the global R community. And with these groups, some of these groups are from all over the world. There's about 800 854 R user groups of about 75,000 people that are members of these groups, and that covers 90 different countries. And if you look at the meetup account recently some new groups that we've got our Tunisia, Algeria, Nigeria, Macedonia to blessy. So it's great to see how we're able to expand over the world. Also, obviously with COVID recently, the funding took a bit of a change this year as opposed to having different vector level funding, we started doing funding their different meetup accounts and supporting different ways for folks to organize virtually. The other way that the social infrastructure of the art consortium is made up is through the marketing committee. So this is the group that allocates some of those funds that you saw in the great slide that Joe presented earlier to help organize different events, put on different blogs and promote the work that our users throughout our community are doing throughout the world. So you can see there's you know some conferences that we've recently helped to support where the are in medicine conferences which have been selling out all the way. We also have the are in pharma conference. We some recent ones that we've supported are the CODA conference which is a data journalism conference in Brazil, and data fest to blessy, which is located in Georgia. And you can see at the bottom is just a snapshot of some of the blog posts that the team has been working on talking about organizing different are user groups from all over the world. And then what are some of the top of mind challenges that some of these groups are organizing to discuss and to help resolve. Next we've got the inclusion diversity equity and accessibility group, and I know it's a mouthful so you can absolutely call that the art consortium our community idea. So the goal of this group is to help promote. This is that second part of the goal is how to break down those barriers of access that people around the world might have to being part of that larger community. So one of the things that this group does work is work on guidance for community organizers. So that includes code of conduct guidance, code of conduct and diversity program review meetings together virtual communities events, as many of us are looking to an entirely remote community. We offered some guidance on how to correctly have those meetings and create inclusive meetings. In addition to finding some speakers that you might not otherwise be seeing at some of these conferences and help to elevate them to whether it be a keynote level or just to help get speakers that are doing all types of cool things all over the world with everything are. We're thinking about ways to make our tools more accessible. So you know different ways whether someone's visually impaired whether there's just a lot of different barriers that people might not actually be able to use are both technically and in terms of you know social organization, and to enable our community by learning what is top of mind for them. For example, we recently helped Africa are which is a major community that had a very successful conference in getting folks to use are to use open source data science solutions, all throughout their community and really fostering those engagements. Last but not least, we've got the are ladies community which has been tremendous in cultivating the women and non male are users around the world. Hello all here we present a review of the work done by our ladies global in the year 2021. Our ladies is a worldwide organization that promotes gender diversity in the our community via meetups and mentorship in a friendly and safe environment. The following video summarizes the events and achievements of our ladies in 2021. The support by the Arkansas team provides the technical infrastructure and enables us focus on the community work connecting our ladies from around the world, even during a pandemic. Thank you. Hello all our ladies 2021 in numbers more than 80,000 members from 60 countries around the world, organized in 212 chapters, which held 3,640 events. We have more than 118,000 followers on Twitter, more than 1,300 experts in the art ladies directory, 100 international reviewers in our reviewing network and we produced over 800 documents with teaching materials. Due to the pandemic we went virtual producing more than 100 videos in our YouTube channel. They are in 5 languages and got over 30,000 views and over 4,000 watch hours. This is all done with 100% volunteer work. Follow us at our ladies global and we are our ladies. Our website is OurLadies.org. So, we have an example here of one of the conferences that not only do we sponsor this but this is a our consortium produced conference. I'm an assistant professor of pathology and laboratory medicine, and I was the chair of the our medicine 2020 and 2021 virtual conferences. The mission of the our medicine conference and community is to promote the development and use of our base tools to improve clinical research and practice. The first our medicine conference took place in 2018 as a two-day event on the campus of Yale University with generous financial and organizational support of the our consortium. The event featured keynotes and invited talks by our stats rock stars like Rob Tipshirani, Max Kuhn and Mide Chedekaya Randall. Fast forward to 2020. In the wake of the COVID-19 pandemic, we were forced to pivot to a virtual format. We took advantage of this by redoubling our effort to market to an international audience. We also work to increase our reach by forming partnerships with our educators, underrepresented minority our user groups and medical professional associations. And as a result of these efforts, we were able to grow almost five fold compared to the previous year establishing our medicine as a major international virtual conference on central themes of the our medicine 2020 conference included the COVID-19 pandemic reproducibility and using our in clinical trials. In 2021, we continued a trend of steady growth participation increased by 13% with representation from 60 separate countries. We almost doubled our revenue due to due to a number of successful sponsorship agreements. And we tripled the number of pre conference workshops and also added an interactive poster session central themes of our medicine 2021 include algorithmic bias, visualizing clinical data and putting our into production. We are already actively planning our medicine 2022, which will again be a virtual event and central topics we are considering include clinical data harmonization and standardization are analytics and medical education and communicating data to non tech audiences. A major change this year is that we plan to provide continued medical education or CME credit, either for individual workshops or for the entire conference. And in the United States physicians need to collect CME credit to maintain their licenses. Therefore, by offering CME, we will create a meaningful bridge between analytics and medical education. Finally, and this critically depends on whether we can secure professional organizational support. We would like to offer year round program. We have built a network of outstanding our educators for willing to teach for free if the administrative and event planning work social media work and event infrastructure and post event work are taking care of. If we could offer free R based educational events with CME credit year round, utilizing the well established channels of distribution of the R consortium that would really take our medicine to the next level. I hope that the R consortium may consider this idea worthwhile for support and funding. Thank you very much. Hello. So there you see some highlights from our technical activities. And also our social activities building our social infrastructure that is not only wide ranging, but over the past few years has increased in its level of sophistication, inclusiveness and professionalism. So at this point, we hope to be able to start a discussion now. It's been fairly quiet, but if you've been thinking about anything you'd like to contribute or to question any of us on, please. So with Mark saying a few words about his recent effort to reach out and speak to members so Mark please. I'll be happy to thanks Joe. So you know earlier this year I had the opportunity to speak to some of our silver members to get feedback on the R consortium on a variety of topics. The mission and vision, the community in collaboration impact the R consortium has on the community and member and community needs. So we have a more detailed set of slides that you can view afterwards with more of the feedback, but I'd like to just share a few of these now and maybe that will spur some discussion afterward. So on the mission and vision, the consensus was that the mission and statement and vision makes a lot of sense, or it was perfect for what the R community needs today. And as you see here I've included the statement again just for you to view. Now for the community in collaboration, the welcoming attitude of the R community, drawing on our diverse global community is viewed as essential for the R consortium to continue fostering. In fact, the R consortium should strive to play an even greater role in facilitating this type of collaboration in the community. Now for our consortium impact, you've heard many of the accomplishments discussed so far, you know a few highlights from feedback discussions include you know recognizing the importance of enabling the farm and bio med communities. And projects like the R submissions, you know, Joe already talked about getting acceptability of our for clinical trials and this is a huge success. Projects like our hub and our validation hub contribute to the overall robustness of the R ecosystem, along with crayon, and the role that the R consortium plays to develop the R community through rugs, conference support, and even the blogs from user groups around the world. They were all recognized as adding significant value to the R community. Now when you think about you know what does the member community need there I had a lot of feedback on this one, and just a few of the highlights so that you know some members would like some assistance with drafting their business investment case for the R consortium membership. As they have to go through perhaps each year, making the request, what can we give them to, to support that. Well, part of this meet is actually met by the annual report and the five year retrospective document that we've put out this year. Now, some suggestions also included, we should have more member specific events like this one, provide curated content that could be shared for an internal corporate newsletter, you know what's going on and that we can have a more greater community within each of our member companies, and make it easier for people to get involved and contribute. We're able to make progress on, you know, many of these ideas generated through the discussions but we still have further to go. Now on the community needs. There were a wide range of suggestions here. Top of the list though seem to be that we need more enterprise scale support for our. For example, there's a need to provide guidance on our packages with the over 18,000 packages on Cran alone can be difficult to know which package should be used for a given task, or what's its quality or its security. As I noted earlier, you know downloads is one way to estimate a packages quality by consensus of sorts, but there are other measures as well, such as achieving maybe a badge using the Linux foundations core infrastructure initiative best practices program. You know, many are packages have already achieved such badges. Now other feedback emphasize the desire for additional projects involving production development with our focusing on the need for greater security evaluation, processing sensitive data code quality, and even further extending code coverage, a working group that I led starting in 2015 with tremendous support from Jim Hester and other members of the working group. And also consensus on the need for even more focus on performance and scalability in our. So with that hopefully this you know gives you know few ideas as to you know what we've heard from the community so far, and we look forward to you know hearing more right now so Joe I'll let you take it from here. Okay, so Brian, do we have any questions in the chat. At the time. If you do have a question you can put it in the chat and send it to the host and panelists. Alright then let me. Let me go back and mention a few things that that I would like to see happen within the consortium. So we have, we've been talking about our success in pharmaceutical industry. And I think that's driven by two things. One, pharma members are the biopharma biostatistics community has been using our for a long time. So there is a large user base of people who are either either using our in their professional industry or want to. So there's, there's a kind of coherence there that has been going on long enough for companies to realize that it's in their best interest to collaborate industry why. In that sense the pharma industry is more mature than some other industries who are still heavy our users, but nevertheless, who have not been at least visibly through the our consortium collaborating to to advance their use of our. So this. This represents an opportunity for us to be more engaged in other industries, banking industry, the finance community, the insurance industry, people dealing with sophisticated time series models and what have you. They're all our users, and we really need your help to figure out how to organize and who to contact and how to get something going in that industry so if your company could benefit from that. Let us, you know, help you make that happen. As we said before, anybody can join a working group. And that's the vehicle for collaboration so if you have an idea for this, we can figure out, you know how to get it going, and we can see what we can do to organize resources to make progress in a particular area. And the other in other area that that needs some attention is to establish the, the promotion and of the of the our community we need to take it to an even greater level, so you can see that we've had a number of successes for reaching out to user groups and other ladies, but still there's a lot of work that could be done. And, you know, the, the our consortium marketing team as strong as it is is still just a little marketing team. It would be really nice if we could find synergies with our members marketing team that that doesn't make a burden on them but enhances perhaps efforts to communicate. All of you are doing in areas of diversity. So how can we help you do that. Is there anything that we can directly contribute as a, you know, as the consortium, we are kind of non partisan, we can help you get a message out in a way that perhaps you would not be able to achieve otherwise. And if we could do that, we would certainly want to try to help. Let's move on to plans for next year. So, what's 2022 going to look like, I hope it's going to mean a growing our consortium that will be able to attract more members from different industries. I'm very happy to see that Swiss RE joined the consortium this year so so that is a really hopeful sign. So management wise, we're implementing software to professionalize our grant tracking process. We have an obligation, obviously as an on profit to make sure we account for all of our money. And we want to make sure that our grants are to the right people that they're tracked that we can do everything we can to help make progress on those projects and to report them accurately so we're going to implement this new software which we hope will pay off benefits in terms of what we can do and also make it easier for, for the our consortium Linux Foundation team to actually, you know, do the behind the scenes work. We'd like to grow the talent base for the ISC so the ISC has been doing a tremendous job. Over the past five years, it's been in terms of grants more passive than active. What we do is we go out twice a year with a call for proposals, and we pick the best proposals, based on criteria that include, what really benefit a large segment of the art community is the team that's proposing the work, or do we think they can actually do it. Is it at a price financial support point that that seems to measure it with the end product. So we have criteria but it's never less been passive. I would like to see us being more proactive in the sense of identifying areas that we think are important for the infrastructure. And that's where all our members have a, you know, the knowledge is out there with our members where is it that you have trouble or run into issues and using are in to run your business. And Mark, elaborated on a few things about performance, you know, maybe professional or pipelines and information flows that kind of thing. So, you know, how can we make that concrete. And I'd like to be able to do that. And then there's technical infrastructure. So we're continuing to work with CRAN, and the our core group and the our foundation to build areas of mutual interest and collaborate where we can things are going much better. For example, this year we are funding a member of the of the our core team. So we are actually putting money into the, you know, the, the essential cogs that make that the our language grow, and that means that that could only have happened. If we hadn't, you know, because we reached a level of trust and collaboration. So that's good progress and we're going to continue with that. And as I just mentioned, we would like to grow the list of the needed technical projects for the community. And that starts with our members you have the new have the say as to what projects are at the core projects are essential for for increasing the adoption of our industry. And that's where we want to go. Social infrastructure wise, we have this kind of idea that we could make a virtuous cycle of better integrating some of our programs. So what we have now for instance the rugs group makes grants to user groups and conferences around the world. The marketing committee also identifies conferences that should be supported. They have a little bit different lens to than the rugs group and the rugs group, we tend to fund things because the community needs it. The marketing committee is a little bit more business oriented and in taking the point of view. Well, how is it helping you know what tangible benefits. Do we get for not only the consortium but for the community from funding particular efforts and the marketing committee amplifies the work that the user groups do. So if you look at our web page in, in terms of the blogs but that have been going out rugs will do something they'll, they'll give a grant, the grant had leads to use a group activity the marketing committee will interview who are doing that work out there in the field, and that'll be will promote that on our social media and blog posts and that will lead to more membership. So, and this year, we want to make sure that the diversity, our new idea group should be in the middle there. In order to suggest where we may not be reaching to help us identify who is doing the important work and get involved in a decision process of how the money and effort should flow. I see this as kind of a tightened up virtuous cycle for for social infrastructure that gives us a better handle on making sure that we can grow and we can do things that are really important. So that's, that's about it. I'm going to end here with a video that was prepared by Procogia. You can see here the Procogia, I invited the Procogia to make this because they're a small user. They're a small relatively small company. And this is a perspective that I think is important. So those of you coming from larger companies, yours will be a little bit different, but so please listen to this and then we want to hear from you to. Hi everyone. For those of you who don't know me, my name is Mayor. I'm CEO and founder of Procogia. We're a consulting company working across the US and Canada and all things data. We have offices in Vancouver, Toronto and Seattle, but our consultants are scattered across borders as we embrace the hybrid working world. Procogia drives diversity and inclusion, enjoying the wide range of accents, colors, and cultures we keep. We're also incredibly passionate about leveling up junior talent and offer continued education to help our people grow while providing a realistic and tangible career path they might take. Our technology agnostic approach and push to open source has allowed us to work with the vast portfolio of clients, ranging from pharma to telecom, shipping logistics, media, retail to nonprofit. Eventually we analyze, dissect, and implement end to end data projects that support our clients business needs. Our scope expands across requirement gathering data engineering data science data operations, bi and bioinformatics. We're also proud to partner with our studio, AWS and snowflake, which ultimately allows us to grow subject matter experts that our clients can tap into. Yeah, joined the art consortium. Why are we here. Procogia joined our consortium to help support the art community, and to promote develop and extend the reach of our course consortium fulfills unique needs in the data science space, and as a critical tool in the data economy. For members, like yourself. The art consortium has been able to make a big impact across the board in the our world, giving grants to infrastructure projects are repositories are specialists are events, and our communities, not just locally but worldwide members help us to ensure the future of our. Thank you. So, this brings us to the end of what we'd like to say today. And we'll end with this question, how you can help. Well, by using our and publicly promoting it. It just helps everybody. And what you can do to promote the art consortium would be greatly appreciated. We spend some of our resources, you know on social media, if your marketing teams could pick them up and amplify them or if you could help to suggest how the art consortium marketing team can amplify something that you're doing in our world. That would just be better for everybody. We can identify potential our consortium members. After all, this is voluntary organization, and we have the, but the luxury of thinking about who we would like to work with who else would you like to see in the art consortium. What would be good for your company to have, you know, a relationship with individuals, a working relationship with different individual individuals from other organizations other companies that may in fact be competitors. It's an advantage to having this kind of level of communication. So, who should we look towards who should we try to sign up for membership in in the common good to the common good of promoting our You can share your expertise, either by joining one of our committees or working groups or sending us out of the blue memos with you guys ought to be doing that. We'd like that. We're a working group. You can join the marketing committee and, you know, we're looking for people who can roll up their sleeves and think about, you know, this is a big world and how to reach it, and and promote propose a particular project. We, we don't really know, you know, everything that's going on in the minds of our members, and we want to get better at that. We want to get better at hearing what you have to say. And, and we would like your guidance. So, so thank you for participating today. Is there, if anybody would like to say anything before we leave, please now. I would just like to add, you know, thanks to all the folks that I did speak to earlier this year, and I think as Joe just mentioned that in the coming year we'd like to continue to engage with more of the members and have, you know, one on one or one and small group discussions to get your feedback and to factor that into our planning for the years ahead. So thank you all. Brian other other any other questions or anything in the chat. Thank you. All right, then. Well then, let me wish you all happy holidays. So, it's the end of the year. I hope you can all enjoy time with your families safely and and make the best of living through this continuing pandemic but take care and and just happy holidays to you all. Thank you so much.