 Hi everyone welcome to the monthly metrics meeting at the wikimedia foundation My name is Jake Orlewitz and I run the wikipedia library project In the community engagement department and I think this is kind of a special day in a way It's our fall fundraising party tonight, and it got me thinking that It was our great Anna still put a slide deck together. What should we talk to the donors about? It was it wasn't a talking point. It was a question. Why do you give and I thought that this was really The right place to begin because we all give for different reasons our donors give our volunteers give our affiliates give and we as staff and We're here for the why that's what brings us here the mission and the people knowledge. I just think this is a great Session we have today because we're gonna highlight a lot of stories about why people give and what they give That's what this is all about. So here's our agenda for today. It's jam-pack I've got your welcome. We've got Jimmy and Lila giving talks today a strategy update a community update a metrics update And a showcase of the fantastic content Translation tool and then we'll have some time for questions and answers Want to welcome our new hires new staff and new contractors Zachary McEwen and comms Chris Schilling Community and Gretchen Holman and advancement Natalie cauldron Ellen advancement Mohammed Abdullai in community engagement and Morgan Jew in community engagement. Welcome everyone Also, happy birthdays. We have some anniversaries Megan Hernandez six Winifred Ole five years Kim gill three years And Amanda Bittaker Grace Gallerman Jacob Rogers Jerry Kim Julia Barbara and the Haricah Coley Sandra George and Stas Malashev All celebrating them when your anniversary and I'm going to hand it over to Jimmy and Lila. Thanks so much a So I'm really excited that Jimmy is here today with us and hopefully we'll actually end up with some time for Q&A later today And we wanted to Jimmy travels at Han I traveled quite a bit lately And we wanted to focus not on so much on us But on some of the incredible community members that either we met directly or heard off Through all of you who are also closer to the community Okay, great. So we just you know as you I'm sure all of you or most of you know we Wikipedia won the very prestigious Princess of Asturias award. It's roughly the Spanish Equivalent of the Nobel Prize and so it's a really huge deal in Spain, but actually all across the Spanish speaking world There was a lot of press coverage and a lot of interest And so we went they invited us to come with some community members and so Patricio and Lila and I were there We have some community members with us, which we'll talk to you about This woman here was really really great really sweet. She's a certain type of wikipedia that I've met many places and many Countries around the world. So Lordus is her name. She is now a 75 And she is the longest running contributor to Spanish wikipedia. She's been around since 2003 Yeah, and so I actually it's one of the things I think when you really start to dig into the community dynamics I see this in a lot of places that as we all know we have a gender imbalance With a lot more men than women and also a lot of young men in their 20s And sometimes they need a grandmother figure to keep them all straight. And so she's quite beloved in Spanish wikipedia We met her so she edits on a variety of topics, but in particular those that follow in the subject areas of fine arts and geography She studied French Philology and music in Madrid and she's worked as an elementary school teacher So what I what I love about someone like her is that she is sometimes not the model of User that we have in mind when we're thinking about our user base, but she and people like her obviously very important There's a photo In my travel in Japan I met with Kita Murasei She's quite incredible Contributor she started as a lecturer at University of Tokyo and during her time there She created a wikipedia translation class project and she got really passionate and involved with open open data and open information movement and when University of Tokyo decided to cut her grant for that For that type of project. She actually decided to leave And pursue her passion and to look for the way she could contribute to the open Open movement and she started to work and make connections with Universities and governments to release more open information so that her students could use it and In their wikipedia work So she's quite remarkable and her work is just absolutely astonishing So G we met him as well. He came to To the award ceremony in Spain. He's a naturalist and a frequent contributor wikimedia commons He's from Kerala, and he loves taking pictures of bugs This is his main thing He has uploaded over 1100 pictures to wikimedia commons 150 are now classified as meeting quality image standard with close to 40 of them being reaching featured picture status By the commons community. He's an admin on commons And he's an active advocate for improved culture and respect on the project, which is quite important One of the great fun stories about him is that he helped to identify a new species of dragonfly So he was out. He does these projects and he goes out and takes photos He identified a dragonfly. They were trying to figure out what it is One of the things when I had a long chat with him one of the reasons he likes contributing He used to upload pictures to flicker but by contributing a wikimedia commons and through the wikipedia community He actually then has access to a community of People who are really passionate and and are experts about insects and so he's able to get help in figuring out what things are they actually Couldn't figure out what the particular I assume is this the one somebody else Assume it's this one. They couldn't quite identify it. They found a naturalist in the Netherlands who is the expert on this particular type of fly and they determined it was in fact a new species in this Genus, there's only two other identified species. So it's the third one of this particular group, which is kind of amazing When asked about his motivation to contribute He says simply I like the idea of collecting and preserving knowledge and making freely available to anyone who needs it What a really sweet guy he He had never been outside of India So it was his first time leaving India and I we were at this little event And I was I told the king. I said I really want you to meet this guy And so he got to meet the king and the king said oh, I understand. It's your first time out of India So it was really really a great moment for him Very very sweet guy. He told me some information about his personal life. Nothing particularly remarkable I didn't think he actually sent to me an apology later saying I'm so sorry that I sort of blurted out all my personal information which is Indicative and the lesson I learned from that is you know, again It's the kind of thing we don't usually think about about our contributors, but his culture is very different He's from a culture. We're sharing some personal information Nothing, I mean nothing really that any American would just blurt out. It was like a big deal and He felt he needed to apologize for being so familiar and so interesting what I love Yeah, and and this is really a theme throughout every Wikipedia and that I meet which is really really incredible and Raban Jafar our tie Who you a lot of you probably know from your visits to wikimania because she's a she's a frequent or Frequent visitor there is I taught me recently something really important something that Makes a lot of sense and I sort of knew but I'd never verbalized and that is Wikipedia and her experience was Wikipedia even though she edits She actually learns from editing, right? So it's a learning experience whether you Edit or whether you read and that's that's an incredible Inside most of you probably is very obvious and for me for some reason the light bulb went off. She's she's really amazing. She is she's actually an engineer a chemical engineer from Erbil, Iraq, and she has been editing Arabic Wikipedia since 2008 so she's been really fundamental. She's also a female Admin on Arabic Arabic Wikipedia She is incredibly curious I've met her she was I met her before but she was at the award ceremony and A couple I spent probably a good 40 minutes with her and she wouldn't have much to anybody else so she's fascinating and full of life and incredible and she's behind a lot of Wiki Arabia events and she's been fundamental to moving this last event Into Jordan so that more people could get visas and attend including Israelis So she's just absolutely an incredible human being Another person that I wanted to highlight was Manjai Lee he's in Korea and you can see actually by the font here Manjai does not edit But he's a scientist. He's a former professor of computer science and currently a distinguished fellow at the at Seoul National University and now he's involved with the Wikimedia chapter there what he did because his background is in data sciences and Knowledge mapping he built this tool to show all of the different interlinking and connection connections on Wikipedia And they're trying to translate it now to make it available for English This is kind of the heart of Wikipedia all of this links that there's a blood system that that connect to each other and he made it visible and explorable Explorable if you click on different nodes, you know, they zoom in and you can really really explore So this is Polana Sanchez She is an active Spanish Wikipedia editor from Mexico And her big thing is I'm not sure how to pronounce. I'm not good at Spanish edit a tone edit a thongs and She runs these edit a thongs and she started doing it. She was asked to join. This is how she got started in Wikipedia She went to an editor for women She got involved in that and then within a month. She thought it was such a great idea She was conducting her own workshops on how to edit medical bioscience student at National Autonomous University of Mexico And she was actually attracted to Wikipedia as you might imagine having come through the edit-a-thon route an edit-a-thon for Women to edit Wikipedia. This is what attracted her the gaping coverage of female biologists such as herself and so she Runs these edit thongs many of them as she encourages people to edit in the area of her interest but also To edit whatever area That that they may be interested in so She's one of the kinds of people who can help us in to move forward and solve the issue of imbalance in participation And finally Leonel He is from France and he's a French programmer and a photographer and that he was He devised a system For taking pictures aerial pictures of Different locations in France and one of the most notorious one the Palace of Versailles did not have any open pictures aerial open pictures online anywhere, so Leonel Decided to fix that so he built the he attached the camera to the drone. He took a lot of pictures and Well off we have this astonishing pictures of Versailles and Thanks, thanks to him. He does much more than that. He got involved with Glam and And is contributing very very interesting work There with museums and galleries and an incredible innovation coming out from our contributors in the in the community something that we would have never imagined and It just says such an inspiring and incredible war Yes, I had anything to say at this moment. I'm really looking forward to Q&A, but I'm gonna sit and watch life. Thank you So I wanted to really briefly address some of the some of the things that were that have been coming back coming up to me since I got back I I really value my time with Interacting with our community is it helps me bring Understand much more about who we are and what is important but also bring us closer to both our affiliates in our community And it's really started to heal some of that Some just just joins that that happened happening, especially in affiliate territory But when I come back there, I came back I realized that I made a mistake in spending that much time out there and that you needed You needed more support and more of my time Right now more than than than probably ever So I heard a lot of your your voices and thank you for letting me know about this because Not everywhere you have the gift of people coming up to you and saying hey This is broken fix it so I was listening to your To your commentary both online and also talk to a lot of you since I got back in town So I really really appreciate everything that you had you had to tell me and here's here a couple of things that I think Are going to help us in the next in the next little while but something that we should also probably retain much more So first of all, thank you for giving me a feedback Thank you for letting me know about that and number one communication. What communication? Vacation is really hard. I have to tell you especially the online communication and I am more than anybody else is guilty of this. I use short hands, you know, I get I Get one liners to get misinterpreted So something that I've started doing and you've noticed I've started doing it started a few weeks ago It's sending longer updates about what's going on Where where's Lila? What's going on with with her and her team and what is What is on the priority list at the moment and what is she struggling with so you seeing some of them coming through and it's It's great that in the last one a lot of people a lot of you have engaged and as I as I read through that thread I also found other things that needed to be done So a couple of things that we've done very recently We are pulling up HR function backs to the sea level so we can hear HR is our venue for hearing your voices As part of the executive team and that is what we're doing effective immediately. It's one of our first steps the next thing that's going to happen and unfortunately Jody and Brianna not here today, but we're setting up Conversation from Monday to have it with all of you We are launching a culture survey that will allow you to bring your voice into the conversation to tell us exactly What do you want to say changed? What is working? What do you want to see more of so we can hear your feedback? It will be completely confidential held by third party and Brianna and and Jody will explain exactly how it works So that so that you can you can have confidence and in the results Fourth one really cool. I'm really excited about that. I've been waiting It's actually been a lot of work to get this done for those of you who are not involved There's been a lot and a lot of work to put the process in place. Remember Last year we said that we're going to put into place a product development process that will help us Identify when do we need to release information at the minimum and how weird we need to release it So that we can make it shareable and accessible and visible to everyone Not just in our organization, but a world of large indefinitely for community to give us feedback so we just completed that work and We as part of that work. We wanted to remove super protect Superprotect said that set up a precedent of mistrust and this is something that was really important for us to remove to at least come back to the baseline of Relationship where we're working together. We're one community to create a better process to make sure that we can move together faster and Everybody is part of that process and everybody is part of that conversation Let's just ask here at the WML and Finally, a lot of you have been asking a lot of questions about strategy about Culture about all of those things all of those questions and there were a couple of requests to to get to this start to dig deeper and actually some of that is already has been on our roadmap to do but I'm hearing your urgency here and Please mark your calendars for Monday. We're gonna have an all-hands Q&A predominantly around both of those topics and then Starting the that very Friday We're going to have smaller meetings and groups of 20 to give fit that both and fast questions specifically on the strategy that I'm going to Highlight for you in about one second So one of your key fed feedbacks was that you are all really hungry for that synthesis of the strategy The way that that the process work over the last year is that we've done a lot of research I'll probably every single person around here did something for it in one form or another So I know that Jan and Seco for example early in the year led two research groups That gave us a lot of information about our readers and about our editors We did a consultation and engage more than 1300 readers from all 300 people from all over the world both readers very very senior contributors. We did workshops with with Thought leaders. We did shop workshops with scientists. We do workshops with Community members. We did workshops with owners and this is a sea of information that we went through and then We started Trying to distill this to some of the fundamental and very high level pillars So what I'm going to put in front of you today, and I'm hoping that they didn't remove my draft slides I'm going to put in front of you a draft It's about this is the draft that I'm going to show to the board Tomorrow, but I'm going to show to all of you today Because you want to see it and there's no reason not to so let's let's dig in a little bit Please keep in mind. This is still very very raw draft. It's just you might get confused But I hope not too much and it's going to be an opportunity for us to tune and learn our One reminder that I wanted to put in place our strategy process is cyclical when we decided last year How we're going to build the strategy going forward. We decided it's going to be different from last time It's not a five-year plan It is a vision for where we want to go and then the yearly cadence of updating this vision that results in yearly goals basically that go into the annual plan and the goals we build we build all of this Collaboratively, but hopefully we don't need to update the strategy proper for many for many years to come And we're about we're about here So according to this cadence were sort of in the right in the right in the right place We've slipped some of the milestones there, but we're getting back on track and that process will we pull Will repeat every year But when I first got to the WMF What we have done because we knew we're going to have a gap in the new strategy and old strategy We've put together The call to action which is serving as our current working strategy the call to action that they put put into place Last February lasts us about 18 months in other words It will last us until the new annual plan goes in place So it's really important for us to get this done and distilled now so we can build the annual plan for the next year Once this expires so what I'm going to put in front of you today is the synthesis and it's a draft So please take it as such So Just to review the high-level principles when we first started with the strategy We wanted to make sure that the vision and the mission is still Still makes sense and of course they do we are here while we hear here for To bring knowledge to every human being in a participatory way that's that's our why I would there yet No And our mission as a foundation and this is that the essence of it is still incredibly relevant In fact, it is more relevant today that has ever before in my opinion because This piece is focused on more on educational content and our our mission to really bring That content make it available to every human being in the world Why because this world is changing so rapidly and the human condition really depends Individuals ability to learn I I often say air water knowledge so they've been shelter. That's the next thing It's knowledge because there was knowledge you can get shelter So our thinking is really focused on helping every human find that path the knowledge to get into the into the knowledge ecosystem that the people that we were talking to in the beginning are a part of and and are Really that is really changing their lives and and as a result ours So the strategy is making a Knowledge more accessible to more people in ways that help them engage in the best Hopefully you could also fun But in our world knowledge does not stand alone. It does not exist without reach It is not thrive without communities So knowledge is a path that starts with that impulse to learn but every step on that pathway matters So things like reaching readers is critical to contributors So reach Community knowledge is how we distill this path We have some challenges. This path is not without some some treachery You know all of this are challenges with readership challenges with Editorship and the growth of knowledge around the world is very rapid and is accelerating Which is threatening to outpace our editing capacity so If we look at reach community knowledge, they are focused on those and and they are aligned with those With those strategic challenges as well. We need to engage more people globally Bringing people into the fold that are in areas that are just now coming online and who need the knowledge the most we need to facilitate communities at scale and and Operative word here facilitate not replace not to do but facilitate enable more communities to grow and focus on on impact that those communities can make and Finally we need to Open and include broader content for that knowledge because knowledge in different parts of the world is different And what our community consultation told us is that there are different formats and different languages that are really really important to it So, okay, let's put some meat on this. What does this mean? How do we how would we look at it in really? more more tangible ways and all of this of course is going to be open for you guys to In our communities to alter to change and to comment on so Here's an example and it's a just an example Like what would we need to do to reach more people grow globally? We need to understand what those Global users actually need we have very poor tools right now to really understand it Most of them are actually living within our community department and a little bit in our comps because people are actually talking Talking directly there, but this is ad hoc. This is not this is not something that's programmatic We need to we need to continue work on developing new interfaces like mobile, but probably different formats Once that are suitable for for people as the world is changing we need to Understand and partner for content distributions and awareness and we already have programs in this place So existing programs like Wikipedia zero and education program are really important here But there could be other partnerships that you may need to explore and those two can scale much more broadly Let's look at the community. What is facilitation at scale may look like well first of all This is the same item that we have an article to action is Improving trust safety and collegiality and I have to thank those of you who have been doing incredible Work, I don't see the team here But if Maggie if James if you are online you've been doing amazing work since the beginning of this year We've started programs on both child protection and trust and safety these programs aren't fly There's a lot of work to be done and but they're extremely important Second one improve curation experience and grow capacity for content quality and breath and breath What does that mean? That means that we need better tools for our for our editors But not just around editing but about curation and content quality and ensuring that so that Process that faster including machine learning algorithms and that's thanks to Aaron I am looking forward to seeing that the algorithm for ref scoring really productize and deployed across the across the Weekies we need to scale content donation programs for partnerships and movement. This are our glam programs They're still ad hoc and why all volunteers are doing incredible work oftentimes that content is bogged down On upload, how do we make it easier? What do we need to do there? And how can we facilitate facilitate those programs better? They already exist. How do we Give them better support and finally knowledge itself at the end of the day. That's what we're here for and creating modern and easy to use APIs for creating and consuming this content is really important. We've started some work there the discovery team delivered the the first API for getting the content of we get data for example the Multimedia team is working on improved uploading of content, especially pictures and And images so again work or it is some work that we have always done We know we need to do there, but that's that's one possible focus area Delivering diversity in our content experience like languages videos voices maps again couple of them We're already starting to put in place the language team has done amazing work and things to layla We can we can possibly double the productivity or double the translations of of our key languages We can we can possibly bring some of the underrepresented languages much faster up to full up to full volume maps again The discover team just completed the maps integration a little while ago and One more idea is improving tools to support community and reduce manual work again very very important How do you with the increased volume and knowledge? How do we ensure that our communities can can actually Focus on the things that they love to do and can do back can do best And how do we automate the tasks that are not that are not? Shouldn't shouldn't even be Manually done. So those are just ideas. I am putting them in front of you as a draft They show you how the synthesis of the strategies coming together what it might look like and we would where we were going to go into a very Very heavy iteration for the next couple of months to getting all of yours and community feedback to help us understand if this is How much of this needs to change how much is how far off target or on target this might be and at the end of the day You all of you it belongs this type of strategy belongs to all of you It's it's pointless unless each and every one of you knows how to make those decisions and makes the right decisions all Every day many times a day. So how do you prioritize? How do you decide what is more important than the next and and we're thinking about how do we provide that framework, you know And this is some ideas of how we were thinking about it But then at the end of the day all we can do is provide a general general frame What's really important is that you make those decisions and you make those trade-offs on the everyday basis And one of the ways that we're thinking about is how much of a spending on quarter day How much you were spending on spring experimentation? You've seen this before this is the has this had been in front of you But it will be really important really identify what is for what is missing and again, this is this is up to you So what are our next steps as I mentioned? We need directions and feedback including and most importantly right now the boards feedback We need the direction and feedback from staff and we need to start working on developing actual goals For the next year. What are the things that we want to get done? Maybe you want mobile visual editor? Maybe we want to scale a language translation programs. Maybe we want to maybe one we want to work on glam Let's get together and make sure that we have our ideas and In the right place and we have them prioritized and of course community our communities need to be involved in that So Michael to action to you as I close this off We're going to need support for this and I would love to ask you to join the Platypus team is that what we call it? To join the Platypus team Please email me if you want to be part of the team that facilitates this because it will require Quite a bit of triage and work going over the next about next three months So if you are interested and it being active Participant and making the strategy happen and making the strategy to you Please send me an email We're going to be looking at this done and about a week time and Lewis and I are looking at it With a lot of intensity, so we're gonna need we're gonna need your support. Okay? Thank you Well, that's a tough that's tough back to follow. Oh so I you know I because because that went into such depth and I think actually because Jimmy and Lila gave a much better community update with some of those awesome stories from Spain Then I can never give I'm gonna go through this a little more quickly than you than usual But you know what? What Jake said at the beginning about the sort of why do people give? I want to call out some of these stories here wiki miss Jonas miss Jonas is a Province in the northeast corner of Argentina. It's got about a million people They just celebrated their 400th anniversary as sort of a as a region So they had an editathon of a thousand students, right? So imagine if so that's one out of every thousand people in the province Was writing articles, right? Imagine if that math worked, you know, if we had one out of every thousand Americans Or one out of every thousand Indians Writing articles that math would be amazing, right? It's so it's still it's still pretty amazing here, too, right? you know Why right it's because this is an opportunity to tell their own story, right? This is I think one of the most powerful motivations for so many of us including a lot of the stories We heard at the beginning, right? And this is despite Poor connectivity a lot of writing articles beforehand and uploading them I mean we sort of take this for granted that of course the first thing we do is Upload is open up a browser and start writing That's actually not the case for a lot of people here and not not the case here, right? You know creating articles in advance talking with teachers It's a it's a different world out there and not always the experience that we have when we're editing together at our Edith Vaughn's every month in this room, right? Serbia How many of you would guess that editing wikis is in the national curriculum in All right Some folks know right like this is actually again because of the actions of volunteers who have been educating and working In this area. It's an you know, it's now they've got a hundred teachers being trained in the past in the past few months to Help their kids with wikis right to learn that kind of Learn those kinds of skills right and to get involved Over here in the US. We recently had a wiki conference I wanted it. I'm gonna skim through this real quick, but I did want to call out one particular thing Gender gap was a big theme here, right? This is something that we that I think many of us in this room know is an issue It's been really refreshing to me to see You know that in many ways we're actually being led right the community is thinking big and aggressive on some of these issues I'm thinking hard about how they can address this right and so that was great for me to see coming out of wikicon We had I love these, you know, that's patricio. You can't quite see You know sometimes we wonder well do these prizes these prizes are cool I think a lot of people around the office who actually watched the live stream Yeah, which I I was in a meeting. Unfortunately. I'm just scheduled that You know, we sort of wonder like how does this feed back right and we had a very cool example out of Spain The prize was announced the press literally called the chapter. It was like can we find out some more about that? they talked to a wikipedia in residence and Got media coverage for a glam event in Madrid right like these kinds of things They're not just it's fun that they're awesome recognition for us, but they also have really positive feedback loops for those communities Again trying to go quickly through these because of the time We had some awesome again glam Focus on gender a lot of articles and the museums recognizing again where the best way to when you have When you have a collection in New York, it's going to be seen by millions of people when you have when you share that collection on wikipedia, it's going to be seen by hundreds of millions of people, right and and And museums are starting to recognize that Um feedback survey, I think we're just going to skip this one today because I cannot do a justice in the time involved. I Want to talk a little bit about project milestones, right? I think most of us how many of you knew that over the weekend? 5 million articles in English wikipedia So how many of you know that within the last few months Hindi wikipedia hit a hundred thousand articles So if you didn't know that let me put in context why Why that's a big deal, right? Hindi is spoken by around five percent of the world's population Right. So this is a huge that five millionth article in English is awesome And we should all be proud of it, but we also make a huge impact in other languages when we make these kinds of You know that hundred thousandth article there makes an impact for a huge portion of the world It doesn't necessarily have a ton of content online as much as we are spoiled to as English, right? wiki data is hit their three year anniversary this year 15 million items How many of you played with the wiki data game? All right, I admit I spent a good chunk of the weekend sitting in front of the Football on one screen and wiki data in the other screen. It was I only had to revert like get it And that's the those are some big milestones that were just hit lately odio with 10k You know we keep trucking along folks. This is Really amazing. It's both these personal stories that we let off with and these big aggregate impacts that we have Are I think really powerful and it's always good for it's at least good for me to remember that so On that note, I'm gonna hand it off to Edward real quick to talk a little bit about understanding more details Alright, so All right, so I'm actually so my name is Edward Galvez. I am survey specialist in the community engagement department And I'm actually not really here to talk to you about surveys Thank you Thank You Louis. So not here to talk to you about surveys. I'm actually here to talk to you about slide Listening to communities because surveys are really more of a tool to actually To to that endpoint which is to listen to communities And of course next slide we have a lot of different communities as you can see This obviously doesn't cover all of it and doesn't cover the different countries and places around the world and your community as a In whatever department you're in is the people who you create products and services for and service can be a way to Improve what you create With and for community in a small systematic way And my role is to coordinate learning Learning about doing surveys in the week media way And so I'm gonna practice my community engagement muscle and and since you are my community I'm going to engage you in a little exercise I know a lot of you are in on your laptop. So if you just looked up just for one second Next slide So if you can get a show of hands really high up how many of you have ever created a survey really high Awesome. Wow, pretty much everyone Next slide Right. So who here feels they've created a pretty good survey Raise your hand really really high Awesome, I got I got this now and who here knows how I actually define pretty good Who here knows what I even meant by survey And So the point at the point of this little poll is that people will answer your questions whether you have good questions or not And so if you don't have good questions, you might have bad data if you have bad data You might really not be able to make really good decisions Have to hold two different things, okay And so what I want to talk to you really quickly is about three common lessons in three months as survey specialist I just came on into this role in a few months a few months ago The first one is to know your goals and decisions that you need to make That will really help you to focus your questions a lot better if you don't know if you don't know your goals and decisions It's hard to really write questions Second know who is your specific audience? Who is it who you want to reach and how are you gonna reach them? If you don't know that maybe the survey or big survey is not you're not really ready for that Maybe you want to do a different kind of survey You want to do focus groups or interviews or something else and third test your questions Test your questions with your colleagues test your questions with the actual people You're gonna be surveying and then test it also once it's actually in the final form in Google Forms or politics or whatever you're using And that is not the end of the road about learning to learn about surveys And so I want to introduce the survey support desk This is on meta and it's for both staff and community alike and This portal is a it's going to be right now. It's a skeleton There's enough information there for you to start exploring But it's going to be building up and we're gonna have a lot more information about how to How to start from strategy all the way to the end of you know, thanking users for taking your survey and analyzing the data And so if you have any questions about surveys consult this you can also email me at surveys at Wikimedia But if you're planning any large surveys, please give me at least a few weeks in advance So yeah, I think that's it. Thank you Hey everybody, I'm Neil Peekwin. I'm a product analyst in the editing department and I'm gonna talk a little bit about some metrics that we use So this is a graph of monthly active editors across all our projects It's pretty well known and in fact somebody told me that the metrics meeting Started way back when essentially is a collective freak out about the state of this graph So you've probably seen this before But there is one problem with active editors is one big number Which is that it's kind of a blunt instrument. It doesn't necessarily tell us a lot about who these active editors are where they came from What's driving their participation? So what we should do is break it down. I Look for that picture specifically So one of the things we can use to do this is the editor model which was made which was a dreamed up last year by Aaron half acre and Toby Negrin and what it does essentially is break down active editor into four major groups First up at the top. We have new active editors people who registered this month and made five edits this month So they're just getting their feet wet in the project Surviving new active editors. These are people who registered last month made five edits last month and stuck around to make five edits or More again this month There's recurring old actors So, you know people who were who are active this month were active last month and registered some time before that So these are kind of the ongoing continuing core of the project And then we have Reactivated editors people who are active this month, but weren't active last month So these are people who are kind of coming back from what from a hiatus of some kind So when we break down active editor numbers into these four groups we can start to see some interesting patterns For example, here's the breakdown of active editors on the English Wikipedia over time There are a lot of interesting things about this graph and what I find particularly interesting is that New active editors is a pretty big band of green But surviving active editors is just a small yellow slipper which tells us that most of the people who make five edits in every given month Don't stick around If we look at Japanese Wikipedia the pattern is fairly similar as well Although you can see that new and surviving active editors make up a bit of a smaller chunk than they do on the English Wikipedia Here's Portuguese Wikipedia fairly similar pattern as well So active numbers so sorry absolute numbers like this are definitely interesting But they do have one flaw, which is that they're not easy to compare between the keys on The graphs I just showed English the English Wikipedia graph and the Portuguese Wikipedia graph are about the same size But if I put them together on one side of the same scale the English Wikipedia graph would be about 30 times higher So one thing we can do about this is borrow a little bit from elementary school math and use rates instead of absolute numbers So here's an example of how that works This is a breakdown of active editors on the Portuguese Wikipedia in one particular in one random month They have a big chunk of recurring editors in blue reactivate deaders in red New editors in green and this little sliver in the middle. That's our surviving editors So where do these people come from? Well to be a surviving editor this month you had to have been a new editor last So that's kind of our source population 673 new editors last month Unfortunately, most of these people didn't stick around for a second month In fact only 16.8% of them did That's 16.8% is our survival rate and it's a bit discouraging but it is something we can compare across wikis So this is the breakdown of rates on the English Wikipedia At the bottom we have new editor activation in blue. That's the rate at which we convert new sign-ups into active editors in the same month Above that there's new active survival in red, which is what I was just talking about And then we have old active survival in yellow, which is kind of the rate at which existing editors stick around from month to month Now if we compare that to Japanese to the Japanese Wikipedia The relative distribution of the rates is pretty similar But if you look at it each rate is about five to ten percentage points higher than the corresponding rate on the English Now that's pretty interesting and it certainly seems like a good sign for the Japanese Wikipedia community I don't really know why that is But it's an interesting question and we know to ask it because of the edit model All right, that's it for metric So I'm gonna hand over to another guy in a grey pants and a blue shirt to talk about content translation Thank you, Nick Okay, my name is Sandosh. I'm from the language engineering team Today I'm going to Present some highlights about the awesome content transition tool. I'll be cute Content transition is a computer assisted translation tool for translating content between languages To address many of the problems we discussed a few minutes back about the imbalance between the content existing I'll start with some quick facts This development started early 2014 The first it was first deployed as a beta feature in Catalan Wikipedia on January 2015 and was deployed again as a beta feature in all Wikipedia By July 8th of 2015. So the team is pretty much small only full-time one full-time engineer one part of means software engineer That's that's it. I'll Go to the keep highlights also for October 2015 So as of now in every seven minutes a new Wikipedia article is born out of this tool and In every week 1500 new articles are created So I want to repeat that this is still a beta feature. Okay, and Every day 200 articles are created to put these things in perspective In Spanish Wikipedia, that's one of the top and Wikipedia every day 200 articles are created So this is almost equivalent to the same productivity of Spanish Wikipedia Also similar to the Italian Wikipedia where every day about 200 articles are created So the productivity is same as what you see in Italian or Spanish Wikipedia 30,000 new Wikipedia articles are created so far. So that is like bigger than the whole Gujarati Wikipedia and even close to the whole Swahili Wikipedia and All these things are by 7,800 beta feature Uses so I want to again repeat that is still beta feature So quickly going through that now how the translations are going from 2015 January onwards the graph is going Quickly upwards. We have a steady rate of like it to 200 translations per day and a thousand and five hundred transitions per week and What you see on the day line is the translations in progress So we allow translations to be done in multiple steps. You can save it and work on later and publish again later This is the weekly trend of how every week transitions are going We also need to consider the deletion rate because not all published articles are there in the wiki is getting deleted, right? So this is deletion rate of catalytic medium about two percentage of the articles are getting deleted and if you compare with this with the English Wikipedia about 20% Articles are deleted, but you need to note that I think in English Wikipedia The deletion rate is for the articles that are created from scratch. I think it's nearly 40% So this is an indication of the quality of the content created using content translations So most of the articles published are going to be present there A few things in progress. We are working with the research team about the Suggestion mechanism or article recommendation system to give an indication suggestion to the translators that you this article is missing in this language You may want to translate this so we are running an experiment on this and we are going to have some support you know inside the tool to organize translation campaigns something like Every community community can organize some campaigns to fill the gap of articles from translating from other articles Other languages and we are working on adding more machine translation engine support as of now We have a person we are going to get more language support very soon and I think That's it. I think it's time for Q&A now a big. Thank you to all our presenters That was fantastic, and we'll start with Q&A from IRC. Ah, there are no questions from IRC So if you have not yet If you have a question, we'd ask you to please just go to the microphone right over there just queue up and you have many knowledgeable people to We have an IRC question. Yes by saying aloud we didn't have any questions from IRC. I caused us to have questions So This is a question from Matt Flaschen who asks What's the Machine translation back ends that are gonna be coming soon. So this is Yeah, the question is what are the machine transition back ends and what's going to come so so we help The open source machine transition engine appersion running in our cluster as the one of the machine transition engine What is being considered and what is going to Come soon and we are preparing the announcement and the final states of moment is about the Yandex machine translation service and We might have announcement and detailed information about that point next week. Thank you What we found out when we were looking into this is that different languages have different translations tools So for example, Google translate is really really bad for like Japanese and Korean So it's really going to depend on which language pairs the team chooses. So we're looking for many to plug into Anything else from IRC James? There's another one from James here Are there any plans to deploy content translation for things like Wikidata? Descriptions to prompt people for all the different places that aren't just articles to translate Wikidata descriptions Nothing planned us off. No, nothing planned on that direction. All right, let's take some from my kid arrow This is working. Yes Very different research first off language team. These are crazy good numbers And then a question for Ed about surveys, can we start sending? Researchers not just community members to you in drugs Oh For surveys If your staff is willing to I don't know I guess we could talk about it Sati So my question actually to Lila on the strategy that you gave So it seems like right now the hypothesis is that our technological solutions are going to be the majority of how we're Going to address our challenges and I want to understand to what extent you think that the that's obviously necessary But it's sufficient. So when do we kind of shift focus to look at the non-technological solutions? Actually, I must have not explained it well enough that I Don't believe technology only is good as long as it supports Something that's meaningful and practices that are meaningful So I as much as I would like to say that knowledge of all, you know, save the world I actually don't think so. I think we need to decide What is that our communities are doing and what's what do we need to do for them to make it to make the technology work? And communities using that word broadly, right a community in South Africa. That's just you know Coming online is also community even though they're not a computer yet So I was actually thinking more when when we were talking about building communities building knowledge is About programs like glam about programs like education. How do we really make them work at a much broader scale? How do we enable? Things like what we just looked looked at museums to put their Gallery collections on Wikipedia and continue to add to them as they acquire a new art for example So I believe that the strategy will be very much program Focused and content focused knowledge focused and the technology is going to be important in so far as it can help us reach Further and engage deeper Anything else going on an IRC Jane? there's a Question doesn't seem to be quite the right term But a point that when you say Lila when you say our glam projects, they're not actually done by the foundation itself Do we have any other questions? We have a lovely lunch Rided by or Sure, bye. I'm not supposed to say that Other questions one more from Iris Lila. There's a question from Pete Forsyth Saying that I in 2010 there was a five-year strategic plan process that Took about a million dollars and a bunch of time to do it and what you described seems to be much more kind of internally originated and Is that a deliberate change of emphasis for a particular reason? Is it just not being seen in the same way? I mean, how should we see it? No, actually So interesting it's an interesting question. We were trying to design a much more What would you call iterative process Actually, the board has asked me in the beginning to make the process More incremental rather than have like a five-year plan like they used to have in Soviet Union I'm sorry five years and four years, you know, we had to deliver No, it's because we need we need to be able to adjust You know the things that you saw today this incredible work that these teams are doing they're learning every day And we need to give them flexibility to learn to make to make changes to their thinking and to adjust But all what we do need is as a community and as us the community not ask the WMS Community to make sure that we're setting the right Objectives in front of our teams. So what our goal was is to run Very extensive program including a community consultation that actually yielded more Collaborators than the one that we run for a million dollars by outsourcing the process We insourced it because we wanted to be the ones that are Talking to our community members talking to people outside of the foundation and talking internally about it We wanted this process to really be owned by all of us Not just us at WMF, but us as a wider community and we wanted to be adjustable so that when somebody's somewhere Including here at WMF or a volunteer who is experimenting somewhere across the world figures out or finds out something new that works much better We can change we can that we can the strategy can emerge Based on that learning we're learning organization. We're a learning movement. We need the strategy That's flexible enough for us to be able to adjust All right. Thanks everyone. We're gonna wrap up Appreciate everyone online watching and all the staff and all the speakers. Thank you very much and our guests Jimmy Thank you for being here