 Great, okay, so as we prepare for a soft landing which means refreshments and Snacks outside. I can't vouch for caffeine, but I know there will be alcohol and hopefully warm snacks Which at least will appeal to some folks So I would entreat you to to rally for this last 28 minutes or so So that we can make the most of our time here together and try to make sense of all this stuff that we put on the table I said or intended to say at the beginning of the day that this was going to be a challenge And I think it clearly has been at least I feel challenged With so much just this firehose of information different perspectives Even trying to get to a picture of what the problem is clearly lots and lots to process In terms of how we understand what we've all talked about today Similarly lots to think about in terms of where we go from here And that means both in the rest of the evening and and tomorrow for those who are around for the hack day So what we want to do is in this session try to make some progress on both those fronts So first I want to make a couple of quick logistical announcements one that for those of you who That's okay up here Okay For those of you who haven't signed up for dinner and are interested in a dinner companion There are a number of different fabulous sounding food for thoughts dinners Proposed on the wiki you can find them if you go to the truthiness website in vino veritas a good debunking Page design What to do if if you do what do you care if someone's a bot and what other questions about identity and motivation and Finally tractable tools So there's a series of at least four and there could be more and I'd encourage you to sign up for one of those Self-hosted super festive fun productive dinners Next on the on the last inside page of your booklet is information on tomorrow's hack day Anyone is welcome to go. There's a little bit of a description as well as a map It would be fair to point out that it is not a hack day in the strict sense of hack day So if you're a stickler for that sorry, but on the brighter side, it has something for everyone Including well, I don't know if Ethan will let the count of the bag on that one No, but think of it this way It's a structured brainstorming around many of the questions that we've been asking today Which is to say it's trying to identify some tractable questions IE moving away from that the vast intractable questions trying to design some small Interventions and experiments that could be tried out some of them might reach the point where we write some code Particularly if people are coming in with tools that they're already building in many cases The output is likely to be a well sharpened idea some design sketches Lots of different ways to move forward on this It's also being very much designed to get people with different skill sets working together So if you're thinking about going to this and your fear is I'm not a programmer I don't know what I'm going to bring to the table that is not a good excuse not to come Actually, that's a really good reason to come We'd love to have people who have experience with coding But we'd also love people with experience with design or basically Anyone who is interested enough in these issues to have spent the entire day sitting in this room That makes you qualified to participate It's over in MIT's media lab which is conveniently located next to Kendall station It's 20 Ames Street or 75 Amherst Street It's a big enough building you can get in from either side It's up on the sixth floor starting at noon tomorrow Because everybody understands that hackers don't start the day at 9 a.m.. And if there are any other questions Please find me right after this or during the reception. I'm happy to talk a little bit more about what we're going to try to do It's probably going to run somewhere between four and five hours But you can duck at at any time and we'd love to have you there and it'll be really fun It will be really fun. I would think that goes without saying but I'm happy that you said it anyway So okay, so now let's turn what Ethan has hopefully placed in a place that you guys probably can't see especially if you're sitting in the back of the room It's something on this side of the board that says takeaways and on this side. It says tractable questions This is our attempt to Have some takeaways from today and be have some things that we can work on both In the tomorrow frame and perhaps beyond in the longer term So I want to ask you guys to start helping us perhaps you can begin with the takeaways But an important caveat on all of this because we're going to try to get lots of comments and very quickly This is not a great time to give a closing speech the remarks are the things that you didn't say these are Twitter length takeaways or tractable questions and in fact I now use this enough that one of the tools that I could really use if someone wanted to write tonight Was something that automatically checked in a document like this when a question exceeds Twitter length But please try to limit yourself to a hundred and forty characters and either offering a takeaway or a tractable question And I think within that within those takeaways I would absolutely include things that help us focus on what the problem is or breaking the problem into pieces because there Are many elements to the problem Ben and then Herbert Say what Chris Who's next Herbert in the back Communicative act sensitive to power we should prioritize power relationships in Developing tools for truthiness That's multiple tweets But they're good. They're good They're excellent tweets, but you're on three at this point We should develop tools Silitate I'll type fast I Like it though Greg How do tractable question? How do we protect people on the pointy edge of fact-checking from bad actors? And what's an example of pointy edge? blackcheck.org Pointy Okay Fidelity to the noble to the noble noble and Spotting what we're not talking take away question What is the fundamental difference between spreading the truth and spreading lies? Good luck Take away Don't only focus on the misinformation but focus on the system the larger system and Question what is that battle war or is that? Instead of focusing on the pieces of misinformation look at the system tractable question What data can help us? Solve some stuff. So what data do we need surfaced? In the middle and then Can we develop like yes, this is a tractable question could develop tools to surface context automatically for users Tuckers and then Jesse Tractable questions create crowd sources and crowds to help Jesse and then in the middle in the back Mike Mike, please Take away separate the frame from the fact in the back middle and then Tim tractable question Who's trying to influence me? I love you guys question Tim and then Esther did you have one? Okay, Tim and then I thought came up was where is Where's the distinction between right and left actually relevant to the discussion and where is it not? Esther and then my Take away need to educate people about how the web works such as search engines Twitter take away the building of narratives of reality might be affected by the possibility of major possibility to check facts but it importantly depend on Defining the authority or who has the authority or the fight around the authority Good Josh and then Matthew and then the question. How can we best determine what the moment is when someone would be most open to it? debunking So timeliness Matthew Allen back and then Sasha not sure if this is tractable take away, but I like to the call to fact check the true Sorting out how we know something's true sort of reverse engineering the truth Alan tractable question. Could we develop a reputation engine to help evaluate? trusting it yet trustiness It's and not just for policymakers, but for independent validators as well Tractable, how do we help consumers be more judicious about the media they consume less gullible tractable can we Track the successful shift away from hateful terms and misrepresentative terms to preferred terms for communities Kathleen and then did okay. I got you Take away communicate community norms to community discourse norms to television stations through editorials and social media Okay Nick Yeah, take away trustworthiness is a hidden variable because we can't directly measure intent or motivation Bruno How can we reach people who are not actively seeking information and how can we? Prevent people spreading misinformation from using the same techniques Okay, Jenny I'm curious if there's a way to put the filters into the gates where we're actually reading and assessing the information So it's more immediately connected to the experience. So it's not an altar text and I'm also Curious if we ever convene a conversation like this again if we can have more people with understanding of advertising techniques Because I feel like the commercial components of this Weren't as present as the journalism questions, and I think we'd learn a lot From the tactics around commercial Ben had a book to recommend on that topic. What was the book in the back? Which lies can be spread? So do we know which remorse can spread? One more time which lies can be spread Which lies can be spread? Yeah These two in the Christian and these two in the middle. Yeah, please I would say that a takeaway would be that we need to think about how to encourage credible thinking by citizens when processing fact-checking and misinformation a takeaway would be Everyone wants to build tools that do smart overlays On results, but what about that algorithm that produces the results? You a lot has already warned us on algorithms Tom and then Tom so growing the truth core Tom and then Josh. I'm sorry Discourse and say is a tractable problem. How can we identify ways to prevent the Shots being fired that the bulletproof vest stops to go back to the source find ways to do that Josh How can we convince? Conservatives that this isn't just a scheme to implant them with liberal doctrines Darren today, it's our issue was that you know in the back middle and then Mike Yeah, you I can't I can't take away appeal to people's common sense of justice and the values behind their beliefs Mike and then go on Just a reminder that we've talked at length about algorithms to regulate speech Tractable, how do we use bots for good bots for good Tim loves it? Jim I think one takeaway is there there seems to be a trade-off to be acknowledged between the speed of dissemination of information and the accuracy of And the accuracy of Ethan's typing Phil, please tractable perhaps Engage build tools to engage citizens in assisting with fact-checking Peter tractable. How do we help these organizations put a fact of others get have their voices be become louder? Have the resume more amplification I Tractable Can we better visualize? Advertising boycotts in real time the power we're reminded the powers of visuals Carla and then Matt How do we reach audiences who aren't necessarily looking for fact-checking to have the truth raised to the top top? Matthew Tractable, I think measuring filter bubbles that was something that came up early in the day Knowing when you're outside of your bubble or or inside of it Jim and then in the back Another question is is how might we map out the problem space of where truth matters? Take away hashtag meta the people in this room need the least convincing the choir Is that Austin I'd say that take away is it's not necessarily about truth But about the impact or power of the truth in the lies Those of you who can see these some reflections. Do I any how about anyone who hasn't spoken yet today who wanted to get in a takeaway or a? attractable problem This is your chance Please what is the goal of truth? Is it a knowledge question? Is it an electoral question? Where are we trying to get to? Looking back on tweets The importance of net literacy knowing how what a URL is and where it comes from Seem to be a kind of value less value-dependent means of dealing with some of these questions Mike please Mike be able to map the space of belief versus fact In order to understand the effect that evidence will have So another tractable Can we build algorithms that optimize for an informed public and not novel content? Sorry good luck one more time on that. Can we build algorithms that? Optimize for an informed public and not necessarily novel content how to move truth In fact based information, which is often dry above sensationalism Which is more popular and retweeted Ken and then Jeff Take away pictures will do far more to convince people of the truth than text and take away Law is unsuited to declaring issues of absolute truth Okay, two actionables How to build a platform to allow people with relatively high skills to critique more sophisticated scientistic arguments the second is How to embed Boycott worthy information into Systems that we used to interact whether it's Scanning on the model that Ellen described of barcodes or whether it's sorry I've moved from the tweet or whether it's Plug-ins, but to connect a particular consumer action to a diagnosis of a lean or an intervention That's destructive of truth Tim as a matter of metaphor are we looking for a bulletproof vest or a vaccination? The distinction being something that completely blocks falsehood or one that introduces some falsehoods as an effort to Make us be able to be better able to cope with that falsehood. So Mika's happy to be back to the public health metaphor Take away figuring out voice. The liar is the first step to truth Figuring out who's the liar is the first step to truth final actionable their ex Josh Can we incentivize? Truth by by increasing the return that people get for being correct So this is the flip side of the punishment conversation the shaming we had earlier. Does that work? More orchids more orchids This is attractable When do journalists cite the work of fact-checkers to contest? Claims made by politicians and what effect does that have on on the likelihood that politicians will repeat those claims? Subsequently specifically the the amplification of the challenge in a mainstream media outlet Peter We haven't really touched upon what kind of regulatory this is attractable But you know the FTC monitors advertising and so is there anything we can do with those regulatory bodies to ensure transparency and sure Sure transparency So we're not going to regulate the truth what Jeff told this is bad, but to see what we can do Mike We need to focus on Understanding how information spreads online and quantifying that more in a more detailed way to which I'd add we need to look for other data sets apart from the twin apart from the Twitter fire hose Matt I'd like to argue for the intractable which is to consider the long-term Factors that form our identities and political beliefs over the course of a lifetime even and how we're socialized so that we don't believe facts When we see them on a takeaway the concept of the marketplace of ideas shouldn't be used to overemphasize fringe points of view Should not to influence the media in 2012 you need to understand what it's like to be within the media in 2012 what do journalists need to do their job? What will they use? Tractable how do we Identify Distortion so consequential that they merit ongoing relentless persistent fact-checking in its dissemination Tenacious Mike In order to motivate the crowdsourcing of truth Assistance we need to be able to help people understand the cost They will bear from the dissemination of a particular falsehood Going any last? Oh, sorry Can we quantify the relationship between? Ownership employment and framing in different platforms by gender and race What can we learn from history since misinformation happened and spread long before Twitter came along? What can we learn from the John Birch Society? What about fact-checking can be ground sourced How can we look at it using crowdsourcing as a way to triangulate trust and truth? I guess the point was made that Again back to the marketplace of ideas is that we should assume that the marketplace of ideas alone will guarantee a positive outcome Well, this is a very good market Can we should not assume that it that it's going to guarantee that positive outcome This is an excellent marketplace of ideas here Ivan I haven't heard the word community use very much today and I wonder if it's possible as a tractable idea to think about how we Evolve multiple communities of trust as a as a human filter that's merged with Make fact-checking profitable I Don't use the fact checkers Because we are talking a lot about it But I mean who chooses the facts to be checked and whether we have some people are going to check these fact-checkers. I Hope it's not Kathleen, but So Wendell Potter talked about how easy it is for journalists to rely on PR How do we make it even easier for them to rely on other sources learn from Wikipedia? Another community invocation Okay, what this is Just having listened to Ethan Peck away, and you all this is an amazing list There's no way well, maybe Ethan who's typed it can offer a flexion on it I'm gonna I'm gonna give a process reflection on it and and more broadly which is to say that As some of you may have noticed there been there's been live note-taking going on also live Storification of the fabulous tweets that you've put out There is There are a series of blog posts up and then more hopefully on the way and would invite you to put more up We're gonna intent attempt to digest both this list here as well as the rather copious notes from from today's proceedings And be able to share them out with this group, and I think more broadly probably on the website with the idea of Helping this conversation to continue both beyond the walls of this room and into the future So we'll do our best to document But also really want to invite each of you to participate in that process to continue with the blog post or otherwise help us to Be fact-checkers and help us to get the story right and to be able to share our learnings More broadly so that they're useful What do you want to say? I? Wanted to add my one contribution to this and so I'll put it in the wrong time But I wanted to say that I thought it was wonderful that we started with What the Potter story which is in part the story of someone moving from one side of an equation to another You know essentially moving from the side of spin To the side of fact-checking within all of this as we think about these big questions How do we change a frame? How do we change a language? How do we take on the real challenge is that Yochai is talking about which is not just correcting when it's inaccurate But really going after those big values and frames. What are other stories? We can find of people who made a decision to look at the world very differently I invite everyone to go out and look at Reverend Richard Sizek Who found himself moving from being one of the leading figures in the evangelical movement to being an advocate for the environment For gay rights while still being well within the evangelical movement There are amazing transformations that people have made There's things that we can do that are far broader than the sort of little tools and experiments that we're going to try out tomorrow I want to make sure we don't lose sight of some of those very big stories while we think about the very practical and tractable And that seems like a theme for so much of what we talked about today sort of understanding What are the little battles? What are the things that we can do to break down this problem and sort of are these problems and take them on But at the same time to have that broader perspective that longer-term perspective That's gonna allow us to actually see some sort of change over time and Denise and others Sort of imploring us to think about young people to think about the next generation to think about how this works more Broadling society, so I think that's that message is definitely heard I Want to before we have any final actually I want to I Want to say make a quick round of thank you's and then I want to ask for any final words from organizer types Like Jenny Sasha But as I was I started to kind of jot down a little list of the folks at Berkman Who we needed to thank and it's about 25 people long And that is just to say that to put to get you guys all in a room and to kind of set up all these fabulous people To come up here and share their work with y'all is no small task And it happened in the midst of as someone referred to earlier a visit by Lady Gaga Oprah and who knows what else So it's been just an absolute pandemonium But people somehow summoned the energy to try to give you their very best And I just want to very briefly think in no particular order because they're all fabulous Carrie Karen Alicia Caroline Rob Amar who is a superstar John Becca Corey Rebecca The team of fellows and friends who helped us organize Judith talk us Ethan Sasha Aaron oars James Kara Jesse so many people and I'm sure there's probably ten more that I left off that list But it really was a team effort as we tried to wrap our heads around this this gathering and these problems To be able to make worthwhile use of your time So a big thanks to all of them a big thanks to everyone who stood up here and Shared their ideas and a big from this spot and a big thanks to all of y'all who shared your ideas from and your time from those spots So that's what I got to say And any final words from Jenny I want to thank you all for giving so much today. Thank you Berkman. You always you always raised the bar Thank you everyone in the audience. I mean, I think we could have had another two hours worth of Ways will solve this and I I'm not sure that'll let tomorrow end sooner than ten hours of Time I don't think anyone's gonna be able to top that so