 Next up, we have Panagiotis Tachis Metachis. I don't know how I did there with my Greek. Metaxas. Metaxas, all right. He is a professor of computer science at Wellesley and a visiting scholar at the Center for Research on Computation and Society. And his area of research, well, I guess this setup, is about misinformation, propagation, and electoral predictions. So I actually was reading about him. And I saw that he said that he loves social media in the Wellesley newsletter. He says he loves using social media, but Facebook is an interesting chitter-chatter. So only Twitter. Only Twitter for me, yeah. All right. Yeah, right. And as a matter of fact, I give a lot of, I don't want to sound like an advertisement for Twitter, but Twitter is playing the role of my collection of editors. Instead of going around like crazy, trying to be informed about the important things, I have selected carefully the people that I want to be informed from. And I follow their tweets. So if you think you have something important, tell me. You send me an email and you'll tell me. So I did something crazy. So let's see how it works. Given the interest of the morning discussion, I tried to change my talk so that it fits into the form of where the discussion is going. I was going to tell you a lot about how web spammers and propagandists have a lot of things in common. And I will tell you, I would have told you a little bit about how the theory of propaganda can help you detect propaganda as well. But I'll skip and I will tell you a few things about the first Twitter bomb that with my colleague we found a couple years ago. And there it was a case in which somebody was attacking the candidate Martha Cochle in the last Massachusetts elections. And I'm acknowledging any Mustafa Rai who's sitting back there. We found out that actually it was easy to detect this kind of attack. This is where they were trying to send their people. And the message was signed by American Future Fund. We had no idea who was behind this attack. Turns out we're the same Mayovan Republicans who were also behind the attack on Kerry. So pretty interesting story when we found. And as Phil said, it would be nice if we had found it a little earlier, not like maybe weeks later after the elections were done. But of course, if you want your attack to be effective, you better launch it just before the elections. Elections are awfully important and you cannot let them down. That led us into the current project that I'll tell you about. The other thing that we found also was another prefabricated tweet factory. So if you wanted to support your cause by attacking particular reporters, you would go to this side. You would find the collection of tweets and then all you would have to do would be to copy and paste, copy and paste, fire. And instead of trying to tell the general public about that, you were going to tell about particular news reporters and news organizations about your message and you would write in the Massachusetts editorial race as a way of getting the message out. So I will close this parenthesis because I want to tell you a little more about what we're doing now. The discussion of this session has to do a lot with trying to create tools for individuals. And here is something that I know that people from, I'm blanking out, you Sahidi is doing. So I had a little discussion with Patrick before about that. What do I care about? Have you ever heard of social theorems? I hope not. Because I just thought of this term as a way of making a point. What's the point? We treat our knowledge, what we try to believe as facts. We treat them as theorems the same way that we are looking to mathematical theorems to make sense of the world around us. But the problem is they are not the same. There is a big difference between the real theorems and the mathematical and the social theorems. Social theorems are things like, there is no such thing as a free lunch, which you might consider to be true, except if you are a graduate student in a university and you will find lots of free lunch after every talk. But in general, it is roughly the case, just not always. And compare it with F equals M times A, which is something that no matter what, it will work as long as you are in this universe. We confuse natural laws with social behavior. So we would love society to behave the same way as nature, but it doesn't. For example, nature will not care if you did another experiment before and it will not change its behavior the second time you do an experiment, society will do that. And that's a problem when you try to find exactly the same behavior or time. And again, here I have the Joe Paterno and Whitney Houston deaths. The first one was a fumble, the second one, the news organizations were very careful not to repeat it so they were kind of slower as they were going. Another bad thing that my mother used to tell me all the time, it's the good guy does not always win, I'm sorry, but this doesn't mean that you do not have to try every time to get the good things out. Finally, just because you found a counter example in a social theorem, it does not mean that the social theorem is wrong. Just because some of the things that society behaves like do not always work, does not mean that we know nothing about society. We still know something about society. And we saw some of these earlier, for example, Brent and Ian talked a little bit about best practices, credible sources, how to make more sense about all of these things. So what are social theorems that I want to tell you about are things that we have discovered in the last five years, some of them. And what we hope is to put them into a personal tool that will help you make more sense as you receive information. We'll deliver your information with a little bit of trust value and we'll tell you whether you should be trusting this piece of information as it's coming to you and why. So I'll give you three of them today and I'll give you some evidence about that. So the first one is that unedited retweets about political issues indicated the agreement and reveal communities in likely minded people. It does not mean that every retweet means that kind of thing, but when you have political discussion, retweets, verbatim retweets actually mean that I totally agree with this guy. Always, not always, and I'll show you an example, but most of the time, that's the first social theorem. The second one is that it's a very optimistic one. Given enough time and enough people's attention, lies have short and questioned lives. That's pretty optimistic. It doesn't mean that every time lies will die. No, it doesn't. If you look in world religions, you will see some lies that they have propagated forever, but there are other cases in which in this world we live in actually they can be detected. And the last, which is not really a theorem, but what the heck, is that people with open minds and critical thinking abilities are better at figuring out truth than those without. Sounds like a da, but with the discussion we had in the morning, it seems like we tend to believe that maybe there is nothing we can do, but it is not like that. So some evidence. The first comes from the data we got when we gathered the Massachusetts Senatorial Elections. This is the retweeting pattern of a group of people that retweeted the most. This is about a thousand people that they retweeted about 14,000 times in the seven days. You can see a way that they were divided and actually they were divided automatically by an algorithm. If you retweet a lot, you get to be clustered together, otherwise you're far away. The big group, by the way, is not unified if you look closer at their individual retweets. There are three different groups there. Some of them engage more with the other group. The others are not engaging at all. The people from Indiana, Phil and Mike and Bruno there have found a very similar picture for the elections in the late 2010. The second about giving enough people's attention. Here is some results of a paper that check to see how much misinformation about rumors, about potential tsunamis and earthquakes, problems in Chile in 2006 I think was propagated and how far they propagated. Some things, the bottom part are the false rumors. They were proven false eventually. The top are the confirmed truths. These ones were questioned much more often as you can see and did not have, here is the column I want to show and here is the number of different questions. It's not like the truths were not questioned, just not as much by and large. Another very interesting example are the London riots rumors that they propagated. The guys at the Guardian have an amazing tool you should visit and play with it. The pics there show some attempts at propagating false information eventually died. They tried to revive but did not live for long. Wisdom from the ages. Here is time saving truth and falsehood and envy. So we're going along the same ways. I need to stop, I know. So a little thing about open minds. The third part, the critical thinking. It's not that everybody will actually be beaten by every piece of information. How does it go? You cannot fool all the people all the time, right? That's something that happens. You cannot expect you will have a tool that you will just click and will give you the answer. What you really want is to be able to have technology that will give you the information but you will need to figure out the answer using your own brain. So education is that important there. Here is Rios Fereos I mentioned in the morning and men notice that he said whoever thinks freely. You want to be free in your thinking but you want to be able to think as well. Thank you.