 Good morning Good morning, will do a Salamat buggy This is our external brain It's our second brain and for some of our kids is the first brain Now this is going to move here and That's going to move here and then if Elon Musk has his way It's going to move here This machine will be a million times as powerful as it is today in ten years and the battery will last six weeks and We'll have nine billion people on the internet in 2030 the numbers are staggering So I'm going to talk to you about what technology means today Where things are going and I always like to say technology is going to change more in the next 20 years Than the previous 300 years. I know it sounds crazy. You know industrial revolution World War two the atomic bomb Right, but now technology is changing us Genomic engineering change in the weather Artificial intelligence thinking machines That's quite different than a steam engine Or or the railway So we're moving into a world where this is the new normal humans talking to machines Machines overlapping in our tasks machines telling us what to do Machines running our elections just kidding. I was different time But the question is how far do we want to go with this? I Mean if you can be superhuman, would you not want to be superhuman? I mean, I'm German But I spent 17 years in the US and The answer is pretty clear for a lot of people. Yeah, but I can be like becoming like God so to speak Yeah, I can be superhuman Why not and guess what it will make a lot of money to be superhuman I mean, it's clear you're going to be having advantage. So who decides what is the right thing to do? We're living in a world of algorithms An algorithmic society that's money is going digital right algorithm society We're living in a world where machines can do some of the thinking where the data economy is king, right? Some people call that the surveillance economy and Imagine when money goes digital we're gonna have even more of this and Then there's the things that on the other side. I call them the andro rhythms in my book the human things When we talk about intelligence with humans, we're not talking about processing power We're talking about emotional intelligence social intelligence Did you know that the research has shown that emotional intelligence is mostly embodied by women? today in a much larger way than men I Think Jack Ma said, you know, that's our future is to get the EQ and Psychologists have said that humans have about ten different kinds of intelligence and what kind of intelligence does a machine have? We'll talk about that later in our discussion. A machine has a binary intelligence zeroes and ones Data figures logic This is our intelligence. I Don't want the machine that does this and Why do we need it? We are very good at this compassion emotions creativity machines are not So here's the thing of course, you know that Basically replacing humanity makes a lot of money Look at the profits of big tech the most powerful companies in the world today are not banks or oil companies their tech companies and They're also the most unregulated Right Incidentally, so very powerful. What's happening here? I mean the stats are really quite clear We have algorithms technology and then we have and rhythms purpose curiosity passion imagination. That's what what defines us And what is the overlap? Will we still have passion or purpose when things are run by a machine? I Always say, you know relationships aren't downloads and happiness is not on a screen. I Mean, it's funny these days people have more relationships with their screens and they have with people I mean, I'm sure you know what I'm talking about here So I like to you know as a summary saying for this part of my presentation I think societies are driven by that tech and their science But defined by humanity imagine a society that is driven by technology But has no humanity in the sense of ethics values ideas what we want, right? That would be extremely scary So that's something we have to think about which way we're going and many people are arguing that humans are essentially technology We can take a vote on this later But you know being German, I don't believe that I live in Switzerland now same difference But in the US I keep hearing this argument organisms are algorithms We are fancy computers So in that case convergence of the two doesn't really touch us a lot of people say that this is basically what's gonna happen Because you know computers will take over our work. They will take over our government They'll run our climate change efforts, and we become useless. I don't know how you feel about this. I Don't think humans are going to be useless if we're looking at this chart. You can clearly see what's happening with jobs and AI Yes, many jobs will go away because of technology Many other jobs will be boosted for example all the jobs in healthcare and scientific and communications And what are those jobs right ask yourself what those jobs are? They're human only jobs They're jobs that we do because we're human look at that when I zoom in you can clearly see these jobs are Not entirely just logic. They're about us as people So important to consider what's happening here the percentage of human only work That's where all of us are going Human only work means we give the work that can't be done by machines Which is increasingly more we give that to the robots and the software and We move up the food chain That will not be an easy transformation for a taxi driver or a call center leader Again as Jack Ma has said is the balance between EQ and IQ if you want to have a drop in the future You got a boost your your EQ your emotional quotient Assuming that you already have an IQ. That's why you're here But you know, this is something that's quite clear that's gonna happen. Oh, you know our kids think about our kids What do they really have to learn in the future? They have to be entrepreneurs. They have to invent. They have to understand people They have to know how to have feelings. They have to beat the machines not by being faster than a machine That's ridiculous right in 10 years. We can't beat the machines for anything Technology is coming. We're not gonna go back on it and put it back in the box This is the most important part when we talk about technology and humanity. It's not to reject technology. I Mean the idea of saying that we we have a risk so we're not gonna do this is odd, right? But then so is the idea of saying well anything we can do we should do so let's all put holes into our skull and Connect to the internet That's also a bad idea so it's about the balance and you know who decides the balance that will be the biggest challenge Automation Mean the financial industry, you know that many of our jobs are going to be automated because machines are learning them Christine Lagarde said automation is good for growth But bad for equality And that's a fact we're gonna have increasingly automation call centers bookkeepers accounting auditing You know half of KPMG Automated Maybe So that's a question like what did we do about this and who is going to be in charge of equality? So in this world, you know, there's also the side effect of what technology does which is to make us Dependent on it. I think when you think of this image, what do you think of? What do you think of? social media We're in this world where we're being pulled by strings We don't even know they exist right to which I like to say too much of a good thing can't be a very bad thing Like drugs Do we not allow alcohol because people may drink too much? Yeah, we have restrictions, right? But we allow it. We have coffee. We have cigarettes. We have pipes, you know, whatever you can think of You know, we're even legalizing raga Rana now and now too much of a good thing is a very bad thing because when you do too much You know end up in a bad place So let me talk about this really important thing when it's about technology We're living in a world where technology is giving us amazing deals on convenience on content on communication Life is better because of technology and these companies here Are the ones furnishing it to a large degree at the top eight in the world American and Chinese But on the other end of the fantastic magic offering We do have some issues I call this the externalities right these externalities are as important as the externalities of oil and gas Which is climate change? Now we have tax avoidance. We have dehumanization manipulation. We have to address the externalities of technology How did we do that? Well Here's a suggestion. We should do this right? We should have a group of people in Every city in every industry and in every country and globally will be a lot of people Call this a digital ethics council People whose job it is to think about what the consequences of technologies are and how we deal with them I'm not talking about politicians or CEOs here, right? I'm talking about Thinkers I'm talking about people that would be on the level where they can be like, you know Socrates kind of think and this is happening in in Singapore. It's happening in Denmark It's happening in different industries happening at Microsoft. It's happening at Google. It's a very very important discussion digital ethics Is known the difference between what technology enables you to do and What is the right thing to do? Now I grant you that is a difficult discussion of what is the right thing to do right? I mean who decides we'll talk about in the panel. I'm sure we'll solve it very quickly Here's a short example Facebook is the new cigarettes. It's not good for you. It's addictive You don't know who's trying to convince you to use it or misuse it The government has to step in and regulate it and Facebook has proven that to us even since I said it over nine months ago Over and over and over again that they need to be regulated because they're not self-regulating Mark Benny off from Salesforce, right? They need to regulate be regulated because they're not self-regulating Think about that for a second. I mean you in the banking business, right have heavily regulated Do we need this for these platforms? Absolutely, and that discussion is raging because we don't want to end up here, right? You know we want to end up in a place where AI can help us build the value Not become the panopticon the global panopticon and here's the key question of that. Who is mission control, right? Who controls what happens? Right now the sector the top 20 companies in the world are largely uncontrolled. I Mean more more uncontrolled than any other industry ever was and this is a very very big issue So going forward, you know, this is one of the key issues that we're talking about which where we're going to go with this You know, we have sort of the externalities of climate change And and then we have the second pollution Which is digital? I'll cause a digital pollution, right? It's a way of you know messing up our thinking and thinking about stuff That we should rather do differently best example really is Facebook in their efforts of Undermining democracy And it's funny you can't say that they did it by purpose or that they are criminal You signed the user agreement But it's unethical and That is the problem of course with technology when we think about what this means and you know how they are Working on keeping us addicted to the feet of technology. Is that unethical? I think it is I don't know what your view is on this. I'm I'm certain none of you do any of those things anyway So AI all right same topic in principle is a great idea. I call this intelligent assistance. I a That's what you know in banking financial That's 98% of you. They're just fancy software, right? These machines are not thinking they're not Learning like we do right? They think like machines. How does the machine think 0 1 1 0 0 1 binary? You know it basically if this than that right they can learn yes But not like us I mean a human sees the world like this Machine sees the world like this, but has no limits on seeing it right now It's quite a different level of things and I think in this world. We should be very careful what we wish for Intelligent assistance artificial intelligence. Yes, but at the end ASI artificial general intelligence a gi I Probably not a good idea. I think we need to really figure out how we're going to Discuss what we do here. I think we're going to see a moratorium on this just like we have on nuclear weapons And I that will not be an easy task just like nuclear weapons So let me wrap up and I think we're moving into a world. That's I call this hell then yeah, it could be heaven it could be hell and And this has nothing to do with technology or silicon valley or China it has to do with how we govern technology Where the technology is used to dehumanize or to re humanize It's not the purpose of technology to decide technology is neutral until we use it It's not good or bad we make it good or bad and we have to think about how we govern technology Not just like government but also in terms of our own use and which way we're going with this So this is kind of quite clear, you know in this world Between the good and the bad of technology What are you gonna do say well don't touch it yeah You're gonna have to ask a different question and the question is not If we can do something or how we do it or how much money it makes that question is getting to be an old question This is the only question Why? What's the purpose when we have digital money and we will Why you know, what's the purpose and who can we trust would you trust a social media company with your money? That social media company Yeah, nice idea, but you know, I don't have to trust I don't know about you I think this is a very very big discussion, right and this world Everything that we do is moving to the cloud everything healthcare records music films television books banking insurance transportation cloud If we don't put this in the middle Human purpose That's not gonna be a good future We have to make sure that the companies that do this and here to a standard They actually are doing this and what I call the the the free future principles holistic business models The circular economy and humans at the center. I will not do business with any bank that doesn't have those three parameters That will be the new normal also in the stock market in the very near future So I'm gonna wrap up saying you know as I say in my book The biggest danger today is not that machines will take over and kill us There is a danger for that It's pretty far away In overall terms, you know 50 years maybe that is possible today the biggest problem is that we become like the machines We look at the customers if they were an algorithm. We're too lazy to do our own things We forget who we are we stop listening and we basically become technology So my call to you is say let's embrace technology and use it for all the stuff that it's good for But not become technology And I think this is also where Europe and the UK Has a leg up so we'll discuss in the panel. Thanks very much for listening. Thank you Good morning. Well, Gerd told me he was going to do this event and he wanted to represent the side of humanity So he said would you come along and represent the robots for me and fight against humanity? Of course, I'm not gonna do that. I am in favor of humanity. I'm a big fan of it But I want to tell you that the predictions that we've heard well Gerd's been reincarnated from some earlier eras because his message is not a new one The world we live in is changing and is new in every way But at the same time this question is very old and this question of whether we haven't held well I'm sure they debated it around these stones Saying this is going to give us a calendar and we're gonna have to do things on certain dates And we're gonna you know, it's gonna tell us when to have our big parties and I think that's gonna change what it means to be human But of course we've gotten used to the calendars We've moved forward to discuss this here in this city of slightly larger edifices that we stand among Nonetheless this debate goes back to the very earliest days this debate about heaven or hell Is not a dichotomy it isn't an escalator going one way or an escalator going up The reality is we're going to see both heaven and hell and we're going to try and make the best of it We're never going to get a perfectly good world or a perfectly evil world Now the first big decision that we had to make when we had this debate was this big question of should we come down from the trees? Because if we come down from the trees Will we lose our monkey-ness? All right, are we going to stop being monkeys? Are we going to to lose all the things that we value that make us monkeys? Well, of course we did and we got humanity instead and we don't seem to regret the decision Although I occasionally do run into people who do We also must have had this debate over fire now This is a slightly more modern version of fire for those of you who've been to Burning Man, but once again We didn't know what was happening. We argued about it and we ended up liking the result in the long run I actually do hear people today who debate whether agriculture was a good idea actually before agriculture as you know We were hunter-gatherers Some people think that lifestyle was very idyllic and you didn't have as many warlords and you didn't have kings and all those other Things but by and large agriculture, which has fed the world seems to have been a pretty good decision And then the industrial revolution began first in textiles here in Bath And then later with industrial technology and iron also here in the United Kingdom And this is the one we often debate the most and yet it's the reason we are all here So what do we do about this? How do we answer this question when when we're talking about Machines that think cars that drive themselves Robots that act as people do or do things that people do The answer is that We have a very difficult time telling the difference between foresight and hindsight All of the arguments that were made about these other great decisions great singularities of the past Turned out to be wrong the people who said don't do it at least as far as I think most people in this room Would conclude turned out to be wrong, but we didn't know at the time how to decide We didn't know how to decide what was wrong and what was right Now the change of pace the pace of change is obviously faster and accelerating today The chart that you see on the left is a chart of the price of computing per dollar And this chart was put together by Ray Kurzweil and Catherine myronic and This is an exponential chart which means that each Dot on the left axis is ten times bigger than the dot before and they noticed when they built this chart that if you Plotted it back all the way to the beginning of the 20th century in 1900 It stayed on an exponential curve for now a hundred more than a hundred and twenty years You don't see the Second World War the Great Depression on this chart You don't see anything that people have tried to change about it or do anything about it or anything else that humans Have done deliberately over the course of this history It's happening and it's continuing to happen and we're now seeing of course the average company on the Fortune 500 Lasting a little more than 20 years instead of 80 years as it used to and on the right You see a picture of the first digital camera Invented by the Kodak company That company took a look at that digital camera in their boardroom and said I don't know what you're talking about We sell paper and chemicals. That's what Kodak does. Why do we want to make a digital camera? They decided not to sell it and of course they went bankrupt the same year They went bankrupt Instagram which knew what photography was actually about which was sharing memories with your friends Was sold for a billion dollars with 13 employees now That's the dramatic story of how much things have changed that 13 people created something that was worth a billion dollars That's happened now several times since then But the Kodak couldn't see it and it's because we're very bad at predicting when the world changes like this How will we be good at regulating? How will we good at deciding what the ethics will be when we are so bad at predicting? It is one thing to work out what the ethics should be about things. We've had for a decade Things like nuclear weapons and even things like Facebook, which we've now had for a decade It's very very difficult to think about what the ethics should be of things that barely exist and to even call for moratoriums on them as has been suggested Now there is a long history of this long before the talk you just saw this morning here You can see cartoons and books going back to 1878 where people put out this call They said machines are going to replace people. It's going to cause tremendous disruption and upset in our society And we're gonna have to do something about it now They didn't actually figure out what to do about it, but all the people who called for holding back So far we think they were wrong. We think that our society is Generally progressed and been pretty good and there's a lot of charts which back that up as more than just intuition Here's my favorite example in fact We discovered this example when a group of us held a conference on the future of computers and jobs and the question of whether or not Computers would take all the jobs and what we should do when we agreed that it was a very serious Issue that needed a lot of analysis and discussion and that maybe our group which had various erudite people as well as myself Should write a letter to the president because we all know the story of Einstein writing a letter to the president long ago about nuclear weapons in during the Second World War and So someone at the back of the room said we don't need to write the letter somebody already wrote it. I found it It begins dear president Johnson So in 1964 the triple revolution letter warned about these three revolutions the Cyber nation revolution as they termed it then the weaponry and human rights revolutions So here we go with people saying people in 1964 think about what computers were like in 1964 just step back even if you're not that old you probably have some Idea of what they were compared to the computers you have today They were scared to death of those computers in 1964 and if we go back the book from 1984 That's when an early Apple Mac was the best computer you could buy for yourself and it was going to be drastic change So this is our history of predicting. It's not a great one And it is no small risk to get these predictions wrong and this is the issue. We must face Everyone sees that there are problems because there are problems But how do you figure out how to decide? How do we? Try and understand that even though we see in hindsight what we might have done better in the industrial revolution But we might have done better in the agrarian revolution What we might have done better even in coming down from the trees in hindsight we see that we can know what it is but It is impossible as far as I can tell or figure out how to figure out who were the people who were right in Those days if we could have listened to them because I'm not saying that nobody saw The problems that we now know about in hindsight. There were the Luddites who said, you know, we don't want we want to smash the machines They're going to cause this social challenge. They turned out to be wrong. There were other people who were right We actually have metaphors for all these type of predictors, right? We have Cassandra who is right, but no one believes her and so there always are some Cassandras in every change and revolution Every singularity who are right, but we have not listened to them in the past And there's no evidence. We're going to suddenly start listening to them in the future There are chicken littles of course who say everything is falling down and they're wrong But sometimes we listen to them and we have boys who cry wolf who lie that something wrong is going on and then we finally ignore them What I couldn't find was a metaphor For people who keep saying that bad things are going to happen and they're wrong every time But finally the time comes that they're right and we regret that we didn't listen to them The closest thing was the boy who cries wolf. Well, these Problems as I've shown you have taken place throughout our history and every time we felt something really bad was going to happen and every time we've been wrong and Every time even the most recent times where we said and by the way, we've been wrong every time before But this time it's different and this time again. We were wrong. So how do we figure out how to be right? well We all are not particularly fond of this gentleman and what his company has done There's no question about that and so people say Why should this guy who built Facebook be in charge of what Facebook does because his interest is in making money And his interest is in building his user base and all these other things. It's not the public interest But if we are to have another decision-making process for how his company and the other companies will run Exactly, who will we trust to have the foresight other than the man who built it and not that he's anywhere near perfect Are we gonna ask for the crowd the public voters mobs? Will they be the ones to make the right decision? Will courts be the ones who make the decision about how our technology runs now many people say Why don't we get governments? Because we can certainly trust the people who run the governments in order to solve these problems and decide things now I think I figured out the answer which is of course. We should have bankers, but I thought that would get a better hand here perhaps No, it's not the bankers either. We don't know who it is and we already are transhuman. I Think those monkeys have came down from the trees certainly wouldn't recognize us and even the people at Stonehenge I don't think would recognize us as human and our lives as human and we don't love Humanity nearly as much as we imagine in the natural human state. I would been dead a long time ago I'm afraid I've taken the services of the medical establishment a couple of times as many of you have and So much of our lives in the past without the natural human life was you know, nasty brutish and short as Hobbes said We don't want to be natural humans. We want to be that in fact I'm going to ask you a question that may be central to all of this Because Gerd put up a lot of different Attributes about human thinking and style and said these are the things that make us human I'm going to tell you what I think is most special about humans. We are the one species that wants to be better than we are We want to improve ourselves. We want to change ourselves to make us not change to make us not become Inhuman from our definition that would be in human that would be Making us what we are not stopping relinquishing That would be the challenge and yet We already can see this in our generations. My father, you know, he thought this stuff was all crazy my nephew on the left he You know uses it as part of his daily life and my nephew on the right says you mean things are different They don't have any concept that anything has gone bad or wrong or is different from what they imagine it to be for us to relinquish these technologies is a huge decision All right, we're talking about technologies that will save billions of lives not millions of lives that will end disease That could end scarcity that could bring education to all that could reverse climate change and Give us the exploration of space to give us the resources we have for everyone can lead a good life That's a lot to relinquish because we're scared of the ethics. We must be sure we do this right and If we do relinquish if we sigh that there should be a moratorium on AI I Can tell you that this country here is working very hard in investing very heavily in building AI technology And so if there is no European AI or American AI there will be Chinese AI and I'm not saying the Chinese are evil I'm not saying that they're going to you know be nasty overlords through the world But they will have different ethics and different principles. There is no choice about whether this happens The only choice is how we make it happen and the only way to do this is not to say no to it But to say as in improvisation people say yes, and This is going to happen and we can maybe figure a way to do it better Thank you very much We're now going to move into a fireside chat to delve a little bit deeper into the issues so Brad you argue that you know we we need to lend progress Technology go ahead and then it could be dangerous or misguided to try to Govern it before we even know what it can do and Gird you are proposing data ethics councils Don't you think we have to draw a line before we we unleash all of this especially if you're right and Indeed we will be changing Humanity more in the next 20 years than we have in the last 300 Are there more dangers? Do we are we? Should we really make sure that we know what we're doing before we unleash this technology? Yeah, well, this is not a black or white decision, right? You guys drink coffee you smoke cigarettes you drink alcohol many of us You're not saying well in principle. I never touch any of that some people do but most people don't But if you drink a bottle of brandy before you go to work on the morning a lot of people wouldn't approve of it So the question of technology is exactly the same question We we use technology for the things that we need it done We use IA and maybe AI, but we should not use a GI you know artificial general intelligence Because when we go on a level that is exponentially so much further out than we are currently at there's a loss of control as Application there's all kinds of issues. We don't agree on anything. So what I'm saying is not to go backwards not to Do any of those things. I'm saying we need to figure out what do we want from technology? I think Tim Cook said Three months ago at the European Commission. He said our technology can do great things But it does not want to do great things. It doesn't want to do anything And if we want technology to do great things, we have to make technology do great things So and we have to agree on what that is is living to be 200 years old a great thing Right is having super soldiers a great thing is beating cancer a great thing. I would say yes So this is what it comes down to that's that's my proposition So yeah You know we if AI has the chance or other technologies has the chance to help us Eradicate poverty solve climate change significantly improve human health, of course we have to go ahead but When we've introduced new game-changing technologies like the internet which you help pioneer We came up with a governing system that was different than just Government or somebody that we came up with I can right it was a new well I'm not saying it's perfect, but we came up with a new type of way to kind of Check how things are going to be implemented Can't we try something new like a data ethics council without? out Hurting the benefits of the technology so I've no problem with people discussing in fact I strongly approve of ethics councils to sit and examine the ethical issues and make sure people are aware of them Make sure the people building the technology both participate in the discussions and are aware of the issues and that we do it in concert with an understanding Society that's absolutely fantastic The question is when you get to the next level, which is to say that we are going to have decision making We're going to have moratoriums. We're going to have companies broken up We're going to that that is the thing we have to be very careful about when we start saying you can't do this We have a disagreement about whether you should or shouldn't do this and someone has to decide whether we should or shouldn't do that That is where the really hard challenge was But can I chime in I think you know it's quite clear in the next 10 maybe 20 years technology only virtually unlimited in power You know quantum computing 5G and what have you and at that point is Just as important that we decide on what we want to use it for as if we had decided what climate change does You know 10 years ago. We didn't so but we are not one entity Exactly are some people who are going to want to use it for this and other people who want to use it for that The question comes when one side says the other side must not use it for that Right now we're in a situation when it comes to AI and ethics where we have literally dozens of different groups and organizations who are working on AI and ethics and guidelines and most of them are Controlled or were initiated by commercial interests and good you have said in the past You know you've asked the question. Are we comfortable with handing mission control for humanity to Silicon Valley? you know do we want overworked programmers who are rushing to push out products to to Satisfy the shareholders make these kind of important decisions On the other hand companies have got to take responsibility because we will get to a point where The companies will not be able to a hundred percent predict what the AI they unleash does and this this actually exposes companies to To to to lawsuits and all kinds of other things. So what's the best way forward? How do we make sure that we make the best use of technology? But also protect society and even protect business itself I think first the story of the future what the future is should be taken away from the discussion of of technology and Silicon Valley and China on that level. It should be given back to people and citizens and Hopefully governments and thinkers Taken away from you know if you talk about a AI you talk about IBM If you talk about credit computing you talk about Microsoft and and they make the story of the future and that's great But it's not enough because they are profit their companies for profit And they it's none of their concern what the pollution of their product is so to speak right Even though they do start talking about it I have to challenge you on that and I was one of the people who helped convince Sergei Bren that they should not Collaborate with the Chinese and the repression of the Chinese people and providing information and he made that decision And it was a very expensive and difficult decision for him to make which has probably cost him more money than most of the companies in this room have ever made There are people making ethical decisions and having ethical thoughts in these organizations They're not these monoliths that you necessarily describe in fact perversely the ones that are led by individuals like Sergei Bren and Mark Zuckerberg and Bill Gates and so on They actually are the ones that that get the time to think about this I agree with you on this. I mean I and I I have met many of people who are of that nature I just think the last two or three years We've had a bit of a mind change on this before their technology companies or my clients to a large degree Their mission is to say you know what we make it work We sell the Internet of Things and what people do with the Internet of Things is none of our business And that is a very very bad proposition That's like the gun companies saying you know people kill people guns don't kill people I mean the most ridiculous excuse for unaccountability you can imagine don't use that argument in the United States by the way No, I get shot So I think I think the one thing that perhaps we could all agree on is that the future does not have to be dystopian Technology is shaping the future, but so are we so is society so is business and Together we have to decide What kind of world we want to live in and then help shape the technology to ensure that that's the kind of future that we want I am convinced the future is amazing. I'm an optimist, you know, you may have not seen it from the slides, but but Basically what is happening is like we get we will have all the tools we need to do amazing things and to solve all kinds of problems technology will not solve Social-cultural political problems that will be left to us, but humans have been actually quite good at once There's a reason like nuclear bombs right to take action what I think is going to happen and I think it's Unlikely to happen very soon that we'll have incidents, you know For example on AI or the IOT that we're very detrimental and then we say oh wait a minute now We you know now we have to do something But I think that's I think that's a good thing right I think that Facebook Doesn't understand when they build it that it will be used for propaganda and to manipulate elections And I didn't know that they very there were very few Cassandra's there who actually warned about that and the people Who built Facebook didn't know it and now we see that and now people are working very hard to fix it And I actually think that's the system working I think demanding that somehow an ethics council would have figured out the propaganda dangers of Facebook when it was being built and Modified it to avoid them. I think that's a very Unprobable it depends on the price that we're going to pay you know I mean I predicted if Facebook doesn't really change in the next two or three years We're going to see a major incident not like Election manipulation, but up a notch of a thousand yeah, and if that happens then we're going to say oh god Now we have to do something but if something happens with the AI and we may have a loss of a million human lives You know that that's not something that we should necessarily take as a condition That would be better if we didn't have to take that you know So my view is that a little bit of foresight would be a good thing to have I picture a global council of Socrates kind of people and and they exist right we know So some of them are so to put actual resources into this not just to build technology But not build humanity you know that that's a very bad idea because we're going to end up in a world like this So I think that's a good note to to end on since we're out of time, but basically I think the message here is Don't Don't put the brakes on technology But think seriously about The consequences and with that I'd like to ask you to give a big hand to our panelists And let me just note first that Gurd will be doing a book signing Immediately following this session So if you want to meet him and you want to get a copy of his book, please come come over to the side of the stage Please give a big hand to our panelists. Thank you very much