 Hi everybody, nice to meet you. Noel Silver Russell. I just got married, so I'm getting used to that. That's why I had to do Noel Silver Russell. It reminds me to say the last name, otherwise I'm like, Noel, what was that again? No, I'm just kidding. Just kidding, honey. When he catches this on the replay. Super excited to be here. I'm going to actually do a couple things this morning. Let me switch it over. Oh, no. I might need someone to come and help me with the password. Thank you so much. So, oh, here, we'll just put this back while you're doing that. So one of the reasons why I got, I don't know, I think they asked me, yes, they asked me to come to speak to you all. One was because of the wonderful way the world works. When you do something cool and you're excited about it, people, they like excited people. So one of my friends who saw me speak was like, oh my gosh, you should come do it over here. The same thing happens in music and art when you are good at something and then passionate about it and you aren't afraid to kind of take the stage, you get a chance to do it well as much as you want to. So today I travel the world speaking about artificial intelligence and I'll share with you as we get going, yay. Oh, I think it says, thank you so much. Oh, but one of the things that I want to share with you first, we mentioned Alexa in the beginning. How many of you know what Alexa is? I know it's silly, right? This is just a practice, like just getting it in the motion. So good, most of you know Alexa, thank goodness. Well, I had one of those moments, I don't know if you know or have ever had this moment when you get an idea and you're like, this idea changed the world. Or you get invited to listen in on an idea and you're like, oh my gosh, this is the one. We can do this. And you get super excited about it. And then you have one or two choices. You could do that thing, which often is scary and something you've never done before. Often times something you've never done before. And so you could go and do it or you could wish you had done it. And many times, I mean, I hear people all the time looking at TV, seeing some commercial and go, I thought about that 10 years ago. Our parents say it all the time. That was my idea. I thought about that. But they, of course, didn't do the building. Well, I was at Amazon. I was working as a cloud architect at the time, nowhere near artificial intelligence. This was just, I'd say, seven years ago when Alexa, before Alexa was born. And I had an opportunity. I got an email. And the email was from Jeff Bezos. I know it wasn't directed at me. It would have been cool. But it was like to the whole company. And it was like, we were looking for people who are passionate about this area to come and join this new team in artificial intelligence. At the time, it was not launched, right? Nobody knew it. As a matter of fact, at Amazon, we had just come off one of the largest failures Amazon has ever had, which is called the Fire Phone. I don't know if any of you remember it. It was cool device. But it was cool device, but it failed. And everyone on that project was like, I don't really want to do another thing that's going to fail. I want to stick to things that work. And of course, at the beginning, this thing called Alexa did not work, by the way. But I thought it would be really cool. So before I tell you why I thought it would be cool, I want to introduce you to my people. This is why I do what I do. These are my valuable humans. I have four children. My first born son, though, has a Down syndrome, if you're familiar with the condition. And when he was born, it was very interesting. I was a first-time mom, a young mom. Never did any of the things you do when you think you might have a child with special needs. Like, I didn't know anything. I have my child. It's normal birth. Only after do they like say, I think something might be wrong. And in that moment, I know a lot of, of course, it's very nerve-wracking. But it was interesting. The solution, they had my child in Knoxville, Tennessee. And the geneticist came out, old lady. Like, in my mind, I remember her being like this, though I don't think she was. But that's how I pictured her, like, crushing the old lady. And she said, you have two options. The world's not built for people like your son. But we've created little pockets for him to be successful. One is an institution. There's lots of them worldwide. And the others, you can give them up to an adoptive family who will take really good care of him. Now, I don't know if any of you know Latinas, but I'm a Latina. And I wasn't about to, like, just be like, oh, sure. I mean, take him. Good. I hope he has a good life. That was not the direction I chose to go. But I'm also a technologist. And some 17 years ago, he's about to be 18, which is crazy. But 17 years ago, I decided to embark on a journey of accessible technology, of how do I work for companies, not little companies, big companies, that would move the needle forward to make a world that's better for him. And that's him right there in the pool max size. So really cool. But so that was my lens, right? When I got this email from Jeff Bezos, my lens was like, oh my gosh. My son, who's now 12, this could be cool. Now, I am a cloud architect. I knew nothing about artificial intelligence. So I go to my manager, which you will do one day. You will get a cool idea, and you'll go to your manager, and you'll say, I want to do this thing. And they will look at you. Some of you will have awesome managers who will be like, rock on, go do your thing, be successful, go forth and prosper. But my manager patted me on the head, not physically, but I definitely felt it. Like, you're so cute. No, that's not for you. You're not an AI person. Oh, I didn't graduate from high school. Oh yeah, and I didn't graduate from college. I went to both, though, and put in very good effort. It just wasn't for me. So my manager was like, no way. There's no way you're going to be successful or will like that. And I, being an naive middle-career person, was like, maybe, maybe you're right. A lot of us get advice like this from people we trust, our parents, our teachers, our, in this case, my first line manager. But something in me said, this is different. This is that one idea that if I don't do something, I'm going to regret it. And so I jumped. I jumped. I went around this person. I went to the hiring manager of the Alexa team. I said, I know nothing. I'm completely transparent about my inequities as an AI professional. And he was like, that's OK. We actually need people with the desire to learn because it's all new. And an attitude of enthusiasm because the number one thing that makes AI successful is getting other people to use it. And that's what they needed, someone who was excited about it and could think about things in a different way. So I joined the team. That year, I built over 100 applications for Alexa. Today, some of my most popular applications, I mean, I have over 2 million unique users of the applications that I've built. I'm not a developer. I don't have a development team. It's just lowly on me on a Friday night coding. Some of you might be this person. It was fun. But I built these applications. And at the time I built them, I literally was trying to think about my son for me. What would a mom, a kid with special needs, want? Well, the year that Alexa was created, first I had my third child. The week Alexa went live. I might have had my phone with me in delivery. Ew, don't do that. But it was Alexa. I was being born. I had two children that week. This is my dad. And the year we launched Alexa, something really interesting happened. Terrible, but trajectory changing. He was hit by a car as a pedestrian. He's a Marine, so he's fine, of course, now, kind of. But he was running. He ran 11 to 15 miles every day, 68 years old. Was running across the street. A distracted driver was, of course, driving and not paying attention. He was in a crosswalk and he got hit. And in a second, he aged 20 years. He went from being 68 to, like, whatever, 20 plus 68. No, I'm just kidding. I did learn that much in high school. But he got old. He couldn't use a phone. He couldn't use a computer. All of a sudden, nothing was accessible to him. He couldn't go to the bank. He couldn't do anything. He became someone, like, I was like, you have to go into an aging person facility, a nursing home. He's 68 years old. So I did. I put him in a nursing home. I gave him Alexa. He was the coolest kid, by the way, at school, at the nursing home. Everyone wanted to be in his room, because everything was voice activated. But the interesting thing about that was that he didn't do well there because he was too young to be there. So I got very focused on how to use the technology. We're talking about today to not just serve the affluent, to not just serve the 1% of the 1% who are going to buy a device you can talk to in your kitchen. But how do we repurpose this technology? How do we think about that technology in a different way? So in that email that Jeff Bezos sent out, he said to all of us, you're going to join a team that's going to build the Star Trek computer. Do you know what I mean when I say that? The Star Trek computer. What that means is that you can ask for a team, and a team will be made for you. Or you can ask for anything, and it'll just magically appear. And I was excited about that, but the reality was, is that today the technology allows you to do exactly that. You can do literally anything that you can write a piece of software for, you can now call with your voice. The problem was, developers didn't know how to make the connection. The person building the solution didn't know how to use the technology that's available. So an opportunity was created. However, I've worked on some of the largest AI models in the world, Alexa being one of them. We're now in over 100 million homes. It has, I think we're at 2 billion devices worldwide that have Alexa enabled on them. That's crazy stuff. That's very large numbers, right? B billion, like very large numbers. And I spent a bunch of time asking hard questions. And the reason I asked these hard questions was because one day I got off a stage like this one and a woman came up to me and she said, why would you name a device after a girl? Why would you do that? And I was like, I don't know. I didn't, that wasn't my response. I didn't do that. I'm just a messenger. I say that all the time. I don't say that anymore. I'm just a messenger. And this woman who was a mom she exposed me to a whole world of heart people that I wasn't aware of. And it kind of comes to the heart of what we're going to talk about all day today. Is that even though I'm going around having a good time, I'm getting awards, I'm talking about AI, I'm building the largest AI models in the world. Meanwhile, this woman represents hundreds of thousands of people that care about the fact that Alexa was named Alexa. And the reason they care is because just interestingly enough, a bunch of young women, girls, moms, I guess, moms named their daughters Alexa. Is there any Alexa's in the house? Because you feel probably like I'm talking all to you. Okay, not surprising. They may have changed their name by now. But Alexa, there was a bunch, about seven years before Alexa was in its highest sales ever. This was around 2015. We were selling a million devices a year, like crazy. And fastest growing AI technology on the planet at that point. But there was this little group of women, little 100,000, that had named their daughter Alexa five years, six years before. This year that Alexa became part of almost all of our households, as you saw when we all raised our hands, those kids were going into first and second grade. Do you know anything about first and second grade? Do you remember? It's like when the mean gene kicks in, the bully gene, I'm going to make you feel bad about yourself. I don't know why, it doesn't happen to all of us. I was the nice kid. I think you all look like nice kids. But you know it when you see it, right? When you see a person and you're like, oh yeah, that's not, we're not going to hang out with that person. But it happens right at this age. There's an idea that shows me that actually this happens quite a bit at this age, six to seven. And here's what ended up happening for these young women in droves. So much that a class action lawsuit is being planned against Amazon as a result. These young girls would go to school and someone, we won't name names, will come by and knock their books out of their hand or knock their pencil off their desk or, you know, drop their glue and they will command that girl, like a robot, to pick it up. Alexa, pick up my pencil. Alexa, pick up your stuff. Alexa, go to the bathroom all day long. Of course, bullies always think they're funny. But it got to the point where these little girls didn't want to go to school anymore. Not only did they not want to go to school, they started asking their parents to change their name. That's sad to not be able to own your identity because some group of data scientists were like, yeah, Alexa's really good because of the lexicon and canonical phrase that does not cause false wakes. We should use that. Did any of us think about the little girl who would get bullied in second grade? No. We didn't even ask the question. It didn't even occur to us that kids would even be involved as a matter of fact. When we started on Alexa, we never thought anyone would buy more than one. We built it for one. When you started buying two, all of our systems crashed because we didn't know how to disambiguate two devices in the same house. We never even thought about the name. There is a cool story about the name though. Alexa is born. The name was actually a bunch of reasons. It is a great lexicon-based name which means it's got these consonants and vowels that don't show up often in the human language unless it's your name. That was a good reason. The other reason was it was named after Alexandria, the largest library in the world and it was meant to be this noble thing. That's just one of the very sad stories that I get to tell. Not all today, don't worry. Another example and the only reason why I think that happened and even to this day, I can't do anything about that. I don't work for Amazon anymore. I can't do anything about it. But I can take responsibility. And the only thing I can do from my very humble perspective and taking responsibilities to let you know that the fact that I didn't have anyone on my team raise their hand and go did we think about all the kids that are going to be named Alexa? We didn't have them all. I was a mom but I didn't think about that. I was focused on my son. I was focused on her again. So it's just really interesting how that happens. Anyway, I'll share with you a couple other stories about this but though I've gotten a lot of awards and it's been a very good ride, it's been pretty painful too to see how my just very simple oversight, very simple lack of critical thinking can actually cause pain to a significant group of people and this only happens with intelligent, artificial intelligence and automating scale getting what we're doing out to hundreds of millions billions of people at one time and you're going to hear lots of examples of this over the next throughout the day all across different domains which will be really fun, different industries but I want to start with something that I've worked for some of the best some of the coolest most rich CEOs on the planet and here's the good news they all referenced this quote Jeff Bezos Satya Nadella he's Microsoft CEO if you don't know Arvind at IBM Jim Whitehurst used to run Red Hat an open source company now bought by IBM but all of them mentioned this Jeff Bezos actually tweeted this out and said I have my kids read this, it's on our fridge and he took a picture of this quote on the fridge it's a pretty interesting story so I want to share it with you I'm going to read it I know you're not supposed to read it but I'm going to read it because it has a good story here we go so what is success to laugh often and much to win the respect of intelligent people and the affection of children to earn the appreciation of honest critics and endure the betrayal of all sorts to appreciate beauty to find the best in others to leave the world a bit better whether by a healthy child a garden patch or a redeemed social condition to know even one life has breathed easier because you have lived this is to have succeeded this makes me happy that the biggest tech moguls in the world are even aware that a quote like this exists let alone trying to teach their children that the barometer for success is different that's not the only story I want to share with you here you'll notice Ralph Waldo Emerson are you familiar with him if not he's a cool guy like poet laureate, American metaphysician, really nice author, you can google him he's pretty popular, very popular he's quoted as being the author of this quote and when I got off one of the stages that I was on a man came up to me and he's like you should research that a little bit just go to page two of google and so I did I'm coachable, I'm like hey if you say okay I'll go look and I go and find out that the author actually isn't Ralph Waldo Emerson the cool looking white guy who does poetry and stuff it actually was this lesser known woman Bessie Emerson Stanley and at the beginning she was well attributed which is why she's on google she was well attributed at the beginning but as Ralph Waldo Emerson got more and more famous using this quote her attribution was lost the lineage of her ideas were lost in the fanfare of Ralph Waldo Emerson and so now of course I give her credit but this is one of the best AI stories I know is that as we move into a world you're going to hear a lot about how do you create visualizations of data, how do you do good storytelling with data how do you use AI to tell a good story great you can tell an amazing story but don't forget the lineage that is part of ethical AI how do we remember the Bessie Emerson Stanley how do we make sure that as we start telling this story and it gets handed down from one billion devices to two billion devices how do we make sure that the data that we collected who gave it to us the rights they gave us how long we can have it how are they getting paid that none of that gets lost as we get excited about its velocity I will tell you no one thought Alexa would do what it ended up doing except Jeff Bezos maybe I'm sure he thought it would but we all right we were kind of flying by the seat of our pants we were kind of like oh my gosh this is amazing I can't believe I just got a hundred thousand users oh my gosh it's not a million it's a million five it's an indie dev like I had no idea what we were we didn't ask the right questions and so now I take it upon myself to make sure that one of the measurements for success is that we preserve the lineage of data we preserve where your data comes from it's why blockchain is so cool and interesting to me now right within five ten years we'll see blockchain provide this preservation tool we're not there yet we're still figuring it out that is what it does it creates a smart ledger it allows Bessie to never look credit for the song for the art for the content for the code you get to preserve the lineage of who owns the data and that is one of my biggest ethical responsibilities as a data scientist so I have learned a few things along the way of course I'm going to share with you there's over a hundred AI models today that is accessible to you through a few lines of code how many of you would call yourself a coder be proud it's a good profession alright a few of you that's good I like it the reality is almost everyone I know thinks programmatically about something and what that means is that code is usually a process a procedure a way of doing things and yes you do have to learn a language but that's only temporary we're now moving into the world of low code and no code and what that means is that you don't actually have to learn a programming language to leverage the technology I'm going to show you in the next 20 minutes or so so that's the good news you don't have to leverage code like learn java noJS type script you don't have to know all of that and then once you have got a proof of concept give it to somebody else and they can code it or you can have the code generated by AI which is the world we're moving towards so the code part I'm less worried about I'm glad we've got some coders in here because you're extremely useful knowledge and excitement that's good but it's not necessary to do what we did and to build however with these hundreds of models that are available today hundreds of them so there's models that can translate on the fly if you want to build an app, a mobile app and in that mobile app you want to be able to speak in 90 languages you can do it with three lines of code and again you don't necessarily have to know those three lines of code you just have to know that they exist and partner up with one of those people I hope you looked around and raised hands people get one of them and link it up so we've got more capability than ever generations of capability my parents, their parents the parents before them we've got more capability than all those generations combined which is incredible however I will see if we're all like friends or something right now but there's a quote that I often use and maybe you all know it with great power comes okay I can relax yes or know who said it or who they think said it Uncle Ben, that's right Spider-Man good okay we're on the same page yes so and Uncle Ben had something to say for the you know other people Voltaire also said it I know I loved it it's fine there are other people who have said this phrase but Uncle Ben made a thing that's kind of like off all the numbers but with great power comes great responsibility to accelerate the development of any idea that you have if you have an idea for a mobile app you can build it in a couple of days without learning a programming language if you want to learn to program you can hop on FreeCodeCamp.org and learn to code in about six weeks on your own or in a hundred days on Twitter like it is more accessible than ever so as soon as you start doing this though I'm going to encourage you to start asking questions not just and my friend Renee will come up and talk more about this later but it's not just about who will you serve right it's not just about Jeff Bezos going we are going to make the affluent so much happier in their kitchen that was the original goal make the affluent rich people happy kitchen because they will be able to set a timer without touching it they'll be able to play music while they cook amazing but our job our job is to think differently our job is to think ok yeah cool I get the kitchen but what about the classroom what about the nursing home what about the speech pathologist what about health care what about retail our job is to think more deeply about who we can serve and then it's also to think more deeply about who will hurt and this is hard because almost always when we're building something Alexa, Microsoft every AI model I built I'm always thinking I'm doing the right thing it's always my attention to do the right thing and yet still people come up to me and go by the way that thing you bill hurt me what I didn't know that so how do we stop that we stop it by asking better questions and by following a few simple principles so the first principle is around well I'll give you some context first so as you know I worked at Alexa that was fun four years I got my MBA in Amazon I didn't really but I felt like it I learned a lot about everything being in that startup and growing it to the size that we grew it I then went to Microsoft and built and was part of a team that created 17 research projects fun little projects I'm going to show you them now teenagers now but when I was with them they were little babies and we took these research projects and we productize them which means we put them in a situation where people could call them anyone could call them I called it AI for everyone I used to say that AI for everyone everyone can use it and then I realized I actually don't mean everyone I mean only nice good people I don't really want bad actors to use this technology to create systems that will destroy healthcare really don't want that but it's interesting these are the ethical considerations of democratization when you create a democratized framework when you decide to make something available to everyone do you really mean it and is it okay if you don't there's no right answer Microsoft was one of the first to take a stand and actually evaluating use cases for its technology and it will shut you down if it's not confident you're doing AI for everyone I think that's awesome some people would call that censorship it just depends on who the person is what they're doing it depends on where you come from what your history is but in all of these massive projects I learned some pretty key principles and I'm going to share these with you and I think you'll see them as you move through your career hopefully it'll get better because it's pretty dismal right now this is known rather than you probably have heard the term inclusion you've heard this term it's pretty popular inclusion which often when we say it we typically think brown people girls women but I actually believe it's something a little bit more I don't know maybe elaborate than that I call it a symphony of talent or a symphony of data I'm looking for when I for example built the technical management team that created four languages on Alexa when I did that work for them I realized that I needed to have a mom I needed to have a single dad I needed to have someone who went to school someone didn't go to school someone who went to Ivy League someone went to state I needed someone who represented a cat lover and a dog lover a kid lover I wanted someone who represented teachers someone who represented people like me who cared for their parents their aging parents I needed to create a symphony of life experience so that when we ask the question who could this hurt there would be people in the room who were like have we thought about grandparents have we thought about kids with Down syndrome have we thought about you know any divergent community and so that's number one is I have to have people in the room that actually know to ask the question that have lived a life experience that says I want to protect the interests of everyone in my life and that means oh guess what I never asked you where you went to school specifically or what you studied some of my best favorite data people data scientists data engineers actually started off in a totally different field one of them is a record producer turned data engineer one of them is an artist turned like a oil painting I don't even know what their called but oil painting artist person another one was a sociologist I had an endocrinologist these people yes maybe technically inclined for some of those fields but for the most part had nothing to do with AI had everything to do with humanity and that was really the gap we were we were facing so inclusive engineering doesn't just mean though having a table full of people with unique thoughts a symphony of talent it also means a symphony of data you have to actually get a diverse data set to give you an example one day had a woman come up to me and she asked this is early like maybe 20 doesn't matter but early in the days of Alexa she's like why does Alexa listen to my husband more than it listens to me and like marital struggles ensue when Alexa listens to one spouse over another or if I am screaming at Alexa and my husband walks in and says one more like the same thing and it like instantly does what that's not okay bad things happen so I immediately was like I know what's wrong does anyone know why that happened what was that we didn't train it on women ew why here is the sneaky part to train it with female data absolutely guess what we did to collect data we sent out an email to everyone in Amazon lots and lots of people and we asked them in their spare time to supply data guess who the only people were that could come in early stay late use their lunch hour guess what they happened to all be a shared demographic not because our whole company was that demographic it's a lot but no we had a relatively good level of diversity in the email that went out but we framed the participation in that data collection in a way that limited the diversity of the data inherently we didn't even know to look we were like we asked everybody it's not our fault that only these people show no we didn't even think to ask about fault we were just like awesome we got 250,000 people to give us data that's our data set let's go wait until the customer tells us we missed it I always tell people you do not want to find out about the good or bad part of your product on subreddits it's not the way to go that's the worst place to find out that your product stinks or hurts people at least it exists though so use it because at least it exists and I know to go there and I can go oh my gosh we messed up another one oh my gosh how many of you know who Marseille Lynch is he's a football player there's a few of you so pretend you know about football and Marseille Lynch he's a character like a character he's on Skittles commercials I think he I don't know got sponsored by Skittles at one point he's on a lot of different commercials today I don't know if he's retired it changes all the time but back then he was on Seattle Seahawks football team and they had just I think one then lost the Super Bowl or something and Alexa wasn't working for him so he calls up Jeff Bezos I don't know exactly someone asked me once like does he have his number I don't know all I know is Jeff Bezos came to us and said Marseille Lynch says that Alexa's broken so what they did is they asked the whole room there was I don't know 60 of us and they're like who knows Marseille Lynch everyone in the room raised their hands except a few of us I was one who was like I don't know like some of you in here I don't watch football anyway they're like great Noelle you're going right because they didn't want someone I guess like oh my gosh can I take a picture with you I could care less about the football did I say that I love football if anyway if you're a football person I did watch the Packers game so the whole time I'm there I'm you know trying to understand what he's doing so I ask him okay just call Alexa right now just call so I can see what's wrong and he's like Alexis and I was like all right I was like no problem okay Marseille Lynch it's Alexa and he's like okay Alexis and I was like no no it's Alexa and he's like Alexis I know that's what I'm saying and I was like Roger that man okay cool good I will get this fixed right away guess what I did I took that data back to my bunches of data scientists and I said he's saying Alexis there's actually a whole SNL skit on this he said Alexis they trained I took recordings of his voice they trained Alexa on his pronunciation and today if you say Alexis to your device that's how data works how crazy is that this one-off thing and who knows how many people who are saying Alexis and it never worked for it started working for but like is that the way to build a product for six billion people we don't know when we're building a product for the world when you're building solutions you hope we'll touch everyone the only thing you can do is have a mindset an openness that says all right if somebody says it doesn't work I'm going to run on over find out why it doesn't work and then fix it seven years later we've made hundreds of thousands of these little fixes and now Alexa kind of works okay so it gives us an opportunity to just kind of see that nothing I mean this is Alexa a lot of people think Alexa was a well-funded project it wasn't it was like a start-up we were fighting for our existence every day we were in the red forever in the red meaning right like we didn't make money for the company I still don't know if Alexa makes money for the company but it was a dream a dream of Mr. Jeff Bezos now he's onto other dreams rockets and stuff but at that time that was it but the reason that Alexa is the way it is now is because we are very inclusive in deciding right and figuring out what data sets do we need to make Alexa better and that data set could be from one person who represents a constituency today there is a model being built a speech model that is specific to kids who have you can actually Google it I think an article recently came out for kids who have special needs who have cognitive and speech delays and because they speak differently there's actually a machine learning model that's being created to help Alexa understand them I actually loved Alexa for my son because it forced him to repeat what he was saying over and over and over again until Alexa understood him and that actually improved his speech so he didn't need a special model he didn't need to be accommodated in that way some do but he actually benefited from having to say it and here's the kicker when he would say it wrong Alexa never got mad never got frustrated never got like it's Tuesday Max like he never said it like that I say the same thing about my dad like oh you know my dad has he's like Dory finding Dory do you know it or 51st dates anyway he's not as bad as 10 minute Tom but it's pretty bad every morning he doesn't remember what he did the day before so he'll be like asking me the same questions and now I just tell him to ask Alexa because Alexa never gets frustrated with the 15th time he's asked what day it is, what county we live in the numbers for coronavirus during corona like he asked me that question every day how many new cases I don't know your data person right yes ask Alexa and Alexa every time with a smile answer the same question over and over again and it created a level of companionship for both my son and my dad of a persona that wasn't frustrated and as caregivers we're human sometimes we get frustrated and it actually helped I think improve their growth so the second to last thing I want to talk to you about is the multimodal development this is the world we're moving into and what it means is that we want to not just think when I went to Amazon Jeff Bezos was always saying voice first voice everywhere voice everything and then he changed it to Alexa first Alexa everywhere Alexa everything he wanted right dominion over all things voice activated what I found out though is that voice is great but it's immediately how many of you are familiar with clubhouse do you know that app right it's an audio app immediately clubhouse alienated everyone who couldn't hear right or speak right and so you instantly when you say anything if you use the word all none everywhere everything you instantly become exclusive which is okay maybe at first but I'm a believer that you want to open the funnel open the doors to your software and be as possible and the way to do that is your multimodal development what that means is that different modalities for different people all pointing to the same tech so the first one right is of course yes I think if you write technology you should make it so that I can talk to it or to use my phone or my computer if I could just use my voice I would way prefer it and study shows about 78% of the at least American people would agree they'd rather just talk to their tech and that's the world we're moving to but I might also want to use gesture control or maybe I want to use a typical device so I went to national public radio if you know it they have like cool podcasts and stuff but I went to national public radio and I became their head of engineering and they had a multimodal approach which I loved they had a web app team they had a mobile app team two of them, one on Android, one on iOS they had a voice team and soon to be voice on Google and voice on Alexa and now they're thinking about the metaverse and how do we create an experiential community as part of our product we're moving to a podcast for example by walking into the metaverse sitting in an audience just like this but it's virtual and be able to talk to some of the people that you've been listening to for years so this is pretty cool but the benefit is that the funnel of people using your technology widens, you get more customers and more customers means more revenue and almost everybody likes that if you're running a business so multimodal does one of two things accessibility for your technology but then two, it actually also improves the productivity and profitability of any effort you take on so multimodal development is a huge part of what I have found made solutions successful and of course today is all about ethics and I, in my professional life I have to be very careful about ethics you don't hear so I'm going to encourage you to dive on into like have you ever seen the trolley video from The Good Place yes, some of you have it's super graphic, like trigger warnings super graphic, I did not know and I was intimidated by the amount of gore but for those of you interested there's a video, trolley video, it's an ethics video from The Good Place on YouTube very popular, but it basically talks through the scenario of let's say autonomous vehicles and this is a true story but for the vehicles we'll call them beslas these beslas were being created hypothetically and the computer vision model had to make a decision when approached with the opportunity to collide with something a small dog or a human anyone care to guess what it chose? right, sounds like dog that's a simple kind of mathematical equation small dog, not human human we should probably save the human however, what happens if it's your dog some people when asked this in a study actually hesitated on the human when it came to their dogs I'm not going to judge them they're family, dogs are people I guess but how interesting is that if you asked the driver what would you rather me do if it's their dog their ethics change and that's what the trolley video also demonstrates if it's personal to you that's why all of my technology choices have been around my son and my dad that's the ethics that drives my choices so interestingly enough we have to kind of figure out how we acknowledge the ethics in any conversation in any decision to make software but also how do we take responsibility for that right so the way that Besla hypothetically decided to take responsibility you can imagine them having this conversation is that they said to themselves alright, what's the most important thing the most important thing is the driver so we will do whatever it takes to preserve the driver in this case it worked out because if you hit a human it's much more likely something bad will happen to you and your vehicle than if you hit a small dog so it worked out but that's not always the case deers humans anyway but they decided to model build the machine learning model the predictive model gets thousands of variables right there's lots of variables but one of the variables was on the security of the driver and that was an ethical decision that the company had to make and those are decisions that you'll have to make I will say I'm a little bit worried today about companies that aren't even having these ethical conversations most companies are not even asking the question about the dog and the human they don't realize the impact that their technology will have on humanity and that's why these discussions in this room and your small groups are going to be so important so finally today is all about I'm hoping learning by doing we have a bunch of different breakout sessions we have a bunch of different breakout sessions that are happening and you'll get a chance to get some practical experience doing this I'm going to be leaving one there's a really cool one coming up but in the afternoon when we break out that's going to be what we get to do we are going to have a chance to actually put not necessarily fingers to a keyboard but definitely practical applications so I want to bring up somebody to say something okay I'm going to bring up