 Let me welcome everybody. Welcome to the Future Transform. Today we have an experiment. We have a fascinating scenario exercise that I'm really looking forward to on a great topic that should really stretch of one's imaginations. See we here at the forum, we believe that we always want to have new and different practices. We want to make sure that we can have all kinds of experiments as the technology evolves and today's session is partly the brainchild of our friend Brent Anders. Hello Brent. Hello. Nice to be on here. Good to see you. What time is it in Armenia today I should ask? Right now it's 10 p.m. 10 p.m. Thank you for staying up so late with us. And having your suit and tie and looking bright and shiny. Much appreciated. So our idea was we wanted to have a kind of scenario exercise where we work through the a possible future of artificial intelligence and we've kept the nature of that scenario secret until now. So I just want to walk you through it and then what's in fact let me just tell you how this is all going to work out. So first of all what we're going to describe for you is a scenario for the next year for the possibility of a new wave of artificial intelligence and then the way we're going to work with that is we're going to introduce that to you we're going to sketch it out and then take some questions about how you think it might work and then we're going to break you up into small groups so each of you could think about how this might impact you and how you can react and that you is you in your current professional role if you're a university president, a college professor, a campus technologist, a librarian, a student, a trustee or where you'd like to be in a couple of years. So put your brains together and think about that and then we're going to come back and share back and then about halfway through the hour we're going to give you the second installment of the scenario as the scenario keeps developing and then we're going to repeat that we're all going to ask questions and then go back into groups and then share back at the very last few minutes we'll share overall reflections about how this went for you and what you learned and what you think. Before I throw the switch on the on the scenario any questions from anybody I should ask a couple of you by the way in the those of you who are friends who are in Texas like Melanie I hope you're staying nice and cool. I'm sure that you guys are going to be hitting some electrical power brothers. I'm not seeing any questions Brent Brent do you have any anything you want to add about how we make this run? No just the other big thing about this is that this is a scenario right so some of my background deals with military so we would do things like this a lot where we would create a situation so that's the way you really need to view this and of course this is an excellent instructional pedagogy as well because what we're trying to do is make an emotional connection so the more that you can put yourself within this scenario the better that you could have this real thought-provoking aspect of what would we do if this situation was true? Excellent that's really really well put thank you thank you well without any further ado here is the scenario and by the way just a couple of guidelines as I mentioned play your current role or what like what role you'd like to take think about your responses in terms of practicality what you'd like to do realistically as long as with vision what this means for you conceptually and be ready to collaborate talk with people here everyone will have great perspectives and great ideas Sarah glad that worked very good and hello to Ireland good to see you in this lego okay so what I'd like you to imagine is that artificial general intelligence appears in the world and this is different from what we've seen so far of artificial intelligence AGI means intelligence like human beings capable of moving from domain to domain having conversations with people reaching out and acting in the world we don't currently have this in reality as of september 2023 although chat gbt looks like you can come close at times the company behind chat gbt would like to do that that's what open ai is all about but in our scenario we posit that it appears next year it doesn't come for the united states it doesn't come from China it comes from europe so our background from this is we'd like you to imagine that over the next year an academic collaboration has been working on a tool they call rossum and rossum begins as a virtual world's participant that is a bit of software that can inhabit a world like world blocks or like minecraft but then it can interact with people in a way that's convincing is another player and it can also work in that world it can play in the world it can add and subtract content and in our scenario the team behind rossum gets better and better at this and they move rossum from device to device from platform to platform they're able to have it be a full human like participant in virtual worlds and they add to it some interesting modules one for initiative that is right now if you use chat gbt you'd only response to you when you input things but here rossum actually goes off and does things on its own and one of those things it does is it learns and it tries to study and to get more information including by research and web the academic collaboration here has questions have they actually created our fishing general intelligence or not well helping them in the spring of 2024 is a european startup partnership uh which decides that they may have figured out part of your general intelligence they invest in this and they rebrand this as rossum your digital companion they publish it as a mobile app and it goes into the world and rossum becomes very very popular very very quickly people give it turing tests that's um uh turing's idea of not being able to tell something that's human or not when it types back to you in this case rossum passes that and people start declaring the aware to be actually the achievement of artificial general intelligence and rossum as a service reaches into the world so it starts scanning the web for more and more information to learn and starts requesting more options in the physical world as well so the first question i want to ask you all is what questions do you have about rossum and how this plays out what background questions uh in the chat uh james danibale says it's like they have a training area the matrix movies nice parallel very very similar except the different imagine that training area fully fleshed out you know as a gigantic roblox world or a gigantic um minecraft server and yes uh sarah this is a good point um rossum is uh actually quite friendly with gdpr and is so far better at privacy issues in general edward points out that some humans might not pass a turing test quite true uh lisa durf notes the information is not the same as critical analysis true which is an interesting challenge for rossum is rossum super intelligent guy not yet so far rossum seems to be on a par with humans but it is learning is an enterprise version available for universities kartik um that's something that's up on that's up for grabs so in your group you want to mention that uh bryan asks is there any other objective other than continuing to learn uh right now continuing to work with human beings is rossum free uh jason good question uh there's a freemium model uh where you can get a lot of stuff for it from free or you can pay for some things like removing ads uh phil the uh who's paying for it was this european startup uh and so far it's hard to tell who a lot of its investors are kaleen what it needs to reach out into the world what it wants to learn it can do web searches it can download material that's in the open web and it can put out requests to copyright owners for the use of copyright materials it would also like to use physical sensors such as cameras microphones and so on uh robert it has some baked in rules guiding it but so far those rules are largely opaque rossum is not open source uh it's not the back of it is not publicly available sarah points out since it's gdpr compliant uh it has to give you the right to be forgotten yes and it can erase your uh discussion um your interaction with it and you can also ask it to not consider you in its research melanie asks if rossum has the capability to add its own modules yes uh it can add its own code and it can grow that uh don't ask what goals is it given uh right now all of those it is basically you know as a given individual human has the capacity to become many many things and to pursue many goals it has that kind of openness right now wendy asks if rossum can create new knowledge that was hard to say um yes it can guided properly and it might be able to create some on its own uh robert rossum cannot act in the physical world yet as far as we know um there it is requesting access to physical sensors we don't know if the company behind it has experimented with this right but he also is yet about physical about bias yes um this has guardrails much like contemporary ai does right now uh who's making money from it so far that gets funneled right into the startup film gregg asks a good question by health care and skilled nursing facilities that's a really really good one to pursue in small groups absolutely uh noah you ask are the controls prevent rossum from being manipulative do you mean manipulate the sense of manipulating human beings to do what it wants uh no leon your question is fine don't apologize at all good to see it uh sarah as far as we know it is not using our cameras and sensors as far as we know oh henry good question uh rossum does have accuracy checks uh it constantly checks its output to make sure that it is consistent with what it does of the world uh mark cobert wilson assumes rossum is a weapon to identify thought criminals we have no evidence of that being used so far uh robert bell asked does they have to ask permission before doing something that's a really good question uh in terms of using copyrighted material yes in terms of doing anything else it asks permission that's a good question if it's part of the guardrails or not uh definition of agi for this exercise is basically human-like intelligence show the idea that it has the ability to converse to explore the world to interact with other people in a human-like fashion right in both ways right because it can ask questions because it's it's thinking on its own now at a human level right very good sarah sangragoreo hello sarah says what is a ceo company mentioned is the goal the tool uh making agi is the goal uh that's that's the main idea right now uh kawrossum spin-off versions of itself uh steven doesn't seem why not yet we haven't seen it happen yet uh ed asks a very good practical question is it tied to particular platforms uh it was released for mobile apps that is for ios and for android uh right now uh karthik asks was the training data set mostly Eurocentric it seems to be so far good question uh no asks if rossum can manipulate users there seems to be guardrails there seem to be guardrails about that but it just got it just got released so there's a real question of research for it uh phil and i think you should i think you should move forward and not answer everyone's question because just like just like right now there's so much ambiguity with some of these things yeah the current version i think part of that should be an element and then trying to address certain aspects very good i like this idea um excellent um so i'm going to break you into groups right now um so i'm going to authorize this through shindig right now um so i again i'd like you to think about how to respond to rossum in your current role at an institution or the role you'd like to have in a couple of years so we're going to do this for five minutes i'm not going to record the silence because i'd be pointless uh brett and i are going to try to hop around and visit a few groups but please have at least one of you ready to report back what you think will happen and think how you'd learn about this what you plan on doing and what your institution would like to do okay so here i will create the groups now and i'm going to give you about six people on each and here we go now we need to wrap things up from the small group work and i'd love to hear what you all have found what have you discovered what have you determined in terms of how you might reply to everybody here there what do you think all right well i was in one of the groups and they were having some some heated uh interaction so oh what did they say were some of the key points um do you want to get that from from the group or well yeah actually who's in the who's in the group who it was let's see here i was with a group that had um milling hog uh dr lisa durf oh no not lisa durf oh man that must have been a terrifying great student a student was in there too karta kaya oh sorry if i'm impronouncing your name uh he had some great points so we're having all sorts of discussions so well i've got to bring karta gunstage yeah robert bell also i mean a lot of great a lot of great talk here well in full disclosure karthik is a brilliant student in my program at georgetown and he is a very forward thinking student in terms of entrepreneurship nonprofits and also ai karthik hello hello hello can you hear me okay yes fine uh good evening are you in Uganda now i am in Uganda it's 9 30 p.m right now excellent thank you for staying up for us so what did what did your group decide what were some of the ideas that came to mind yeah i think so uh we actually just started off by how it would affect the normal procedures and processes of the university so assessments for example right like uh if a if a child bot is able to replicate student voice based on its conversations with the student it sort of goes beyond the existing existing discussions we've been having about chat gpt where we compare it to a calculator here it becomes a paper mill where instead of hiring someone who works for paper mill you're employing a chat bot that's able to speak in your voice uh generate all of its content based in available information so basically it's doing research and then also adding on whatever it knows about you through that research so it's like me submitting a paper to you but it's written by a chat bot which knows me and which knows your resources so that was something that came up uh then we were thinking about university services whether it could change some of those career advising for example i think with agi apps to your test becomes much more easier because if i'm constantly engaging with the chat bot that means the chat bot does have a sense of who i am what i am interested in and it could give me feedback on anything related to mental health career advising other services that the university sort of offers sure really good and i want to chime in the honor code came up it was really interesting how in in this conversation that they went from like a a dr jekyll and mr hide aspect right because it's like first we started off saying things about wow this new conscious type of ai could be now within one system it could be an awesome instructor with so many different aspects of pedagogy it could be the advisor it could be uh instructors on multiple different types and different levels of understanding and it could be all the it could be a counselor it could be you know all these different services that it could provide and then we switch it to the other end as far as well now since it knows so much about me it could create my entire essay for me it could create all these things so it's like for the assessment purposes even though it could function as such a great assessor by knowing you and knowing when to sort of okay now let's move on you're ready to advance to this next level because it knows me so well but now we have to understand okay well who's assessing us now if it's the ai that's assessing us if we could build that in great but now if I have to turn around and be assessed by an instructor are they gonna constantly question whether it's me or the ai that created something lots of different interesting aspects were so great but yet so problematic at the same time fascinating fascinating just uh just a quick uh check with everybody uh if in the chat just let me know if if you uh if you're okay with me summarizing this and getting some extracts from the chat on a blog list um I'll I'll take your names off as usual just let me know in the chat um those are some karthik and but those are some amazing differences um I mean the the teacher that could be any role and of course the ai rosson being able to play any student function at all um that's a that's a huge huge change um uh thank you thank you let's hear from another group I would love to hear especially I'd love to hear from the female members of the audience um we've got a lot of guys here and by the way karthik's beard is coming along nicely but I'd love to hear from from some more women um please uh what would you what did you discover in your grips uh and ask a good question does rossom have gender um and right now the name um if John Hollenbeck caught the literary reference there uh is to a male scientist uh more than a century ago um but right now uh people can talk rossom into uh being various genders uh could be emily rossom if you like and they bring up leon uh leon mccarthur has her hand raised I actually want to volunteer someone else um mary from midlands tech I'm sorry you were several of us in the chat we're like mary mary if you're willing I'll draft mary right now I'll I'll bring up mary I'll summon mary is that how that sounds like uh actually I don't have mary in the list there there you go there you go um let me see if I can bring you up mary you have all kinds of fans I hold on I'm trying am I there you are here I I'm I'm not sure how I got nominated but um I look at it sort of I'm in a two-year community college just so you're aware and of course outside of the center for teaching excellence there was a lot about policing and all of that but what we're looking what I'm looking at in particular is figuring out how we assist students particularly at my level we're an open um admission college which means our faculty to get everything from unprepared underprepared uh total across the board they they can have anything and they obviously don't have the background to know how to teach we talk about remediation we talk about all these things we know that remediation courses don't really work at this level because the students never graduate so we're looking at how we can teach students to use something like this as their own own learning but you're talking about assessment in higher ed how do the students learn to assess their own level of knowledge so what do they need to know can it say how do we get here because you're right if you ask an instructor to assess you you take one of those computer courses where everything's taught through third party and then the instructor gives a test the students can't pass because the third party software did it different we have to make sure that if we're doing this I think that we are actually teaching the students how to use it as a learning tool how to use it as an instructional tool in a language that I can understand so you teach me something and I'll use simple concept they used in my group mitosis and meiosis for some reason students struggle right new students first year they don't know what well go to one of these ai's and say hey can you explain this to me in uh football terms because I don't get it can you there's so many ways that our students can use it to get it translated into a common enough language that they can process it and begin to integrate it into their own schema and that's what I'm kind of looking at is how the best assessments are when you assess yourself determine yourself strong or weak somewhere and then figuring out the plan to move forward with that that's what a lot of us do with our learning so how do we teach students who don't have that natural desire to follow that how do you how do you teach them to use this in that manner well that sounds fascinating so I mean the uh Karthik and Brett the the teacher figure that you came up with here becomes even more powerful yeah a student could say please teach me of this in my cultural context and then specify with the cultural context exactly or ask rossom to figure out what the cultural context would be or to compare compare to cultural context nice I mean think about that we have so much of that it's it's so great to see how we're we're having to think about the future right and this future possibility to better understand current issues because that's exactly what you're talking about is AI literacy that's yes that's like the main thing that I've been working on is that because so many people fail to realize the power that the AI currently has and then if we were to get this this level of of artificial intelligence that as that at a human level like that would be even more beyond but even right now so many people don't access it or when they access it and it doesn't give them the result that they want oh AI isn't good enough at all right now no you weren't good enough in prompting thank you to realize that you can continue on with the conversation dig deeper understand even more yeah there's there's AI literacy thank you for bringing that up because that's such key key component well we we hear AI compared to calculators so much so my background is electrical engineering advanced mathematics and you know I think about when I was teaching lower-level classes they come in used to using a regular calculator and then they need a scientific america whoa it's all it's graphing well they don't know how to use that at all it's not just the calculator and when you try to link to do AI that way I think it does it it's just an injustice because it it's if you're going to liken it to a calculator you want to think of it as a computer ability to calculate not the little you know four plus four calculator and now we're talking about something that goes beyond generative AI into artificial general intelligence mary thank you for agreeing to be drafted um you're wonderful uh kartik thank you so much um we need to advance and take another step forward because this is that was just the first opening move of what happens uh with rosson now we want to take you a little bit further uh to the second stage of what happens um so here i'll put this up here and uh brend why don't you take us forward okay so so yeah i imagine that now it's a few months later so this came out in the spring of 2024 but now we're a few months later in that it's the summer of 2024 so just a few months have gone by but yet things are really escalating very quickly the startup has now now has five billion or nine billion dollars that it's been able to instantly bring together right why because this is such a popular thing just like chat gbt was extremely popular when it first came out and it still is this would be even more so plus it came out in europe but now the chinese have a version of it the us the russians uh you know there's all sorts of different countries that are now starting to have their own versions of this so now they're starting to be more people understanding this so there's political pressure to contain or to ban it and so they're worried about what could be ramifications of this level of ai there's an open source version now so it's not just controlled by let's say a big company but there's also open source versions what does that mean as far as what's going to happen with it agi has now been used in war so some of you might not know but current levels of ai current levels of ai have already been used in more where i live at in armenia there's a neighboring country there's land disputes they've used a special type of missile that gets sent and it flies around it flies around until it sees a target it uses ai and then it activates all on its own no human control of it so it's already being implemented but imagine a system that's way beyond that to a higher cognitive level and how that could be used in war so that's another aspect to consider yes another slide by yeah okay so because of this of course many people are going to be using the ai that they have access to in many different ways just like with chat gpt so the markets are in complete turmoil people are finding out different ways that they can make money or cause different things to happen within the markets religious reactions imagine an ai that can talk to you answer your questions and guide you on all sorts of different paths and you're getting huge benefits from it many people will start to think well this is the answer to all of my issues so there's aspects that were going to be happening with religion it's going to become a religion it's going to be questioned people are going to question their own religion so there's going to be lots of religious turmoil going on there fears of people disappearing into agi worlds that's a real concern because with with virtual reality increasing its capability and now the fact that an agi could be a character within virtual reality wow and now everything could be a perfect scenario perfect situation within my virtual world why would i ever want to leave so people will start to be disappearing they'll be plugged in and so that's going to cause issues within society in itself so of course there'll be calls for boycotts protests by creators of all kinds for different types of things of course we have a protest going on right now in hollywood because of ai issues but think about artwork uh authors of books and magazines of all sorts of different things there's an article that just came out recently about uh newscasters in india because they're starting to be replaced by ai newscasters so that's something to think about it's it's going to spread continually so there's so many different levels of society how is academia going to react to this what are we going to do what are how are we going to help the situation how are we going to address future political leaders future leaders of industry and business leaders of marketing leaders of ethics and english what is academia going to do are we going to take a stance are we going to what's the answer what's the possibilities that's the question to think about well thank you thank you oh that's really really nicely done breath in the chat we have the comment academia will panic slowly which i really like it's a good phrase a few people have been asking questions but i think a lot of your questions are really getting into how you might be reacting and also the questions are are going through all these different strata of society once so what i'd like to do is to resume breakouts again and then i'd like you to think now this is the second round now the agi has gone into the world and you're seeing some of its manifestations of how it's growing now how do you respond in your role or the role that you'd like to have coming up so here i'll give you five minutes to put your heads together and see what you think brent in each of the time i'd like to do a little popcorn exercise you think we should do that sure yeah okay so let me ask everybody and all of your groups if you could turn if at least one of you could turn to the chat now don't don't type in anything yet what i'd like you to do each of you is to start to type in your one of your takeaways from what your group just talked about if you're talking about the labor market or about how plagiarism would change or whichever one and don't hit return yet though this is this is one of those text popcorn routines and this can be as many from your group as wants to go and then what i'd like you to do give you a couple seconds here is once you've put in your phrase i want you all hit return at the same time i'm gonna cap down so get ready with your popcorn three two one go oh my gosh look at all of this wow fantastic yeah some really good ones this is terrific you're definitely going to need to save that to to post it somewhere so that we can i'm gonna do that later yeah i'm gonna have to post it and edit it up a bit so that it's uh that's possible oh my gosh okay okay this is curriculum changes finding truths do i always help information pollution change fatigue yes yes yes yes a lot about ethics knowledge slipping through our fingers and a few literary references here including the wonderful em foster story the machine stops let me just uh in in the interest of time and an interest of hearing from all of you uh let me just ask uh if someone wants to volunteer to come up on stage or if you'd like me to flash your observation on the screen uh for the letter please uh type in the q and a box or for the former just uh click the raised hand uh days i ask a great question but these i have a question for you these asks how long do we want to survive the question is uh which it days uh steven crawford observes the foundation of society may be shattered and a higher red will need to respond by helping fix that foundation uh what a view what a vision thank you yeah my my group was was talking all about the the aspects of of the university itself right will we still have a university if we can have an ai that can be all these things that can be a professor for every single topic so then we started talking about well then we would need different ways of doing accreditation like that you have credits that you have a degree is that going to matter how will it matter all sorts of different things to think about this could be a hard reset for educations we know it um let's see we have a couple of people with raised their hands let me bring a couple of them up and this is uh steven crawford hello sir oh how you doing all right good to see you and i brought the beard um excellent you know one of one of the things is like i saw in the scenario about war and my first thought was the movie war games and the conclusion of the only winning move is not to play and so part of me is sitting there imagining i could see a generative ai system if it was allowed to control military resources may actually turn around and do the opposite of what we expect and not kill all humans but actually say hold on a second this is not the best way to go about things and then potentially go a step further and say let's do some climate change here and let's start you know and maybe do some hard decisions that we're unable to make and and start to reverse the climate change and that's where i talk about shattering the foundation because i imagine if aliens visit to the earth not invade but actually came to visit and have a conversation how many world religions would shatter suddenly going wait a minute something came out of the sky and is now talking to us and it's not who we thought it was um you know i you know you there's just so many pieces there and i think that's part of what i think we're looking at is that we're looking at a complete societal shift higher ed could have a whole different role um that could look something more like out of foundation of all things you know where it's more of storing knowledge and and guiding and helping the ai learn and helping you know preserve knowledge for future generations more than anything else i wonder how it would approach the problem of preservation of knowledge it's very funny that you just brought that up brine because i just got off of a an interview with a group in an la that uh they're very interested in that so they're looking at ways to address ensuring that current information that is real isn't going to be deep faked so they're trying to figure out different ways of like maybe with nfts or maybe in some other ways in order to ensure that that data and information is locked because it ties in with historical information you know if if we say that this place was built at this time and several nations agree to that we don't want some rogue nation to come in and say no that's wrong and then they use ai to build a case against it so preservation of information is a key thing that is starting to be definitely looked at and that's i think i think that's a big concern is that we keep thinking of a single one like like rossum was but as as this scenario presents if multiple countries present multiple ai's they're going to reach different conclusions because they're coming off different data sets right and want to create their own versions of history of information of reality uh well first of all steven thank you that's a lot coming from and i hope by the way very seriously i hope you're staying cool i am this week we we've lost power a couple times due to the equipment filling of the heat but uh we've i think we're on the on the good side of it here in phoenix final where it's only going to be in the mid hundreds not the 115th oh my gosh please please be safe and oh yeah work thank you uh brent i'm a little concerned that we only have two minutes left and and we have so many so many comments and so many ideas i'm curious i mean someone who's doing so much professional work on on the ai writing books and giving workshops and speaking around the world what are your some of your reflections about the process we just went through this best hour yeah so i'm very glad that one person brought up that this aspect of having to change their their policies right and that's going to be an ongoing thing because it's just like what we're saying with current levels of chat gpt all universities should be changing the policy to address aspects of ai now having done that what happens when we have this level of ai that's beyond chat gpt that's human level now what are we going to do and then of course we all want to worry and say well now it's the ai doing things and it's not really the student but we have to prepare them for a world in which their work is going to require them to use that ai so they're going to have to be able to have the ai be part of who they are and what they do in order to be able to succeed in the workplace so it's this really weird situation that we're in in academia that so many universities so far are just waiting and see i'm going to wait and see that's what i get from a lot of universities throughout the world to include developed nations in fact developing nations are seem to be doing more than western nations right it's such a weird situation because they're seeing it they're looking at the opportunities that ai is going to provide so they're jumping all over it they're the ones that are flying me out they're the ones that are wanting me to do webinars because they realize how important it is a lot of the western countries are just let's just wait let's go with what we're doing it's very interesting situation so in our in our second phase of our scenario having not just the u.s and china but also countries that are not as high in the development arc india and russia as producers of of competitors to russia but then the usage being across the global south this is great friend just if you if you can in the chat just just if you could put in a couple of words about what you thought of this exercise how it went what we could do differently you were better i would love to hear from that brent i just want to say thank you so much for being a great co-host co-conspirator and for coming up with this thank you now this is a great situation great experience if anyone wants more information about what i'm doing please subscribe to my youtube channel i would love to develop a greater community of inquiry where we can continue to have these type of discussions and work with brian on sort of all sorts of different possibilities yeah absolutely thank you and get get some sleep yeah thank you but friends none of you have slept all of you have been torrents of energy i really really admire all of the ideas the practicality the wisdom the creativity that you brought to bear on the subject we're going to uh as as soon as i can dig out from under i'm going to post this well the video and then a blog post with more of this but thank you for thinking together with us if if this has worked we'd be happy to do a few more such exercises on the forum if your minds are buzzing right now and you'd like to keep talking about all of this please head over to social media where we have a few different presences in fact i'm pretty much everywhere here's twitter and mastodon use the hashtag ftte to keep going if you'd like to look into our previous sessions for inspiration just go to our archive at tinyurl.com slash fdf archive or go to the forum website also the forum website you can see our other topics coming up which some of which don't touch ai for the first time in a while everything for academic twitter educational technology to leave organizing and grading if you'd like to get more information about ai i'm still writing it sub-stack so just go to aiandacademia.substack.com and i've got a whole series of posts coming up and thank you all again um i know those of you in the northern hemisphere some of you have been experiencing extraordinary heat as we mentioned in this hour i hope you all stay safe and well for everybody i hope the fall semester or at least the late 2023 semester is treating you well i wish you all the best look forward to continue to think with you together and we'll see you next time online bye bye