 Welcome, welcome, welcome everybody, I hope your conference experience has been great so far. Thanks for coming into our session, our workshop for the next hour. We are going to focus on behavior change design, techniques for behavior change and social impact. We're going to talk about how to think about and use behavioral science in the way that you work to develop programs, communications, initiatives that you have. And we're going to give you some tools to explore a bit today and some resources, some of which Olga has posted in the chat already. And some resources that you can explore on your own and hopefully tools that you can integrate moving forward. That is our plan. Welcome to the introduction and we're going to talk about specifically two categories of tools and methods that you can use. Category one around behavior change techniques, which we will teach you about. And category two, the functions of your intervention. So we'll tell you how these work together and how you can think about using behavioral science and evidence-based behavior change techniques. And intervention functions together to build, analyze, test interventions that you put out in the world. This is us, we'll say hello really quickly. Olga, do you want to go first? Sure. My name is Olga and I'm a behavior change designer. I work with impact startups, nonprofits and impact investors to help them apply behavioral science and design thinking to their products, programs and initiatives. Love that. Folks, Dustin DiTomasso, I lead a behavior change design discipline for an agency called MADPAL. We work primarily in the healthcare space, also financial services and well-being with the goal of how, again, how we can build successful interventions, effective interventions and how we can bring methodologies like behavioral science, like human-centered design, like data and technology together and provide those tools for other teams and individuals to be more successful in their efforts. So we'll start here. We'll start with the big question of why behavioral science. Why have we chosen to focus on behavioral science and behavior when we think about how do we make impacts in these areas, particularly in sustainable development goals. And many of you may think about it this way already and some of you may not. But when we think about these sustainable development goals and what we're trying to achieve in terms of outcomes and impact, behavior is really central, human behavior is central to all of the outcomes that we care about. There is a human behavior, individual groups, populations at the core of both sides of this equation, at the core that contributes to the problems that we're trying to solve and behaviors that are central to the solutions, the behaviors we want to change. So when we're working in this space, we can think about organizations, businesses, individuals that are addressing sustainable development goals as well as the goals themselves. We're asking individuals, organizations, communities, governments to change behavior in one way or another. Usually in ways that will positively impact the outcomes that we're focused on. When we think about quality education, we think about student behavior, we think about teacher behavior, we think about organizational behavior that can roll out schools and communities where they don't exist. We can think about how to optimize education and what that takes, whose behavior is central and necessary to make those improvements. When we think about things like recycling or single-use plastics, we think both about the behaviors of the organizations that can make choices to cut down on the production of single-use plastics. And then the other side of what do people do with their plastic and single-use plastic? Do they recycle? Do they throw it on the ground? So on and so forth, these behaviors. And we can think that through for all of these sustainable goals when we think about energy or climate, things like installing solar energy or biking to work instead of taking a car or fossil fuel vehicles. Has double benefit, right? Benefit on climate as well as benefit on health and well-being, right? So these are behaviors, the behavior of biking, the behavior of choosing to use solar where possible, not throwing our bottles on the ground. And to think about these problems and these processes in the process of identifying social impact goals, sustainability goals, and how we frame them, how we understand them, and how we design and test, design, implement and test solutions focuses on a process that puts behavior in the center of that process, right? When we understand and frame the goals that we have in behavioral terms, who needs to do what? In order for what outcomes to be achieved, we can then design and implement and target those behaviors with techniques that are best suited or most likely to address the factors needed to change those behaviors. So we think about very quickly the big picture of how do we change behavior and how do we put behavior at the center of the process? We can think about these steps. We can think about understanding, starting with the problem, right? Understanding what the social or environmental problem is. Who is at play? Who contributes? Who suffers for it? Who is the population? How do we measure that impact that we're looking to improve? Then really focusing on what behaviors are central to achieving those outcomes? Whose behavior needs to change in what ways? What barriers or facilitators influence those behaviors? And then getting down to where we focus today on when we understand behaviors and drivers of behavior that fit within our problem. What do we do about it? What techniques can we use to overcome those barriers or amplify those facilitators to change behaviors in a positive direction to overcome those barriers, achieve outcomes that we're looking to, and implement those into solutions? And this is where we're going to focus on today, right? This idea, these frameworks of behavior change techniques and frameworks of intervention functions so that we can analyze the work we have in stream or out there in the world or start to apply to work that's in earlier development for each and every one of you. Olga? Great, thank you. So without further ado, we'll start with something that we thought is going to be the most interesting part for everyone is actually strategies, techniques, what are the things that you can use in your programs, in your products, in your services, in your fundraise initiatives, whatever it is that you're working on. And next slide please. So we're going to start with asking people in the audience how many of you have heard of... You can put your answer in the chat if that's something that you've heard of that you are familiar with or using, like, dislike, don't like any feedback. So that's one. As you continue to think about this, how many of you have heard about gamification? That's my cue, there you go. Gamification, game design, rewards, incentives. Okay, excellent. So we have very few people who are familiar with these terms. That was there a hope that those are going to be the techniques that many people have heard of or tried or applied in their programs or services. In fact, there are more than 90 different behavior change techniques, according to just one methodology, that you can be thinking of as active ingredients for your program, for your solution. Those are the techniques that can help people overcome the barriers and change their behavior. And these techniques, actually, you can see them here and we'll share, that was one of the resources that we shared earlier. Those techniques are categorized based on the determinants that they are meant to address. Are you trying to help people increase knowledge? Are you trying to help promote or enable some behavior through environmental change? Are you trying to motivate people? Are you trying to substitute a behavior, replace a bad behavior with a good behavior? So there is a lot more than nudges and rewards. And today, our goal was in the next 40 minutes to get you acquainted with another nine behavior change techniques that you will be able to also say yes to next time someone asks. And the nine behavior change techniques that we thought would be really helpful to get to know today. Next slide, please. Yeah, the nine behavior change techniques we selected are basically selected because they are versatile. They apply to multiple different behaviors. They apply to multiple different outcomes, whether you work on SDG 3, 4, 8, or 13. Some of these techniques would still be, most of these techniques could still apply. And they could be delivered in digital intervention, in in-person intervention. They could be delivered in a physical object. And that's what actually we'll get to as soon as we go through some examples. So just to quickly go over them, there is self-monitoring of outcomes of behavior. There is instructions on how to perform the behavior. There's the technique that helps you help people conserve their mental resources. There's credible source that also may be familiar. There's information about others' approval, adding objects to the environment, social support, material incentive, and framing or reframing. And just another lens for you or another perspective for you to keep in mind as we continue is that these techniques are kind of a blank paper for you that you can draw on, that you can use and continue to change because the techniques are just the definitions. And they also provide some examples, like in the link that I shared earlier, you can see what are the examples. Really they are not ready to implement solutions. They are, in fact, the things that you are building from and you're translating them using your knowledge of communities, using your knowledge of social, cultural, and environmental context of the challenge, using the knowledge of your people that you are, the target audience. And without further ado, let's go to the examples to see how these techniques can be applied in the products or services. We have three examples so that you can get familiar with what the techniques could look like. Again, this might be easier to see at some point through the full screen, so hopefully that doesn't interfere too much with the chat. But example one, so we're looking at the digital app. The digital app is meant to help people pay off the debt, right? If you look closely at what this app is trying to do and you try to apply a behavioral lens to this, you'll see that there's at least three behavior change techniques. On screen one, you'll see that the app is actually providing a material incentive for people to join, to join this app to use this solution to pay the debt faster. On the second screen, once the participants join, you can see that they are getting actual practical support because the app immediately pays off the chunk of their debt, making the behavior of paying off the debt more likely to happen because it makes it easier. And then on the third screen, you see that it creates the technique, the method present to self-monitor the achievement of the outcome or paying off the debt. Our second example is a website or a crowdsourcing platform that is designed to help fund career opportunities for people experiencing homelessness. You can see here that there are three behavior change techniques that you can spot right away. We can start with self-monitoring of the outcomes because you see that Matilda is trying to raise funds for becoming a hospitality worker and there is a special amount that she is targeting. The platform allows her and her supporters to see and monitor how well she is doing towards achieving this outcome of getting the funding. So getting the funding is the behavior in this case. Then she is getting social support, the practical support, because people can contribute to her fund. You see button number two. And then you can also share the campaign that is also a support so that can get more awareness for others. And then finally, you see how others are thinking about this. You see the number of supporters. You can see the different comments from people who funded the campaign. So that actually provides you, Matilda, people who are viewing this page information about others' approval of this behavior. And then our final example before we jump into our BCT scavenger hunt is a Cancer UK smart bench. So this bench is a really interesting physical object, an example of delivering behavior change techniques in the physical space versus more common digital. And you can see here that number one is obviously you're adding a bench. And you're adding the object to the environment to facilitate to prompt people to donate. So you don't expect them to learn about your website. You don't expect them to open the email. You actually are inserting the intervention in the environment through this bench. And then you put the visual and verbal communication on the bench, communicating to them that this is a credible source. This is a Cancer UK organization and number two. And then number three and number four kind of go together and they often do go together is providing instructions on how to perform behavior because it shows that and tells you tap here to donate and to make sure that people to minimize demands on mental resources. It tells you exactly how much you should donate. So that's kind of the example. And you've seen a digital app, a website and the physical object of how these techniques could be integrated in a solution. And now what we're going to do is we're going to do the activity of finding the techniques in the existing solutions. So just a few things here to note the difficulty will be increasing. So first we'll ask you to find one technique, then we'll ask you to find two techniques, then four techniques, then five techniques. So hopefully that would work. And then you'll have one minute for each of the slides. Again, you'll see different examples, digital apps, websites, physical products. So let's try to get started. If you have any questions again, please put them in the chat. And here's our first example. Okay, so we're going to time one minute before we reveal what's the answer. And the question is which technique, which behavior change technique do you think this solution is using here? There's only one. So just put one number. There's numbers next to the techniques in the boxes. Feel free to put the number. Let us know which technique do you think this solution aiming to reduce litter is using. Okay, start seeing some numbers coming in. And in about 40 seconds we'll do the reveal. So feel free to still add your number. Which technique do you think... Which technique do you think it is using? Numbers between one and nine. Okay. We've got six, seven, four, six, four, six. We've got eight, nine. Okay, more nines. Okay, so we can do the reveal. And the technique that this behavior change intervention or physical object in this case is mostly leveraging that you can observe is that it's adding object to the environment to make it really easy for people to do the behavior. There's of course others. And actually I agree with Dave and Daniel who mentioned number four because in a way, indirectly, if you think about that the box front is transparent and you see other people doing it, I think that in a way that is information about others approval. So it's not information necessarily about others approval as it relates to the long-term goal of SDG number 14 and avoiding having the cigarette butts in the ocean. But it's definitely helping to communicate that other people are using this intervention and they're also dropping their cigarette butts there. So yeah, great guesses there and some good engagement. So let's try one more time. We have four more examples for you. So this might be something familiar to you. That's a fundraising letter, a donation prompt on the website or in the digital app. Once again, which two behavior change techniques do you think this solution is using? In this case, again, this is a letter. You'll see that there's two behavior change techniques plotting numbers between one and nine. Which two numbers is the solution using? Which two techniques do you think are here? So we have two and three. We'll have another 40 seconds. Other answers, two and five. We have two and nine. Dave, you can add one more technique because there's two hiding here. If you have any other guests, thanks for Shaila. Okay, we have three and nine. Okay, Dave is two and three. Shaila is two and nine. Okay, we have another 20 seconds. Any guesses for which behavior change techniques is this fundraising letter trying to leverage? Two and five. Okay, let's do the reveal. Okay, it worked. So we have, whoever you have guessed, I know that they're partial correct guesses. There's, again, some argument for number two, for example, being present as well. But the most prominent, the most active ingredients of this fundraising letter are credible source. And we highlighted the logo of UNDP in the top left corner. And then framing and reframing. So like why framing and reframing? If you read this letter throughout the whole text, there is not so much or any mentioning of donation. It's always being referred to as making a gift. So it says make a gift to create this with your gift today. So this is the implementation of the technique of framing and reframing of helping people see the behavior from different perspective. And that's what we see here as the behavior change techniques. And as for number two, I think that, again, overall, you could also say that providing instructions as it relates to how much money you should donate or helping you decide exactly the amount that could be also identified. But the main, the most prominent would be credible source and framing. So you can note those. And great job on doing all the guesses. We have three more examples. So this time we'll have a look at, this time we'll have a look at community-based programs. So this community-based program is tackling SDG number three. And it is focused on empowering communities to adopt farm-to-table organic lifestyle and it provides trainings. It's providing the courses. So you can see, again, from some of the screenshots of what is happening during this in-person intervention, what is the intervention based on. So please, in the chat, post your guesses on which two techniques do you think you can observe or identify which two behavior change techniques. Do you think this intervention is leveraging? We have two, two and seven. Quarantine, we have two techniques on this one. So if you have any second number that you'd like to add, two and seven, three and seven, four and seven. So two and seven for quarantine, two and seven for Kirsten, two and six for Lynn, three and seven for Shayla. So people are convinced that seven is there. Almost everyone got seven. Okay. Okay. So let's do the reveal. Which techniques does this intervention leverage? Okay. So almost everyone got number seven, social support practical, actual courses. Those are the trainings. People get practical support and being taught how to cook healthy recipes. And there's, I mean, in any of this interventions they'll be sharing. There's a lot of behind the scenes and other components that many of you have guessed right. But as it refers to this one, you can break it down into instructions on how to cook or how to perform the behavior and providing practical support of actually helping you to do this. Okay. And really, really good job on guesses. I think that this one was one of the best rounds so far. We have two more and as we promised, they're becoming increasingly more difficult. There's two more interventions, one of them digital, one of them physical. And here we ask you to think about what are the four behavior change techniques that this one single screen in the app that is helping you to save unsold meals is using. So this is just one screen, there's more, but in this screen only, which behavior change techniques can you see four numbers? Please. And you have one minute. This became too difficult. Any four change techniques if you're not sure about the four, feel free to drop in the numbers that you are more certain of. Okay. So we have two, four, seven, eight. We have two, four, eight, nine. That's good. We have three, four, eight. Two, four, eight, nine. Two, five, nine. And a few more seconds. Eight, nine, two, four, three, four, seven, eight. It's like a lottery. Okay. Let's do the reveal. One, two, seven, eight. Okay. So those of you, actually Jacqueline got it. Absolutely right. Two, four, eight, nine. Congratulations. So instruction on how to perform behavior. Information about us is approval, material incentive and framing, reframing. Just to highlight a few, you can, if you basically look at the, at the right bottom, no, upper right corner, you'll see the number, right? The dollar sign. So it tells you that if you buy this, you'll save money, the material incentive. If you go where you see closer to the bottom of the screen, the rating of how other people's rated it. That's practically the information about others approval. Like 4.5 stars, five stars. Framing and reframing actually refers to the middle part. Instead of saying that those are leftovers or things that are on sold at the store. They actually talk about throughout the app and in this middle part of the screen as delicious food. So it's delicious food. Delicious food left or delicious food from the store. So they're trying to reframe the language to make it really appealing to people to participate in it to buy the on sold meals. And then finally, the instruction on how to perform behavior. There is the actual like time when you can collect it address where you can collect it. So all the details and really good job on guessing different techniques. Basically, this is going to be something that can help you spot them and see them and identify them. Not only in this solutions, but in yours, in your program, in your initiative. And now final one. This is going to be a difficult one, but that's the last one for behavior change techniques. So this is a really, really cool intervention that was designed by a group of students in the University of Washington. And what it is, it basically is an insert flushable paper product that you put inside of the sanitary pad to help communicate to victims of human trafficking, which like how they can, who they can call and where they can get help from. So you need a whole product, it's a physical product. Now, if you can think through which five behavior change techniques, do you think this product is leveraging? There is, I think that many of you will probably see other techniques as well, which is excellent because there probably is more, but five, we definitely want at least five numbers from you. And we'll have one minute again to think about which ones we have here that are helping drive this behavior change. Okay, we have six, two, seven, eight, five. Yeah. We have two, five, six, seven, nine. One, two, six, seven, nine. Two, three, six, seven, nine. Six, seven, nine is definitely two, three, six, seven, nine. Two, five, six, seven, nine. I'm trying to remember what those are. Yeah. Just by numbers. Six, two, seven, nine. Two, five, six, seven, nine. Okay, it should definitely be six, seven, nine. Yeah. There's too many of those. Two, five, six, seven, nine from Daniel. Two, six, seven, nine from Darren. Okay, let's do the reveal. Which behavior change techniques is this product tackling human trafficking leveraging? Okay, so it's two, three, five, six, seven, nine. Okay. Did anyone get it? Absolutely right. I cannot see. I think that, I think there's too many nines. I think that Corentin got close. Six, two, seven. Yeah. Six, two, seven. Okay, so yeah, let's just quickly go over some of that and then we'll jump to the second activity that hopefully is going to be equally fun and similar examples. So, okay, we have here, if you were thinking of, okay, let's say, like many people have answered nine as framing or reframing. In this specific case, if you were to zoom in and look at what this intervention is doing, it's not directly doing the framing and reframing because it still is using the same words, it's the same terminology. Like if you read it, it still is talking about, like, have you been a victim of trafficking? You know, like the imagery. So it's very much, you know, direct communication about the problem. So framing and reframing would be, for example, if, you know, like in the previous cases we saw, like donation that might be considered as negative is being reframed as a gift. Leftovers that might be seen as negative is being reframed as delicious food leftover at the store. So that would be more of a framing, reframing when you identify that there's some negative word, negative terminology that people might be reluctant to, you know, engage with or respond to and you swap it with the same way of expressing it but positive, like you frame it into positive term. If you, so yeah, credible source. So if you zoom in on the first, so the object is itself the object, that's an insert, I thought that was, like that should have been part of almost everyone's response. The credible source, if you look at the left part of the insert, there is actually a priest, a doctor, the victim, and I couldn't figure out who the fourth person, but there is this imagery that is supposed to communicate to you that like those are, you know, like kind of cover all the different credible sources that could be providing support to victim. They are not actively providing support to victim, but that is the imagery because credible source is about communicating that this is delivered through or approved by credible source. Again, they probably have done research, this team have done research to say that a priest, a doctor, and this fourth person are the credible source when it comes to victims of human trafficking, which might be different in other cases, but that is the element. Yeah, and then basically instructions, the code itself, and it's so cleverly designed because you actually tear the number off and it gives you the instructions like tear, flush, call on the second part of the insert, that's the instruction, and you save the number and the saved number looks just like Chinese lucky cookie. So if the abuser finds it, it's not going to be attracting the attention, and it's conserving the mental resources too because you don't ask the victim to remember the number that you need to call, you actually are giving them this tool, so it's really clever intervention. Okay, and on that note, we're going to just show that we're not running out of time, we're going to do some key takeaways from the behavior change techniques. One key takeaway is definitely that behavior change techniques are, and many of you throughout this activity have tried to spot them, identify what they are, so they should be observable and replicable, and they are basically active ingredients of your intervention, of your program, of your service. They are the things that make it work. They are the ingredients that facilitate the change of behavior. The number, as you can, you know, if you go back to five examples that we shared, the number can vary. You can have one behavior change technique, being active ingredients, you can have five, or sometimes you can have 15, if the behavior is really comprehensive or the intervention is complicated. It really depends on what you're trying to solve, and then other two important things, when you're thinking about designing your impact program in sustainable development, if you're thinking about it, and you're looking at the outcome, and you realize that the outcome is driven by behavior, the best thing you can do is to think about behavior and behavioral science as the core, as the core foundation to your intervention, rather than a sprinkle on top, and if you think about it as the core, you basically go back to these behavior change techniques, and you think about how can these behavior change techniques be translated into the messages, materials, and activities. So instead of thinking how can we nudge someone to use my product that might not be that engaging, you're thinking of what is actually my product trying to do, what are the active ingredients, or what Dustin will cover in a minute, what are the functions, what is my intervention function, what is the intervention trying to do. And finally, behavior change techniques, as you have just observed in the last 15 minutes, can be delivered digitally in a physical object, in-person interactions. So it doesn't really matter what is your program or service, almost certainly you can build behavior change techniques, you can build behavior change strategy inside of your solution. And now back to Dustin. Thanks Olga, that was great, and thanks everybody for your participation. More to come. So as Olga mentioned, the behavior change techniques, you know, we focused on nine out of 93, right, to give you a sampling, something digestible that we could work with, those behavior change techniques are the active ingredients, the what of your intervention. When we think about the goal of your intervention or how it's proposing to work, we can think about these nine intervention functions, and there are nine, so that's good. These encapsulate broad functions, right, or descriptions of what our intervention is doing to change behavior, right? When we think about these large buckets or these large categories of how we try to change people's behaviors, we can think about it along these different functions. We can try to educate them on what it is to do, how to do it, and if it's a good thing, we could train them to build skills. We could try to persuade or convince them through communication. We can provide incentives. We could try to coerce them, right, to create an expectation of punishment or setback. We could physically change the environment to make it harder to do through restricting, through rules or laws or other objects. We can change that environment to make something harder or easier to do. We could model the behavior, like we heard a lot of modeling within the social support or at least in the chat channel around seeing other people do it with the Ronaldo example, was that modeling or not? Or we could try to provide resources or make something easier to do for an individual population in one way or another, right? So we can think about these broad categories as descriptions for what our intervention is doing and how it's aiming to change behaviors, and we can apply that to the same kinds of interventions we just looked at earlier. So when we think about, you know, we're going to go right back to the start in where we define those very specific behavior change techniques, we can also come up to that level and think about the intervention function. So in Tali, when we think about what Tali is doing in order to help people get out of debt faster, we are incenting them, right? We are, in fact, the application is helping people to save that money and it pays off debt or part of the debt. The behaviors that we're targeting, spending and saving behaviors become, you know, amplified or facilitated through the incentivization that the app itself applies. And it enables people to save and to change spending and saving behaviors through the things that they can do with the application and the service. So we incent and we enable. When we think about Matilda and we think about crowdfunding and, you know, helping people get a leg up out of homelessness, the techniques that we looked at before, some of those granular techniques, bubble up to modeling, right? Showing the expected or the wanted behavior, right? So we can see here through that technique of support, we're modeling the behavior, right? We're showing the support of others, making that visible to everyone who comes to this site. So we're modeling the expected behavior. We're giving them a giant button, a way for people to make those donations. And we are using persuasion, right? 25 people need your support today, right? We're convincing or we're tying into emotional appeals to sway or to convince people to make those donations as well, right? So those are those techniques there. When we look again at the smart bench, right? You would simply just look at a smart bench and think, well, that's not a heck of a lot, right? But there are a lot of techniques baked into it and there's also a high number of intervention functions here. We're changing the environment, as we talked about. We're placing a bench into the environment. Again, we're modeling the expected behavior here as well. We are persuading individuals to make those donations. And then, as Olga spent some time talking about the very specific techniques here within making it easy to do, we're enabling that behavior that we've targeted, making a donation, we're enabling it to be done in context in the moment right there where we are. So we can think about, again, how adding objects to the environment bubbles up to environmental restructuring, how we might persuade other individuals with this intervention and how we make the expected or wanted behavior very easy. So we can think in terms of these broad categories. And often, this is where many of us do spend our time or how we do think of our goals for our programs and services and initiatives. And this gives a language and a category in a framework for doing that. So let's take a spin through those activities again and see how quickly we can spot intervention functions in the same interventions we just looked at, products and services. So if we go back to Ronaldo and Messi, I didn't add numbers, sorry about that, which two intervention functions do we think this cigarette box is using? I'm going to type more letters this time. Okay, we'll give you a little bit more time because you might need to type letters. So yeah, which two intervention functions is it using? Feel free to post it in the chat and we'll do the reveal in about a minute and a half. Should have given you numbers. I didn't do a good job enabling. Okay, Shayla, environmental restructure and enablement. Thank you. Another 40 seconds. Any guess on... Okay, we got education and enablement, environment and enablement. On the other hand, maybe that would lead to remembering that the function's better than the techniques when you have to type them up. Could be a good thing to test. Environmental and enablement, okay. Any more guesses before we do the reveal? Five more seconds. Environmental restructuring. Boom. So very similar to adding objects in the environment. The names are almost one in the same. We're restructuring the environment. We're changing a person's environment. We're adding this to the park. The modeling could be the expected behavior instead of seeing a pile of cigarettes on the ground. We are seeing the cigarettes in the question boxes. There is a good argument to be made for enabling as well. We're now giving individuals a place that's different than the ground to throw their butts. But the argument could also be made that maybe there's a trash bin right next door or by that people aren't using. This gives them an added prompt with a bit more behavioral techniques baked in than a regular everyday trash can. But enablement I think would be a very close third. So structuring and modeling through the visualization of the butts where they lay. All right, we'll keep us moving. For the next one, we go back to the fundraising letter. We think about the content and the structure of this email. It is relying on two functions to urge those donations. Which two do we think are present within this email? Okay, time is on. About a minute and 20 seconds to find two intervention techniques and type them up in the chat. Okay, we have education. Go ahead, Dustin. I'm still in your life. It's all right. No worries. I like it. Your voice is nicer. Education in sentence. Persuasion and modeling. Two different. So we've got four different techniques in here. Another round for persuasion and another one for education. Are we educating? Are we persuading? How did we know which? Modeling has popped up as well. Can we see? Can we help others see the wanted behavior? Modeling. That was your timer, in fact. All right, let's do the reveal. Persuasion and enablement is where we would classify these. Enablement clearly here with giving people a big call to action for how they can make that donation to one click or two clicks to do that. Much like the cancer UK, same thing, tap to pay. Sometimes we can get a little, the lines can get a little blurry between education or persuasion. Are we teaching people what to do, how to do it? Or are we convincing them that it is a good thing to do through communication, whether that's through words, whether that's through imagery. We can take a close look and make that call. It's a little bit different between appealing to facts and thoughts versus maybe appealing to emotion or things like that. Here, with the language, we're focusing on persuasion versus education, the way that the copy or the text is framed. You can take a look at that when we make the deck available and see if you agree. All right, the next one. If we go back, there are two here as well. When we think about refresh live, which is bringing cooking classes, demonstrations, fresh foods and vegetables to communities that need it. What two intervention functions do you think this program is using to help people adopt and sustain healthy eating lifestyles? Okay, you have one minute. I see modeling and education. Great. And we have three minutes. Education and enablement. Education and modeling, again, two for that. Great. Another round of education and modeling. Any others rolling in? For the purpose of time, because we have only four minutes left, let's just say time and do the reveal. Sorry, skipped it. Oh, ha! There is three. Surprise! There's three here. So this is a helpful distinction between education and good one and training. When we think again of education, targeting knowledge, informational knowledge about the state or shape or reason of things, training very specifically can focus on the building of skills. Those can be physical skills or mental skills. But here, we're teaching people about fresh food but we're also training them on the skills it takes to cook that food. A fine distinction, but we do like to think about a differentiation between education and training. Training often involves practice. That's a really great way to separate those two. Does this behavior involve or improve with practice versus necessarily a one-time information dump? And then modeling as well. We're showing or demonstrating the expected behaviors too. Here, when we think about other components, there could be different interventions as well. And we have time. We do. We've got time. Let's see if it's really two in this one. But one more, the good to go app that helps people pick up not quite inspired food to... That's not the most beautiful framing, but so that it doesn't go to waste. Delicious end-of-day food, what-to techniques or functions are being used here in this intervention. Okay, the timer's on. One minute. And then I think we'll bring us home. Who shall be the first? As you are typing up the responses to which two, and we don't know if it's two because Dustin will reveal and we'll find out. So if you see more than two, please feel free to add more than two. If you have any questions, I'm not sure if the room would close at 3.45. So if you have any questions, we'll leave a slide with our emails, and actually I'll type in our emails in the chat. Feel free to send them over in case we wouldn't have time to answer them live. Time for reveal. All right, so we see incentivization, two for enablement, so let's hope that's on there, and one for modeling. All right, what do we think? Boom. Yes! Nice going, Jacqueline. Incentivization and enablement, right? We're giving people the means to change their behaviors and to reduce food waste, making it very easy for them to pick up food on location, and they're incentive to do so, right? We get a good volume of food for a way reduced cost, and not just for the benefit of not wasting food, I'm going to get us to the end, but also, you know, there is a value trade-off as well. So again, to wrap us to bring us home, intervention functions, broad categories that we can think of in addition to behavior change techniques, they serve more than one function. We can educate and persuade. We can enable and change the environment. They describe what our intervention is doing to change the behavior, while the techniques describe the how, and using these individually or especially together really helps with the planning, designing, describing, and evaluating the program services initiatives that we use, and is a great way to get evidence-based frameworks integrated into our design process. Okay, I'm over. Thank you, Dustin. Thank you. Final thoughts. Naval science is about so much more than nudges. Hopefully that's one of your takeaways today. If you're trying to improve the outcomes that are driven by behaviors, make sure that behavioral science is actually helping you design your program materials, messages, and activities, and is not just sprinkled on top in the end. And then, just for you, for what's the point, what's the value, if you actually understand what is your program, what is your solution doing, and you can break it down into the components of what are the ingredients, what are the functions, you're actually going to be so much more successful and being able to continuously test and improve it. And that also would impact your outcomes that you care about. So thank you so much for joining us today. We hope that you learned some stuff about our emails in the chat so you can reach out to us with any questions you have. And also, you can find links in the chat to some of the materials. And if people are interested, we'll also share the deck, at least with those two. Email will already acquired. Feel free to post yours as well. And we'll check with the organizers if there's a easier way to share the deck with everyone as well. So thank you all.