 Last session of the day, and then I guess there's a panel at the end of the day or what do we have? Keep everyone guys are passionate. You want to go to Lee at the very end. Awesome All right, well Hopefully we'll have a little bit of fun today This is an opportunity to Run through a simulation where we can be it's going to be going from all sorts of Chaotic to even more chaotic here as we get going so the Confusion to chaos So this is a value and certainty game My name is Todd little VP of product development for IHS They took a data analytics company Let's see if this is going Okay, I was gonna look at the jelly beans we do that if we still have time at the after finishing this We may do a little jelly bean experiment to So how many of you were in the talk yesterday myth busters quite a few So I left you with a click cliffhanger here now what so we're gonna do a little simulation of sort of both now What so they're just a quick review of what I just went through yesterday First of all, we had a test we did a bunch of tests a bunch of tests of different things Up and then we looking at whether we actually have how good are we at estimation? A little bit of gratuitous humor here Go through this quickly little stories. We basically suck at estimation. I think we know that So is it understood? No, we are not very good at estimation. We're gonna experiment some of that today Significantly in estimation accuracy significantly improves as the project progresses is basically the cone of uncertainty That's pretty much not true either estimation uncertainties pretty much consistent Estimations are frequently impacted by biases. Yeah, that's pretty much true We're pretty good at estimating things relatively. No, we just suck in a relatively different way Velocity is a good tool Yeah, that's velocity or throughput cycle time. Any of those are also all good techniques For improving getting better data. We're a bit behind but we'll make it up in testing. Nope. We're not gonna do that Scope creep. Yep, we got scope creep Having more estimators, this is the wisdom of crowds. Yeah, that can that can definitely help Or more people involved in the estimation Project success is determined by on-time delivery It some organizations it does unfortunately, but we want to move towards more value oriented outcome Oriented view and then estimation is waste. I'm look at let's consider that plausible so So now what so let me go through how I how I have coached teams to to work And I found that this worked very well for me in getting dealing with the trade-off of what's the right level of estimation? What's the right level of predictability that we need? The particular exercise we're gonna go through where you're gonna live this Call the simulation exercise. You're gonna get a set of stories. I don't know if the stories were already handed out Okay, you're already looking at them. You're already cheating. Okay, that's So he's gonna be a set of stories and on each story You're gonna have a sum of you're gonna have a value proposition and then you're gonna have a test Okay, and you're gonna be looking at the common as a trade-off between the value proposition and the cost Which is the cost is your estimate of how many roles it'll take to make the test Okay, some of them are very easy. You'll almost certainly make it in one role. Some of them may take multiple roles Okay, so that's what we're going to be looking at is two sides of estimation I consider estimation to be to be two pieces one is a value estimation the other is a cost estimation Both are necessary the primary part of the primary thing you're trying to do is Understand what your priority is because you want to work on the things that are the highest value for the investment Okay, so in order to do that you got to know a little bit about cost get a little bit about value If you want to assume everything's the same cost and go through in no estimates that can be done It may or may not be a good idea a few What I use something called ABC is a prioritization sort of keep it very very basic a lot like Moscow anyone here familiar with Moscow Remember with Moscow. I Don't like Moscow for one particular reason and I think it's the power of language Moscow uses must shoulds and coulds So must is pretty obvious the one I hate is should because if I don't deliver on a should that sounds like I'm bad So I work a little bit differently. I said that there's a's which are must The nice thing about ABC's is it's very basic It's I call it Moscow for preschool or sometimes But it everyone seems to get it pretty well, and it's also doesn't have that same loaded loaded message So a's are must be completed The B zero wishes, right? The shift in wording from should to wish is very significant Wishes are things that when you get them you're happy Okay, as opposed to shoulds and when you don't get them you're unhappy It's a very significant difference in the relationship You have between the development team and the business of the product manager And then season the things I think are still valuable, but they're not they're not even in the consideration They're not in the target I'm only going to be allowed as a product owner to communicate to customers based on a features I can't talk at all about B's and C's and the other when you we're looking at the overall release plan If more than 50% of the effort allocated to a items It is either allocated to a items and I consider the release plan at risk I want to build in enough buffer that I can deal with what I know to be sort of the very the overall normal variation in estimation This is sort of this is the approach that we're going to be working with today As I go through this this the reason this approach generally tends to work pretty well is this as I'm looking at a timeline here You know, I've identified You're working with the marketing team and what with other parts in the business We generally come together and we say this is sort of Nominally our target that we're working with and we might be doing some rollout or something If I start to plan this out and I look at the a's it comes There's only half the time That's my backlog. That's my initial plan What I'm actually going to deliver This is you know This is if it was sort of in a general what we've seen when we've been recording this if it on average We'll deliver our a's and we'll be About on target if we if we have adjusted ourselves so that our bias is counted for because you know First thing is you got to know how bad or good you are and once you know how bad or good you are You can adjust your bias a little bit with your historical data so that you're if you're always coming in Underestimating you can correct for that But if we deliver all the a's then we have some time left over it turns out that by the time the product owner You know learns more information Some of the C's turned out to be more important than some of the B's and we come up with some items There are D's that are totally new that we discovered in the process So that'd be a typical but if we have a particularly bad situation The only thing we may deliver is a we may have a situation where the uncertainty is so great that all we deliver is a And this gives us the ability to balance the overall Uncertainty and still guarantee to the business of the product owner that they'll get the things that they absolutely have to have So the structure I use As I said, I consider estimation Typically in our industry estimation is used mostly for cost I I consider that estimation is predominantly is a value and a cost situation and it's predominantly driving the business question What do I do? When do I do it? So it's a priority if I'm doing prioritization to me if you're doing prioritization You do an estimation because you're estimating a value and actually what you're estimating is not just a value You're estimating a value per return. Okay, so how I like to look at I look to look at them both at the same time some structure in terms of just ballpark T-shirt sizing small medium large extra large if you feel more comfortable putting numbers around that go ahead Similar on the cost side, okay Then priority is driven by the trade-off things up here in the green are the good things do those first Things down here in the red Do them last or don't do them at all, right? It's not, you know, that's very low value for the return Very low return for the investment Well, you get into these It's a bit of a trade-off question, right? Because nominally This is a set these all up and down that so this is that's what we're going to use now Does everyone have all the we've got cards out? Okay, what's that? Okay. Oh, yeah, yes Okay, okay, we're gonna have any hanging out so what we're gonna do first You've got a set of stories, so Let's go through a good look at the story Pull up a couple of them have a couple of them out there, and we've also got some Actually, you think I should hand out the score sheets later later. We'll get started on this first, okay? So on your table is already This chart, okay, everyone's ready to already get really started on that What we're gonna do is we're gonna look at all the stories that we have So actually maybe I can Get two stories for me here A one and two. Oh, okay. That's fine. Okay Maybe just borrow one. Can I borrow? Story one and two. Oh, you don't have it yet. You have it Okay, I'll take this one I'll get it. Okay. I'll take story one and two Okay Okay, so you each have ten stories to work with all right So on there just as you're going through and looking at them There's a value proposition, which is what you're gonna get and there's also a Test and the test is an indication of how what the cost is going to be I'll just give you any go we'll go through an example story that we're working on so we're gonna in the process of doing it so you can get Essence of what we're gonna do we're gonna run we're gonna pull this story into the back like so this is a story We're gonna work on we're only working on one story at a time when we pull it in So here we roll the dice The test is to roll three dice Pay no attention to this fourth dice It was they have a more a more complicated version of this in which case we always run four dice But this this version if it says to roll three dice only roll three dice, okay? And the test is so this is the three dice We're looking at and the test is here roll three dice and two or more dice are the same So in this case we don't have two or more dice the same So we fail this test okay, so that cost us one roll that was one one But we continue to work this story until we get the test and here we roll it and now we get a three a three in A one okay Passes the test okay, so what's the value? Seven awesome You learn that from the Russia's program that doesn't The rest has his math calculation thing so at a high level here's what we're gonna do We're going to run three iterations with ten rolls of the dice per iteration So just so you have an idea of how big this thing is We're working on one story at a time Your management wants you to commit to six stories for the release They said commit to six stories for the release and when when you're pulling it into the iteration since there's three iterations They would say let's pull it. Let's go to get you to commit to two stories per iteration That's their decree to you six stories for the for a release and two for iteration We're gonna score points for accepted stories and then this is just a thing values just an estimate at the end We're gonna do some magic and some other things will happen. So keep you in suspense on that So now the next step we're going to do is release planning So in the release planning your first step is to look over the stories and then you're gonna look at whether there's the The cost is going to be in the small medium or extra large You're also going and that's going to be along the x-axis You're gonna look at the estimating the value that you're gonna get from it And we're gonna do a lot of relative estimation right once relative to one another We'll then do the prioritization based along the diagonal and you need to commit to at least six stories Okay, we're gonna keep keep track of two types of value which is there's value points and there's committal points So value points we're going to do based on the value of the dice That the test says and on the commit basis you'll get ten points per committed story that you make But if you don't make one you get zero okay, and The same thing on the iteration you're gonna get well when you get to the duration you go five per iteration So right now focuses on release planning. Okay, so we're gonna get this going on release planes I'll come back and go through a little bit more on the iteration planning pretty clear not clear Not clear. Okay. That's fine. It usually usually takes a while to get things going so what we're gonna do I'm gonna give you Yeah, okay We're gonna start with this baseline We'll take each of the two store so I got two stories here story one and story two So I'm not gonna look at story one story one says Roll three dice and two or more are the same. This is the one we just did Okay, yeah, we ended up with more people here than I thought I brought a bunch of dice thinking that Yeah, if you yeah, okay, sorry about that. I Was expect I was expecting to have about six tables But but we've ended up with 12 so that's forgot about that. Okay, so so we have two dice to work with and we'll figure We'll improvise here. What's that? Yeah, yeah, so we just that's it was a distraction here So let's get back to the yes to the release planning side. So release planning what we're gonna do is we're gonna estimate these stories along the diagonal here So this number one roll three dice and two or more are the same Where do you think? How how hard did that look to be pretty pretty simple simple medium somewhere? Yeah, there's a there. Yeah, let's just say it's medium. Let's we'll start it as a medium I don't know whether it's where it really is we're gonna start it's a medium and then the value is the sum of all the dice So there's three dice involved and we're gonna sum it up Medium I will just say let's just say it's in the middle here Okay, so we're gonna start with that then what we'll do is we'll take that because it doesn't matter if this Is in the wrong place we can just adjust it later with this check things around What we're really trying to do is get a judging place here. So value number two is We're gonna roll four dice and two or might more of the same So when we roll four dice and two or more of the same is that easier or harder than the first one Easier it's easier. So it's somewhere. It's somewhere to this side and then the value is the sum of the matching dice It's gonna be more or less But only the matching dice realize Matching dice so most of the time it'll only be two dice probably right sometimes you could might know if you get three matching But so probably down here just this is a guess. It's so it's probably like that That's the relative work You're gonna be doing and we're gonna map it out and if this happened to be in the wrong place It's not that big of a deal because it may just be you may be skewed one direction or other because all you're looking for is this relative priority to work from That makes sense Okay So we're gonna start with this section and then we'll we'll go into a little bit more detail. So I think these are yours here, right? So everyone should have ten stories Everyone should have ten stories. We won't be doing anything with dice for a little bit So so we're just gonna be working on creating the the estimation backlog. All right Yeah, give him five minutes. Let's give him six. How are we doing on time 20 minutes? This should be fine Okay, hey take Yeah, but I don't want to distract them too much. Yeah Give them hand them out, but don't see you're gonna take two each one of you take you take two you take two Yeah, one three that's from one table Yeah, some of them have it but not all of them do so they just all of them need one of those So we'll just make sure they all get it And I've got some spares here. I've got some Here I think this this this this and this is another one What's this? Oh, maybe that's this one Number six we can find a six We may have to make a six out of here. Okay. I have a six. Oh, yeah, make them a six Yeah, make a sick just get carried up Make sense I Don't know We should have enough should be just enough probably I think We have Just one time you just get one die one die. Well, yeah, so the cost So you're sort of Blocked out of it. It's gonna get chaotic and it's gonna get more chaotic as we go So it starts from confused chaos to just sort of really Energetic chaos pretty soon. So let's let's let's take a step check and checkpoint checkpoint Okay, so it looks like people were making pretty good progress. Is anyone just totally stumped here totally stop Everyone's making some okay progress. Okay, that's okay. We don't have to absolutely be done. What I need now our Step right now. We've got our things laid out And we're gonna be committing management wants you to commit to six stories for the release Okay, so we're gonna be choosing our top six stories and how we're gonna be doing that is by looking at the matrix and Working down the diagonal working down the cross diagonal there. Okay, that's they're gonna be your next step It's a sign up for six stories. Okay What we have also we've just passed out Every team should have a score sheet Okay, okay. Hey listen listen up. Listen up Every team should every team should have a score sheet. Okay That we hid and told you to not look at now We're gonna look at that a little bit on the score sheet. I'm just gonna get it for hot There's two of them one is gonna be your score sheet that you keep during the iteration I'm not gonna worry about that one right. I'm gonna come back to that one The one that matters right now is this one which is sort of your layout of your release plan What we're gonna do for each story You're gonna mark it here quickly whether it's an a b or c and The a's will be your top six. Okay, you're gonna have at least six that you're gonna commit to that are a's So you're gonna mark on the score sheet which six stories you're committing to for this release Okay, you've got to commit to at least six on Some of them are marked on the on the cards. Don't worry about the cards themselves. This will be on the sheet on this score sheet Okay, yeah, we reused the cards from and we did this at my office the other day And so we reused the cards and some of them have some markings on it. Okay, what's that? the category This category Okay, all right, so Is everyone understand where we're out right now with the score sheet, right? This is what their next step is going to be to commit to six stories Mike oh Mike Mike Okay, Mike Mike, okay Remember when the power goes out the Mike goes to okay All right good now what we're also I want to just go through just sort of how this is gonna flow a little bit too Just give you now now you're gonna sign up for six iterate six for the for the commitment When we do it we're gonna go through three S three iterations of ten stories and Actually, let's we can come back to that. Let's go ahead and get the the sign up I'm gonna give you We should be everyone should be pretty close to being able to do the sign up So let's give them a two three minutes or what to do Yeah, really just take the commitment, okay? six stories Management wants to commit to at least six stories for the iterate for the for the release For Larry, then we're gonna get into the iterations and we'll work and that's when we get to roll the dice Then we get to play with the dice. Okay Good hand. Okay, so give you a couple minutes here to get your to get your release plan done When your team has your release plan when you have your release plan done raise your hand, okay? Is six story we've got your stories When you've got your stories bucketed into a B's and C's Get your stories bucketed into a B's and C's the a's of the ones you're committing to for the release You have to you want to commit to you have to commit to six so that there have to be six a's Yes, so even so your B's what your top B's will become a's based on this. Okay. Yeah. Oh, you're not supposed to have those. Oh Does anyone have more than ten Is it only one group that had that that must have been the I guess that was me who handed that one out Everyone should have ten Release commitment Awesome, good job People are getting close here We're getting the top six stories will all be a's your six commitments will be a's. Okay. You're good. Awesome Anybody stuck ten six a's Six a's yeah, so there your B's will become six your B's will become a's Yeah, and then you're you can decide how whether you want to call the rest C's or B's But right now we're gonna get them we're gonna end up at this six a's and then the rest of these B's are C's and And you have and you have sort of a priority queue Right because we're asking you to commit to all you will we're working something faster perhaps It's still prioritizing who does not have their priority queue those six a's they got their commitment six There should be a six a's is anyone not there yet You're not there yet. Okay Okay, let's see what we need need some help there actually maybe about we're not too bad all right who We still people are starting. Are we ready to start getting okay? No dice No rolling of dice yet. No, we shouldn't be playing. Okay. Are you already rolling? No, no, no don't don't roll yet. No dice that I know everyone's anxious to get moving I but we've got we've all got to go at the same pace and everyone has to help that team back there All right. All right. All right. Now if you don't have six stories signed up right now Management is gonna be very mad and sign them up for you. Okay, everyone have six stories signed up. Yes. Yes Oh, that was really fast now Hey, that works it works I'm playing yeah, it works. All right. You get you got signed. Okay. All right. We'll be checking Would you okay? We have six we got six stories signed up. We're committed to now. We're gonna get into iterations Okay So for the first iteration, we're gonna go into iteration one Ten rolls of the dice each dice each dice roll is you check it against the test, right? If it test passes you do it So we're gonna estimate the first thing we're gonna do we've got a release plan We don't have any new stories coming in right now We're gonna ask we're gonna adjust we pretty should be pretty good with this for the first iteration Now we're gonna sign up management wants you to sign up for at least two stories for the iteration commit to two stories For the iteration. Okay, so we're gonna pull your your stories that you want to pull in Now based on how you commit here You can get five points for committed story that you deliver in the iteration if you don't make that commitment it goes to zero Okay That means zero forever for the whole for that that whole iteration for commitment Okay So if you commit to two stories and you don't make it you get zero if you commit to two stories and make it You get ten points Okay Couple of special actions just so you know, too If you get stuck on a story and you don't want it and you want to abandon it It's okay. You just it just you just it's if you didn't work on it. It's just dead code, right? It's also okay to redo a story, you know, we can either you redo or refactor the story All we do is we just pull it back into the backlog So we've done it but we're not happy with the value we got right so it passed the test But the value is really weak we might say yeah, let's you know We've finished our up and we're gonna pull it back in so we're gonna pull it back in Sort of like a refactoring or redoing or whatever and we just work on it again And if it doesn't pass we still can revert back to what what did pass Okay, so it's okay to do to redo it. You can't do a story to get points for it twice You just get points for it one time, but you can get the higher of the two if you if you have Capacity to work on it that way. That's just some strategy things you can work with Otherwise if we had more space, I would use a product progress board We don't have this. Yes question Within it. Yeah, you can abandon the story Now if you've committed to it and you abandon the story that means your commitment is at risk Yeah, so you get zero for the whole iteration right for that So it might more it would more likely be a story you didn't commit to if you're gonna abandon Like he maybe try something out. Okay Okay, all right keep quiet here. Let's let's keep keep going here As we get so I'm gonna say let's go ahead and we'll do the commitment and we'll go ahead and start the dice rolling Okay, okay, because I know everyone's anxious to get rolling dice because Okay, you guys it the commitment should be pretty fast here I think you got this because you already spent a fair amount of time committing your top six So we're gonna commit the top two to the iteration. We're gonna start rolling dice when we start rolling the dice What happened here? This looks funny Okay We're gonna record the dice. Yes. Yes question. What's that? Oh the color coding on the header Okay, this is just dice one dice one dice two dice three dice four, okay Normally, I would have had to have four color-coded dice and and but what we're gonna have to do is dice one dice two dice Three dice four and hey, hey listen, let's keep I know that there's gonna be some questions here on the scorekeeping So the question is what are these these color codes normally? I would have had I'd have four four of the same or four different colors of dice We don't need the four different colors. We just need four dice or or whatever it says whether it's two or three So we only have two per table Which is unfortunate, but that will make it work So if it says to roll three dice you'll have to roll two dice And then you have to pick one of them you'll have to remember what one of them was and then roll again Okay, you'll record that dice one dice two dice three, okay? If it doesn't pass So for some reason I don't know what what happened here, but what you do is you would still record. Oh, I know why this is Ignore the blank ones here. Okay, because I was this was part of my more exotic version of this But you're gonna say so this is your first day here. You roll you're gonna work on story for and you happen to roll back Okay And you get a value 60 if you passed okay You got very lucky, right? You took one of the hard ones and got a big point So what we're gonna do is we're gonna record dice the story you're working The first thing you'll do is pull the story into the to the backlog and you'll record the iteration one or Roll one of iteration one day one iteration one. You're working this story Okay, so everyone will pull out there you'll commit to two and you'll pull the top one in and that's the one You're working. Okay, you'll work that one and whatever the test says. Yes. Yes Yeah, if it says to roll three dice It you'll roll two dice and then you're all a third dice and you'll record your dice as you go. Okay, and then There's room for four iterations ignore the ignore the fourth one. Okay What so what we'll do as we'll roll the dice we'll roll we'll pull the first step you'll pull All right, all right, you guys are Crowd control tough here, man Okay, so we're going to We're going to fold first step. We'll do is pull the story in. Okay, so we're gonna pull a story What says what says what says to roll three dice? We're gonna roll two dice Record the two and then we're gonna roll the third one. Okay. Yes question Oh Okay, okay. Okay. All right, quiet What you guys excited here gosh, okay Okay, first step commit to two stories Second step pull one of those stories in record it in this in this here. Okay Next step roll the dope roll the two dice Okay, because every unless you're pulling a story in that's only rolling one dice if it says to roll one dice You roll one die if it says to roll two you roll two if it says to roll three you roll two and then you roll another one Okay, so you roll two record it and then roll another one. Okay. Is that part clear? Okay, if it passes the test if it passes the test you will record the value Okay Ignore the release and iteration commitment until you finish the iteration. Okay, so We'll just be working up to here and then the end of the iteration will figure out what you got for iteration Okay The 60 came for this one because the test for this one was that it was three numbers in a row And it was the product of the three numbers in a row. So it was three times four times five So the it'll pass the test once it passes once it passes the test you'll get the value from that. Okay Okay, once you've passed it you record the value here Okay now That makes sense for this and then you'll go on to the next one. Yes question back there if it fails you just keep moving Okay, the story stays in the queue. You continue to work on it until it passes If you want to abandon the story you can abandon it and pull a new story in you had you either What's that? You get ten rolls you get ten rolls for the iteration You can commit for more than two if you wish No, no, do you only get that you have to commit at the beginning you if you can you can also pull new stories in What's that? No, no, if you'd miss your commitment you get zero points For that it you get zero commitment points. We're keeping commitment points and value points For the entire iteration the commitment is okay everyone. Let's repeat the steps Hey, hey What time? Okay, one You're committed to so like in this case I'm committed to commit story one to iteration one Okay, so you're two that you're going to commit to will be marked at least two that you're going to commit to You'll mark that on this score The other thing that if you'd like If you want to record the cost it's optional, but it's sometimes useful you can record the cost when you finish the story The number of rolls number of rolls, okay? So those you've got to score keeper to score cards you're keeping Yes Which I the cost of the how many rolls it takes to get it to pass So the number of rolls it takes to pass so you're yeah, and you're only you're already on to iteration two No, no, no, we just started Yeah So you committed to six in the iteration Okay, so you committed to the two you committed to the two already so you committed to the you only committed to the two But you ended up pulling in five. Okay, so you now on The fourth one is okay. Yes, exactly. That's that's not a surprise new items You're working at your release commitment, right? Or you can pull get there. You can pull something in that's That's something you're that's a you just pull anything in or You finish five if you've done one iteration you've done five here Facilitators, okay Some of you may not be done with round one yet, but you're getting close. So, okay, let's take a Checkpoint checkpoint. Okay. I think everyone's pretty close to finishing round one. Okay, right? Okay We're gonna go ahead and start passing out. We've got you know product management has been out to see some customers And we've got two new stories coming in. Okay. All right. Yes, but you're ready for them, right? Yeah, ready for give us more give us more. All right So here's what we're gonna do you're gonna when you get into iteration planning So finish out the iteration first don't pull any of these into if you haven't finished iteration one Finish iteration one first. I'm just gonna try to keep things moving here We're now gonna hand out these two Stories and you're going to Reprioritize a little bit you're gonna jigger your prioritization and figure out where these fit in and and then basically start up again Now remember your sick your release commitment is still a release commitment. Okay, you can't get out of your release commitment But we're gonna give you these two new stories. Okay, so Everyone ready for them. Okay. I think they're over here So they'll be passing out the release the two new stories. They'll be story number 11 and number 12. Okay, 11 and 12 Okay, you guys have already seen them And they did okay iteration to We're gonna we're gonna reprioritize We're gonna recommit Okay, it should go much faster iteration to once you've got once you got some traction here You're ready to start. Okay, go ahead and go ahead and make your commitments sign your commitments up on this No, no, which one did you commit you only committed to if you committed to yeah, the ones you committed to mark them here the ones you didn't commit to It was five and six just circle them Okay, and you can't commit it is significantly harder with this mini it's significantly hard This is crazy. All right. We're doing good You're stuck Yeah, yeah, you can talk it and put another story if you want. Yeah. All right, how we doing pretty good Have who's done with iteration to iteration to you done with iteration to done with iteration to Okay Who do you done with iteration to? Done. Yeah done done with iteration to Done with iteration to Yeah, but you're you want to be done with all ten rolls all ten rolls So we got an executive injector and a customer request coming in so 13 and 14 these we're gonna start iteration three We're starting iteration three same same basic story same same program To do stories coming in the special they have a special orange version Okay iteration three commit to at least two stories and Then get rolling You're done done with everything no call at no penalty and get more value So you can take one of the stories that has a potential up to one Right No, it's not the cost. It's the value you recorded a value here, right? All right, how time time Okay Next step we're gonna do several teams have finished all three iterations if you if you haven't it's okay We'll continue to that but the step we're gonna so we can get moving on here the next step. We're gonna do Make sure on this sheet now. We're gonna record what value each story got Okay, if you hadn't already been doing that use it switch over to this sheet You've got sort of two sheets to record this on now record the value that you got And now that you've done this also if it was part of your iteration if it's part of your release commitment and you made it Then you'll get your ten points per story that you committed to so you committed to six stories And you made all six of those in the release Then you'll get your ten points per story Okay, if you committed to seven stories, you can get 70 points. Okay, if you made them all I think most people probably committed to six because that's all I told you but but you wanted to commit to seven You could have okay Keep that under the release commitment points, okay So keep this separate value points release commitment points and iteration commitment points So when you make if you made it during your iteration, you'll get those five points per story you committed to okay Cost is less important. I think we've been recording that so you understand that everyone understands that Okay, we're gonna have three columns of points The value that you recorded if you made the story If you committed to it in the release and you made it you'll get ten points for that story Okay, if you committed to it and you didn't make it you get zero for all of them If you didn't make a really if you didn't make one of your release commitments You'll get zero release commitment points because you didn't make you signed up for something that you and you didn't make it all the way through Okay, if you made it you'll get your ten points per story that you committed to if you made stories You didn't extra stories that you didn't commit to they just are not counted there If you for the release it's only for the it's it's all of them All return for the iteration commitment It's just the iteration and you and you made those two you're good if you didn't make it you got zero Yeah, okay, so everyone understand that Per store look on a per story basis Record your value the value of the from the story Record the release commitment points that you made and record the iteration commitment points that you made Include that for these extra stories 11 12 13 and 14. Okay, and then tally up those three columns Okay, so we'll have three separate columns here Okay, so I put this up just as an example here work this out recording value Recording release commitment and recording iteration commitment. Okay, make sense Okay, you still rolling. Okay last roll Okay, so sum up the three columns everyone should be ready to sum up your three columns now, right? Sum up the three columns. We'll have a value points. We'll have a release commitment points And then we'll have an iteration commitment points once you have those three columns The values the value assessment at this this organization is that total value is your value points Plus half your release commitment plus half your iteration commitment points. Okay, this is just an arbitrary thing I would if they if they had a little bit more time I'd actually do a something a little bit more complicated But I just arbitrarily said this is Navigating through all the chaos is a little bit a little bit much, but we're doing good. We're good. We've got you in this lap So let's go ahead and see where we're at with these total points When you've got it give you total points give all three numbers plus your total the fourth number is your total Okay, so get three numbers plus the total out to and when you're done with it write it write it on a on a on a note and and get it to one of the Facilitators the new stories that came in can't be counted against the release commitment. All right. How are we doing? Stone liquid liquid stone. All right Okay, who else who hasn't turned it in yet who needs you turned it in You're still waiting still calculating you've already turned it in. Okay, good. Okay. Okay, which one Okay Okay, we got it. Okay 215. Okay, awesome Okay, who has not given me their score sheet this one one in late. Yeah, yeah unknown Okay Okay, and you have a name you have a name here you have a name Put a name on What's your name? Okay, let's go ahead. I think we're already over here. So let's let's Wrap up you get the value points, but not the commitment points. I have no idea how anyone did anything Rules are meant to be broken I guess Okay, that's good We'll see what's how things work. Okay as they're finishing up. Well, I'll go ahead and read what we got here We got I got team crazy coming in at 215 Table by the door. That's a good name 230 liquid stone came in at 245 Yeah, you guys we can go at this for a long time bring the audit in here see start putting people in jail here for 249 for unknown Team unknown Table one is a 203 and a half What's that? At least yeah They're doing it very carefully they called for the audit before they turned theirs in Now they wait now they create the mess create the mess and then they come in and sneak it in underneath Okay, so do you have a number back there? 256 all right Now the whole game is made up that's okay. Yeah, okay next one. We have the navigators At 329 and a half what I didn't do what happened to team Lee 307 let's see. This is superstars or 307 271 for team Lane. All right What do we have here 256 and then The navigator is 329 and a half and the best one I have looks like the one is the last Beach Boys plus curious tester 345 and a half 345 and a half Alright the winners they get their bonus Okay, so a couple of things we are running late, but we'll we'll see. Is there something at 530? The the next session there's something at 530 right Nothing here. Okay. No, but isn't there something something on the main ballroom or something? Yeah, okay Okay, so we'll try to finish this up, but I'll do a quick retrospective here The first one did you have fun? All right, it looks like it was pretty good energy here a little crazy, but yeah good Was that a lot of chaos? Yeah, we had a chaos. Yes, we definitely had chaos I think I predict I can predict something. I predicted there'd be chaos and there was okay, so that was pretty good So what'd you learn anything? Did anything come out that? Okay, good. How was it fairly easy to do it relatively quickly and and then also how accurate was it? Was it did it do any any indication as to whether he did did a good job of it or did it you know? Was it pretty easy? Okay, good you had a Yes, yeah, it was extreme chaos at the beginning and then and then performance chaos after that, okay? Yeah, yeah Estimates don't matter. Just do it. Okay. That's possible. Did anyone use no estimates? Nobody nobody used no estimates You could What else anything else? What's that? Oh, you thought it was a bunch lower Okay, you thought it's gonna be big and it turned out to be a dud right does that ever happen in software? Okay You got a comment over here, I think What's that under other command and over over deploy. Yeah, okay. That's good. Yeah, okay Don't cheat Don't cheat. Yeah, okay So how what are sort of things that are like soccer development or what are some of the things that maybe you're a little Misinterpret or not quite right in terms of the simulation Yeah, the value is not easy to estimate and in fact if I would do something more complicated if if we had a little bit more time And probably had the corraled some things in where value would have been even more uncertain But I would have added some uncertainty to value that came in later. I also do some things where Most teams got almost all the stories, right? so Sometimes when I do this and it's in a more complicated I'll make a deal where if one team does a story and no other team does that story then their value gets to be more right because then They're differentiated in marketplace, so I pull some other things in but we didn't do that for this one So so but yeah values one of those things that yeah, and the other thing is to notice that some of the stories value was very Random, right? It was a big gap in terms of value from almost like six to 120 I think on one of them so big range of value Not rolling dice exactly. It's a creative process, right? So this is just numbers, right? So it's fun. Yeah, everyone had a good time, but software development is fun, too Exactly Yeah, okay, here's an interesting what what the impact did committing have on your behavior You didn't do it So I've since we're running through time. I'll just a couple of observations. I've had when I've run this What I see happen is when when you have the commitment did anyone notice that they got more conservative You got very conservative when you committed Think about that in your regular software development, too. How much is commitment impacting? your Risk avoidance, right? So you got to balance it out. Why did they even include commitment? What value this commitment points even have? To the customer sometimes done, right? It's mostly politics. It's an internal thing So you could have I could have said can you set up with all these things having to tell you how to do commitment? And I could I have one version of this. I'll probably just zero the whole commitment thing out, right? so if it's a game sometimes we play so What really matters to the customer is the is the is the value you deliver I think there is I tend to feel that there is at least a little bit of degree of value to the release element because that's the business object that actually matters iteration commitments to me are relevant. I think are overblown in our industry. I mean, I think it's a little bit of a Almost an attempt at micromanagement. Now that given that there are times where I absolutely Expect the team to meet an iteration commitment if you got a trust problem I actually think an iteration commitment to making sure you can demonstrate Delivery and that delivery of value and delivery gets commitments is a good thing But if you've got a high-trust environment I tend to believe iteration commitments are actually creating potentially bad behavior Anything else I think we've got a five something Coming up now, but you get a reward. I would their bonus Yeah, we have to the audit stuff. Yeah, this team's gonna work extra hours and do the vote do the audit And I think you I think this team this team gets the gets the weekend off. I think right Take the rest of the day off. I think that's that's what we get I wish I had something Okay, thanks. I had fun. I hope you did too