 OTAN, Outreach and Technical Assistance Network. I want to welcome you to TDLS and especially welcome to success. And you've noticed it was after COVID. We're going to say through COVID, but it seems like we're getting near the end. So we kind of went back and forth as to what to say. My name is Susan Coulter and I'm one of OTAN's D-LAC coaches. And I want to introduce our panelists from Garden Grove Adult Education. We have director, Melissa Patterson. There we go. And teacher, Alisa Takeuchi. There we go. And from Tested Adult School, we have coordinator, Will Netterson. Hello, everyone. And teacher Virginia Burroughs. Now I'm going to turn it over to Melissa to tell you a little about Garden Grove. All right. Thank you, Susan. And thank you to all of you who've chosen to attend our session today. I want to start off by saying I'm just so grateful to D-LAC and the partnership, the professional friendship and partnership that we've been able to develop with Tested Adult School. So I appreciate that and also the Susan's coaching. As Garden Grove, as the director of Garden Grove Adult Education, very excited to celebrate 50 years of serving the adults in our community. And we currently offer courses on two campuses, but most of our classes are offered at Lincoln Education Center. And the next slide, you will see a breakdown of who we're serving. So right now we have students on our campus between 18 and 80. And I'm happy to say that when we added this number to this slide, it was 1,057 active students. And currently we are up over 100 active students. So our ESL program, of course, is our largest program. As you can see, we offer ABE, GED, citizenship, pronunciation, really proud of our high school diploma program that's grown to over 100. And then we also offer our concurrent high school credit recovery. We have an adults with disability and very proud that we actually serve individuals from 24 cities in our community. All right. So as you can see on our slide, we have 29 part-time teachers in many different departments with ESL, ABE, HSE, VESEL, which we don't really call VESEL anymore. It's our CTE, English support classes, adults with disabilities and CTE. We offer classes in the morning, in the afternoon, and the evening, Monday through Thursdays. And then we also offer a couple of classes on Fridays. So here you go. Oh, I'm sorry. Go ahead. No, I was going to say thank you from Garden Grove. I believe we are passing it over. No, not yet. I'm sorry. That's okay. So as you can see, we at Garden Grove are ensuing the high-flex model of instruction, simultaneous instruction, where we have students in the classroom and online at the same time. The photo on the right, you'll see students in the classroom using Chromebooks, as well as on the big projector. You see the Zoom students who are also learning at the same time. There we go. Now for Justin. So hello, everyone. I think it's pretty awesome. I need to echo what Melissa said. It's been great to be able to join D-LAC, but with that really perform this bond with Garden Grove Adult School. It's pretty neat. We at Tuscan Adult School are based in South Orange County, but we're another important point in South Orange County. So we service two different areas of the Orange County components, Garden Grove, more northern, us more southern. And if you don't mind moving to the next site, we're based off of one site, but it's weird because we share a couple of different locations. Our program is much smaller than you'll see our colleagues here in Garden Grove Adult School, but I think that's trying to help give the perspective of two agencies and what we're doing. We're pretty excited to say that we have a total active students of 593. That is growth or returning back to adult ed. We saw a significant drop last year. We've almost doubled in size from last year, but not in the heyday of 2018-19 where we're almost 1200 students. So we're still seeing that our ESL population is growing back right now at 415. Last year we were about 200. So it's really great to see that population coming back and starting to see some of that lower ESL population return, which is pretty neat for us. And then our citizenship, which we only serviced about 25 students last year, has already increased back to 62 this year. And then AB was another area for us that was quite small, almost doubling in size. So we're pretty proud of that. We did see growth last year that continues this year in our adult diploma and equivalency prep. And then our age range, it's pretty cool that we have individuals from the age of 18 up to 82. And they are determined that the couple of 80, we have a two 82-year-olds that are here and committed to learning English, which is pretty cool. And we have 12 various languages that are spoken at our school besides just English itself. And just really proud of this. Like I'm going to go to the image of our graduate right there in that far left corner. That was from our fall graduation. We've already had a total of 17 individuals who've graduated or completed their equivalency and looking to grow that as well. But we were able to celebrate that group in fall. So just great things that are happening. And then you see that top left-hand corner, I mean right-hand corner, our citizens celebrating citizenship as well. All right. And Lisa, there it is. Tested adult school has 28 part-time teachers. Some of our teachers literally only teach one day a week. So there's kind of a niche for everyone. We have one part-time counselor. Our program areas include ESL, ABE, diploma, equivalency. We still call it vessel even though that's an older term for it. We don't have a very, it really is more like vessel than CTE for us. And then we have a citizenship program. We don't have any afternoons. So our programs are primarily offered mornings, nine to noon or evenings, six to nine, Monday through Friday through the mornings and Monday through Thursday for the evenings. We do have a Saturday program. And our classes are offered both in person and online. Both garden grove and test dinner part of OTAN's digital leadership academy, more affectionately known as D-LAC. The goal of D-LAC is to help agencies meet their technology integration, distance learning, or blended teaching goals. It is a two-year program. And this cohort will be completing in May with their final reports. D-LAC is open to all California WIOA funded schools. And applications, all of them are open to all of us. And they are open to all of us. And they are open to all of us in the keynote that they were opening in April. So be sure to check OTAN's website for D-LAC under the trainings tab at the top of the page to learn more. And they have been a wonderful group to be working with. Question one. What prompted you to apply for D-LAC? Well, I did apply for D-LAC and my background itself. Before hitting the adult ed world, this is my fourth year in adult ed. I was an elementary school principal in our district, a teacher in our district in those components. And moving into test and adult school, digital tools was not a big thing for us. We were very paper heavy, loved our paper, loved those components. The tech that we had was really being able to use a digital tool. And we were able to use that overhead projector. If you think about it that way, some basic elements that were there. So it really looking for test and it was, how do we start integrating technology to make it a great tool for our teachers as well as a skill to invest for our students to look towards the future, whether it was workplace, job place, or just supporting home as well. So that was test and stance of what we originally went in using digital tools. Melissa, how about for you guys in Garden Grove? Well, I think pretty much the same. Well, it was for me as a brand new director, stepping in and being offered this opportunity to be a part of DLAC. Really, I learned how important it was to survive through this COVID that we needed to increase our use of technology and power our teachers to make their way through this. And I was fortunate to have Alisa invite me. She's kind of an OTAN star, as many of you know. And so I knew that this would probably be a great progress. I think we have a couple slides. Well, Susan, if you want to go forward with the first one, well, there's some things I think on the next slide, right? Oh, okay. Sorry. The work for year one of DLAC had agencies create goals. What goals did your agency create? And how do they continue to support your agencies during COVID? So I think I get to talk first for testing. So Melissa brought up some things that's interesting. So you heard me share. Tustin's original reason for applying really was about a digital integration just into our instruction and trying to build or base the need for those components to come and affect our students as well. I think COVID came as we were applied and sort of shifted everything that was the plan and really set new goals for us or open our eyes to what some of our goals should be. So for us, it started looking about how do we onboard students to get them digitally prepared. As you heard from me and Tustin, we lost almost 65% of our students with COVID. Part of it was because students were nervous about technology didn't have access to technology. So really learned that our students needed to understand what it was. I would say a majority of our students that remained with us either had previous technology skills or somebody to support it. So we really wanted to look at that goal of how do we build that in supporting our students? I'm going to be honest with this. It's also supporting our teachers and learning the technology too. I think that's a part of what that goal means for us. Again, understanding how to build a marketing presence. It used to be word of mouth. And when we didn't see each other through COVID, how do we get that element out there? What is it that we do? You'll hear more. We've learned something from Garden Grove and that that we did as well as a couple other things. And then for us, you heard Tustin. We love paper. Paper was a really good friend of ours. We were able to do this testing up until this year was only paper pencil testing. We were fortunate enough to be able to, through our district's approval process, bring students in to come, paper, pencil tests. So you can see that that allowed us to at least get the assessment components going, but really wanted to move forward with e-testing. And then distance learning, I will be very honest with you. Prior to COVID, prior to DLAC, what we would call distance learning is when I sent home a DVD player and a packet with putting English to work DVDs that students would watch. And then we would do a check in here and out, but really weren't looking at a distance program. So that was a big goal for us, like what's that clear expectation? What's that learning going to be like? And then I'm going to go back to teachers and it changed for the second year, but first year was really about teacher professional development. And so that way they felt comfortable with the tools and could integrate those with our students as well. And so that was really helpful. Like Will said, we applied for DLAC. It was right at the forefront of COVID. And so we were trying to decide how we were going to move forward in our next school year and how that was going to look. And because Melissa was new also, we wanted to make sure that we created goals that would help with our whole program. And so we had decided to develop a Google classroom for all of our teachers, no matter what department they were in. And teachers went through extensive PD on how to create a Google classroom for their class and then how to get the resources and share the resources with their students. Our other big, big component was to register students all online. Prior to COVID, you know, it was the traditional triplicate where the students would come into our office and then they would fill out their information, including the WIO information. And so our front office clerk, he developed a whole Google form with the exact same information. And then now students were referred to our website, and then they could register for any classes that they would want to take on that Google form. And then on top of that, since now we were doing everything online, we had to create an orientation. We had to create something that the students could use to help them be successful in our program. So we created both an online orientation and an in-person orientation. At the time, we were only using the online registration because we only had remote classes. Once we were able to open up our school again, then we would use the in-class orientation to help students navigate our program. And so that they could be successful in and navigate through our system. Am I one more? No. Melissa, I think this is you. Oh, okay. All right. So, sorry. So, yes, the other part of it is increasing our marketing and social media presence. We were able to create job boards and really market our programs. And then the high-flex model of instruction using the owl camera has really been a huge change for our students. It makes the learning environment a little bit richer for those who choose that distance learning. It's also shown great growth with our staff being able to go from sort of basic use of zooming to a really complex model of screens and instruction, live instruction. And then another goal that we set through D-LAC was helping our students use their school email accounts. How do you feel about the D-LAC program? What's been beneficial? So I think I get to start with that one. And Will and I are going to bounce this one in Virginia too, I think back and forth. So the first thing that I can say about what I appreciated were those top two bullets really coming together. Dr. Porter led us through strength-based leadership and as a brand-new director on campus, being able to really look at my staff and to be really strategic about identifying strengths and bringing them on board and using those strengths and bringing them on board. So we have the courage to be risk-takers and we know that that's really what we need to do if you're going to try to grow your program or recover your program as we did through those campus closures. And so I just really appreciated the sessions we had with that, the collaboration that we had with Tustin who was very similar to Tustin who was like D-LAC opened that door and provided those opportunities for us. So and I think something to make mention, the past two slides we were talking about what our programs were doing, that was all based off the first year setting our goals and moving that work forward for us. I think that came with, if you look at that third point there, it's the ideal 101 and 102 courses. D-LAC brought in some coursework with that. And I think it was a great process. We had an approach that it was a great process. It chapter by chapter broke down areas that maybe we didn't think about and really gave us resources and questions to really think through. Virginia, I'm fortunate enough to have her as a teammate. I had an original teammate in year one that again found a full-time job somewhere else but Virginia was able to be a part of the reflection with that and really about resource evaluation that we get into. It's just been great reference material to give us really ways to think about what our next steps are. Again, blended learning, distance learning, partnerships with Garden Grove or other partnerships as well and hearing everybody's responses to the questions from the courses. Right. Honestly, I think COVID had the potential of being very isolating for most agencies, but I think D-LAC really brought us into a spirit of collaboration. You're in a statewide project where you get to meet with people from other agencies, top to bottom, every area of California experiencing similar and yet different things. So obviously you have this important collaboration with OTAN, including our wonderful coach, Susan. We get to work with other agencies. Some are very different, some are very much like ourselves. There's a regional partnership, which is, again, we also appreciate our partnership so well with Garden Grove Adult School. Just a very similar location and in some ways a similar population to serve. It also fostered collaboration amongst our own faculty. The things that we brought home from D-LAC really came into our staff meetings and professional development and really fostered that whole idea that you can lead, this is a leadership academy, but you can lead from any position. Very empowering, I agree with you on that, Virginia. I love how you say bring it home. Really taking what we learn from these support from Destiny-led, the Ideal 101 and 102 courses, Dr. Porter brought up that risk taking, leadership-based, engaging in difficult conversations, all those components. Then we had Susan, if you were there, our welcoming keynote, Penny and Neda are always there, Marjorie. Like everybody, it's a resource and support that you really bring through. So I feel like I've been able to network, even though COVID might have separated us, I think there's a stronger network. I know that I can send an email out, I can make that connection or bring it up in a meeting. I feel empowered. I know it's a bummer to think that we're closing out year two and one sense of this component, but I know that I have resources and it's been great to know it's up and down the state of California too. Can you describe the progress that has been made in meeting your goals? And I think I'm going to start that one off. And I think the first something that we learned early on was about marketing our programs. And given the changes that were going on, we definitely had to look at how are we going to do that? How are we going to be able to bring back our students who did not return and then also increase that? And one of the first things that we looked at here at Garden Grove was how we had been sending out over the years an expensive multi-page mailer. It was absolutely beautiful, but I wasn't really sure of the impact on it. And so I met with my leadership team. We talked this through. We looked at other things that come in mailers in our own homes. And then we talked about this in D-LAC. And so I went to the printer that had been supporting us with that for sure. And I wanted to still support local business. And the printer helped design that top right postcard that you see up there. So we were able to still give a visual what was going on on our campus, but in multiple languages, share with them that we now had online registration. And we chose to go back and we mailed those out to every student who had been on our campus in the previous three years. And we feel that we had a pretty good response to that. We also, because our campus was closed, right? We were limited the number of people on campus. We made the smaller signs that you see on the top left. And that gave outside instructions. And we put some of these postcards outside so that people could walk up to our doors and our campus. We wouldn't have to have that as many physical contact, but they could still get a clear instruction and now on how to register online and see our course catalog online. I think something I'm going to add to that. This partnership again. I sound like the Kumbaya moment of, you know, just really appreciating Garden Grove, but hearing it in the postcards and we had a brochure that we were trying to produce, knowing it wasn't making out to anyone. Garden Grove inspired us this past year to try and do that postcard as well, but I didn't have a printer, maybe not the great skills. So I used Canva.com and that lower one that is in the blue and the whites was able to put our images into a preset form formatted component of a postcard really truly was postcard size. And to build a postcard out that we then printed through Canva printing classes were decent. We again, I'm a smaller school. So we send out about 1500 going back to that past three years of the moment, like was recommended from Garden Grove. And we spent honestly, I think the printing of those postcards, small five, five by seven postcards. It was about $300 for the 1500. It was there edited all those components to Canva. So when I just put that plug out there, if you're not using Canva, that's a great resource to make your postcards or flyers. If you want something looking a little different professional, maybe don't have that artistic mind, but we, we re-secured our process of distributing flyers through our schools as well, trying to get those out, knowing that schools were sending information out. And then that social media component really trying to communicate. I know Garden Grove, you guys use that social media to really just say what's going on at our school and letting them know that we're open. I think that's, that's a huge piece. And then we've seen supporting us word of mouth. Now that some students are returning him back in person, that word of mouth is helping us. But again, low staffing, I don't know if anybody else is affected by it, but just trying to get staffing members, you know, I could open up more classes currently because I have waitlist, but it's now trying to get the word out of staffing. Hey, we'd like to hire you or competing with those full-time staff members to, so that's that recruitment side and marketing side that would go on. And I know if we move on, I think we'll get to registration if I'm not mistaken here. I, I, Melissa, if you're okay with me, I'm going to start this one off and maybe you can add to it. Really registration had to be shifted. You know, I, I, you heard me talk about tested love paper. We didn't have the trip to get formed like our, our partners in Garden Grove, but it was paper. You had to fill out a piece of paper for us to really say we're going to register and being shut down. And we couldn't let people in to come fill out forms or wanted less touch points. It really was about getting registration online. So we're using Google forms. I believe Garden Grove, you're also using Google forms as that initial registration form where we're collecting information. Again, we do have to think of the balance of security. So I know for testing, we're not collecting social security number and things, things like that, but it's been pretty amazing to have that registration process go through there. My office staff can now see how many people are registered. It's a common practice for them to go in and see. I think what's great for me in year three and now year four, we've been able to see, oh, we've had so many people who've registered showing that they're interested in getting that comparison to those that are actually coming in to either assess with us or enrolling in classes and being able to do follow-up phone calls from it a little bit easier because we've got that list and that component. So the online, online registration form has really been pretty powerful for us. Miss, do you want to add anything to that or? No, I would agree with you. And I think a surprise bonus that came from moving to the online registration form is our registrar now has a more accurate account at all times about who really is active in the system and moving students out when they're not returning. And so it's eliminated a waitlist for us. Obviously we're down in our numbers, but I know in the past, we did not have that accuracy. So that was a nice surprise that came with that online registration. And then the other thing I would put there that we learned from our partners, Garngrove and I know Lisa, you were part of the team that was leading that orientation program that was going on for Garngrove is just requiring that you come in and do that. So we and test and call it orientation and assessment and we schedule it. We use, again, trying to use another tool. It has ads to it, but we use signup.com where we tell people after they've registered, we send an email out that they click on that link and can choose the day that they want to come in that they're not having to call the office. If they call the office, we help them as well, but it's just that tool to say you get to choose and the empowerment signup.com sends reminders for me. I'm not having to send that out or work with my office staff as well, but really having individuals come in to do that assessment and orientation with us. Yes. And Garngrove. Yes. I'm going to turn it over. I'm going to turn it over. I'm going to turn it over. I'm going to turn it over. I'm going to turn it over. At least it's going to talk about. Assessment. Yeah. Oh, I'm sorry. Go ahead. Go ahead. Okay. So at garden Grove, we had really redeveloped our assessment. Because, you know, like testing, we had been kind of procrastinating on the whole e-testing situation. But right before we closed down for pandemic, we had a pre-test and post-testing. And so that was very fortunate for us because it really allowed us as an agency and then some of our students to understand how to get the testing done. Now, during the pandemic, that first year, it was very difficult for do, for doing post-testing, pre-test and post-testing, trying to do it remotely as well as so many other agencies. Once we did work, we were able to come back and we started year one, we were able to go back and think about the process and how do we, you know, fix the situation that we were in. And we went back and we trained office staff to become proctors, which really alleviated a lot of stress for, for everybody because we had only one or two at the time. And now we have a full staff that can proctor to e-tests. Our other thing that we did that was very beneficial for us was that we were very intentional now on when we were going to schedule our post-tests. Because that whole COVID year, we were just scrambling and doing the survival tactics of trying to test anybody that we could. But then once we came back, we were very like saying, let's do the post-testing this time, this time, and this time. And we really stuck with that. And that helped a lot. As Will was saying about orientation and assessment, we now also do that. So that as soon as students come in, they get the orientation, they get that pre-test done. So that is off the table. So that's a no question now that all students come in with a pre-test. And then as far as just for our agency, we use ventures. And so students are tested on the unit after we have completed the unit. And so we had developed either testing so that online students could take it or also the in-class students now that we had been open, now that we had opened up our school. And Virginia is going to go ahead and talk about test and test. Yeah. I'm very similar. We except we, pardon me, we didn't pull the trigger on e-testing until this year. So, and actually, I mean, it does require a lot of training in our office staff. And I have to say, I take my hat off to our office staff. They've really rolled with it. And it works. But I really sometimes think our faculty really doesn't understand how many eyes are on that to make a student show up in a class. It's quite a system, but the e-testing is working really well. And as the bullet point says, it actually makes the listening testing easier to do. We do have the need for that. And sometimes logistically, that was just difficult and it's less difficult now. So that's one bonus for that assessment piece. We don't use ventures. We use side by side, but it's the similar thing where we have unit tests. We are also a, you know, a federally funded agency. So we do co-app assessments. And then I'm sure very similar to garden grove in terms of how assessments are run through our high school diploma and through our equivalency preparation students. And I think I start this one up for instructional practices. For core curriculum, but one thing that we did in test and we added Burlington English kind of in the middle of our pandemic experience. We had some access through our core textbook, but we've realized we really need something with a very rich online courseware. So that had really helped put curriculum into the hands of students. That was a very big deal for us. And it really gave us a way to give students to do more work at home. And in a very engaging way. Plus they were using all these new tools. So Burlington English plus just making better use of some of our, our paper and pencil curriculum that had online components. We're doing, we're doing better work with that as well. Do you want to jump in now, Lisa? Do you want me to do the end first? Go ahead to the end. Okay. So we're going to drop to that, that fourth bullet where it says students reception of new skills or supports being used. We are using primarily iPads and classrooms and a lot of our students were not familiar with iPads. And so we are seeing, because we're taking them into classes with help from support staff and from faculty, faculty members that our students are just loving it. Having it in class made it feel safer rather than trying to do it separately. They're enjoying it. They're willing to take more risks. It definitely has boosted confidence. And I've been that person going into a beginning lit low class. And I, and I hear the students say, we love the iPads. When are we going to use the iPads again? And I, I don't think we would have heard that necessarily two years ago. We had the iPads, but we weren't using them as well. So I think that has, it's actually boosted our instructional practices. Yeah, I completely agree, especially with the, you know, your assessment about how technology was welcomed into the classrooms pre pandemic, you know, then all of a sudden surviving during the pandemic. As far as team meetings for garden Grove, we've been very, very fortunate and that our directors have been very supportive with us and that we actually incorporate professional development and team meetings level, you know, by levels of ESL or departments weekly. And so we are able to collaborate with our coworkers on best practices or challenges and things. And so we have a very real grasp of what's happening within our levels and how we can support each other. And then we can also meet with the levels either above us or above us or both into suggestions of transitions. And so that's been very, very helpful for us. We also do the, we also have been very fortunate in that. One of our consortium, one of our consortium has sponsored us getting Burlington English licenses. And so again, that was a very, at first it was a very small portion of licenses that we're able to, so we kind of incorporated it somewhat slowly. And then now as the push began, we got more and more and more. And so many of our classes now have access to Burlington English, which has been a really big boost for us. And so that has really helped with our bringing back the 21st, you know, bringing the 21st century skills into our classrooms and getting our students really, one of our student learning outcomes is digital navigators. And that's what really one of the driving forces for us. And then Lisa, before you click off on this, may I have one more comment to that talking about that collaboration? Again, we're in testing. We don't meet weekly, like you guys are fortunate, but through COVID and everything else, we learned how to meet as teams online. And it's been interesting because coming back when we could come all in person, January came right after winter recess. I'm not sure how everybody else's districts were thinking or evaluating with Omnicron COVID variants and all of that. We were able to look at our ESL team and say, you know what? We're still going to have a collaboration, but we're going to take it online and go through Zoom. And it still was a rich, powerful collaboration because we've learned breakout rooms and things like that. So I think that's the other piece of surviving through COVID. And after we give ourselves to those options, I know my high school and equivalency and ABE teams will meet online for half of their team meetings. The other half will be in person as well. So we're seeing that, that it can be worked both ways as well. So that instructional practice is really reflecting back into our teachers as well. So thanks for letting me add that quick bit there. Of course. We'll be talking to professional development with Virginia. Yeah. Will, my boss, Will has an expression he likes to use about drinking from the fire hose. And I think at the beginning of the pandemic, we all felt like we were drinking from the fire hose. It was, it happened so fast. I actually got to the point where I'm like, please don't try to teach me anything else. I'm done learning for a while. And I'm sure our students helped the same way because it was just a lot. So the teacher PD that went on at that time. And as I'm sure as many of the agencies of those of you with us today, it was, it was a lot. And it was a crash course. The second bullet was something that we've kind of learned from this is that now we have the luxury of maybe providing a nugget rather than drinking from the fire hose rather than that overload, that overload. That really kind of went along with the territory of COVID hitting us. Two years ago this month. So our PD now is it often, I would say it always includes something technological so that people can use it in a classroom and for our online teacher so that it's something that is happening on just, you know, no matter how you're teaching your class. So those skills are there, even if we got the crash course at the beginning, we're reminded of them. We're learning new ones, but in like smaller sips. Yeah, that's such an important component to things because, you know, when the pandemic first started, the teachers were drowning. We were, we had also become students because we were trying to learn so many things at once at the same time trying to teach our students. And so, yeah, it was very difficult. And so it was trying to just survive and get all these resources in. Again, just piggybacking on what we talked about before about our weekly PDs. In bullet three, just being able to revisit some of the tools that we were trying to learn very quickly and really turn around the next week and say what worked, what didn't work really was helpful, because most likely sometimes agencies have a staff meeting maybe once a month, if that. And so you learn some tech, you know, some tech skills, but then you don't see anybody for a long periods of time and either they just drop off or people get frustrated or they have questions and then there's nobody to turn to. So we were really able to come back in our weekly meetings and talk and share with others what worked and what didn't work. Our TOSAs, they did a really, really good job of really incorporating within our weeks, bringing in some other, some other TOSAs, our district TOSAs, tech TOSAs and to share with us some skills and develop our professional resources to help our students the best way they can. And again, it was just being able to learn it and then use it and then a lot of times we would do it within our PD itself. We were not just listening to a directive, but we were actually doing it at the same time. And that was with CASAs or that was with data. It was with so many other elements that we needed to learn and it was hands on. That was what I think our teachers really appreciated. So I think that something came out that we've been reflective in talking as agencies is the support staff professional development that really came out from that. It really was not only teachers understanding how to use the tools and even thinking of G Suite, you know, how do we use it for instructional purposes, but then bringing it back, you heard us talk about for our recruitment or registration, we went to Google forums. So there really was a training for staff on what that is, what's our process from rolling now, is that change from that paper base and pulling that information out. So it really was, I know for us in Tustin, sitting down with the teams, this is how we see Google forum. This is how we're going to get our students to understand it or just going through the registration process where it's not a, oh, come in, you know, we're going to lead you to our website. Click on that, that image there, you know, for at least Tustin Tustin, the link is right under this large picture. So we always say go to our webpage under the large picture, click on that link, you know, and understanding that and then understanding how to communicate with our students that orientation and assessment for us using signup.com. We have a process that we, even on the Google forum, my office staff through training process knows that they put their initials. So we know who sent that email, that way we can do that follow up when somebody says, oh, I didn't see it. We clearly see that that's been identified. We have a staff member that does it, our color coding and highlighting components that go into it. So really that training of the process is something that's been important. And then we and Tustin have this digital skills survey that's been part of our orientation that we have students fill out to really see if they understand how to send an email, how to search on the web, on a website, those components. So it's just making that a process that we've had to train through and meet with our teams. And Melissa, I'll let you keep going. I feel like I can keep talking forever. Sorry for that. It is exciting to see that through Tustin's collaboration with other agencies, especially Tustin, hearing their practices. And so this was something that was exciting here is to really empower our office staff with additional jobs. I think traditionally people kind of stayed in their lane and this was this task and her task and his task. And so we learned through strength leadership to really find those strengths. And I saw this office, my clerical staff just kind of come to life. And I was like, oh, would you try this? Can you come to this training? My toes were fabulous in putting in those supports and those strategies. And I think it's just really changed the whole dynamics in our office. And one fun thing that I learned early on in DELAC was just the importance about routinely checking in. And so when it was just my clerical staff on campus and my teachers were still off in the distance, I started a stand-up meeting every morning. We did 8.15 every morning because it was COVID. We wanted to make sure we were spread out and masked. But it just has become a really fun thing on Friday mornings, just 8.15. You see everybody heading up for, and it's all of them. My custodian makes his way up and the staff members come around. And we're sharing now, people are sharing about that. And I think this week we're going to work with so-and-so and this and that. And so it's just really been exciting to see that move into the support staff as well. How has your team grown and benefited from the 102 course? But let me say this first. These are some of the modules from the 102 course, which is on resource evaluation. This is about the 101 course. And that was more getting the site plan together. But these are some of the things that they were studying, different modules within their course that they wanted to talk about. So my question is, how has your team grown and benefited? So I think for us and Tess in the conversation has been it's more that opening, you know, of understanding how we're trying to talk about or discuss or reflect on really beneficial. And I think that that's this ideal one or two really got us to that point of, you know, how are you going to evaluate that? How are you going to make sure that this is a tool that is going to benefit whether it's a resource or not? And I think that's one of the things that we're trying to talk about. And I think that's one of the things that this is a tool that is going to benefit whether it's the teacher and the student. Is it truly the student? So it's breaking out these components and we were fortunate to be introduced to different rubrics to then create our own rubric. So you're going to see for Tess in that green in the columns is our rubric we took and broke it around. We have this overall effectiveness that we go back to. That's the top of ours as we go into these different categories about accessibility, for the teacher, for the student, looking at financial impact, you know, what's the cost is the how how is it being maintained in those pieces and we went through and we evaluated and we were encouraged by D-LAC to really go into a new tool and something that you might want to use and for us Virginia and I reflectively our EESile teacher is a little bit, I don't want to use the term jealous, but wants a tool that can be used both in class and online that students have resources for citizenship and so we've been talking about it and USA learns in their citizenship models was something that we went through and evaluated to see what's there and again there's been positives as we went in and explored and so Virginia and I each completed the rubric and came back together and evaluated trying to look for a program. So we think we're going to go pilot now that we've evaluated with that teacher and students so that way they have those resources but that's the design structure that is there to really say you know what are we going to use and not just waste everybody's time component so that's where we are and that's the tool we're using I think we know that we want to tweak it especially as you hear what our partners at Garden Grove are going to share and then what we learned from other D-LACs that share because we all got to hear each other's rubrics we know we want to go back and tweak the tool but at least it was our starting point to really get deeper into is this a valuable component or resource or app that we want to use. So I think that's definitely the benefit of D-LAC and 102 is really looking at your needs and then the idea of this rubric and they shared in-depth rubrics with us and then we were challenged to create our own and as Will stated the original task was to evaluate something before you purchase but here in Garden Grove we had jumped in and we had bought the Al 360 cameras but there were still additional pieces that needed to come along with that so we used the rubric for an existing product that we had and we wanted to really understand is it being effective and then we decided to go one further step and what we did is we created a rubric for the teachers to respond to and then we also created a rubric for our students and so Alisa and I created a Google form that followed the same questions as the rubric and we put it out to all of the teachers who were using the Al camera and here you can see one of the responses so we aligned our student questions to be very much in line with the teachers as well so we would have data that we could compare and look at. One exciting thing in response to all of this was we did find that our teachers really found that the Al camera the red signifies their strength right and in most of our the responses we discovered that the Al camera really was a benefit for the teachers and we learned that our distance learners really appreciated it as well so the D-LAC really taught us this evaluation and how to look at this and gather data and now we'll be able to use our rubrics for purchases that we plan to make in the future as well. I just, I'm going to add it's a nugget I think we want to steal and test in is the wisdom of putting the rubric into a Google form so that way you could survey that way and pull that data rather quickly I think is a great tool to think about and use so again a compliment to you guys in the Garden Grove team. Thank you. What are your agencies next steps to meeting your goals? All right so for Garden Grove because now we're kind of like taking a deep breath that first the year one was really just go, go, go, go, go because we really had some long-term goals but many of them were short-term we were just trying to check off the list and so now that we were able to kind of sit back and relax we can actually set some goals that we can make long-term and so for one of them is we really want to strengthen RPD for new technology and we're kind of taking what will, what test and did and utilizing the rubrics for some new technology that we are thinking about using and so we will develop a rubric for that in addition though we would also like to continue to use rubrics as surveys for equipment or technologies that we're using currently and especially again with the teachers and with the students so we'll go through maybe through our our Burlington English also with our ventures and really you know getting a feel for how is it that the students feel about the resources that we are providing for them for their instruction and then on the last one is that we really still want to develop our orientation because it's an ever-flowing thing because we've been so up and down with how the school's been structured as far as in class or online the high flex masks, no masks things like that it's going to be a continual flow of the development of the orientation and to further, you can see our student learning outcomes we just went through WASC accreditation which we got our six years so that's super exciting for us but one of the biggest proponents was that we had to redevelop our student learning outcomes and we're super proud of them because we had the whole school together and so it's a buy-in we're all bought into this and so now we are really ready to share them with our students from the get-go from when they start orientation they are now being introduced into our student learning outcomes and they are being sucked into this as well as this is what we want for you and we want you to succeed so those are really exciting for us Will, do you want to do this one or shall I? I would be glad to the first one, how about that? Yeah, for our top three goals we have identified other ways to support student digital literacy through classes and when we kind of started out we thought we'll get to students before a class we'll try to front load that I think we're finding great success especially with our lower level learners that we need to get them comfortable in a class and then get the devices in a class getting technology into their hands I think that's been to us obvious that they're more comfortable doing it in a safe and supportive environment and it's fun, I think they enjoy the fun nature of it, so we just need to continue exploring other ways to support that literacy and comfort Well and I think then going back to like shared from our Garden Grove colleagues this need to really evaluate the tools we're using, the apps we're using in our curriculum as well getting that feedback, I know we talked about the differences, we were asked one way in Garden Grove approach to another but even that reflective on the tools that we're using currently and what we think digitally this is the use of an iPad or do you need access to a laptop those kind of components and evaluating that so we would like to develop those rubrics and I'm going to be honest, Garden Grove we're going to steal put on to a Google form so that way we can get that data and condense it down but really trying to get that student voice I think that's the pieces, sometimes we get so focused on the educator and the office staff but it's the students we're servicing so wanting to make sure that evaluation of those resources and digital skills are really meeting students needs and hearing from them as well and then we've always called it the teacher toolbox, how do we keep developing professionally that teacher toolbox with the technology that we have, the new apps the new strategies that are being used and really pushing our student success, I think whether we do it through co-apps or just our basic construction, a Burlington English has made us have to touch a digital tool more, there are teachers balance between the two so just trying to push that forward as well so that's what year two is about for us as we're trying to move forward I'm sorry we're not going to yeah yeah we're running out of time it's been pretty amazing they have a lot to share and we want to thank our panelists if you have questions these are the contacts for Garden Grove and for Tustin so we want to thank you