 Hello, good afternoon. I am Becky Keith from IntelliBord. IntelliBord is a learning analytics platform that brings together your Moodle learning data with other learning data sources to provide you insights and metrics on success and I'm here today with Dave Kelly. He is one of our clients. Oh, am I not loud enough? One of our clients from the the United States and he is going to share his story his user story on how he Deployed learning analytics with his company. All right So before we get started just a level set on learning analytics and our definition of learning analytics At its base form, it's pulling your learning data together in a list or a report to You know to organize your data, but a stronger learning analytics platform allows you to summarize make Comparisons look at trends over time and then provide you insight to interpret that data And to make it actionable. So at IntelliBord, we have our framework where we bring your data together Analyze it make predictions so predictions of learners at risk learners who aren't won't complete risk for your courses Provide you notifications. You make the interventions that data comes back in we analyze the interventions and in the cycle continues Alright, so Dave tell us a little bit about since I Well, thank you for coming today everyone. I greatly appreciate it and hopefully I'll be able to share some stuff that you guys can take back with you To your institutions. So since I is a cyber security company since I stands for sensible cyber We mainly service Small and medium-sized organizations. So organizations of 500 employees or less is generally our sweet spot and What you're looking at in the box there is Not only all of the services that we provide to our clients as one pack cyber security package But every one of those is data that we need to then present to our clients right in an understandable way So on the left-hand side, you see the cyber health evaluation that generates your SunSci score In the US, you know, we have this credit score. So it's calibrated like a US credit score. So if you have an 800 You're gonna get the best interest rates. So if you have an 800 cyber security score You're doing everything that you should be doing to protect your information If you're 700 you can get still get credit But but not as a good of a rate then if you're 600 or below good luck And so it just makes sense to everyone that doesn't understand cyber to start with that number If you work your way over to the right That that SunSci score then generates Our cyber health plan for our clients, right? So what do they need to improve that score and each one of those boxes? Appears not only in our Moodle instance, but then the data gets fed into and teleboard for our clients Our clients can track all of these metrics. So we have things like a policy library Most of the time, you know, you get policies when you onboard and you forget about them, right? So we're constantly training folks on these cyber security Awareness and also what what is our company policy and what should we be doing and not be doing? Because 88% of cyber attacks to this day are still caused by user a user making a mistake as we walk through these I'll talk about the dashboard and sort of how we brought that data forward to our clients But just to say each one of those things comes into either through Moodle or directly into and teleboard and then gets displayed to our clients Okay, so this is our Moodle landing page So this is what our clients see when they first come into Moodle So this is where they get their cyber awareness training served up We have tutorials on how to secure your applications. So in cyber security, there are a lot of things That's live outside of your boundary, you know, we're all we all have mobile devices Our marketing teams are using social media to do You know marketing and so forth and how do we secure those things that are outside of our boundary? So that's a tutorial You can see on the bottom left. That's the cyber health evaluation So that is a proprietary algorithm that we've developed it examines 106 cyber security data points and that's what spits out your SunSci score Also have Policy library and that incident response planning but on the upper left hand side where it says cyber health dashboard That's what takes us to our on teleboard instance and present presents this data in an understandable way to our clients So everybody who's using Moodle is probably familiar with this, right? It's the quiz Format so the cyber health evaluation starts out with that quiz We have a client and their IT team generally On a consultation and we walk through it We've got it down now to 39 questions that examine the hundred and six data points and they're weighted based upon What is the most likely thing happening today? In the cyber world that's going to cause a problem for your organization or your institution This is our sort of what our training modules look like So we've really positioned our cyber awareness training more as an employee benefit as opposed to a crap I have to take more training right and how we do that as we're really trying to with a lot of remote working and things going on right now We're really trying to make every single video Be what can I do at home to secure myself at home? I have kids online. How do I how do I do this in my personal life and oh by the way? We also have a policy so your policy training and everything comes into play here Served up to Moodle and then we're analyzing that And serving it up to our to our clients on and teleboard will get into that just a second Thank you So, you know when Dave came to us he had the learning figured out the learning data The learning is is happening in Moodle. Obviously it looks it looks great but he also came with very specific challenges and Key data fields that heat that he needed to to be able to measure that that cyber score and and Prove that the learning how do you prove that the learning is preparing the clients and that they are Going to be successful and not click on the link or download the the file when it is sent to them So what challenges did you have Dave getting that that data out of out of Moodle? Yeah, I think first and foremost right we needed Something that was easy for the clients to look at and understand right Business professionals are not cyber security experts So how do we take a complex set of data and show it to a client in a way that they're going to understand it That was the very first challenge and It was one of the things that really attracted us to a teleboard at the beginning because we can do this in graphs and charts very simply I think secondarily I Talked a little bit about the proprietary algorithm that generates the SunSci score We needed to protect that but then also be able to show The information that the clients needed to see in relation to that score without divulging how the algorithm is sort of working And then also and I think we'll talk about this a little bit more in more detail, you know in cyber security It's really important that only the users Who have access who have need to see data and authorization to see data can see that data Right, so we needed a platform that allowed us to be role-based whereby our internal employees have a role and they can see certain data the Client has a role and they can see certain data and they may even have Employees that need to see a subset of that data, right? So those are probably the key the key points from the list Yeah, and you know you identified what success looks like and then You know linking together that the training the learning and then the success and measuring That the training with that success. So now that we've seen what your Moodle looks like Let's see what you've done with and teleboard. So this is your your main Overall dashboard. So tell us tell us what data you have here I'll work from the top down So the first thing you're seeing sort of in the dark blue box there is that's a real-time RSS feed of Cyber threats. So we're serving that up in in teleborder real-time to clients We tune it based on an inventory that we bring in so we know sort of what Applications clients are logging into what software they have what hardware they have and we serve that up to them in real time So they can click on each one of those things if there's a vulnerability that they need to address It's coming in through the RS as feed Into their into their specific dashboard related to them as we work our way down You can sort of see the SunSci score over time So again, that's our that on the left-hand side is with this particular client is where we started with them And as we work with them through their cyber health plan You can see their score going up occasionally the score will go down Based on some other factors and I could talk a little about that later Below that in the two bar graphs the one on the left is I should have mentioned that the cyber health evaluation is based on the NIST standards, so you have identify protect detect respond recover Each one of those things makes a good cyber security posture for your organization So we're tracking each one of those how are they doing in each one of those categories on the right-hand side more Relevant probably to educational institutions is their training, right? So that's one of the metrics that can take the score down So if we're not getting 80% compliance on the training a minimum of 80% then that that score can go down So by virtue of the client looking at the score and being engaged with the score everybody's competitive They want to have a high score it helps drive that adoption of the training Because they look at that and they know their score went down and now they can start to push out Hey, folks, we need you to take this this training And then at the bottom are some other things that we're mentioning. I think we'll get into those in another slide Yeah, so it's that one it's the one location It's the one place that brings everything together with the key key critical data. So this is for SINSI and their advocates, but it could be an advisor dashboard at an institution or a learner dashboard or an instructor dashboard So this next one is for your advocate. So advocates are your SINSI staff your SINSI employees So how how did they use this dashboard differently than your overall dashboard? Yeah, one thing that's great about this is we build it once right and then we can use it for multiple use cases So you'll see as we go through these slides the charts look similar Right, but based upon your user role or based upon your need to know information The dashboards can change. So in this case what we're showing is There's several things that we have to monitor for clients where we don't have direct access to the data, right? We know what the information is But either we can't get access to the data for some reason or we're just not plugged into that information It could be a legacy system could be you know, lots of reasons In this case, we we're doing external vulnerability scans and dark web scans for our clients That data set is a as a proprietary data set. We can't build an API to connect it to the dashboard So what's really nice about this is there's something that we use called inform that Allows our advocates to run those scans and very quickly enter that information in five boxes Into the dashboard and then it displays it as if we were connected So we have real-time connections and some manual things that we have to put into the dashboard, but it's all there Sort of in one source of truth for the client Right and that can live inside Moodle as an LTI as well. So wherever your Users are they it could be coming to Intellibord or instructors Advisors if they're inside Moodle Intellibord can live inside Moodle. So in this one dashboard He's bringing together the Moodle data, but then also using inform additional data sets So at an institution it could be interventions. It could be performance events It could be any any information that could that gets added to the data can then be tied to the learning data And that's where you start to see the impact of your interventions because that data comes right back in with the learning data And it's in that one spot. So the one place the one source of truth for your advisors to go and see learners at risk or in your case Companies at risk in addition to the form it could be a CSB file of data So you can bring in any data source into Intellibord and combine it with your learning data So similar similar dashboard, but different use so building it once and then applying it to to other users So this one is for your managers, and that's the managers at the the clients your client managers So tell us about how your client managers utilize the dashboard Yeah, so when we're talking about client managers We're typically talking about either the leadership team inside the company or folks that are tasked with IT right and so this is the dashboard that they look at To determine how are we performing right? So how are we performing not only on our sense? I score But our employees comply complying with the training. Are they learning from the training? Where do we need to improve right so by consistently looking at this right and we can drill down we don't have a drill down slide here It's actually at the bottom So if you look at the bottom it's a little hard to see but you can drill down into each one of those bars And you can see actually by percentage how you're performing and what makes up that overall total Which has helped us to when we have our client advocates our cyber advocates talk to the client When they're looking at this on a regular basis It helps us to advise them on the things that they need to be doing to improve They immediately know because they look at it and they know okay. We're not doing this What do we need to do to improve this particular aspect of our cyber security posture? Right and this dashboard is automatically filtered to each client So you build it once deploy it and each client is only seeing their data So it's the same in an institution if you you know build that learner dashboard of the instructor dashboard And when it deploys every instructor sees the data that they have permission to see You know, I think one of the things that's great about that is so we have you know Multiple clients on the platform, but from an internal perspective when our people are looking at it It's the same dashboard to them. It's just a different set of data for that individual client So once they look at it and understand how to navigate it. It's the same for every client. It's just different data And you know your risk is identified through an algorithm that you created but Each client we work with you to identify like what does success look like and then how would you individually define risk? So it could be a calculation. We have machine-based Predictive learning analytics as well as rule-based where you create what you think risk should be and And you know adding that critical data to the dashboard and then having the ability to input that intervention is powerful Great. All right, so we've talked through a lot of challenges that you have overcome Deploying your learning analytics How has Intel board supported that process? Yeah, I think each one of these bullets is important You know engagement and fidelity of corporate learning so By virtue of being able to integrate the algorithmic score with some of the other things that we're trying to get the clients to do on one Dashboard automatically creates that engagement because they know and they have to do these things in order to improve that score So having them see that on one dashboard really important Compliance super important to us. We're a cybersecurity company. You know, we need to make sure that Folks have access to only the data that they're authorized to have access to and that we can clearly identify those roles And that we can have control over that when we talk to our clients. So very easy to do With the platform and very happy with that Compare training results results with performance that can tell you a really good story about this So we had a client reach out to us about two weeks ago And telling us that he had almost wired a hundred thousand dollars US dollars to a Fraudster so a cyber criminal and what happened was he had taken a training on business email compromise So through our platform, right and recognize this as a potential business email compromise And then dug into it a little bit further and found out that's exactly what's happening So what had happened was his his somebody had been squatting in his Vendors database or sorry in their email and Was waiting for something to happen, right? They didn't change the password. They didn't take over anything They were just in there and when our clients send an email to them saying Hey, we're about to pay this invoice. Just letting you know it's gonna come out on the third They took that client's email moved it to the RSS feed So that particular client couldn't see it anymore and then responded and said hey our banking information's changed Thank you for letting us know you're paying us on the third. Here's our new banking information This is a really common thing that's happening right now We've seen it all over the place and we had created in real time a training video on this because we had been seeing it And because he had that training video he recognized it He did the extra steps to call the person and confirm and they were like no I didn't change my banking information and also that client didn't know that someone was in their system, right? So a really good tie-in to how the training helps them You know recognize things in the real world to save to save money that could have been a really I think that company has 60 60 employees so the hundred K was no, you know small amount to them That is a great story of impact. Do you have any other wins within teleboard? Sure, I have I have a really like one of our one of our favorite clients actually is a software development company and you know I come from that world. So I know like when it comes to Security we're all just trying to get code out the door, right? So we're not necessarily thinking about security and when we first spoke with this client They first did their sense. I score they actually scored an eight So an eight out of a thousand Our client success person who was doing the score actually reached out to me and said hey I think the algorithms broken at these people scored an eight, right? So I immediately jump in and look and said no they scored an eight So, you know over the course of About five months we got them up to a 650 And today they're at a seven hundred ninety six So four points away from that eight hundred which is what we're trying to get all of our clients to write so it's a really great success story and They by using the Intellibor dashboard, right? We're continuously monitoring. Where's my score at? How are we doing and then we were helping them sort of prioritize the things that they need to do? To improve that score right? Hey, let's get you here's the things that are most important because this is your biggest risk vector So let's get those things done first and then secondarily Let's work on the things that are easier for you that are going to incrementally improve your score So really great success story and really had they became You know really aggressive about improving their score as fast as they could which which we loved and that's because they were Seeing everything kind of in one place Yeah, that visibility and identifying and you've identified the key metric the metric that is most valuable so So what Dave and since I has done is is kind of follow this they've identified what Success looks like or what data is most critical and built an algorithm. It could be a calculation. It could be Pacing for a K-12 school. It could be based on engagement of participation and in higher ed But you know identify the critical data that will help you achieve that learning goal So you're delivering training or teaching instruction. What does success look like? So if you start with what success looks like what the rural world goal is and then tying that training to that to the goal and Making it actual actionable. So giving access to people who need the data right now data It continues to be siloed. There's lots of different educational applications and And it lives in multiple places so having a secure way to bring the critical data the data that that needs to that They need to know not the entire system, but bringing in the key data And in providing access inside your Moodle all one dashboard and then allowing Notifications so Dave and I've actually been talking about notifications We have recently released something new that he will hopefully be taken advantage of soon which will be Not even the the advocates going to the dashboard, but that data being delivered right away So if there's a drop getting that data delivered immediately and then of course tracking tracking the results that can be inside and teleboard but That the interventions the communication What impact did that have on the learning that ultimately leads to the success? Yeah, one thing I didn't mention to you that I should have when I was looking at this that reminded me of it is The other thing that's was really important to us is when when the clients looking at their analytics or learning analytics, right? We wanted it to be a seamless experience So when they log into Moodle, they don't feel like they're leaving to go somewhere else and the integration is really nice It opens it up as if you never left Moodle It stays right in the iframe you can go back and forth between other Instances of your Moodle other parts of your Moodle without without ever the user ever feeling like they've left the air They know left and gone to some other analytics platform So that was also important for us who wanted to have that smooth user experience All right Dave if you all have any questions or right outside for myself or in teleboard or with Dave, but Dave You rocked it. I'm not sure what's happening Maybe you're a student logging into Moodle, you know, you're gonna graduate some day Got a smile on your face gonna be an ace posting in forums all over the place We picture logging into Moodle, you know, you're gonna grow it all these papers today Got a smile on your face gonna be an ace posting those grades all over the place Sing and we got a smile music jam that in teleboard is sponsoring. So come join us tonight And and you can join in on the song. Well, I want to do it another thing My name is Anna Tull. I'm CEO of Intel board when we started Intel board. It was very small We started talking with Martin about how we can work with data today Intel board is completely different what it was seven years ago, but Moodle provides the most sophisticated data set and Out of all the messes and believe me we work with everyone and we are proud that today we are certified part Integrator with Moodle and I'm super excited that we brought Client who actually showcased it now that we talking about how our technology is cool It is cool, but when clients are using it and they make a difference So that's how we would like to support Moodle mission. We're not open source However, we're doing everything to support that mission and that's where our pride is You can come to us at the booth. You can talk to Dave. You can talk to us Dave is also hosted by Moodle US and This is another proud thing for us that how we collaborate all together and it's not just about one company It's about all of us. Thank you so much