 Before I dive in there's one of the reasons I'm excited about this is because part of I've always wanted to be a scientist That was my my dream as a kid and then life took over so I'm became a computer person But I get to work with scientists all the time now and I met Dr. Tom Levy who is the the main PI on this whole thing a few years ago when the library was invited to the table to work on research data things and He had this whole concept called cyber archaeology, which is really pretty cool because archaeology is a destructive science You have to tear a place down or dig into a place to get things out of it when you're done You're basically you're left with a hole. It's very hard to document that hole after the fact So they do a bunch of work on documenting things in 3d and we get to work with them on that and One of the things that we wanted to do Was be able to show this content within the library and so this uh, they got a grant from I call the catalyst grant from uc Ucup um uc office of the president For 1.07 million dollars to do a bunch of stuff to make that happen and It was meant to leverage that we have a specific specific research platform a big network to 10 to 100 gigabit that goes up and down california and to curate and Analyze and visualize a bunch of 3d data about these sites from usually from the middle east I have one slide behind sorry that and there's a there's a map Um, so these are the different kind of places that they work on if you've heard of dr. Levy's work at all. He's he's got some pbs specials on Early metal making and metal metallurgy in the in this this region of the world. It's really really cool Um, so the goals for this this grant were to capture at risk cultural heritage Sites and objects. There's a lot of stuff going on in the world right now things are disappearing and uh They want to be able to make sure that doesn't get lost forever They wanted to basically get that content and deliver it in 3d part of the whole preservation of well Their kind of preservation of the site and of the dig was to take three-dimensional scans and And pictures and things of the whole thing, but that's pretty complex data And we want to be able to show that and make it accessible for people for dissemination Um, we work with four different uc campuses. San Diego merced berkley and ucla We also wanted to be able to create output from this that created Virtual reality things that could be used by people in their personal devices. So oculus riffs, hgc vibes And even the cardboard the google cardboard and whatever else comes out from there There's part of the Grant that works on a product called terror terror watchers.org That um, I'll show you a little bit in a second here that watches for things for pollution Bombardment looting that sort of stuff And then like I said, we want to make use of that big pacific rim network And then it's one of the signature signature products for the cyber archaeology lab and a Group we have at campus called the qualcomm institute used to be collite cali t2 terror watchers is a site anybody can log on to it's um a crowd sourced watch the world's Sensitive are are under at-risk places to see what's happening and you can look in once you log in It'll show you give you a whole tutorial. This is a an example of looting So this is you kind of look at a spot where there's this probably a burial site Or an old Archaeological site that's been looted pretty badly and you can watch for things like this to happen You can they have they have a whole site a whole list of things you can watch for like gun emplacements and things like that It's pretty interesting. So that's part of the grant This is the big network I was talking about. I know c and i love his big network So I had to get a slide of that These are the collaborators from the four campuses There's a project manager named margie burton who kind of keeps us all organized Tom defante is a project advisor. He does most of the tech or manages leads the tech for these caves The payoff on this thing is I have a movie at the end of this that shows a lot of pictures of the caves And how it works and things so most of this is exploratory and we'll get to that at the end We have a fairly decent size library contingent as well to the aol for user services Catherine Friedman is on the team and makes as many meetings as she can as does hojung You who is the research data curator? I go and then scott macka boy who runs the Digital media lab and also is pretty much the owner of the cave kiosk in the library Making sure that it works Now these are the researchers all of the software all of the The work the the ui work is done by undergraduates, which is really cool So we get to work with them and hear how they're going through at the meetings and then They're graduate students who kind of do some of the the tech stuff and some of the transport stuff in the background It's funny we we normally have that earwig chart for for data life cycle This is the cyber archaeology version of that and it follows a lot of our same beliefs They go out in the field acquire things They curate it analyze it and then disseminate it and I've put a couple places in here Where the library ties in here the metadata management and data Staging and storage up in the top right and curation were involved there Then in dissemination I'll show you the flow on this in just a little bit the We use a library digital asset management system to hold a lot of that stuff and to make it available for preservation and for access So this is just one of the sites that's out there that they go and do things at this I believe Is it petra? Um, you can see the balloon and they have cameras tied to the balloon and they basically just walk it back and forth And take a bunch of pictures and they take those pictures and put them through an algorithm called structure for motion sfm Which then creates a really neat 3d model Let's see. I'm smart enough to make this run ah space This is the 3d model of the uh of it itself. What am I doing wrong? It's a point cloud. Um, so this this the first one was structure for motion with the balloon This is then used. They also use lidar to look at things like the actual The whole cliffs themselves and then some of the altars too as well. This is another movie, which Doesn't seem it says playing video Oh, it doesn't play for me. Oh, sorry folks On my screen. It's just sitting there statically. Let me go back to the one before them Let me go to this one. Oh, thank you. Anyone are always helps That's actually doing something. Oh cool. So not only is it just pictures and a pretty, um View of the whole thing. This is now a mathematical model This is now something that can be worked on and measurements can be made in real real with real space and that sort of thing Um, but I'm not going to show all of that And this is an actual altar. Um, so more of a specific Thing not moving Boom, I bet it's moving now. So that's that's an actual watch. So one of the pieces itself See how there's gaps and things too. That's because the lidar is on a stand shooting lasers everywhere getting those points back So it can't see around things. Um, but it looks a lot like a bad video game And interestingly enough I'll talk about that in a second. Um, this is the data flow. So this is actually pretty interesting from the library side and the data curation side because You can see that stuff over on You're right the uh the red thing and then the Archaeosol field data capture they go out there They're out there and they don't have high-speed access out in jordan and and out when they're doing digging in the dirt Um, so they have all kinds of different mechanisms. They use Uh with ipads and and and pcs and then let macintoshes that are going to Intent somewhere that they go back to and put their information and all their everything is geo uh, geo Notated um Anyway, so they do other work there and then they bring it into a couple systems. They have one's called a archaeo store and one's called arc field and Um, it eventually makes its way to the 11 teen um hub server lab server there. All right, put your glasses on And I'm not so pretty now Then uh the the processing there it goes into a bigger database called cave base Which knits together a lot of the metadata and the pictures and it renders a bunch of the pictures and does that Structure for motion work This is all happening on their side on what I say they the the researchers Then this box in the middle see that prp server the blue one That's that piece that connects into the whole california backbone The cumulose server underneath is a really kind of neat thing we have at the library Where we have this big storage system in isilon for all of our normal production work The cumulose server was something we got funded from some campus money For staging space and for experiments for how do you get big data into a dams into a into preservation? Or into um curation and this is a shared space we have right there They're in that box there because they're kind of competing at the moment to see which one has the best performance And which one is working the best for the researchers because we don't know yet. We're still experimenting here They're using both actually Of an r syncing between the two because the prp server has a much better high bandwidth connectivity to the other three campuses The cumulose right in the library's uh Right in our world So when we want to work with the the data itself and do things we have it right there I watch my time Um down below you can see that's the digital asset management system things get flowed down into there and then That's where it goes for longer term storage and for longer term access The other arrows go those four um sequences there in the bottom are the caves at the four different campuses And up at top. They're um the ucsd wave and the ucsm wave. There are a couple other caves um and these are um Basically screen constructs, but they call it a wave because not only is it just kind of a Screen to stand inside it actually curves over you like this. They have it built so you kind of step into it. It's very very Engaging it's really kind of cool All the green stuff is the things that the software and hardware that I control hard software and hardware I control within the library itself But it works within the ecosystem of everything else there And that's a lot of what the experimentation for the grant is to figure out how do we work at scale in real time with real data um Then also the other caves aren't completely built yet I think two of them are up right now besides ucsd's But I know they're still working on some of the details there the grant still has another year left in it um Like I was talking about that our dams at the library. This is when things come to roost there This is our collection page for one of levy's um cave cam Sets for luxor I believe And anybody can come in and take a look at this. This is a list of the objects within the luxor collection This is what we got originally as a schematic for what when I said what do you want us to build in the library? What's it going to look like? This was the original picture we got here and what it is it's it's six On their on their um End screens. So one two three one two three other 50 some inches They're 3d hd tv's which are kind of getting harder to find which is kind of scary Uh run by one big computer that nits them all together even the 3d is knit together pretty well with that And we made it stand up as opposed to sit down so that it was a bit more Key husky and a little bit more traffic could work a little bit better with people It's got a sweet spot So I'll show you here in a minute. You'll see when people look at it So it's really not meant for huge um crowds to take a look at it in 3d in 2d It does actually very well You can see it from way in the back of the library and I've got a shot of that in just a little bit In november, um, we actually unveiled this um at the library and this is you know picture of basically what it looks like here And we did an article on that And I have a video with audio here today here at the geisel library we've inaugurated this Uh immersive 3d environment called a cave kiosk and this is really great for public outreach and um, this is a game changer in many respects because we could put this um device in a museum Or library where you have lots of traffic And people are going to experience world heritage sites around the world So this system is uh the first off it's kind that we hope Sir that's Juergen Schultz. He's another professor on another PI on the um Project and he's done a lot of the tech and working closely with the undergraduates and grad students on some of that That those back end systems I showed you before he gets actually to the caves We'll see many of what we have here is six four cave displays that have eight megapixels each And they're put on edge so that we can stack them up and we have a way of curving the screen around the viewer And these things are also 3d so they can do They're like 3d tvs except that we put six of them together in an array And we run them all with one computer that's hooked up to all six of them and generates the images for all these displays And with that one computer we can synchronize the imagery so that it looks like The image is all one big image that is to stretch across all these six displays This project which is really student-centered it involves the undergraduates who've been doing the programming and Those are actually those are actually the kids who do the work. They're really cool It's really fun working with him. I have to re-cue this How do I move it forward? You got the idea It's a It's a pretty did you see also when it was in 2d from from they did the long shot It actually grabs the attention nicely from across the library Sorry, I hit the space bar instead of that. I don't know how to set it back up again But you got the idea basically gillio thing. So that's kind of the All the interesting stuff about that as far as Aspirational where it's supposed to go that actually works. It's physically there and working the stuff I talked about In this diagram where we feed the other campuses Note that he said that there's one computer running those six computers there. So that's those that Display is not both pulling from the dams in real time right now It's got a pretty much its own big strong computer there with a lot of video stuff running those six six screens So one of the things we want to experiment with over this next year is maybe we can start eliminating that local device And make it just an output somehow or a very small computer that pulls real time from the dams Maybe not maybe that's going to be too much of a load, but we'd like to know we'd like to know What might happen there another interesting thing about this device Especially in a library and especially in a space that's 24 or 5 most of the time We'll come back in the morning and see how they're nicely those those angles those angles are off just a little bit The 3d doesn't work very well And then we had to call in Juergen and his staff to come in and kind of realign it for us and do different things for us To make some sense out of it and eventually we got a little template so we could put it there overnight the kids tend to touch stuff And they'll kind of we don't know what's maybe it's a cleaning staff. We haven't quite gotten a good answer on this yet And we're not totally locked down on exactly the footprint where it's going to sit in the library So we haven't you know nailed it down totally But that's been sort of interesting as well too Something we thought we learned with these these screens. They're all granite leds They burn in remember that from crts. They actually burn in over time It was it kind of boggled us because we had a nice Ui people could walk up to and pick the stuff And you turn them off or don't turn them off Actually, they moved into another thing and and another another view and you could still it was burned in That's what i'm saying But they unburn in you can you can do things to them that unburn them in But it was sort of a surprise to us and we've had to do some software Reengineering to get the the the thing to move around a little bit the the static Ui space The the walk-up space. So that was really interesting We thought we'd have tons of problem with the the glasses walking away. They're about 25 or 30 for the glasses because they're the rectilinear Anyway, they're they're static glasses, but they still cost a couple bucks no problem with that at all getting those distributed No one's had much problem with that. They're pretty close to the digital media lab. So people feel like they're kind of being watched I think at least during the day I think other things that came up with it Other things are just having it in a library space There's you have to think about what's behind it. So we put a big melamine wall behind it So that we could post information about the cyber archaeology project and and the The catalyst grant itself. So that was pretty interesting But it does it is kind of weird how much it drifts during the week And we're not totally sure why Thanks. Sorry I talked so fast