 Yeah, so thanks guys, how are you like it? So it's my first Europe Python, but I like it a lot Let's see where it's next year For those that so in the printed Version of the the program now was something about cities That's not it. So they changed the schedule a little bit. So Yeah So I'm gonna talk about plot we are a client kind of a hobby I I had for the last couple of years Now I'm then doing something for it and now that I was accepted here for Europe I think I finally could put some effort into it to have it like Usable and since yesterday evening it for the first time it did go through so let's hope so in the morning today It wasn't maybe In the meantime it was so let's see Um, it's not as polished as it could be So maybe about me first Yeah I'm Mathematician by formation Spend a couple of years in academia Now since two years, I'm senior consultant with the one-shot solutions where I'm doing projects in data science AI Coaching people setting up infrastructure for data science stuff like that and also Having I'm having some open-source projects. So you you will get the slides there you will find the links and Introducing today for the first time to a public audience plot VR is there as well One or two sentences about the one solutions so yeah We are about 40 consultants and I Think it's I It's really correct to call us a talent heaven so if you think you are a talent and You're working or want to work in Switzerland, then maybe contact us. We are hiring Come to me or go to our homepage. We are doing all the things for clients in the data pipeline Yeah, and yeah, it's really a Smart team that we have there Okay, what is plot VR about so A show of hands who of you is doing like graphs like this or plots a scatter plot stuff like that on a weekly basis Or monthly basis something like that dashboards. Okay Lots of people data scientists do that a lot and you you really get skillful Producing the things that you need but now and then You are missing this one dimension that actually would be there the third dimension. Yeah, you know And then okay, you go you look up what is what is there in the in the field would I have libraries and you probably have used them so Who has used such like plotly or or scatter 3d or stuff like that most of you okay? Who is using them on a? As well weekly or monthly basis Okay one person there Cool I Usually don't stick with them. I Think it is because they are still they're not a real thing There's still a 2d projection of the data. You don't really can feel the data the third dimension So there are they used to be Expensive possibilities like 3d Monitors or maybe domes stuff like that But as data scientists usually it's not so important for you to use these tools So probably you won't have a standing something like that around So three years three or four years ago there was this announcement At Google I owe about the cardboard and when that came out. I thought hey If that's inexpensive so because you basically you need to buy the cardboard you don't even need to do that and then you can Visualize really in 3d and you get a three-dimensional impression because you really have the stereo effect that could be it so Yeah, I thought hey, let's do that and that's what this talk is about So how did I progress with that or what are the issues you you need to think about so the first issue is okay? You are on your desktop or Notebook having your data doing your gg plots or your Seaborn are whatsoever and now the idea would be to get it onto a device So you need to somehow transfer the data from from your from your workstation to your device Okay, that's one point you need to think about Probably Bluetooth could be an idea, but that's a little bit weird for me to program. I have Frightened maybe once but I didn't achieve it. So I thought okay. Let's do it via HTTP stuff Then maybe we can do so two years ago the AR hype came so maybe you can do both of those together That would be an idea then the next question Can we just put like a mobile web app where we look into these things or do we need a real? iOS or Android app programmed Also, how do we navigate in this VR? That's always a problem And then will it cost to use or something so will we need some some expensive hardware or not? So the idea was no, let's use open source for that and then also can I create all of that in my free time? So the last point was maybe the biggest issue. So that's why it's now three years later So a little bit an overview what what is there now? So basically we have three Three devices where we are three clients where we can look into the HTML one the iOS one and the Android one The Android one I started back then when I I did those things and then I switched to an iPhone and now I'm I did it mostly for iOS. So the Android is a little bit lagging behind Now VR works in all of them the HTML version of the VR is kind of not nice I don't know why The AR version of HTML seems to not be as nice today So it needs to have like some some anchor in your in your vicinity But the others yeah, you see what it is there and actually Since today also the iOS version is on GitHub So if you want to double around with it Yeah, let's show you how it works So I'm going now for the For the iOS up So let's see Okay, so here you see my screen share and here see say the Jupiter lab So the code that basically is really simple You import this package after you have installed it This will start in a different process so a tornado server on this port 2908 and Yeah That's it. Now you need some data to plot. Let's plot iris Who of you doesn't know what the iris data set? No, so these are the not died data scientists, I don't know or not the classical statistical data scientists Okay, and then you play basically send it to that server. So now, okay, that could be just empty functions, maybe Let's see what happens now in the iOS version So we open this plot. They are now you see they need to communicate via IP So they are actually I'm using here my phones wireless I'm also here for for my Macbook and It actually shows me up that here. I need to connect to that. So first of all, I need to find the server so I'm Do it going for the qr qr code tech. There it is So now it's there. So I now want first to look at the AR version So let's see what the demo got sting Okay, so first of all, yeah microphone is maybe not there So you see here. I put like a the origin It's always where the phone is when it started and now you can really Go and look into your data I think really this is a huge difference between having like a 3d that 2d plot Or 2d projection of your 3d things So you really can get into it. So below you see the where it found like the the plane the floor So in an advanced clinic would like calculate. Is it a floor or a desk and put it in different heights stuff like that But yeah, so there are some issues if you go like this you see from from behind. It's dark because I don't Yeah, but I think this is nice Is it okay for you if I take a picture of that? With you so and can is it for who is it not okay if I put that say on Twitter or stuff like that? Okay, then cheese good, so that's the AR version Now for the VR version Let's see Now I will need to Do like this and this and this So here the problem is I don't know whether we can maybe we can kill the lights or at all. I don't know whether that's possible So you will see it only just very faintly now In the in the middle here. I don't know whether you can see it. So yeah, that's the first thing a Little bit huh So yeah, that's the problem now We would need to get it closer to us know the data in order to be able to really see it so How do you navigate and now? Usually this cardboard thing you would have it like really here and you wouldn't see anything else Yeah, so you need to have something in your hands or in one of your hands That you kind of know so something like a game pad. So you could connect a game pad to that thing but probably most of you I Don't know maybe a door Europe height and more than in other circumstances don't have a game pad in the in their working environment So well, let's think about what do we have? Ah, yes, we have the workstation. No there. There's a keyboard So could we use that? I mean here we are typing in all the time. Yeah Okay, yeah, so we just need to get those keystrokes and push them to the phone So let's do that Maybe do it a little bit bigger This and now it needs to have the focus of the of the keyboard. So we click on it Ta-da and now you see you are like in who of you has ever played like a first-person shooter game So, you know ASDW probably so Now if I I never know which way around I did it because I couldn't test it that much So I'm pushing. I'm now Getting the data back to me. So I'm clicking on s So now I need to get it up Now you should see it much better. I know you don't see it at all like that So again, I Can get it up. I can push it back Down come back to me and now I'm through so I need to get back So basically if you know your your first-person shooter, and I guess you you do blind typing in first-person shooters You don't W Yes, so you know that by hand So if you are in the immerse situation You really can go through it and and really start examining all the things in 3d in VR Okay, so that's basically the demo part so just one For debugging purposes because that's the only thing that also works in the simulator. I have also the 3d part here And you there really see okay You can get to the data and you can explore it, but it's for sure not as nice as if you are doing it Maybe you see it. Yeah Okay, maybe go for you some of you might have come for the city's talk, so let's do the following Maybe even do it like this So you I guess most even if it's a international conference most of you might recognize this data set It's Switzerland But if you now go close to it So in the in the other direction so you really can start looking into these things But use that on the using that on the iPad is really amazing. So I like it a lot. So So just to finish a little bit So Yeah, the demo gets gods were willing so I don't need to show that slide. Oh It's not connected anymore So this slide is not needed, but I I hope you agree it works kind of So a little bit the architecture now is is really simple we have a Server in tornado that can run anywhere basically usually it runs on on your workstation where also your Jupiter runs In the Jupiter notebook you have an iframe that embeds this html controller you can so from the Jupiter the data gets posted to the To the server the iframe here the controller talks via a web socket to to the server to exchange to send the keystrokes And to exchange status so you know whether how many controllers are active and so on so basically here you see There's one device connected. There's one controller and it has focus. So if you go if it loses the focus Yeah, then the focus number goes down something like that would be nice also to show it's done in in the app I'm basically the server than is a broadcast mechanism. So all the the devices connect get the data right now via HTTP get and Get the keystrokes and the status via web sockets and Right now be careful. Everything is unencrypted and it's open to everybody who knows the IP address and the port So that's for sure something that if it gets bigger one needs to address Okay Do you want to have it? Good so you can pip install it right now from from github Currently, I hope that I push it to pipeline soon. You can get it for R. It's a slightly outdated version right now I will have that up in a couple of weeks the iOS app since I think two hours is on github Either you download that you clone the repository and install Xcode and you then you need to have a Free personal team setting there and then you can deploy it to your devices I think I will have soon something where I can push it like to a hundred devices worldwide if they gave me Give me the device number and then maybe via the app stores test flight I can even have like a shared public link eventually, but there it needs to go to the browser So I think the app is not ready yet And the Android app is there as well. So there are APKs on the releases Here as well slightly outdated Yeah, okay, so What do I think? Will do will be the next steps. So first of line first of all I would really like to have texts there. So my my dream demo for today would have been If it would have been running already say day before yesterday Say to get all the abstracts of the talks here puts stem through word to back so that every every talk gets like a Vector and then you can walk through the talks. So that would have been a really nice demo It's not that hard to do now Yeah, I hope that so stay tuned for that I'm also having lines or surfaces I don't know the ISS trajectory to see it really in 3d would be something I'd like to do or a flight Then make the scenery nicer Maybe don't have a black background or I don't know Put it onto all the Repositories and stores and then solidify the protocol and make everything like really working together. So that's Maybe I hope that by end of summer. I'm somewhere there Yeah, and then there are some other ideas HTTPS having that having something like an Authentification authorization actually Jupiter is a tornado server. So could we just plug into it? But I think it's it's not that easy You need to be careful with the async things. Maybe then it works Interface to plot legit plot then and maybe eventually have like some some new Data hub where you really can walk where you can publish your data sets and people can walk through them stuff like that That would be really nice. So Yeah, thanks to all the Giants shoulders. I'm standing on Also my employer To send me here Also to Euro-Python to accepting this talk so that I finally could bring it forward and to all the future contributors of these open source projects Thanks Okay, I think we have a couple of minutes for questions. So there's a microphone over there I've got one here. Anybody has any questions? Yeah, do you have an idea how to get users for that? Like, you know, like you're talking about Technical stuff right now, but it would be like really nice. That's like lots of people are using it. So where is I Once worked like the proteins and stuff. So various like online database with 150,000 Proteins like it's like 3d structures and they have like a lot of tools So to plug such finger on this is like in my eyes It should be like pretty nice because people are using it not here. That's probably not in your workplace, but the yeah Biologists all over place. So yeah, that's I guess an idea and probably a question, but I don't know Yeah, thanks. Yeah, I think actually this isn't like constrained to to data science plots I mean having something where people can by some means produce some 3d things and Then just being able to look at it in in their devices and I mean Apple really is announcing now in a beta version What is it called reality composer or something like that where where you can start building things to your AR kit things I guess that's the same direction. I'm more now on where I'm coming from so I Think it's it's yeah, you you can use it for for many things. So Yeah, so maybe if you if you're willing you can write a converter that just gets out the data points and Then we we can just grab all of those proteins and Publish them in a in a in an AR view. Maybe they haven't done that yet and for us now It would be just the conversion then having it Yeah, thank you for your talk So my question is have you actually tried it in house for practical things? And what were the results because with these first-person through the shooter? We know that these experiences can be pretty immersive and well It's kind of we navigate it from the technical side, of course, it's bleeding edge of interfaces It's like very interesting technology to play with but I'm interested more like Reception side or neuro psychology side of these things. Are they really make people work and analyze this data more efficient? Yeah, we will see. So that's the test of time. No, I Think actually the AR thing is nicer for that because Really the VR thing It's too Too occlusive so you are really in in the data and it might be something cool to do but maybe not that practical I think the AR thing is much more if you really can just push it onto your phone And then look at it like if it was was standing there on your desk and you can look at it And if it's no hassle, so that's that's the key point. It's no hassle if it's no hassle I think then it it could be really beneficial. Yes I mean in in corporate environments. There is the problem of Do you get the the data from your? Through the firewall to your device, I guess there will be a problem So I'm not sure how to address that yet. Maybe one can push it through through the QR code actually now that I'm thinking of so there's some Developments that allow browsers to render augmented reality images there So you are talking about web XR for instance. Yeah. Yeah, so there the AR needs really like a barcode anchor So I mean we could just have that on the display and then it's like anchor to the display It could work I Kind of don't like that too much personally. I don't know why so I thought I really want to go for the app there Because there it's really you don't need that anchor. So you can also show it then at lunch to somebody or show your newest plot to your Significant other in the evening. So, you know But yeah, I mean that that certainly would be to to to have it In an HTML version, I think that would be the way to go right now. Yes Okay, any other questions? No, then I would like a big round of applause