 Hello everyone, I'm Yossi Palmashi and I wrote a VR server That's a ever since ever since Zuckerberg sold I mean changed his company name to met These goes by the by the name of Metaverse. So, you know, that's what we call these things like today So what am I what am I doing on on finance conference? Well, spoiler alert those spoilers We'll get to it I'll try to to do this presentation in three chapters every every one of them in why what and how manner and Why Would I do a open source VR server in the first place? Well, because finances are boring, right? I mean, I know you can't admit that in front of your bosses But but we've all been there, right? I mean if you were interested in finances in the first place with study economy or something, right? that's the software engineering and I've been science fiction and open source fan for a long time and to me these science fiction books read like Like a project handbook in many places So there's no you can see that they write there's no collisions on the street This is you know direct optimization technique To save your CPU power or there is no shadows on the street again, you know too easy to make rendering easier So, you know when I read it I thought to myself. Yeah, I can do it You know and I and started writing it. It was somewhere Somewhere 20 and Three years ago, I guess Three yeah, it was last century, you know when I started writing it. It was a It was very very long time ago way ahead of Way before it made sense from that round of VR attempts Only only second second life made it all the other companies including mine failed miserably specifically failed to find funding and a Project went on hold for quite a while now that now that again Zuckerberg is spending like 10 billion a year to make it happen now. It does make sense, but more importantly best thing that's Happening right now in terms of we are and especially we are enabled Internet is not Facebook changing gay and changing name to met our whatever but the way I see it it's Final and permanent debt of Internet Explorer think of it. How many times have we heard This does not work in Explorer. That does not work in Explorer, right? It's web sockets It's web RTC. Whatever you wanted it. It never worked in this border like right So now that Explorer is finally that that Everything just works and we can make plenty of good things, you know web GL works web sockets work Web RTC works. It just works and you can use it Only with the open source libraries that utilize open source standards, right? and So What else is there? I mean why why why this what's my motivation to continue now? because you see Facebook Google Well, everybody who is anybody fights for data Fights for data to collect as many of your data as they can to learn there to teach their ai's on your data, right? And they well to do whatever. I'm not saying this is good or bad or anything But this is I mean ownership of data is important and we should have some choices here, right? says the guy who has a Facebook Messenger Viber A telegram, you know and everything else on his mobile phone and all they have application have complete permissions to access anything that I have on my on my cell phone So yeah We are devices we are devices measure Your movement when you put it on they transmit your height Straight to the well to the owner to the whoever you connect to and So that's when you put it on all your moments all your moments go somewhere This is huge amount of data that opens up possibilities for unseen yet abuses, right deep fakes like You know unseen really We could mimic really you just by digging through your data, you know, what have you transmitted? so and you know Well enough about my motivation. I'm here to really I came back to show the I think proper way proper way to do it And it's it's hard it's hard, you know, there is a plenty of a synchronous processing concurrent Concurrent programming that needs to be done that is nearly impossible to debug once you put the break point It never happens, you know web developers Don't that's not what they do usually so I simply made a Made a library for them to use it to make their life easier to make cool cool cool websites in the right corner It's me in my hairy days with another hairy guy. I believe you do recognize it This is you know, how I discovered open source and on the on the left corner This is my discussion discussion with an AI character back in 2004 I think this is Alice, you know chatbot in In, you know, which browser this is this is the one that died finally So What What do we do? How do we I mean What we need to do to make it happen Truly we are enabled. Oh, I need to stick with microphone. I Will all right We are an AR are available on the web in the web browser that that works Out of the box on mobile phones PCs and VR devices this goes by the name of web XR specification that is developed By I think Google is pushing for it mostly Mozilla is lacking behind They are on a previous iteration that is called web VR I'm not sure if they gave up. It would be I would be very sad if they do, you know But it just works in browser So to make it happen. We know we need a lot of 3d characters and I downloaded like 50 Well, no 109 109 and made a made a move Just like I do so this is called inverse kinematics and the motion tracking I downloaded a bunch of 3d models and I like open spaces. I Did it all during corona crisis during lockdown? It was it was worse than Where is that or so they say it was worse than Prison even prisoners have even prisoners have one day outside one one one hour outside every day, right? And we were in lockdown like three weeks personally. It was madness really and This really did help me to get over it. I didn't stop there, you know So What I'm going where I'm going to With my project is a self-hosted solution like I Think we are server is like web server. There should be no no difference You can run Apache or anything else you want right for your website You can do you can rent it somewhere You can run it yourself Install your this is just different type of content really. This is 3d content specifically GLTF open-source standard that can be read and written by Everything that is out there every every 3d tool can read and write GLTF GLTF files cross-platform Well close cross-platform on both client and and server side As I said, you can view it in an access it in in mobile phones or whatever tablets You know PCs VR devices, but also on the server side, right? I don't want to constrain you to you know Linux Right or maybe even Red Hat Linux or you know Debian or something like that. So anything should do We have to have 3d streaming so When another person enters the room There are what are loads in the runtime, right? This is 3d streaming Video audio streaming so we can chat in the Like in real real reality we can chat just using our voices And as I mentioned motion tracking inverse kinematics to follow our movements And we need orchestration now What kind of orchestration it's easier to explain in how section so two green boxes here are The server and the browser and And This server does the this kind of orchestration that I have just mentioned so when another person enters the room 3d room 3d space We need to add that person to existing chat room Provided here by a streaming server So that kind of orchestration we can create chat rooms on demand That kind of stuff so In that box along with VR VR server we have a this is what I actually run on my my server on VR space or this is a Demo or whatever it currently is in github repository so it may be broken. Yeah, I do that sometimes But it mostly works and this is what it what it runs Most of the things here I have already mentioned open standards, you know Jason gltf And how we communicate with them Browser downloads Content either from the VR server or from the content provider. There are plenty of providers that offer 3d avatars you can take your picture And build your avatar Based on how you look Most important one is sketchfab sketchfab is a Think of it like a web shop for 3d models But they they also provide by the way by the way they provide 500,000 free 3d models published on the different Creative Commons license 500,000 models do we really need anything else to build a you know metaverse? I Mean why not but 500,000 model is plenty, you know And a of course we need chatbots so far. We have only Both Libre integration because I mean I'm not aware of any other open source chatbots out there, you know And they you log in with whatever, you know github Facebook and so on This is a Overlay of of the current state of the project. What why would anyone want to use it? This is actually why people use it virtual parties again corona times, you know Corona times I had my first virtual party last year around April. I think Usually 60 or 70 people come, you know, we party, you know, you have good times and they and recharge Around later that year Some other guys just dropped in downloaded software and made their own concert in this is in Bratislava some next Next festival. I really have no idea what it is because all the resources there's nothing on English They just my made their their own, you know 3d space with their characters and whatnot NFT sales, I didn't know that but I mean till the guy came and told me about it Asia was hit much worse than then Europe with corona crisis like Bali lost 85% of their income go figure 85% and they depend on on tourism So what do they do? They sell NFTs of what they usually sell Time-sharing in luxury apartments sell NFTs To keep just to keep any kind of income going going You can resell these NFTs eventually for more money, you know Things like that and really why do they need we are space here? Well, there is a AI chat bot that will explain you what they do how they do it and Where to buy their NFTs, you know, so Then there is a Indian startup that makes these AI characters for 3d spaces, you know and sell them as service or company product promotion Just company and product from promotion. These are all the models that you can see here are Available out of the box on Sketchfab. I made a simple Search that really calls their API and this place this place these models Other than that I've been approached with a Usual education, you know, this is a Ideal thing really to get students interested in 3d in or just just to collaborate to collaborate in You have I suppose we have all been on Large zoom meetings. They can get massive You don't know who's talking You don't know who is cool, you know things like that. So in 3d, this is more natural It's just like we sit around the table Very quickly you get the idea who's on your light right who's on your left and spatial sound improves the overall Experience assuming of course you still can share you still can text chat and whatever, you know, you do one thing that I'm Sad I can't help with and I get you know Queer is very very often are virtual therapies. So Father of autistic child Wants to train his child to cross the street So this is super simple game, you know, just a 3d street Model of car here and there crosses the street, you know, and they need to Crossover I'm not This is not something that developer can do nor, you know, not even the therapist You have to have child therapist that is into virtual therapist. So To to be able to help help help in these cases, you know but obviously and This is very very technically very simple very simple multi-user scenario To implement and that's why I mean this is these are all all all Specific cases of people who came back to me. I see some stars I see some forks so people use it I only know these about these who explicitly came and asked me about you know and told me what they do So what they do? So they they choose their avatar They click on the gate to enter, you know You may or may not type your name you click on the green button to this is website And if you click on the green button, you get texture. You just scrolls down and click on the goggles to enter VR mode and there is a And that's like all everything is documented up there you can go to wiki you can go to github, you know whatever or read read Read documentation online and really How they proceed them? Well open standards make parts interchangeable. You don't want this chatbot. You want your own chatbot. Just replace it Things like that, you know typically first thing that he gets want to They want to get rid of and replace his logo, you know, I don't mind I don't mind that's fine quite the opposite. I've allowed that to be super simple, you know Then they need to run their server it's a I believe it's straight forward for any developer because it's all documented But if they don't want they don't know how or they just you know want to play with html I have made this VR space or server open to public. No questions asked No, no cookies. No nothing just you know come and play with it and the same thing Where they web sockets web sockets are also open, you know, you can download everything and just develop, you know So then what what do people do they customize authentication, of course Streaming software for instance Open video that I use is not very good For for music If you want to stream music you will need to have some better better Quality, you know and so on sadly All these customization Typically never get out into open source They are all proprietary Customizations why because that's how venture capitalists to do That's what they do. They want to if they want to invest into your startup They have to be able to purchase Every single asset that you own, you know and that's why never gets out I hope I'm wrong on the left side. This is a screenshot. Well, this is screen sharing So I just got into this this United alpha space Hopefully this startup will publish everything and they is sharing my presentation this one so Why am I here? I mean on this conference so far this this doesn't have anything to do with the with finance well Cryptos cryptos are obvious answer answers Even with five hundred thousand open source model models One thing that I have to do is credit authors. I am required to do so by by Creative commons licenses, which I so blatantly Violated in this presentation because there are no credits look. Sorry guys. I can't I just can't because if I Show you authors for all these models that you see you've seen here. There wouldn't be Much room left for the presentation, you know for the text of the presentation But I'm trying to solve it with a What I call open source NFTs and This is the reason why I'm here really I'll show you this contract. So Anyway before we get there How does all this get Along, you know First thing that people want is I want to look like me and nobody else When you see me in the crowd, you should be able to recognize me. So how do you how do I protect my avatar? Well, allegedly NFTs are supposed to do that allegedly and They they should also provide ownership and portability and what not Allegedly because once you store, you know this token on the blockchain It's there. It's immutable. No one's gonna temper with it like Right. Well, you know first which blockchain? Okay, because you know you have blockchain this blockchain that How many of you of different technologies, you know, and then suppose you choose a terium There's like any theory of networks that don't talk to each other, you know so really portability is We are we are pretty far from there and especially if we get to identity Identity on the blockchain. This is I I don't even know where to start. You know, I've seen I Can't say how many of these competing technologies even open source projects You know that that I honestly don't know where to start last but not least investment Crypto tokens are much easier to deal with than traditional bonds shares, whatever and Investors love it investors love it They get response next day or maybe even the same day how how the sale goes with traditional Financial securities it takes six days to get any kind of response You know and that's why investors love it. The other thing is that it's completely era There's no regulations of any kind. I mean if you played Well, you make sure you have to make sure that this is not Then this is not Bond that this is not share that this is and what what what do all these startups do? They sell virtual You know like this token represents One square meter in our virtual world So this is digital asset like any other and has nothing to do with any kind of financial securities And that's why we have explosion of these these Virtual worlds that sell, you know virtual assets. This is how they collect investment What happens then you know so So we have you know like n organizations that all their Each and every one of them can run a number of virtual spaces Inside one server they they can plenty they can have plenty of their servers On the ledger distributed ledger they store identities avatars inventory, you know like what you can carry around How many tokens you have this is all on the ledger somewhere in ideal world, right? Now it doesn't matter what kind of ledger that is but the point is that to you when you like cross from LinkedIn to Facebook You have your avatar coins and everything with you, right? Except You know, how does that solve my question with tracking authors of five hundred thousand Free models that are there, you know Well, it doesn't I mean this is how I came up with the with the with smart contracts that that I call open source NFT and they and This is entire contract. So on the left side This is something that I copied from who knows where honestly just a cut Just just cut some pieces that I didn't need on the right side, this is my my my Super original contract that consists of constructor and Below it is a boilerplate code that doesn't do anything really. I mean It just there to to keep the thing connected This open source NFTs like any other NFT contains, you know, you are I of model of 3d model It is ownable so we can like any other NFT it is a numberable unlike any other NFT so it can it can be copied around it can be copied around along with the model and We need a On-chain content registry on the left so So registry contains author information Essentially and model information and points to URI URI of metadata. This is on-chain information of chain this URI contains Jason Jason information of metadata Which contains, you know image URL well Image is actually Miss nommer here because we are dealing with we are dealing with 3d models, but this is NFT standard. That's what that's how they call it and Did that this this image points to the actual location? So we are server registry means NFTs writes metadata if necessary and Reads reads metadata anytime and Deliveres the content net result is We have two tables. We have table on-chain table with All the models and the other table with all the others We can at any time Figure out how many Uses of a particular model has Everywhere, you know, how many how many times a model has been copied around? We have on-chain information right and We could do the same for Git commits, you know, I mean was the was the essentially difference You have this hash or that hash or this ID or that ID? Are you following? I mean I hope you do because you know, whatever we do and and this I mean I Hope It opens the way to get open source Authors rewarded for their contributions Right, so pull the report First every month and see how many commits someone Contributed right so Now that we think of it, why don't I'm not in the good any any kind of good business myself, but why don't Get hub get lab get this and get it that already do that Why don't I do it already? Well, if you try to pay some someone In in Brazil or China, you will get pretty pretty good idea. Why you know truth is That banks don't talk to each other and you will have to go with some FinTech That solves these payment issues and that this is if you Figure out Bank account where the money needs to go Blockchain solves all these issues as long as you don't lose your wallet Because if you lose your wallet you lose lose everything you you have you know Specifically my proposal here is is this really let's enable open source economy somehow With blockchain along these lines and that's why I'm here May I have the first questions Does any of this make sense to you do you know am I seeing things? Is this crazy idea does it make sense? to reward To reward open source authors based on number of their contributions second At the moment most of the code is mine less than less than 10 really Less than 10 no one. I have no idea. I have no idea. I'm techie. I'm techie I can I can write smart smart contract to enable it But other than please go on This is great question, and I don't have answer. I Really don't have this is really a equivalent question to how do you measure? Quality of a programmer obviously we're not going to measure lines, right? But I I think I think that overtime, you know overtime Someone who's contributing to Linux Ten years is obviously going to have you know continuously is obviously going to have more contribute contributions then Then someone who is new around you know and so on even if newbie is pushing commit three commits every day No If there are enough people that like your project, then your project will get part of the fund so it multiplies the amount you receive based on how many people you attract. So I think I get it. This is what you are doing, but with real money, not with blockchain. Blockchain, I mean it goes through this connection and all the funds are received with crypto money. Ah, I see. You were about to ask something also. So far I'm only displaying the attribution in JavaScript console after a model loads. I mean, there needs to be some UI. All this is only proof of concept that I've made specifically for this conference. Specifically for this conference I've asked my contributors, guys, does that make sense to you? And does this conference sound like something that we should ask? Never about it. And they said yes, and here I am. I mean, honestly, I need a reality check here. Should we waste time on this, you know? Or does it make sense? I mean, I don't know. I'm not sure it's thought-based, I don't know. Maybe one way I would imagine is more like trying to convince these auto to actually meet the energy in the first place. And then they maybe get a variety of other methods. Well, something like that, you know. Again, I'm not sure. I'm not sure about my intentions. I was trying to solve one problem and came across possible other kind of applications, right? I implemented this with Hyperledger BESU, which allows no-guess networks. I don't really intend to build my own network just for this, right? So I'm honestly asking for opinions and inputs, you know. Here, whatever you can help with it. And I appreciate your opinions and inputs. Why blockchain in the first place? Because anybody can download software without ever asking me anything, you know. And of course, that's the point. Each of their users can download some of all of these 500,000 free models from who knows where, you know. And they never attribute original author. So that's why I thought, you know, that blockchain could be a solution for these issues. I mean, especially in generative art. Because there's people which scored, which is easier to fill here, I put MIT and everybody can use it. Because they did that before the NFT craze. Because they just do this score, they generate beautiful art. And then some guys say, okay, I'll copy that, I'll put the NFT, and I'll make money out of it. But the guy who created the software gets nothing. That too. Which is sad. Because they are legally allowed to do that. Yeah, yeah, that too, that too. We are facing a huge amount of, I mean, ridiculous. It's free, how can you steal it? Well, you know. But you can, all that you need to do is fake credits. Okay, thank you for your attention and for your input. And any questions or anything else, please reach out.