 My name is Claudia Bilinska and today here I'm with my colleague Martin Gill. So our presentation will be divided and we would like to give you a very brief introduction about Creodias platform, what possibilities it brings, what data can you see on Creodias and we will show you also how to set up virtual machines. Okay, so our today agenda for our webinar, we have five points to cover. First of all, Martin will tell you about Creodias platform architecture, then I will tell you about available data collections, both free and paid VHR. Then we will move to Creodias platform, I will show you how to use Creodias tools, such as EO browser and EO finder, and then Martin will show you how to set up virtual machines. Our last point will be Q&A session and we also hope that you will have questions during the webinar. Our colleague from Support Dominic is waiting for your questions on chat, so whenever you have a question please write it down or you can also wait until the end of our webinar so you can also ask questions anytime you have something. Okay, so Martin, the floor is yours. Okay, so let's go to the first point, Creodias platform architecture. Creodias consists of several modules, one is Creodias Portal, this is the entry point for contacting us, you can register there, you can create your resources, you can order resources, you can see information about both Creodias and Cloud Ferro. The other module is called EO finder, this is the module that is used to search for satellite products. EO browser allows you to also visualize some satellite products and use some scripts to filter and to change these visualizations and Cloud and Cloud dashboard is the place where you can both create your resources like virtual machines, attach volumes, store your data, create private networks and change the way you can access the virtual resources and also there is a place for third-party applications, some of our users have their own applications installed on our platform. The satellite data is stored in our EO data repository, it is stored in public collections so anybody can access and see the products and some of the products, if they are offline that is not available on our platform but can be downloaded on demand, these products are stored in big cache which is also, if you order some products, they are downloaded to the cache and they are available for all other users as well and you can store your products also in your private storage so-called here private collections so that they will be available only for you so you can make some processing of satellite products and store the results on your private storage. You can search in various methods, search for certain products, you can access the satellite products and all the products that you store on your private collections as well, you can access them using various protocols like NFS, S3 and HTTP and you can also use our partner's Sentinel Hub and using WMS, WMTS so on the right there is a summarizing of our architecture so the whole infrastructure is based on open source software called OpenStack, the virtual machines are located on servers so-called computes and EOData is stored on the storage that is managed by another open source software called Ceph and some of the data you can process using our internal function as a service processors. The data can be both stored on block storage so the storage that you can attach to your virtual machines and format with your chosen file system and also on object storage and on object storage you can use access with S3 or OpenStack Swift protocol and you can also create your virtual networks inside your domains and make backups of course of your systems. Our virtual machines are divided into the flavors of our virtual machines are divided into several groups called EO1, EO2 and also you can choose from various sizes, the sizes are both dependent on number of vCores and RAM and also SSD network storage which is attached to the virtual machines that are created using these flavors so these are the basic sets of our virtual machines flavors some of them are based on inter processors and some of AMD and also you can also use virtual machines with GPU some we have a flavor called GPU medium and some of the flavors are also equipped that is the images are equipped with ARC GIS you need to pay additional license because this is paid software but you can install it from our repository of our images and they are also so-called dedicated servers that is this servers are equipped with bigger amount of cores and bigger amount of both RAM and SSD NVMe storage and also some of these dedicated servers are equipped with GPUs as well and more details you can find on our page so please visit this link so that you can see some more detailed information about our virtual processing resources so now Claudia will tell you about our data collections okay thank you of course so data collections which you can find on the Creeodias platform I would say that we have a really plenty plenty of data you can use so first of all as probably all of you know that Creeodias is actually was developed under the Copernicus scientific program so most of the data which are available on Creeodias those data come from Copernicus Copernicus program so Sentinel mission so these data are available for free they are open and everyone can make a use of them we have available data from Sentinel 1 A and B Sentinel 2 A and B Sentinel 3 A and B so both optical and radar data sets also they are on different processing levels so you can use processing level 1A or 1B and as followed 2A to B and also you can make a use of raw data which are directly coming from satellites we see that some of our customers are using raw data some of our customers are using process data so depending of the purposes of your work and probably your familiarity with the data all of the data from Sentinel they are on different I would say levels actually resolution scale so the bands which are included in Sentinel they have 10 meters resolution 20 meters resolution and 60 meters resolution and the time of the revisit of the Sentinel satellites is also different depending on the satellite we have also in our collection data from Sentinel 5P so if you would like to make a use of this data and to measure to monitor the atmosphere the current situation of the atmosphere this data are really usable in our data collection we have also data from Landsat satellite so Landsat 5, 7 and 8 they are also archive data starting from 84 until present what else you can see here NBSAT and SMOS data that's not all we have more within the Copernicus program the special Copernicus services are provided so we have you can access the data from those services like atmosphere service emergency land and marine so through desired data available through protocols S3 or NSNFS protocol if you are interested in different thematic let's say layers thematic data sets you can access them one by one you can download them or you can simply open a virtual machine and use them in the software on your virtual machines and the other data collections which are available are digital elevation model and here you can see that digital elevation model are coming from are coming from different as are available for different products and maps in SRTM you them Copernicus them so as well depending on what you are looking for we have also data from Jason 3 these are data from the altimeter let's I would say that Jason 3 is a kind of precursor of Sentinel 6 and that's what I also wanted to add that we hopefully we hope that soon data from Sentinel 6 will be also available on Creodias so we are really counting to see them soon on our platform the other data collection which is available is S2GLC this is Sentinel 2 Global LandCover these data sets were produced were developed developed by Space Research Center Polish Academy of Sciences so this is the LandCover of Europe it was actually done in 2017 so these are the thematic layers it was thematic classification based on the Sentinel 2 satellite so these are the data sets you can access completely for free you can download them or you can access them on virtual machines but also in our collection in our data offer we have very high resolution data sets so starting from the Chinese satellite Zhilin 1 then Kazakh satellite Kaseosat and then Korean mission CompSat these data sets have a completely different resolution in comparison to Sentinel because here the special resolution starts from centimeters so like CompSat in panchromatic bands it has 40 centimeters so this is really detailed resolution and the revisit time is also different because it's one one point four days so it's quite often on at the same point on globe but of course these are the very high resolution data sets and they are coming from commercial satellite providers so this data are not available for free you have to pay for this data but of course depending on the purposes of your work sometimes really detailed information is really really needed if you would like to learn more about our data collections please visit our website data offer or if you would like to get more information on Sentinel data please visit Issa Sentinel site where you can learn more about particular satellites and data which are coming from these satellites okay so now I would like to invite you for a short introduction to our tools your browser and your finder so we will move to your browser and finder okay so when you enter the Creo-Dias platform Creo-Dias website here you can see in the tools menu your browser and your finder of course these are the tools which are really helpful for data searching and data downloading we can see that some of our users are using our virtual machines to download the data actually to access the data and to process the data on virtual machines but some of the users are only using those tools like browser and finder to download the data to a computer and processes that process them in their own environment so if you would like to use the full functionality of your finder you have to be logged in user so the best idea is first of all to register yourself here using the registration button and then you can create your own account and then access the tools of course for free and download the data so I will log in to my user account and then I will move two tools so first of all I will show you your browser so your browser as the name says it's for browsing the data so depending on your location you will be located on the point where you are now so we are in Warsaw so here you can see the base map of Warsaw and here in this field we have to indicate the data which are we are looking for so here we have the full list of our collections of freely available data so Landsat data Sentinel data also NVSAT and S2GLC Europe I would like to see the data from Sentinel to A so I will just click this data on and then we will search the data we will find the place on the globe which we would like to see the data from so we can just zoom in on zoo or zoom out on the map or we can also enter the name of the place here here you can also see the other possibilities of database maps but what is also interested that here in the browsing let's say configuration panel you can also indicate the cloud coverage I think it's very important because of course we would like to see as much clear image as possible so the best would be lowest percentage of cloud cover I will leave 10 percent here then we have to select time range so the time when the data was when the data was collected so we can indicate here years month months or dates years days sorry okay so let's choose the date I will start from December 3rd and I will finish today here you can see great great days so these are the days which are indicating when of indicating when the satellite was was here moving around the globe at this place where we are now okay so then I will go to the search place and I would like to show you today Madrid I'm sure this is now very popular place and most of you probably has already seen the data from Madrid but let's check it so let's move to Spain to Madrid so we are here and now let's search the data of Sentinel 2 from Madrid so here we got the results of the data collection from Sentinel 2 so of course we have we can see the cloud coverage not cloud coverage but snow coverage in Madrid but let's see if we can see also the other data sets when there were no when there was no snow so it was December okay so we can also see the data without snow I would like to see the data from this area okay here we have even 0.0 percent of cloud coverage I will make a pin so I would this will be pinned to my favorite items and I will also see another day of this collection so here a third of January and then we will go to visualizing the data when you visualize the data you can use here different band combinations so it can be visualization in true color bands so here we use band 3 and 4 and 2 it can be sin classification it can be false color false color color indicating urban areas and DVI so so environmental I would say friendly indicator moisture index SWIR and DVI so water and NDSC so snow I will leave this true color visualization but I will also go to my pins to see the snow cover around Madrid so you can see here Madrid covered in snow and when I will go again to my pins I can compare those images so I will click this option compare and then I will click split so here just using this tool I can see Madrid covered in snow and also Madrid without snow so it's really nice and quick tool to visualize the data and to maybe present it during some presentation but also if you like the data and you would like to save it you can download the data it's not going to be saved in all bands like the completely full Sentinel data but it will be downloaded and saved as an just a normal image file okay so this will look like this okay so browser really quick tool for browsing then we will move then we will move to EO Finder so again from the tools menu we choose EO Finder so EO Finder is a more advanced tool for finding the data and downloading the data so here the download looks differently because if you download the data from here you download the complete folder with the Sentinel data with all of the bands and all of the metadata so you can use some remote sensing software EO software to process the data okay so let's maybe stay around the Europe and find some place here in Europe so first of all here in the search criteria we can indicate the name of the place so it can be Warsaw it can be Madrid or as it's written here it can be even winter in Quebec so we will receive imagery of winter in Quebec or if we have already found some data and we have the ID or the name of the path of the data we can enter it here then we enter here observed time so when the satellite was actually acquiring the data or when the data were published in our let's say repository we can indicate your position we can indicate your cloud cover and of course collection so let's start from the published time I will search for the data starting from December and until today then the cloud cover let's say 10 percent I would like to see the data from Sentinel to and I will indicate level of processing to a and that's all what I will indicate here in the search criteria then we can and we can zoom to the map and point the place from the data which we are looking for or we can write we can sorry draw polygon selection here we can point the name we can point the place we can also upload polygon so if you have if you have a vector file you can upload it here so I will use polygon selection to find the data of my interest so let's see maybe how italy looks these days so I will draw a polygon around venice and then I will click search button so here we got a full list of the results we can see that we have zero percent of cloud cover five percent seven percent and so I have just clicked one of the data to see how it looks so here we have just a small preview of the data set and from this point we can download the data we can receive some information about the data and here also you receive the metadata information so complete information about the sentinel and data sets which are displayed here so I will say that this is really quick and user friendly tool for browsing the data and from the for downloading the data you can add data to your cards order them and then download them to your computer okay so I think this will be all about our tools and now now marching will tell you more about virtual machines configuration okay okay so I will now share my screen first of all you need to enter our customer portal to to login and I assume you already registered if not please register to our crudias eu I will log in now with my test credentials when logged in I can both see some various information on this portal or go to the dashboard where I can create my virtual resources so I go to tool and choose cloud dashboard and this moves me to another page this is called horizon this is the dashboard of open stack uh opa stack cloud and I can choose both open id connect and keystone credentials keystone credentials is in this if you use keystone credentials you need to uh put the name of your uh domain so in my case it would be cloud 02722 and use a name uh john john doll uh it's cloud and put a password here but the easier way is to use open id uh so instead of putting password here I can use open id connect and click connect and then because I was logged in to uh crudias eu I I moved directly to the open stack dashboard so in this dashboard first of all I need to check which project I chose because by default there is one project chosen in my case it is cloud 02722 project with eu but when I open this menu I can see that there are also other projects available so these are other projects so I can move from one to another and uh among these projects the resources are separated so they don't see each other so you can for instance create various projects for for your customers for or for your other users and they do not interact with each other so let's stay with this project with your uh and the main uh dashboard is overview you can see uh how many instances you are using how many vcp use and ram you you have been using in my case this is empty project so only I can you can see that the uh free the floating ip is attached to this project and some security groups so uh first of all let's uh see the network and the network topology allows you to see in graphical way the resources that you have already assigned to your project the important information is if you have routers available because as you can see there are there is private network one called private network 02722 and another is private network external 2 this means that these two networks are have access to the external world there is also your data sub network which if you want to have access to your two satellite products from your virtual machine then you have to attach this as well and here is another sub network which we'll not be talking about now but you can create your own sub networks as well and so I go to and one important thing I will show you the floating ip's available and this is important because sometimes it's easy to make mistake you can see that this in this project I have allocated already free floating ip's which I can use to attach to my virtual machines and if they are not available then I can create that is attached to new floating ip's but please bear in mind that various floating ip's are attached to various pools so for instance I can one I have one floating ip attached to that is in the external pool and two in external two and I will show you in a moment how to attach it to the newly created virtual machine the important thing is that if you see the networks you can see that you have three networks available in my project and there is external external two and external three so you can on it you can attach various sub networks to your virtual machine so now let's go to the compute a pane and go to instances and I will create a simple linux ubuntu virtual machine and I will show you how to access it from also from the ubuntu desktop so also from linux desktop if you want to see other configurations because generally there are four possibilities you can create virtual machines both linux and windows server in our open stock infrastructure and you can access them from both linux and windows so these four configurations you can see the tutorials on our youtube channel so if you go to our cloud server youtube channel you can see the tutorials how to create virtual machines with various configurations we do not cover access from mac os however it it can be similar to accessing from linux so coming back to instances first I click on launch instance and here I can first of all choose the name for the instance so let's call it test number five for instance and choose source from source source is the place where you can choose which image will be used to create the virtual machine so you can choose from centos ubuntu windows server and also we have windows with arch gis however this one you have to if you want to choose this one you have to do it from our creodias platform because this is the paid licensed software so let's choose ubuntu 18 I click on the arrow up and now I have the ubuntu image chosen I also have other possibilities because I chose the simplest one that is create from image but I can also choose creating the virtual machine from instance snapshot from volume or volume snapshot and there is also a possibility to change the system disk so if the option by default the create new volume option is chosen as no but if I choose yes then I can choose the size of the system system disk so the simplest way is to to choose no that is to agree for default flavor and default disk so now I go to flavor pane in flavor pane I can choose how big my virtual machine will be so how many CPUs and drum and how big the system disk will be so let's choose some small machine like here one small next step is to choose the network and as I showed you you can choose from networks that have routers attached that is private network two private networks available here and if you want to access the your data products that is supplied products you have to attach your data as well so I will choose the private network external two and also choose your data and next pane network ports is you do not have to choose anything here and the next step is security groups and here I have several security groups already defined if you register to start using our resources you will have this group security group defined and others you can define yourself as well so this one is needed if you want to access the virtual machine using either SSH or RDP protocol and if you want to to have to the VM that the virtual machine responds to ping so I add this security group and the last step is to add keeper in fact you do not have to add this keeper if you for instance using if you are creating the windows machine you do not have to use keeper because you would rather connect to virtual machine using RDP protocol so remote desktop but in case of Linux it is recommended to use SSH and then it is necessary to to attach this keeper I already have several keepers defined here so I can choose one but if I do not have any keeper defined I can create keeper using either this button create keeper or import keeper so if I click on keeper import keeper I will I would have to put the public key which I create outside of this open start so I can create it in our in my on my desktop for instance in my case I will use this test too because I already have this key defined so I will check on my terminal I already created the key that's put in I put it I put it on on in my keys directory so as you can see this is the key so I would choose this one test two and now click launch instance the instance is being built it takes a moment depending on the size of the virtual machine okay so it is already created and as you can see it has access to two sub networks your data and private network external too so if I want to access this virtual machine from the internet I need to attach floating IP so I choose from this menu associate floating IP I can either select floating IP that is already in my project so I remember that these two beginning with 45 are the floating IPs from external to network if I try to attach the the other one this 185 I will have an error so I choose the and this one for instance and it is important to attach the proper to a proper port you do not attach floating IP to your data subnetwork but you need to attach it to one of the private networks that is this ones that have access through router to external world so I choose this port and click on associate associate okay so now you can see that the floating IP is already attached if I go to my terminal I can check if it is responding to to ping so I can copy this address go to terminal and ping ping is responding so the machine is working and if I want to if I want to connect to the machine I have to use the command ssh and dash e for inserting the key just just to show you once again so there is one key already in this directories and it's important that the key has proper rights and so I invoke ssh dash e and name of the of the key and the user for the default user for the for the virtual machine a linux virtual machine is eo user at and the floating IP address so when I click enter I have this it did not connect connect to the server for the first time but this message shows me that it notices that I have already been using this address before so I need to copy this line and and invoke it once if you invoke it here and enter and now I can use the ssh command again and confirm yes and now I'm logged I'm logged in already and so if I want to see the data collections I go to cd there is cd here data because this using this your data subnetwork there is the the repository is mounted to the to the linux server and if I alas now I can see the various collections of satellite data so you do not need to download this data from Finder but you can access it directly here so I will show you that for instance if I go to Finder now and if I choose some some collections just like just like Claudia was showing you before this collection for instance Sentinel can be Sentinel too and so it can be level 2a if I search just big search I have plenty of products here and if I click on one of them I can see in the metadata the product identifier and this is the path to the product on that you can access on the virtual machine so if I copy this line here and go to my instance and cd to this to this place I can see that I can see the products that these products are available here directly on the virtual machine so thank you very much for taking part in our webinar please follow us and if you have any question please write it directly to us we'll try to do our best and answer your questions so Marcin as a specialist of IT and cloud computing and I can help you with the EO data thank you very much and hope to see you again soon thank you thank you bye bye bye