 So we're here at the ST booth here at Mobile World Congress and hi indeed. Welcome to the ST booth at Mobile World Congress 19 I'm Frederic Doloméz and I will do a quick tour of our demonstrations latest innovation. We are showcasing here Let's start with the artificial intelligence where we are showcasing some nice Applications running on our STM32 MCU. ST has a big role to play in the mobile world, right? A big role and a lot of building blocks are coming from STM microelectronics for any IoT devices And this is one of the key blocks we are showcasing today. So This is right here. There's like an AI IoT device right here. Yes here We have And writing a character recognition which has been ported directly on our L5 microcontroller So if we write S See it recognizes the letters Nice. So there's actually AI on microcontrollers. It's a big deal for ST to have this, right? It's a big deal to be able to to port the artificial intelligence neural network into a small and compact MCU to be able to have AI on any kind of MCU And this one is also AI Right here the demo Specification Nice So moving to the sensor part with our imaging Brand-new brand-new sensors And also ambient life sensing I will let Ken comment about that. Hi, so who are you? Hi, I'm Ken I'm from the image and division based in Edinburgh the UK where we one of the big sites where we make our our time-of-flight sensors And what I'm demoing here is the latest generation where we actually have an eight-by-eight Array and each of the numbers that you can see on the screen is actually representing a range of centimeters So you can see that we're now starting to build up quite a nice three-dimensional understanding of what the scene looks like So this could be used for touch-to-focus for example with the camera system and a phone And even start to build up a simple depth map of the scene So is this the resolution the resolution is eight by eight and The range that you can see the number that you can see in each of the zones is the is the centimeter distance that What happens if you go over there can I go over there so the maximum range will depend somewhat on the target It's looking at you can see we're ranging that gentlemen there until it's two meters If the light level comes down we can range further or if the target The light level the light level is lower will range further It's good it's good for us. Yeah, correct Because remember within our device We have a light source, which is a 940 And then we have the array Light sensing dials both of these elements both the laser and the array are our lens Yeah, so we've got one mounted here How do you connect them to the tablet it's coming in through USB we have an ST microprocessor And this is being adopted already so this particular one is yet to enter mass production But the previous generation where we're only able to range for one zone Has been in over a hundred million phones already worldwide. So it's a big success And it's called time of flight time of flight is the underlying technology But the key application the key use case that we've had best success with this what we call laser autofocus But we're using the range that we return on the target to help the camera system Focus faster and more accurately and we hope that this device will be helping the next base autofocus correctly Correct, so we're speeding it up. So we're essentially another element of a hybrid autofocus system Phase detect different from phase Dual pixel is laser But it's in addition to so where the phase detect data is less reliable with a contrast data is less reliable We can help with our exact range on the target so they can all work in conjunction with each other Is there any chance this kind of stuff could do like the same resolution as the actual pick the photo? I think every single pixel that could happen I think the the the natural thing and in fact we have a road map to higher resolution parts over the next couple years And for this to happen you need the laser you can't just do it with a light that's there You need to have an underlying light source. That's correct. You need to eliminate it. Yes, so it's like So it's you've already seen it for example inside some of the iPhone family with the the structured light solution And it's also operating in the infrared. Yes, that's different. It's slightly different technology But working at the same wavelength. Yeah, we're working at 940 nanometers I should say although although we've used the word laser. It's of course all I say if it's all class one So no problem with damage to the human eye. Is there any chance this can go to a very long distance? Well, that's a good question. I think for this type of technology Yes, you can and you'll start to see systems on cars for self-driving called LiDAR Which is much much longer range where you may operate up to a hundred and fifty two hundred meters This lighter is different take right? Fundamentally the underlying technology is very very similar, but just implemented in a slightly different way. Yeah. Oh, all right. Thanks a lot Thanks. All right One of the big deal for the forest another new brand new product is I live sensing Sensors So What are we looking at? So the small product is called video 62 81. It's the smallest color sensor in the market 1.1 1.8 for 1 millimeter and It combines three in one functionalities. The first one is color sensing air GB IR It also combines ultraviolet sensing UV UV a and Last but not least it's also a flicker and giant that is able to extract the light frequency To get rid of the banding effect on the image. So there on the desktop you had the actual chip. Yeah And it's why did I see those lights? Can you show it again? Sure? What is this? That's the those are the colored photodiode in the circuit. So the color they each have different color Yeah, correct that the active array of the circuit So we have several photodiodes that are colored with some color filters RGB UV and infrared To send slides and provide the information to the system and what happens when you what we're showing? So right there this demonstration is what happens with all recent smartphones in the market. So the light in your Home are usually flicking your usual tank stand neon and in a fluorescent flight are usually 50 and 60 Hertz But with the modern lighting LEDs are flicking at total unknown frequencies that can go up to 1 kilo Hertz So that's a total headache and a challenge for all camera systems today And what our sensor is providing is the actual frequency of the of the light system Flicking we can compensate With some algorithms and find the right exposure time for the camera to get rid of the bounding effect on the image How do you do that? So the flicker doesn't have to do with the color sensor. It's a two-in-one product So we are able to assist the camera for not only the camera Let's say white balance With RGB color tone tuning, but also we correct the bounding effect on the image That's a two-in-one product and that's the key differentiating factor in the market So first step is to set the right exposure time with the camera to avoid the bounding and The second stage we are just the color rendering if it's a yellow blue ish color You can compensate with true tone color sensing with the product and this This is one of the style chip and what do other people do they only do that software So usually competition is only able to perform the white balancing with conventional RGB Let's say filters. It's not fully accurate because you still miss the ultraviolet information UV information is useful to indicate if you are indoor or outdoor in the In the scene All right, okay Yes indeed the camera system complexity is increasing in the market when you look at Samsung Huawei or all Chinese phones The number of cameras becomes no two three four times We put the sensor we just connect the sensor with USB as a proof of concept to adjust the white balance of the camera and also the flicker bounding effect to correct and get rid of the The balance on the image My application of the color sensor is to help the camera system to provide a true tone and accurate color to the end user Auto white balance and also good videos without bonding effect whatever the circumstance Without flicker effect and bonding effect to avoid any, you know Blur image or bonding on the on the picture and on top you can also integrate the sensor behind the plus Because it's very high Sensitivity product and you can afford to have this kind of cover glass backside That is almost opaque Nice So if you put that here you can still correct So having that sensor the photos and videos are gonna be better. Yes, definitely It's improved you the experience for everyday life, whatever the use case front integration or rear integration into the phone That's really a breakthrough application All right, okay So let's continue the tour So here we have some demonstrations from partners using our sensor and actuator products Then this is the one of the star you will see also at embedded world the new SM32 MPU mp1 that is combining an m cortex m and a cortex a So it's a brand new product from ST and we are really proud of this integration Cortex double cortex a and cortex m integrated into a single chip And so now we have an open Linux Full ecosystem on top of the SM32 ecosystem. This is a great news. This is 60 years RF transceiver it will be good for smartphone to have some high bandwidth Transmission between two devices. I think we can go back to that demonstration quickly Yes, let's go. Sorry. Let's go this way Sorry So now you have a connection of of demonstration related to connectivity as always Bluetooth Bluetooth mesh thread mesh Moving there. We have Laura and fixed six fox connectivity also running on our SM32 boards Then here we have the NFC reader for payment application. That is also a product that has been recently announced Nice, and we'll move to the security part We Will attack Hello, so here we introduce ST 25 hours 3916 which is our latest NFC Frontend chip The demo of the purpose is to show you Payments So with this chip you can have a look that's It is my banking card Yes, a real one and so it's just using the standard system of contact less. Yes Yes, and what's special about this? There is a new Specification the EMV Oracle MasterCard visa 3.0 Specification and this chip and this board is certified EMV code 3.0 We are passing the test in the laboratory EMV code, what is EMV code? EMV code is specification Required for the contactless reader embedded in the POS and M-POS So anybody else have this solution or is brand new? All the new M-POS Have to be in the coming months all the new M-POS put on the market have to be EMV code 3.0 compliance. So it's increasing the security increasing the Capability to make very nice contactless payments. All right. Cool. All right. Thanks a lot. Thank you very much Let's move to one of the big move also in the smartphone industry that is the embedded Cima And I will let Adlo present the demonstration. All right. Hello So, who are you? I'm Adlo Sixu. I'm Working for Secure Microcontroller Division and I'm responsible of the general communication for this division And here you have a new solution for eSIM right? This is a big deal for the future of the smartphone industry. Yes, it's a big deal But the main message and the main important message that we are rich and we exceed One billion you need for the advanced Secure Microcontroller ST33 So you said one billion ST33 More than one billion you need for ST33 What is that? This is the Secure Microcontroller and the importance of the Secure Microcontroller It has been designed to fit with all the security requirements for all the application security application such as Cima or eSIM Embedded Secure Learn but also Automotive M2M or TPM And one of the main market is the Cima and eSIM and the Deployment and eSIM embedded Cima Then the eSIM based on the ST33 is now able to fit with all the requirements whatever the form factor and whatever the device So do you provide the best eSIM solution on the market? Are you the market leader for eSIM? We are the market leader for the eSIM and we reach more than 100 million units on the eSIM This is the future of the SIEM connection And it's very easy to use? I haven't tried it yet so it's just no need to a SIEM card No, no need a SIEM card You can use the SIEM card but you can also use an eSIM Nice, that's very cool But usually when devices have eSIM sometimes they remove the second SIM card Is it important to only have... The difference between SIEM and eSIM that the eSIM can manage the switch between all the MNOs With the SIEM we are connected with specific MNOs With an eSIM we can move from one to another MNOs It's really a great advancement point for the user, the final user But it's connected physically to the model? Yes, it's directly sold on the PCB of the device And an eSIM is flexible to get any SIM information in? Absolutely, the eSIM in fact is configured thanks to the remote system And the specific platform And is eSIM 100% secure? Sure Impossible to hack this eSIM system? It's a secure element It's a secure element like classical It's a really secure element And it fits with the last generation of security features We are embedded with all the last generation of attacks Is it possible to upgrade the eSIM systems or are they just secure forever? They never need to update it You know that the security is not great forever Then you have to evaluate with the attacks Then the next generation of the eSIM will be designed by our father Then we will embed another generation in the future next year Alright, cool, thanks a lot Thanks Let's continue Here we have a demonstration on the imaging as well But this time on the automotive world Where we have in-vehicle monitoring So for driver monitoring For power by our imaging sensor Let's move to the other plane We have telematics and GNSS And I will let Pascal present that to you Cool Hello, who are you? Hello, my name is Pascal Avion from eSIM Microelectronics I'm here to present MTP MTP stands for Modular Telematics Platform So what it is basically is a set of modules Connectivity modules, ATE, Wi-Fi, Bluetooth, Bluetooth through energy This goes in the car? Yeah, this is a pre-development platform That would be the main brain of the car or what is this? That's the brain of the connected car So it's where all the communication is taking place Over all those wireless and wired connectivity standards Can, internet, flex-ray, that's wired Wireless with LTE, Wi-Fi, Bluetooth, Bluetooth through energy Also positioning, we have precise positioning And this kind of technology and all that Is very old technology in the car industry, right? But it's not very secure And you want to make it more secure? What are you doing here? Yeah, exactly So on this development environment called MTP We have attracted working on the Tele-Maco-Trip That is a security processor here We have attracted an ecosystem of partners Also security companies such as Caramba Security, Argus And also Airbnb for the software database So those companies are putting their solutions Security solutions on Tele-Maco-Trip And we deliver to the market this solution That is pre-integrated, fully working And we have customers such as FICOZA And they have used this platform In the development of their carcom platform This is a real product that goes in a real car? It is a real product that is going to a car And they have been using the same philosophy Based on Tele-Maco-Trip They're using what we did there on the MTP And then they have used Some of the modules are the same Some of the other modules are something different Targeted to their applications So when you say Tele-Maco-Trip, what is... Which part is that? So Tele-Maco-Trip is here in the middle This is the processor That's the security processor Which one is that? Is it running an ARM Cortex something? Yeah, so it's Cortex-A It's a Cortex-A7 double core dual core And there is a Cortex-M3 So this is the new STM32MP? No, no, no What do you call it? Or is it not? Tele-Maco is a family of processors Dedicated for automotive Created for automotive With high robustness to high temperature Also for safety-relevant system Asil-B And dedicated around a very strong security core With an HSM The HSM is the key element here of Tele-Maco-Trip And that's why also all those partners Have been attracted to work with us on security What's the HSM? The HSM stands for Hardware Security Module And you're showing some kind of... What are you doing here? Hacking it? So this is what we are developing together With Caramba Security Caramba is a security expert company And we are working together here On a security system To protect the Linux application space In the Cortex-A7 So what I'm doing here on this PC So I'm connected So here this is a debug console Connected to the processor And I'm going to attack The attack I'm going to attack the processor So first I'm doing... The security is implemented The Caramba CarWall application here Is implemented on Tele-Maco So I will attack the system that is already protected And this is what's going to happen So I'm trying to Break in the system And send an exploit So injecting the exploit Doesn't work Why? Because it's protected by CarWall So now I'm doing the same Exactly the same but using a port That is on purpose Not protected So this is what's going to happen I'm attacking this other port Again I'm trying to take control of the machine Of this Linux machine here And what we normally Will see It succeeded to get the roadkits So now using this So I'm connected to the ethernet So using the network I can manipulate So here this is a Windows Laptop But I manage the roadkits So I have the full system This is Linux and it is running here So I managed to take control Of this computer in the car And I can do all nonsense that I want So for example So we have a little application Running here on Tele-Maco That is an attack So I'm doing an attack On the vehicle You're owned It says airbag deployed Speed exceeded And the doors open So it's really what you don't want to happen When you're driving a car And here we are able to hack the vehicle Completely This is when the car is not active Is this groundbreaking For the auto market Nobody has this Nobody has such a wide ecosystem Of security on a single platform With Argus providing the intrusion detection With Caramba security Providing car wall With all the hardware and mechanism Implemented in Tele-Maco 3P Such as isolation with several cars Such as the HSM Secure boots And also TEE For Linux So nobody has such a strong security architecture On the automotive processor Cool, alright, thanks a lot So this is Clothing Zotura I hope you enjoyed it And see you next year For the next edition Of Mobile Rock Monres So ST is big in a better world But also big in mobile We are everywhere And we are covering markets Like industrial, automotive Consumer markets So that's why we are everywhere And this is one of the demos that shows All the different stuff you're doing Exactly, it's That allows us to show that we are Doing a lot of industrial applications A lot of... Trying to have another view of ST Is a big challenge That's why you have a nice way To see all the different things All the different things we have And you can see more Automated World That is happening at the same time So, have a look and so