 So we're here at the Lenaro Connect here in San Francisco, and who are you? Hi, I'm Mark Ogotsky. I'm the director of the Lenaro Digital Home Group. We've had a great week here in San Francisco with all of our members, and just wanted to share with you some of the latest things we're doing in the Lenaro Digital Home Group. There's a lot of activity and a lot of traction and a lot of the things happening at the home group, right? Yes, over the years we've been working on a lot of core technologies, and now we're really seeing them get a lot of traction in both the open source community and in some of the deployments that people are doing using some of our technology. So in the Lenaro Digital Home Group we've been focusing on secure media playback using OPTI with DRM integrations. Some of this stuff here, it says here play ready DRM with OPTI. Yes, so the commercial DRM integrations consist of both play ready and wide vine for Linux and for Android, AOSP. So we're covering all the bases, we have play ready integrations there, and again, wide vine integrations as well. So if you can just check it out, so right now there's DRM support on this one? How is it supported? Alright, so let me introduce Alexander Zhutra, the assignee from NXP. I should mention that NXP is the newest member to join the Lenaro Digital Home Group, so Alexander will describe his demo that he has set up on the high key. Right, you're from NXP? Yes, I'm an assignee for the Lenaro. So there's a whole bunch of stuff NXP is doing with the home group? For example, what do you have here? The demo is not quite set up yet, but I have play ready integrated on Android 8 with OPTI available. So it's running right now on a high key development board with all this stuff going on here. So when you talk about AOSP8, all this DRM stuff, OPTI, LHG is always the first one to get everything to work. Well, in terms of integrating with OPTI, a lot of people notice that in the industry OPTI is gaining more and more traction. So we've always been promoting OPTI as an open source trusted execution environment. And then the additional DRM integrations we do are seen as something of a very high value to our members. And there it mentions AOSP8.0 and right here later I'm going to check it out, something to do with AOSP TV. But what's the latest stuff that's going on with Android TV, maybe? How do you help with that kind of environment? Well, right now we focus on core enablement on AOSP in terms of media features through the TV input framework for Linux TVB libraries. But again, the other component that we bring to AOSP is the OPTI DRM integrations. And our members then are looking forward to doing OPTI integrations on their own Android TV deployments. And there's all this video for Linux too, there's hardware acceleration work. Right, so primarily on the Linux media framework side, in the last six, nine months we've been really focusing on essentially making media run better on ARM. And that is looking at integrations of Gstreamer with V4L2 as well as some work that we've leveraged for FFMPEG for V4L2. And we can see that when we run our media pipelines with V4L2 as well as Wale and Weston, DRM KMS for the graphics, we can see that we really offload all of the computation onto the video codec as well as the GPU. And we see that the CPU utilization is actually very low and we achieve very high optimized performance media playback on Linux with V4L2 driver framework. And for example, there was this conference at IBC recently, you were going over there, there's a lot of set-up box over there going on. And what kind of things are you noticing in the LHG is maybe a couple years old now? Well, no, I just celebrated my fourth year working anniversary here. So yeah, we're into our fourth year. Because just before this conference, I was at IBC in Amsterdam, can you pause it? Yeah, no problem. Done, done, done. Yeah, so the fourth year. Okay, so LHG is in its fourth year right now and I was at IBC and like I said, it's interesting that the technologies we're working on are getting to be more known in the industry. So for the set-up OEMs, the Opti integrations with DRM are very important. Really people are looking at being able to interoperate with multiple DRMs and they're looking for lusting the burden on integrations and Opti provides that. And the other thing, of course, that's really big is ultra high-def and high dynamic range, which incorporates many technologies. So what do you do with the ultra high-def and HDR? You had a presentation about this, right? Yes, I had a presentation on this earlier in the week and really it was to provide an overview of what the technologies are and also what the, you know, how they're currently supported in AOSP as well as Linux before L2. So right now, it's an exciting new technology. We're looking at incredible color reproduction playback on user devices with extended high dynamic range luminance as well as the wide color gametes and really produce some stunning playback on some of the newer monitors. Is HLG becoming kind of like standard? Everybody is supporting that or there's also the Dolby Vision? It looks pretty good, right? I would say there's primarily three HDR systems that have been gaining traction. One of course is HDR10, which is the open standard and it uses something called a perception quantization curve developed by Dolby for what they call an electrical optical transfer function. So HDR10 is something that is being supported by almost universally because it is open source. Dolby Vision is proprietary, but it actually extends the high dynamic range to 12 bits with a 2-bit enhancement layer over HDR10. And Dolby is able to provide a scalable solution where they can actually support SDR standard dynamic range output HDR10 as well as Dolby Vision. They had an impressive demo at the IBC, right? Yes, really what HDR is showing is that the content that is created and mastered is really what you can actually end up seeing on the screen. In the past, there would be so many transfer functions and sort of degradation of the content and then the monitor at the end would only be able to capture a very limited range. Now with the newer monitors that support the UHD Alliance requirements, you can capture essentially pretty close to the mastered content and preserve the artistic intent that was involved when they actually mastered the content. It's quite impressive. The other standard is HLG, which is Hybrid Log Gamma. This is another electro-optical transfer function and this is used primarily with live content. And really all this is doing is extending its staying at the power law that's used for the standard gamma-based transfer functions, but then it extends it at the high end in order to support higher luminance. Did you do some work with that in an hour? We're not working with it right now, but it is one of the supported types in Android AOSP at this time and we expect support for it to be added to V4L2 very soon. So we're looking at UHD HDR technologies as being the next really, really big technology. So it's really quite stunning in terms of the quality of pictures that can be produced with 4K and UHD HDR. When all this on the market is getting these amazing 4K HDR displays for $500 and less and stuff and you need to connect awesome set-up boxes, how about the UI? Is that in 4K too? Does that mean the Nero has even more work to make things smooth? Well, that's where you're looking at issues with GPUs where you want to be able to support typically the video processor, the VPU path is where a lot of the HDR work is done. But then the GPU is responsible for then also supporting some video textures as well as the graphics overlay at 4K resolution. So ultimately what we're looking at are better quality monitors supporting this HDR content and then with fantastic 4K graphics as well. So some of the UIs that we've seen that are being shown at consumer trade shows and maybe in there a few years out before they'll be really commonly available on high-end TVs. These user interfaces and guides are just incredible. It's going to be like they're remarkable. Like entering a new world kind of on your TV, you'll be like, oh, I want to get into this UI. It's so beautiful. Yeah, and the other thing that's interesting is that we're seeing more voice activation. So for example, as you know with Google, Amazon all have their home, like the home assistant in Alexa. We see that the trend will be that people will be, in the next few years, will be talking to either their smart TV or remote to change channels or do whatever. And how is Nero involved in that kind of world? Well, I think at this point what we're looking at is really some of the, we've been talking with some of our members and looking at their initial concern right now is for voice activation to have very low latency. So that when certain commands are uttered by the user that the device or smart TV, the set-top or smart TV can react very quickly to these. So you may be in kind of a low power mode and just listening for some key words. Once you hear those key words, it will wake up and start doing whatever the user wants. So that's really one of the things that some of our members are saying. We want to be able to be listening in low power mode. And as soon as we hear these key words, we can fire up the system. Could it be that it has kind of like a connection with the lights group? Also now all these set-top boxes want to have IoT implemented, right? Everything's starting to converge, of course, in what they call the smart home or connected home. That terminology has been around for a while. But now with these voice activation controls, the interface for the user is much more natural. And so not only will they probably be controlling TV channels and things like that, they can make queries just as you do with your Google Assistant, for example. And they can also, you know, it can easily be extended to like the smart home and control other elements in your house. So there would need to be an involvement in what all the stuff that light group is doing and putting that into the set-top box. Well, I think... Maybe some of the lower power chipsets. It could also be included in the SOC to have that kind of functionality. Yeah, but typically what happens is the set-top boxes in that are usually... They have very high-powered CPUs and GPUs in them. So to add IoT capabilities just for the home, it's usually not... It's a relatively, you know, if you're just controlling certain items, it's not a huge processing load to add some of that. And can we look just around a little bit more? So there's some stuff over here that has to do with the RDK. Hey, is your demo is working? Sit up. Yeah, we are trying to set up. Still we don't have the networking. Yeah, so this is Shiva who's working as an assignee from Comcast and he'll talk to you about what he's doing with his demo here. So what are you showing here? Yeah. So this is RDK ported on Dragonboard 410C, which is one of the 96 ports. So this uses V4 L2 acceleration and optimized DMA path. So the complete 1080p video playback we are able to do less than a 20% CPU usage, which gives 80% of the CPU to the MSOs to do different loader, different applications. So you have the full hardware acceleration, accelerated video. And what is the A306 GPU? Yeah, that is Adreno 306 GPU. So that is used for graphics acceleration using Mesa, the latest Mesa driver. All right. So there's Android stuff. There's what's called RDK. What kind of platforms are being worked on? So for the RDK, we've been working on the Dragonboard to start doing some prototyping of RDK with video for Linux to driver framework. And as she was mentioning on the Dragonboard 410C using the video decoder as well as the GPU, we can achieve very high performance playback. All right. Should we check a little bit further over there? Yeah. So let's see. This is Kellyanne. He is also an assignment for Comcast. And he's actually done a nice kind of proof of concept work over the last six months. And I'll let him describe what he's done. So what are you showing here? Yeah. So the secure boot implementation we are doing on a high-key platform. This one? This is a high-key board. Yeah. And we implemented the reference solution, secure boot and DRI disaster recovery image on 96 board. So that is the reference implementation. So you have, it says here, a chain of trust for authenticating an OS loader. What is that? Yes. So in the secure boot loader, we are authenticating the Linux kernel and the root of s. So to authenticate those Linux kernel, the key, public key has to be placed in a different partition. For root of s also you have to place the key in a different partition. So the image and the corresponding key will be in a different location. That way we are meeting the chain of trust. All right. Yeah. Cool. Cool. And then there's all this stuff that has to do also with the Android TV world. We were talking about it a little bit before, but there's a lot of things happening there, right? Right. Again, some of the work that we're doing, we're looking to enable technologies that our members can then integrate into their solutions. And some of those solutions, some of our members are working with Android TV as well. So in AOSP, we're trying to provide improved enablement for some of the DBB libraries as well as these security integrations with Opti. And that's something that our members see as valuable and want to incorporate into their final offerings. So there's going to be a lot more stuff to happen in the months to come at the home group, right? Yeah. In the year to come. Again, when I go to shows, now people, instead of me always pitching to them Opti, now they're coming to me and saying, we really want to talk to you about Opti and things like that because they're looking at having that integration and having an open portable trusted execution environment that gives them commonality for all their DRM integration. So when they have to go from one DRM to another or work with another SOC vendor, it helps them in all of their integrations because they've got one element that's in common in a very important area. And yesterday was a very interesting keynote about the project treble, right? How much is that going to happen here with the home group? Well, yeah, that's an effort that's going on within Lenovo and the home group is really kind of a consumer of what is being done there. We look to at one point support things like the Android common kernel. Again, these are provided to us and our SOC vendors now for Android O are now responsible for supporting these vendor test suites and implementing what's been done in trouble. So this is in the kernel space, this is a very big area, but LHG is really using the output from other groups within Lenovo. I can imagine that once it would be awesome if the setup box that gets Android 8 just get automatically updated forever with treble. Yeah, treble was introduced to make a cleaner delineation between the SOC components and one of the goals was to enable security updates to be done much more quickly. So again, there's other kernel folks here in Lenovo who are more deeply involved with this than we are. We're using the output that they provide. And there's even more demos? For now, this is it.