 Okay, well, then let's start for now. The previous session was just above, so now is a more general overview about what is the status currently in Daemon Squeezy, in what kind of a world do we live currently? First, I want to introduce the PKG multimedia team. The PKG multimedia team is a team that was formed or recreated during the Squeezy Cycle before that we had actually two teams and both were of pretty around that active teams, I'd say. At some point we identified, well, why do we need two teams, actually? And the other team was called, Adrian, what was it called? Ibn Multimedia, Dmudi? Yeah, exactly. And we agreed on the name PKG Multimedia. And, well, if you want to reach us, this is our mailing list. All of our packages have this as maintainer field and we can be found on OFTC and the channel DmudiMedia. Okay, so what is the multimedia world? In the multimedia world, we are talking about new media. We had the Myth TV talk before, and the people, the folks that attended the talk of Myth TV, they already raised the question about libraries and how they interact and don't interact and source copies and everything. So this is very typical for multimedia kind of software where we have to do also some upstream work as maintainers to identify the source copies and to see what dependencies they are and can they be removed for compiling and system copies and that stuff. We're talking here about digital TV. People nowadays do want to watch, to use a DVB terrestrial satellite or cable. But we're also talking about, we want to provide medias and movies and trailers and all that kind of stuff on your smartphone or your iPad and all these devices have different requirements, have different requirements on how movies have to be compiled for air and what option do we need and the most pressing problem about this, this changes very, very fast. Every half a year there's a new device that needs some different codecs, some subtle different options that improve quality better and that's a really, really challenging task here. If we only look about codecs in the last five years they have been an immense boost of this H264-AVC codec. If you see some papers or some Wikipedia articles about AVC, AVC is the marketing name of the MPEG LA. So H264 and AVC is basically the same. The codec that, and it's still very, very widespread out there is the MPEG-4 visual codec. MPEG-4 visual is very, very similar to, now it's pretty similar to H263 but it's standardized also in the MPEG-4 family of standards. Recently Google has entered the HTML5 game. You have perhaps heard there's a new HTML5 standard upcoming. This new standard will include the video tags so that you, in order to publish a video on your website, you no longer needs to require users to install some proprietary additional plugin but you can rely, okay, this is HTML5 video so your browser needs to be able to play it back. There was a huge discussion about what codec is going to be used. Is it H264 or is it Theora? And now Google has answered these questions. Now we propose to use WebM and VPH for this. So the race isn't over yet. There's still no general agreement of what codec will make it but I think we as a Debian should encourage the developers of the VP8 to make this codec more widespread and I will personally work on to have the video recordings trans published as VP8. Let's try if we can manage this for this. And there's of course the thing with DRM. This was also mentioned in two talks before which makes it also very challenging. Blu-rays have technically different but from the user point of view very similar problem with encryption so you will need some additional packages in order to decrypt your legally bought Blu-ray disks. So as I said, we have an extremely fast evolving technology and we hardly managed to keep up with these in unstable and currently stable users, especially stable users in any basically lose. So for all these new kinds of media just running stable is pretty hard and this is all of why we had the buffer just right before us. I didn't know the scheduling before the talk. Currently stable use generally lose but as we have seen in the talk before we are working on fixing this or to providing some intermediate measures so that we can provide stable users some ways to, I think. Why is back parting actually so hard? So just to give you an overview about the multimedia stack that we are talking about how to output audio on your physical actual output device. Well, in order to output on your physical audio device you generally in Linux we use also the advanced Linux sound architecture but there's the packages there's using OSS for example, our free BSD kernels only provide OSS and for firewall sound cards so many laptops still have these firefight connection. You generally only have this FFADO library. There is no alternative driver so there's no other driver in OSS for a certain set of professional sound cards and this sums up. We have several kinds of audio demands we have GStreamer is a library that modularizes output modules it can end video modules so you basically create a pipe. The application says what I want to create here's a source with a movie file so please open this file and put it out to this OSS or POS audio sync and this is only the, if you think this is fail you're totally right but the thing gets even worse if you consider about decoding libraries and demultiplexing libraries and what we actually try to do is to for Squeezy Plus One to make this much more simpler so this is our view how it should look like and other distributions are also working on this plan so this is ongoing work on Squeezy Plus One and we could really need help so if you're interested in cleaning up our current stack feel free to discuss this with us. On top of that we still have another bunch of packages and libraries that stack up on this. So what are possible solutions to this? This is basically what we have talked about is Debian Backpods has been proposed Debian Volatile has been proposed or in your archive we really need to talk about different infrastructure maintainers, Volatile, Backpods and the built-in network if they think this is feasible especially with the release manager so if the stable release manager if they are going to accept such a transition and why we really do want to do this in Debian is because we really want to reuse existing Debian infrastructure for quality assurance and bug reporting and stuff like this. Okay, so I'm ready for this part now Adrian is taking over. Thank you, thank you. So we're actually in the second part of our talk as you might have noticed the first one was about playback and as we call it the consumer side of multimedia and we're now heading to the second part the pro and we want to understand that pro here means producer not necessarily professional also producing so for most and already mentioned FFA the free FireWire audio drivers we now have them and we will have them in squeeze well this is good news for everyone who owns and FireWire based audio card we're actually packaging the SVN trunk of FFA because newest everything there's more to why support where no time is up Hello? Oh, I'm still on, okay. So if you have a FireWire audio card just install JackD FireWire and that's it basically. Speaking of which, we had a Jack transition both of you who use Jack might have noticed that it was slightly broken during the last few weeks but as far as I know it's almost over the transition now and I can say we are at least to my knowledge the first distribution ever providing both versions of JackD there's JackD1 and JackD2 developed by upstream and JackD2 is by no means a successor of JackD1 this is just a completely different code base JackD1 is pure C and JackD2 is C++ while JackD supports SMP, multi-core processors on the lot and JackD1 does not there are reasons to have JackD1 or JackD2 if you want the one or the other you already know this we're not going into detail here in theory JackD2 could provide perfect pulse audio integration because it's talking to pulse audio via debus unfortunately it doesn't work, it's an upstream bug hopefully we'll fix this for quiz plus one anyway for producer audio you normally have two sound cards in your machine or you don't even run any consumer software like Flash in a studio this isn't actually a problem but bottom line here is you can either say install JackD1 or JackD2, whatever fits best for you and there you will have it we also have updated quite a lot of production tools I would like to mention Hydrogen most work was done by Jonas sitting here in front Hydrogen is a really capable drum sampler I will show it later to you in a demo session who's doing audio production? okay, some people let's see what we can do with Hydrogen we now have the 094 in squeeze none? it's probably the transition with Jack okay, modular Jack transition but it's Spark Spark as far as I know and I was able to build this Spark package there seems to be a built demon broken or whatever we also have LV2 and this is big news for everyone who already did audio production on Linux what's LV2? LV2 is Latspar version 2 Latspar is the audio plug-in API in Linux and unfortunately Latspar was crap there was no way of having a graphical user interface for your plug-in a thing that other platforms like Windows or OSX provided for years don't quote me but I would say for 10 years or so so Linux was really lacking behind here and now we have LV2 and the most important change with LV2 is we have graphical audio plugins and we have quite a bunch of LV2 plugins in Debian already I've mentioned a few of them on top I would like to put some stress on Kafka because Kafka really is cool we will see it later so this basically is a library and an API and you won't gain anything from a library without host support so lucky thing is we also have applications, host applications supporting this new LV2 plug-in standard especially Arduino we've updated Arduino to version 2.9.11 modular jack transition but I'm sure we will have it there so this is the most up-to-date Arduino package in the whole of Debian derivatives for now well ahead of everyone else including 64 Studio, AV Linux and whatever so when squeeze comes out I'm sure for this very moment we provide the best audio experience on Linux you can get out of the box you can always tweak a little more in addition to Arduino there's also a queue track too kind of a new kid on the block still a lot of development but it can do some MIDI for squeeze plus one we would hopefully see Arduino with MIDI support let's see there are pre-author state right now so there was absolutely no use in including it it's creation all the time but I think that's fine for development stuff so this is the good news from the producer site and I would now like to spend the remaining time on showing you these tools in action so I now dive into my laptop here and switch to Hydrogen as already mentioned Hydrogen is a drum sampler and let me show you how it works you basically start first with loading a kit perhaps we load a techno drum kit then change the speed of our song tool let's say 128 whatever and start with... can you turn up the volume for the laptop? that's what we do and when we play this back we already have a... it always should work to make it a little bit more interesting we put in some additional kicks on one and three and also plays a snare on two and four and to make it more interesting a second snare together on four if you play that back you will get an inclusive two beat now let's add... a musician would always play the first note a little louder than the others let's adjust it here I think that's fine so now let's put in here some fancy... toms and each decent house track needs a hi-hat hi-hat always comes to the off beat so... is it off? no, here it is yep, yep it's scrolling the resolution has slightly changed what I used to have I guess this would probably be enough for... German music or something you see what hydrogen can do I've also prepared a groove that I call salsa so it's not actually real salsa let's see if all the notes are there as you might have already noticed I've loaded a percussion drum kit so if you play it... we have other sounds here now because you probably won't play other with techno drums so how does it sound? maybe a little slower I'm sure you get the impression what hydrogen is for you could spend your whole afternoon just... it's really called programming beats so if you want this you can use and let me also add that hydrogen is good compared to commercial stuff because it supports multi-layered drums you don't need to have one sample for each drum you can have multiple then cycling through these layers in a round-rubbin fashion so you get a more human feeling I think hydrogen is pretty cool to have so... is this... yeah and I've prepared a next one I just need to show it no I haven't I still have to load it because I am going to show you something else later a little slower but I don't know how fast it was so... that was too slow okay that's a beat I made with hydrogen and then record it into arduo I've already mentioned arduo here and here it is I hope you can see it and when I now start play let's put it in here there's the beat that's exactly what we had in... in hydrogen I fired it via jackd into arduo and then recorded some more stuff you can see here the bass and the synthesizer and lots of stuff I'm now just playing and you will be able to watch the slider going over this song so you can see what arduo actually does I would like to put some stress here this is a fade in so this means audio is getting louder some blend of one into another you all know this one or your production just for those who are not common with it so now start the bass I would call this loop based editing you have all these snippets or regions that they are called arduo no fade in section and so on one more minute I guess we can skip this as you can see I put this song on the net just somewhere and pointed to some friends and when I was at a birthday party I suddenly recognized they are playing this song I made a couple of weeks before so it seems actually people like it the bottom line is you can use linux for audio production yeah it's not released but if you want to have it we could link it on the dapcon perhaps including the session material if you want to remix it there's a question in the back I wanted to know what do you think of the dyne balik distribution G what is it it's been there for a very long time and it's still dedicated to pro recording and it has order it has tons of stuff in there I'm afraid I've never heard of that and I the question I wanted to know is that do you use a realtime kernel for this so you can do it on any kernel I always use vanilla kernels or distro kernels but not realtime kernels good you mentioned it we have realtime posix priorities with jackd so if you install jackd it will take care that you end up with new priorities but we don't have a realtime kernel even if it's not enabled in kernel yeah even if it's not enabled and it's if you don't target for a real low latency let's say 1 millisecond or so then it's sufficient to have this standard kernel and it works I never used anything else even with ffado which is a user level firewire driver and subject to user level run trip I think also that dynbalic has clustering capability so if you want to use it's made to run on old systems and if you want to combine all the old system you have in your house to use it for music it can actually do that I reckon they are using jack that for this I just read their documentation so I've never tried it or I don't know the intricacies of distro but it's worth to take a look at I think we really should just to make this sure audio production on Linux is done by let's say 5 to 10 people at all and we're sort of lagging behind every other system especially on the plug inside I think I do a pretty decent digital audio workstation but it only cages for you to arrange snippets and cut and do some fades and automation like this as we will see now we need lots of plugins and this is the second session I've loaded for you just start a girl came into my office and said I had an idea here's my song and we recorded it and I'll play the original version just a few seconds she's half French and half German the pronunciation might be a little unusual ok that's enough for the original and I will now play you the result after tweaking it with Adure and only tools we have in Debian and then we'll go into detail what to do and where to do and under my feet and only one step only one step and maybe I could be free and every day and on the night the same game is starting again the same game is starting again and so on as you can hear a lot of delay and I think so what were the first steps the original recording wasn't tight to a beat so if you fire them up you will instantly notice they're not matching it's completely off the beat so what I had to do first was to cut the vocals so they are matching it's what you can basically see in the pink track these are all cuts just to get the vocals aligned to the bars and then I fired up my keyboard and played some strings future stuff nothing special so let's stick to the piano if you play it back so you can hear it is rather basic and then I decided to add a room so it sounds a little bit more like a movie and we have the calf reverb plugin for this as you can see 2.5 seconds approximately of delay and if we add this I'm sure you can hear the difference so if you're looking for this effect with the ALF or calf as I pronounce it what might be wrong and together with the strings one could argue that the strings might be a little bit too loud but it's easy to tweak them here so what you do with the vocals let's hear the vocal again it's there and switch off everything else I can't really describe it basically the first thing you do with the vocals is not the first but some people put it first it's a compressor we now have let's activate it so if you're into audio production you know what a compressor is I won't go into detail here because it makes no sense for non audio production people the good news here is that we have a graphical user interface and that's exactly what I've been talking about when I mentioned LV2 this is LV2 without LV2 you won't have this but we now have it and I'm glad we have it so we have a compressor pushing the signal a little bit up and if you add this into the mix you will notice that it's a little bit dull still dull somewhere and the reason for this is the vocal is buried in the strings the usual approach to get this right is to play an EQ I've used a normal filter here a high pass filter cutting off the bottom and in the end the signal more clearly I don't know if you can hear it where the speakers are at home but let's try where are the vocal if I would tweak the frequency here you know what this filter does this is mostly without if you are into techno you'll probably hear stuff like this any more with it what was it? it was a 12 dB high pass around 150 so it's okay for the demonstration well and done we added some reverb to the vocals they are here you could barely hear them if I increase the send level it's getting obvious the key is to keep it subtle together with the reverb we had a vintage delay let's play it solo only one step maybe I could you can clearly hear the delay every day and all the nights the same game is starting again so this is what the delay does the same game is starting again I can't see it so that's basically it I would like to save some minutes for the question and answer section so much from my side and we are now waiting for your questions if any my question is how do you get multiple inputs do you have an external mixer that you mix in do you capture the sound through a special outboard engine or do you use your onboard soundcard no I never use onboard sound and I guess no studio does it's an FF80 based how do you interface the LASIS IO14 to use a firewire cord on your laptop it took me approximately 3 months to hack the port into FF80 for this special device because there was no help from the window and LASIS isn't interested in helping at all so we have no specs how this device works but basically in the end we were able to get it working on my desk and I use it all the time could I have your stand your statements on firewire using firewire for audio compared to usb based breakout boxes well that's a really difficult question let me point out there are quite a couple of firewire based audio devices with high channel count so if you are many channels I'm not aware of any usb based device that supports 50 channels also but you can buy this for firewire based like the RME Fireface 800 there is USB support no thing is USB 1.1 works with linux USB 2.0 usually doesn't so usb devices are in most cases not an option so on the other hand ff80 is a user level driver and it's far away from stable it is stable, it is working you can record and even without a real time kernel but if you want to get decent stability and not run into the risk of ruining your recording you would clearly buy or PCI express and if you are on a laptop this probably means express card or PCI which is quite a good thing because RME they probably one of the best vendors of audio hardware provides linux driver support on other so you don't have to mess with user level drivers and there are some fancy RME cards there are 64 channels in and out at the same time for express card on your laptop so if you need this just spend 1000 euros for this card and then you have it there are cheaper options like the HD sp hammer 4 series which is around 300 or 400 euros or so for a multi-channel card where multi-channel means something around 14 to 20 or so I'm not an RME sales representative but these cards are really good and they provide linux support and they help us and they help everyone so I guess it's fair to mention them in contrast to let's say Alices they ignore linux I know a little bit about Dynabolic and it's and there's also like 64 studio and there's also another one called puredine which is they're all kind of similar things and I was wondering so puredine is actually a buntu based dynabolic I don't know but I was wondering if there's ways that we can to get all this kind of efforts merged and your thoughts I mean from my point of view I guess we could tell them all to join the package multimedia team is that a good option well if I may well I think at the beginning of the talk I wanted to point out that the package multimedia team is a relatively new effort and we invite everyone to get in touch with us and we really focus about getting things into Debian and we are generally pretty open there are some team rules that basically say well we expect you to generally follow what's going on on our mailing list pay attention other than that there are no strict rules and so sure if you know about other projects that could benefit from having their packages or their work integrated into Debian this is a collaborative effort to get packages like this in and this was also one of the motivations to give this talk to show we do exist what work do we have what problems do we have and to invite others the parties that you have mentioned to join us and get in touch with us let me add here that we have a couple of Ubuntu, Debianapris also in our team so at least with Ubuntu there's some kind of coordination and they're using our packages and doing stuff for our packages this actually works quite good and AV Linux is also teaming up with us yeah AV Linux it's a one-man show specialized I think focus is more on non-linear video editing as far as I know do you want to re-ask a question I just do is there any has there been any communication with the 64 studio people as far as I know Free is from yes Free has been pretty much involved if not he's one of the driving forces of 64 studio he was one of the first members of PKG Multimedia to be honest I haven't heard much about him recently because he's buried in other stuff but generally yes we at least in the past we have been in close contact with 64 studio should we wave into the camera hey for other questions is there a tool in Debian I'm singing a choir where you could scan a partition and let the different voices play and then does that exist so you want OCR for music sheets right Rosegun can do that repeat he said Rosegun I haven't heard about this way around as far as I know Rosegun can be used to produce these sheets but not to re-import and play it back I must confess that's not what I'm working on so I might not be the ultimate expert here someone in the audience could comment on that Paul I just loaded the Wikipedia page about music OCR and there are two open source apps based on Java so it's a possibility have a look at the Wikipedia page thank you please file a request for packaging bug report it will help, seriously it's not a joke it will help a lot to have request for packaging and that's one thing when you do a request for packaging that's generally for Debian that's like the thousand Debian developers and just will maybe not be discovered by others so what you can do is two things file a request for packaging and send a nice email to the mailing list even if you don't think that you are a geek and you can do the packaging then send an email to this list and say hey there's this package over there I have filed a request for packaging which means the simple things of oh it is free and it is here I found it already that will help find some people that might be interested in packaging things like that if I may add to the request for help we have shown you what packaging related task we are focusing currently at but that's really not all other things that technical things that we want to work on is something like these back parts this will require another amount of effort to get back parts of infrastructure packages like libraries for stable use and another very important thing that we have only briefly discussed is something like documentation we imagine and we could really help need help from non-geek users and non-technical users that could help us with documenting all this stack what producer audio software is available and in the first time it would be enough to just give some pointers what is available, what requirements do we have what hardware do you need what is available what you can generally expect from Devin Squeezy regarding ProAudio so if you are interested in helping us out with that again, please contact us if someone surely needs to write some clarification this is Patches this is more or less how it looks inside Jack D the media team is asking us to this is Patches and you can see these are wires going from one channel here back into another one, this is the FX Session this is the drum sampler there and I can assure you this is a rather basic setup so once things get complicated you end up with lots of wire here and there are ways to keep that clean but however we need some kind of documentation for end users if you are used to logic you might have seen stuff like this but anyway end users experience could still be improved especially by Emmanuel Paul, where do the samples come from for that piece that you've been playing glad you've asked, this is a Korg Micro X keyboard we are talking about the strings and the bass not about the drums because the drums is everything in Debian and everything else you've heard is not this is one of the main drawbacks of audio production on Linux you don't have virtual instruments we could probably package Linux sampler and I think we should do but still you don't have the sounds you need some sort of sample library providing you with the sound and there is to my knowledge no open source project recording orchestra or other sources of sound and then providing them for free there was some kind of a project starting but as far as I know they never ended up with something you could actually download so I bought a Korg Micro X this is a fancy keyboard this size for 450 euros or so yeah there I get my samples from the Suga project the Suga project has some few samples that is free software released as free software maybe could separate those so they can reuse you have your own microphone and then there's freesound.org do you know this site? yeah yeah you can get lots of samples from it and there are some people starting to upload sets for samplers on that site but it's under a creative kind of sampling plus license which I don't know yeah there's they're supposed to change the website to allow people to use other licenses so hopefully they do that we actually have some synthesizers in Debian, Faze X and some other M44 so so as long as you don't have to rely on samples we have something to offer to you but if you're used to high quality sample libraries like the Vienna Symphonic Library or a Bosendorfer piano sample which is 3 gigabytes in size well by the Giga format Linux Sampler can play Giga format and so you could at least use Linux for producing this and I know some people actually doing this this works but bottom line still is it's not as fancy like OSX we have tons of different virtual instruments available can you say something about the scope of the team does it cover things like animation software or video production stuff or is it just low level stuff and audio perhaps perhaps someone from the video team is more qualified under this question I think the question was the scope of our team just the scope yeah this question was raised a couple of time in the past and we general had a simple test to see if a package qualifies in the team it basically says do you find a second person caring for this package and then we can it's in the scope so if you propose a new package we generally think that at least one other team member should say yes I like to see this package as well in the team that's general of the test it really depends on the package but I think that's yeah we are not strictly limited to audio not at all so if there are any fancy video editors we should add one thing that has been in the past is that encoders have been stalled by patents so in reality especially in the video camp but both video and audio if you want to produce something that is compressed for web publishing or something like that then you need encoders and encoders are not in Debian so all the tools that require these encoders was also not in Debian so hopefully in the future this will change but this is not to do with what the multimedia team wants to do it's what we can do so interest yes so basically the time is up do you want to really quickly has anything changed with the patent stuff in terms of Debian being able to include that or no we are not sure but we tried we are working on that but the current status is yet unknown as far as I understood it was only certain countries I mean it's some key countries as far as I understand for example the patents on mp3 have partly expired perhaps you can give it to your neighbors do you have some details the microphone mp3 patent take the microphone please the format was published the mp3 format was published in 1991 and we are supposed to be approaching the 20 years of the publication of the mp3 format the lame project I don't know if you are familiar with that we have actually refrained it from distributing binary packages for the reason that we actually don't know about the legislator and we prefer to refrain from anybody suing us but actually we do expect things to be improving the sense that some paintings are going away leaving our way much clearer soon you'll be able to play some outdated mp3 files freely in your devices regarding the patents I really I'm not really sure about the things in the U.S. but in my country those don't exist and I do expect things if they exist in other countries to go away really soon okay thank you we're not going into patents so time is up now thank you all for coming and I think the next talk is almost regular we need some time to put in a new tape so that's it we have a multimedia track and we're now to something completely different