Information theory: Coding (2 of 2)

An explanation of prefix-free codes, and another demonstration of Huffman coding.

More on information theory and coding:
http://tinyurl.com/cnuo9z
http://tinyurl.com/6lzn6d
http://tinyurl.com/zozlx
http://tinyurl.com/bh6rw
http://tinyurl.com/cf3knb
http://tinyurl.com/cqjv4o
http://tinyurl.com/z2ey9

The music is the second movement of Handel's Suite I, No. 2 in F Major, as performed by Ivan Ilic. http://www.musopen.com/music.php?type=piece&id=199

http://myspace.com/zjemptv
http://emptv.com/

Category:

Education

Tags:

• information
• theory
• coding
• uncertainty
• and
• self-information
• entropy
• more
• on
• source
• data
• compression
• bits
• binary
• tree
• prefix
• prefix-free
• variable-length
• fixed-length
• code
• words
• symbols
• logarithms
• probability
• frequency
• fair
• die
• david
• huffman
• weighted
• average
• communications

[itskelvinkkc]

You're really smart. Are you studying in university currently?

[ZJemptv]

Nope, I left school when I was 14 and haven't been back since. I just picked this up on my own because it interested me.

[Boneamps]

Ohh dude, you were cool until you said that...

all of your videos seem very informative and interesting, except the ones you talk about sexuality, it´s so cliche.

Anyway, the fact that you droped out of school puts your hole character into question now... it´s a pitty really...

Pleas don´t take it offensively

[ZJemptv]

Really? Because I wouldn't have learned anything more about information theory had I stayed in high school for the remaining two years -- I'm pretty sure that wasn't part of the curriculum. People are well aware of my "character" and simply take me as I am.

[ScrewAttackChina]

why would you have two symbols 1110 and 1111 that both have the same value

[ZJemptv]

Those aren't values, they're just the probabilities for those symbols. For example, with a fair die, each of the 6 sides (symbols) has the same probability: 1 in 6. However, you still need different codes to represent each of them. Using the same code for every side wouldn't be very useful, because you couldn't use the code as a representation of which side turned up -- it wouldn't tell you anything.

[dizzymj17]

u have just taught me in 15mins wat my lecturer couldnt in 2 hours, i love u

[vasilis8488]

ευχαριστώ πολύ

[olucim]

@Boneamps Well, Dude, I am an MSc graduate student and I find this information useful and 'water' clear, even clearer from what I've found in many textbooks or papers that I've reviewed. About the coolness... Having a diploma doesn't make you cooler or proves that you really know about something... Believe me ... been there... with many college teachers that can't seem to comprehend concepts and transmit them properly to people... keep the nice work up ZJemptv :P

[absentmindedprof]

Could this be used to express the probability of individual nucleotides in a given gene sequence within a DNA or RNA strand?

[tedtdu]

your tutorials are awesome and best than ever so-called Doc & Prof have ever tried..Because your theories are well-organized and there is no word unnecessary. I feel little sad once your information theory is finished , since I am really desperate to see its continuation. Thanks for your efforts and contributions,,,we all really really really need tutorials like this, because schools , universities do not really teach sth,Your knowledge is the same before you enter school and after you leave

[robotcommanderful]

@Boneamps Can't tell if trolling...

[TheDudeKicker]

@Boneamps

Who cares, follow your dreams. The smart ones always land on their feet. Be free. Oh, and thanks for teaching an old guy something. :)

[yashdgandhi]

Respect

[newperve]

@ZJemptv People confuse schooling with education.  If someone is intelligent and interested in some form of knowledge they will learn, whether or not they have to turn up at a place where desks face a whiteboard. Clearly you're in that category.

[premlalpaleri]

i really respect u dude......even after not having a well built educational background,u seem 2 be better dan most f d undergrads whom i kno...hats off to your attempt...