Information theory: Entropy

An explanation of entropy in information theory and how to calculate it. (The last video ran long, so I had to slice it up.)

More on information theory:
http://tinyurl.com/zozlx
http://tinyurl.com/8bueub
http://tinyurl.com/bfpu8b
http://tinyurl.com/as2txv
http://tinyurl.com/dcsgt2
http://tinyurl.com/ct5phc

The music is the third movement of Carl Maria von Weber's Clarinet Concerto No. 2, as performed by the Skidmore College Orchestra. http://www.musopen.com/music.php?type=piece&id=67

http://myspace.com/zjemptv
http://emptv.com/

Category:

Education

Tags:

• information
• theory
• uncertainty
• and
• self-information
• mathematics
• entropy
• probability
• logarithms
• summation
• sigma
• notation
• average
• source
• weighted
• sum
• symbols
• fair
• unfair
• coin
• die
• binary
• bits
• claude
• shannon
• communication

[wownov83]

lol you're explaining information entropy to people but presuming they don't know what the symbol for summation is?

[Anonymouz1337]

Are you a wizard?

[bebeheuy]

I am very happy to see the vidoe after you give this An explanation of entropy in information theory and how to calculate it.

[AntoMelta]

I Really Like The Video From Your An explanation of entropy in information theory and how to calculate it.

[willamricard]

Your Video Is Very Useful Sharing An explanation of entropy in information theory and how to calculate it

[imegatrone]

after i watched this video, my insight is very open because the video An explanation of entropy in information theory and how to calculate it is very good to give information

[Nademox]

@wownov83 i think it's a good practice to unpack the sigma expression esp. if your audience are students?

[Jdonovanford]

The real formula has a negative symbol before the summation, man!

[xsni]

cool vid

[SunStrokeCactus]

that dude makes me feel very stupid, and thats a very sad thing for me... :(

[MightyTokez]

i see a lot of great minds on youtube.. continue learning, finish school and lets fix this crazy planet! Thank you ZJ for this cool and informative video.

[Yallniggasbetrollin]

That's entropy or E-N-T-R-O to the P to the Y,

the reason why the sun will one day all burn out and die.

Order from disorder is a scientific rarity,

allow me to explain it with a little bit more clarity.

Did I say rarity? I meant impossibility,

at least in a closed system there will always be more entropy.

That's entropy and I hope that you're all down with it,

if you are here's your membership.