Lecture - 8 Information Theory (Part - 1)

[tareq992403]

Thanks a lot. Very well explained.

[bistabirajan]

Thank you very much for your clear and simple explanation on information theory Prof. Bikash kumar dey...I am a graduate freshman in electrical engineering and found your explanation excellent..wish to learn more from your videos...

[rangjungyeshe]

Nice and clear; the horse race example worked very well. Thanks !

[jp86II]

is the thing he used at 16:31 some kind of huffman coding or someother kind of coding?

[someman7]

@jp86II it's huffman. he kinda weaseled that one in.

[thefrbalucard]

all is well but he keeps saying which as huvich

[SamiHelif88]

the drill sound is killing me :(



[socratus1]

Information / Consciousness can be transfer only by Electromagnetic waves

There arent Electromagnetic waves without Electron

We know Electron is very important particle

It acts in Maxwells electrodynamics

It acts in the atom

But how Electron acts in cell we dont know

We need time to understand this fact

And when we understand Electron

we will know the Ultimate Nature of Reality and the material basis of Quantum Consciousness

[gregrutz]

@socratus1 The electron is only one of many particals of nature. We know the electron acts the same in a cell as it does everywhere.

[DarkShroom]

@socratus1 lol rubbish, makes about as much sense as a string theorist

[J0EH3AD]

@socratus1 OMG stop smoking that stuff and get educated.

[raghavghaiee]

@ abskebabs

Please revise your class 11 calculus, and limits to appreciate the assumption.

Lt x->0 (x log x)=0

[arunrangarajan]

Prof. Bikash Kumar Dey has done a great job here! Everything is explained so clearly! Thanks to all the IITs, IISc and youtube for these invaluable videos!

I was one year junior to Bikash when I did my M.E. in IISc, Bangalore. He guided me a lot during that time and gave me tremendous encouragement. His thinking is crystal clear and his Math background is phenomenal! One of the brightest people & best teachers I know!

Hope to see more lectures from him!

- Arun Rangarajan.

[abskebabs]

Hi, I think you made a mistake on about 29:34, 0log(0) is not necessarily zero, as log(0) is -infinity surely?

Otherwise, great lecture! Thanks for putting it up.

[xicalhada]

Conventions used in Information Theory:

0*log(0/0) = 0

0*log(0/q)=0

p*log(p/0)=inf

[fielsjd]

The convention is usually adopted to maintain continuity at 0. The limit as the variable approaches zero is zero.

[Thirdeye300]

@abskebabs Take the Limit. (L'Hopital)

[Shisno2392]

bravo! :)

[laks316]

great lecture

[kuracburac]

Prof. Dey, thank you very much for your excellent lectures, you are a great teacher.

[somethingnotthere]

very good lecture.

[talkwing]

Really good lecture.