Lec 1 – Entropy and information

Slides: zachariah_slides_gilc_lec1_entropy_2023.pdf Download zachariah_slides_gilc_lec1_entropy_2023.pdf

References:

• Shannon, C., A Mathematical Theory of Communication, The Bell System Technical Journal, 1948
• Cover, T & Thomas, J., Elements of Information Theory, Wiley, 2006. Ch. 5, 7 and 14.