信息论入门探索

• Overview

  需要了解信息论。秉着大牛+历史这两条学习主线。调研一下有哪些学习资料。

• 入门

  Visual Information Theory, by Christopher Colah. It’s a website, not a book.

  A First Course in Information Theory; Yeung, Raymond W. 2002

  Network Information Theory; Abbas El Gamal, Young-Han Kim

  Information Theory, Inference and Learning Algorithms, by David J. C. MacKay, 2003. Pdf and Video. Another PDF.

  Information Theory(Lecture Notes); Stefan M. Moser;

  Information Theory: A Tutorial Introduction; James V Stone; 2015;

• 进阶

  The Information: A History, A Theory, A Flood; James Gleick; 2011

  Elements of Information Theory, Thomas M.Cove, Joy A. Thomas ; 1991

  Information Theory: A Concise Introduction; Stefan Hollos; 2015

  Time Travel: A History; James Gleick; 2016

  Lecture Notes on Information Theory; Y. Polyanskiy, Y. Wu; 2017.

  Information Theory and Statistics; John Duchi; 2019

  Information Theory: Coding Theorems for Discrete Memoryless Systems; Imre; 1982

  An Introduction to Single-User Information Theory; Alajaji, Fady, Chen, Po-Ning; 2018

  Information-Spectrum Methods in Information Theory; Te Sun Han; 2003

  Information Theory and Reliable Communication; Robert G. Gallager; 1968

  Principles of Digital Communication; Robert Gallager

• Shannon

  The Mathematical Theory of Communication, Claude E Shannon, Warren Weaver; 1971.

  Claude E. Shannon; Neil J. A. Sloane; 1993.

  Shannon’s work is brilliantly analyzed in the paper Mathematical Theory of Claude Shannon.

• References

1. douban 信息论基础
2. 知乎：可以推荐一本关于信息论的通俗好书吗？
3. What are the best introductions to information theory? by Henry Norman
4. 100 Best Information Theory Books of All Time