论文标题
信息理论的视觉介绍
A visual introduction to information theory
论文作者
论文摘要
尽管最初是为通信工程开发的,但信息理论包含具有科学和工程中许多应用的数学工具。这些工具可用于表征在存在噪声下数据压缩和传输的基本限制。在这里,我们介绍了信息理论中的关键概念的实用指南,重点是直觉并尽可能提供视觉解释。我们的演讲仅假定对基本概率理论的熟悉。
Though originally developed for communications engineering, information theory contains mathematical tools with numerous applications in science and engineering. These tools can be used to characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a practical guide to key concepts in information theory, focusing on intuitions and providing visual explanations wherever possible. Our presentation assumes only a familiarity with basic probability theory.