Academic Calendar 2024-2025

Search Results

Search Results for "MATH 874"

MATH 874  Information Theory  Units: 3.00  
An introduction to the fundamental principles of the theory of communication. Topics include: information measures, entropy, mutual information, divergence; modeling of information sources, discrete memoryless sources, Markov sources, entropy rate, source redundancy; fundamentals of lossless data compression, block encoding, variable-length encoding, Kraft inequality, design of Shannon-Fano and Huffman codes; fundamentals of channel coding, channel capacity, noisy channel coding theorem, channels with memory, lossless information transmission theorem; continuous-alphabet sources and channels, differential entropy, capacity of discrete-time and band-limited continuous-time Gaussian channels; rate-distortion theory, lossy data compression, rate-distortion theorem, lossy information transmission theorem.   Offered jointly with MATH-474).  Three term hours, fall; lectures.
Offering Faculty: Faculty of Arts and Science