Computer Science 650 - Applied Information Theory

This course will introduce the basic concepts of Information Theory: entropy, relative entropy, mutual information, channel capacity, and rate distortion. Applications, rather than proofs, will be emphasized. In addition, the statistical problem of computing information theoretic quantities from data will be emphasized. Non-parametric and semi-parametric statistical models will also be covered.

Open to Computer Science graduate students only. UNDERGRADUATES WITH PERMISSION OF INSTRUCTOR. PREREQUISITE: ANY COURSE IN PROBABILITY AND STATISTICS. STUDENTS NEEDING SPECIAL PERMISSION MUST REQUEST OVERRIDES VIA THE ON-LINE FORM: https://www.cics.umass.edu/overrides.