Three Concepts: Information, Course at the Department of Computer Science, University of Helsinki, Fall 2006.
This course belongs to the "Three concepts" series, and provides an introduction to information and coding theory for computer science students. In fact much of the course can be viewed as applications of Shannon's central result known as the source coding theorem. The theoretical results will be illustrated by various descriptions of practical data compression systems from Huffman coding to Rissanen's arithmetic coding. In order to demonstrate the wide applicability of information-theoretic concepts, the role of Bayesian inference in data compression is discussed, and we end the course by describing application of information-theoretic principles to (statistical) modeling, i.e., the Minimum Description Length Principle (MDL).
Petri Myllymäki, Head of the
Intelligent Systems Specialization Area and the
Complex Systems Computation (CoSCo) research group
Course assistant: M.Sc. Tomi Silander
Language: Although all the material in the course will be in English, the lectures will be given this year in Finnish.
Lectures: 07.09.-12.10. Thursdays 16-19 in B222.
Posters and projects: In addition to regular lectures, the course involves project work and poster presentations (see the schedule below).
These pages will be updated during the course and the current schedule and topics are only tentative. Follow this page for updates!
Course Schedule (tentative):
|3 Concepts: Information|