Three Concepts: Information, Course at the Department of Computer Science, University of Helsinki, Fall 2007.
This course belongs to the "Three concepts" series, and provides an introduction to information theory for computer science students. In fact much of the course can be viewed as consequences of Shannon's central result known as the Noiseless Source Coding Theorem. The theoretical results will be illustrated by various descriptions of practical data compression systems from Huffman coding to Rissanen's arithmetic coding. In order to demonstrate the wide applicability of information-theoretic concepts in intelligent systems, we discuss information-theoretic principles to (statistical) modeling, i.e., the Minimum Description Length (MDL) principle.
Instructor: University lecturer
Teemu Roos, A346: teemu.roos at cs.helsinki.fi
Course assistant: M.Sc. Jukka Perkiö: jukka.perkio at cs.helsinki.fi
Language: All course material will be in English. Lectures are given in English, unless all participants are Finnish-speaking.
Lectures: Period I: 5.9.–10.10. Wed 13–16 in B222. Period II: 31.10.–5.12. Wed 15–16 in B222.
Posters and projects: In addition to regular lectures, the course involves project work and poster presentations (see the schedule below).
|3 Concepts: Information|