Three Concepts: Information
Posters
A part of the course (25 % of the grade) is to prepare a poster
presentation for the joint poster session. The posters will be
prepared in pairs.
A poster session is an occasion where you present your topic to the
public with the help of posters on a bulletin board. Your role is to
stand nearby your poster, explain details and answer questions to the
public. Because everyone is doing this at the same time, you do not
need to give a lecture, and the public can wander around the poster
session room and concentrate on posters whose topics interest
them. The session is meant to be relaxed and rather informal.
Poster report
After the poster session, each student has to write a poster report
containing a short (one paragraph) evaluation of each of the posters
(execpt his/her own). The poster reports are to be done individually,
not in pairs. In your evaluation, pay attention to both the poster
layout (How well does the material explain the poster topic? Does it
support the verbal poster presentation well?) and to the verbal
presentation (Did the presenter/presenters seem to know their
business? Were they capable of explaining the material well?). Please
give the name or names of the people who were presenting the poster to
you. Give also an overall score of the poster using the scale A
(below average), A (average) and A+ (above average). Note that
this means that each student has to visit all the posters during the
poster session! I strongly advice you to take notes during the
session, as this will be a great help when writing the poster
report. The deadline for the poster reports is Wed, 05.12. (at
midnight).
Guidelines for poster presentation
Some guidelines for designing the poster can be found from the
following addresses:
»
Poster preparation guidelines in Chemistry
»
SIAM guidelines for preparing posters
» ... and many, many more from different
search engines.
The poster area is 95 cm x 115 cm (long side vertical, i.e., "portrait"
orientation). Copies of the poster material
should be delivered to the instructors after the poster session.
The poster session will be held Wed 21.11. Participation necessary in
order to pass the course.
Language: Prepare the posters in English, but it is OK to speak in Finnish during the session, except that please be prepared to use English for potential poster session guests who do not understand Finnish.
Poster topics
You may choose freely a poster topic for yourself
from the following list. The topics that have been already assigned
have the name(s) of the presentator(s) after the topic. In case there
is only one name, please contact either Jukka or Teemu or the
person in question directly in order to find out whether it is possible
to prepare the poster in pairs.
The topics are not ordered by their
difficultness, for example  they are in "random" order.
If needed, more topics will be added after the course has started.
Note: You may also do the poster from a topic of
your own. Ask Teemu whether your topic needs improving or whether
it's ok. The source material below for each topic is only a
suggestion. You can do not have to use it, and you can use any
other material you find.
Favourites: Personal favourites of the lecturer are
marked by "".

Information Theory and Gambling

Compression with Infinite
Alphabets
 Presenters: Otto Räsänen & Jaakko Sorri
 Material:
A. Orlitsky, N.P. Santhanam, K. Viswanathan, and J. Zhang:
On modeling profiles instead of values, in Proc. 20th Conference
on Uncertainty in Artificial Intelligence,
2004, pp. 426–435.
 MDL Denoising
 Presenters:
 Material:
T. Roos, P. Myllymäki, and J. Rissanen:
MDL denoising revisited, preprint arXiv cs.IT/0609138, 2006.
 Kolmogorov Complexity and
Shannon Information
 Presenters: Mika Wahlroos & Jussi Kurki
 Material:
 A.N. Kolmogorov: Three approaches to the quantitive definition
of information, Problems of Information Transmission, Vol. 1, 1–17
(ask for a copy from Teemu).

Grünwald, P., and Vitanyi P.:
Kolmogorov complexity and information theory — with an
interpretation in terms of questions and answers,
Journal of Logic, Language and Information, Vol. 12, 2003, p. 497529.

MartinLöf Randomness

Algorithmic Statistics
 Presenters:
 Material: Gacs P., Tromp J., and Vitanyi P.:
Algorithmic statistics,
IEEE Transactions on Information Theory, 47, 2001, pp. 2443–2463.

The Incompressibility Method
 Presenters:
 Material: T. Jiang, M. Li, and P. Vitanyi:
The incompressibility method. In Proc. SOFSEM 2000,
Lecture Notes in Computer Science, Vol. 1963,
SpringerVerlag, Berlin, 2000, 36–53.

Quantum Algorithmic Information
Theory

Randomness and Mathematical
Proof
 Presenters:
 Material: Chaitin G. J.:
Randomness and mathematical proof.
Scientific American, Vol. 232, May 1975, pp. 47–52.
In Chaitin G. J.,
Information Randomness and Incompleteness.
Papers on Algorithmich Information Theory. World Scientific Publishing
Co. Pte. Ltd., Singapore, 1987, pp. 3–13.

Minimum Message Length (MML)
Principle
 Presenters:
 Material:

Baxter R.: Minimum Message Length Inductive Inference: Theory and
Applications, Ph.D. Thesis, Department of Computer Science,
Monash University, 1996, Ch. 1.
 Baxter R. and Oliver J.: MDL and MML: Similarities and
differences, Technical Report 94/207, Monash University, 1995.

ZivLempel Coding
 Presenters: Antal Bese & Rita Marton
 Material: Bell T., Cleary J., Witten I.:
Text Compression.
Prentice Hall, New Jersey, 1990, Ch. 8.3.

Dynamic Huffman Codes
 Presenters: Anupam Arohi & Marija Furdek
 Material: Vitter J. S.:
Dynamic Huffman coding,
ACM Trans. Mathematical Software, and Collected Algorithms of ACM.

Gene Expression Data
Classification via MDL

Information Bottleneck

Normalized Information
Distance
 Presenters: Väinö AlaHärkönen
& Antti Tani
 Material:

Universal Types and Simulation of Individual Sequences
 Presenters:
 Material:
G. Seroussi: Universal types and simulation of individual sequences.
In LATIN 2004: Theoretical Informatics, 2004, pp. 312–321.

CTW Compression Algorithm
 Presenters:
 Material:
F. Willems, Y. Shtarkov, T. Tjalkens:
The contexttree weighting method: Basic properties,
IEEE Transactions on Information Theory, Vol. 41, 1995,
pp. 653–664.

Model Selection by NML
 Presenters: Esa Elovaara & Timo Nurmi
 Material: J.I. Myung, D.J. Navarro, M.A. Pitt:
Model selection by normalized maximum likelihood,
Journal of Mathematical Psychology, Vol. 50, 2006, pp. 167–179.

Image Compression
 Presenters: Tomas de Mora Garcia & Jessika Penttinen
 Material:
 D. Solomon:
Data Compression: The Complete Reference, Springer, 2004,
Chapter 4 "Image Compression".
 Pasi Fränti,
"Image
Compression", Lecture notes, Univesity of Joensuu, 87 pages, 2002.
(MS Word format, 3352kB).

Predictive Text Input and
Shannon Entropy
 Presenters: Aija Niissalo & Markus Heinonen
 Material:
 J.J. Darragh, I.H. Witten, and M.L. James:
The reactive keyboard: A predictive typing aid,
Computer, Vol. 23, 1990, pp. 41–49.
 C.E. Shannon: Prediction and entropy of printed english,
Bell System Technical Journal, 1951, pp. 50–64.