Three Concepts: Information
A part of the course (25 % of the grade) is to prepare a poster
presentation for the joint poster session. The posters will be
prepared in pairs.
A poster session is an occasion where you present your topic to the
public with the help of posters on a bulletin board. Your role is to
stand nearby your poster, explain details and answer questions to the
public. Because everyone is doing this at the same time, you do not
need to give a lecture, and the public can wander around the poster
session room and concentrate on posters whose topics interest
them. The session is meant to be relaxed and rather informal.
After the poster session, each student has to write a poster report
containing a short (one paragraph) evaluation of each of the posters
(execpt his/her own). The poster reports are to be done individually,
not in pairs. In your evaluation, pay attention to both the poster
layout (How well does the material explain the poster topic? Does it
support the verbal poster presentation well?) and to the verbal
presentation (Did the presenter/presenters seem to know their
business? Were they capable of explaining the material well?). Please
give the name or names of the people who were presenting the poster to
you. Give also an overall score of the poster using the scale A-
(below average), A (average) and A+ (above average). Note that
this means that each student has to visit all the posters during the
poster session! I strongly advice you to take notes during the
session, as this will be a great help when writing the poster
report. The deadline for the poster reports is Wed, 05.12. (at
Guidelines for poster presentation
Some guidelines for designing the poster can be found from the
Poster preparation guidelines in Chemistry
SIAM guidelines for preparing posters
» ... and many, many more from different
The poster area is 95 cm x 115 cm (long side vertical, i.e., "portrait"
orientation). Copies of the poster material
should be delivered to the instructors after the poster session.
The poster session will be held Wed 21.11. Participation necessary in
order to pass the course.
Language: Prepare the posters in English, but it is OK to speak in Finnish during the session, except that please be prepared to use English for potential poster session guests who do not understand Finnish.
You may choose freely a poster topic for yourself
from the following list. The topics that have been already assigned
have the name(s) of the presentator(s) after the topic. In case there
is only one name, please contact either Jukka or Teemu or the
person in question directly in order to find out whether it is possible
to prepare the poster in pairs.
The topics are not ordered by their
difficultness, for example - they are in "random" order.
If needed, more topics will be added after the course has started.
Note: You may also do the poster from a topic of
your own. Ask Teemu whether your topic needs improving or whether
it's ok. The source material below for each topic is only a
suggestion. You can do not have to use it, and you can use any
other material you find.
Favourites: Personal favourites of the lecturer are
marked by "".
Information Theory and Gambling
- Presenters: Michael Duku-Kaakyire & Markus Aukeala
Compression with Infinite
- Presenters: Otto Räsänen & Jaakko Sorri
A. Orlitsky, N.P. Santhanam, K. Viswanathan, and J. Zhang:
On modeling profiles instead of values, in Proc. 20th Conference
on Uncertainty in Artificial Intelligence,
2004, pp. 426–435.
- MDL Denoising
T. Roos, P. Myllymäki, and J. Rissanen:
MDL denoising revisited, preprint arXiv cs.IT/0609138, 2006.
- Kolmogorov Complexity and
- Presenters: Mika Wahlroos & Jussi Kurki
- A.N. Kolmogorov: Three approaches to the quantitive definition
of information, Problems of Information Transmission, Vol. 1, 1–17
(ask for a copy from Teemu).
Grünwald, P., and Vitanyi P.:
Kolmogorov complexity and information theory — with an
interpretation in terms of questions and answers,
Journal of Logic, Language and Information, Vol. 12, 2003, p. 497-529.
- Material: Gacs P., Tromp J., and Vitanyi P.:
IEEE Transactions on Information Theory, 47, 2001, pp. 2443–2463.
The Incompressibility Method
- Material: T. Jiang, M. Li, and P. Vitanyi:
The incompressibility method. In Proc. SOFSEM 2000,
Lecture Notes in Computer Science, Vol. 1963,
Springer-Verlag, Berlin, 2000, 36–53.
Quantum Algorithmic Information
Randomness and Mathematical
- Material: Chaitin G. J.:
Randomness and mathematical proof.
Scientific American, Vol. 232, May 1975, pp. 47–52.
In Chaitin G. J.,
Information Randomness and Incompleteness.
Papers on Algorithmich Information Theory. World Scientific Publishing
Co. Pte. Ltd., Singapore, 1987, pp. 3–13.
Minimum Message Length (MML)
Baxter R.: Minimum Message Length Inductive Inference: Theory and
Applications, Ph.D. Thesis, Department of Computer Science,
Monash University, 1996, Ch. 1.
- Baxter R. and Oliver J.: MDL and MML: Similarities and
differences, Technical Report 94/207, Monash University, 1995.
- Presenters: Antal Bese & Rita Marton
- Material: Bell T., Cleary J., Witten I.:
Prentice Hall, New Jersey, 1990, Ch. 8.3.
Dynamic Huffman Codes
- Presenters: Anupam Arohi & Marija Furdek
- Material: Vitter J. S.:
Dynamic Huffman coding,
ACM Trans. Mathematical Software, and Collected Algorithms of ACM.
Gene Expression Data
Classification via MDL
Universal Types and Simulation of Individual Sequences
- Presenters: Väinö Ala-Härkönen
& Antti Tani
CTW Compression Algorithm
G. Seroussi: Universal types and simulation of individual sequences.
In LATIN 2004: Theoretical Informatics, 2004, pp. 312–321.
Model Selection by NML
F. Willems, Y. Shtarkov, T. Tjalkens:
The context-tree weighting method: Basic properties,
IEEE Transactions on Information Theory, Vol. 41, 1995,
- Presenters: Esa Elovaara & Timo Nurmi
- Material: J.I. Myung, D.J. Navarro, M.A. Pitt:
Model selection by normalized maximum likelihood,
Journal of Mathematical Psychology, Vol. 50, 2006, pp. 167–179.
Predictive Text Input and
- Presenters: Tomas de Mora Garcia & Jessika Penttinen
- D. Solomon:
Data Compression: The Complete Reference, Springer, 2004,
Chapter 4 "Image Compression".
- Pasi Fränti,
Compression", Lecture notes, Univesity of Joensuu, 87 pages, 2002.
(MS Word format, 3352kB).
- Presenters: Aija Niissalo & Markus Heinonen
- J.J. Darragh, I.H. Witten, and M.L. James:
The reactive keyboard: A predictive typing aid,
Computer, Vol. 23, 1990, pp. 41–49.
- C.E. Shannon: Prediction and entropy of printed english,
Bell System Technical Journal, 1951, pp. 50–64.
Three Concepts: Information