Last changed
5 Nov 1998 ............... Length about 900 words (5000 bytes).
This is a WWW document maintained by
Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/dublin.html.
Web site logical path:
[MIRA]
[MIRA workshops]
[Dublin workshop]
[this page]
[more details]
Final timetable for Dublin MIRA workshop
Wednesday-Friday 28-30 October 1998.
(For other information, go back up to
workshop central page.)
Wed. 28 October 1998
Introductions from new faces; and a thought-provoking demo
5pm-6:30pm
Heimo Mueller [10 min]
The VICAR project on indexing and retrieval of video information.
Ned O'Connor; Teltec / DiceMan [10 min]
A project at Dublin City University
Brian Trench [10 min]
A science journalist's view of using IR
Kai Grossjohann (for Mounia Lalmas) [10 min]
An interesting project at Dortmund on evaluating structured documents
Introduction to David Harper's Web Cluster software [10 min]
Iain Campbell. [30 min talk; then demo]
Talk and demo of his radical picture retrieval
system that could be seen as a no-query, all-relevance-feedback design.
Love it or hate it, whether it is a breakthrough or a horrible mistake,
this is a landmark IR design you need to know about.
Its importance is in part that it invalidates the old test collection
approach to evaluation (which couldn't test it).
Thur. 29 October 1998
[Theme: Beyond test collections: wider understandings of information needs and relevance]
(More on the idea behind the morning's sessions)
The main different senses and types of information need.
[10 mins.] Stefano Mizzaro: 4 types of information need
[10 mins.] Pia Borlund: simulated information needs as a practical approach
[10 mins.] Matthew Chalmers.
[10 mins.] Steve Draper (Mark Dunlop) on the types they find useful in
experiments.
Non-binary relevance judgements (RJs):
Fabio Crestani's working group.
Relevance judgements not as binary but as scalars: e.g. quantities between 0
and 1.
[10 mins.] Fabio Crestani: Generation of non-binary RJs
[10 mins.] Gianni Amati: Techniques for using non-binary RJs
[10 mins.] Jane Reid: An example of use of non-binary RJs in task-oriented
evaluation
[10 mins.] Nathalie Denos: Non-binary RJ criteria and data quality criteria
Multi-dimensional relevance judgements.
Stefano Mizzaro and Silvia Gabrielli
Relevance judgements not as scalars, but as 4 dimensional (vector?)
quantities.
The purpose of this will be to discuss the other 3 dimensions in Stefano's
model of relevance; and to report on new results by Silvia and Stefano since
his paper; and hopefully to provide a practical exercise or demonstration.
Lunch
A discussion / panel on interactive TREC. To what extent do we think it is
adequate?
Paul Over [30 mins]
A review of Interactive TREC
Kal for Peter Ingwersen [30 mins]
Shortcomings of Interactive TREC.
Developing practical user-oriented IR evaluation
Dunlop&Draper working group
Report and demonstration of a basic user-oriented experimental set-up, using
the Muscat IR software as a testbed.
Exercise/demo on collaborative filtering Matthew Chalmers
MIRA business meeting
Fri. 30 October 1998
[Theme: the need for field studies and methods.]
Workplace study of journalists and technology
Catriona Macaulay [20 mins]
Eero:
photo retrieval domain study
Report on that working group.
Consensus in relevance judgements: Jane Reid et al.
An exercise / demonstration comparing the degree of consensus in relevance
judgements in different media (text vs. images).
Lunch
Designing an MMTC (Multi-Media Test Collection) proposal.
Report from Mira Working Group:
M. Beaulieu, S. Draper, M. Dunlop, A. Pejtersen, Alan Smeaton.
Please read
the current draft of the paper
which will be discussed in this session.
Web site logical path:
[MIRA]
[MIRA workshops]
[Dublin workshop]
[this page]