Last changed 5 Nov 1998 ............... Length about 900 words (5000 bytes).
This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/dublin.html.

Web site logical path: [MIRA] [MIRA workshops] [Dublin workshop] [this page] [more details]

Final timetable for Dublin MIRA workshop

Wednesday-Friday 28-30 October 1998.
(For other information, go back up to workshop central page.)

Wed. 28 October 1998

Introductions from new faces; and a thought-provoking demo
5pm-6:30pm
  • Heimo Mueller [10 min]
    The VICAR project on indexing and retrieval of video information.

  • Ned O'Connor; Teltec / DiceMan [10 min]
    A project at Dublin City University

  • Brian Trench [10 min]
    A science journalist's view of using IR

  • Kai Grossjohann (for Mounia Lalmas) [10 min]
    An interesting project at Dortmund on evaluating structured documents

  • Introduction to David Harper's Web Cluster software [10 min]

  • Iain Campbell. [30 min talk; then demo]
    Talk and demo of his radical picture retrieval system that could be seen as a no-query, all-relevance-feedback design. Love it or hate it, whether it is a breakthrough or a horrible mistake, this is a landmark IR design you need to know about. Its importance is in part that it invalidates the old test collection approach to evaluation (which couldn't test it).

    Thur. 29 October 1998

    [Theme: Beyond test collections: wider understandings of information needs and relevance] (More on the idea behind the morning's sessions)

  • The main different senses and types of information need.

    [10 mins.] Stefano Mizzaro: 4 types of information need
    [10 mins.] Pia Borlund: simulated information needs as a practical approach
    [10 mins.] Matthew Chalmers.
    [10 mins.] Steve Draper (Mark Dunlop) on the types they find useful in experiments.

  • Non-binary relevance judgements (RJs): Fabio Crestani's working group.
    Relevance judgements not as binary but as scalars: e.g. quantities between 0 and 1.

    [10 mins.] Fabio Crestani: Generation of non-binary RJs
    [10 mins.] Gianni Amati: Techniques for using non-binary RJs
    [10 mins.] Jane Reid: An example of use of non-binary RJs in task-oriented evaluation
    [10 mins.] Nathalie Denos: Non-binary RJ criteria and data quality criteria

  • Multi-dimensional relevance judgements. Stefano Mizzaro and Silvia Gabrielli
    Relevance judgements not as scalars, but as 4 dimensional (vector?) quantities.
    The purpose of this will be to discuss the other 3 dimensions in Stefano's model of relevance; and to report on new results by Silvia and Stefano since his paper; and hopefully to provide a practical exercise or demonstration.

    Lunch

  • A discussion / panel on interactive TREC. To what extent do we think it is adequate?

    Paul Over [30 mins]
    A review of Interactive TREC

    Kal for Peter Ingwersen [30 mins]
    Shortcomings of Interactive TREC.

  • Developing practical user-oriented IR evaluation Dunlop&Draper working group
    Report and demonstration of a basic user-oriented experimental set-up, using the Muscat IR software as a testbed.

  • Exercise/demo on collaborative filtering Matthew Chalmers

  • MIRA business meeting

    Fri. 30 October 1998

    [Theme: the need for field studies and methods.]
  • Workplace study of journalists and technology
    Catriona Macaulay [20 mins]

  • Eero: photo retrieval domain study
    Report on that working group.

  • Consensus in relevance judgements: Jane Reid et al.
    An exercise / demonstration comparing the degree of consensus in relevance judgements in different media (text vs. images).

    Lunch

  • Designing an MMTC (Multi-Media Test Collection) proposal. Report from Mira Working Group:
    M. Beaulieu, S. Draper, M. Dunlop, A. Pejtersen, Alan Smeaton.

    Please read the current draft of the paper which will be discussed in this session.

    Web site logical path: [MIRA] [MIRA workshops] [Dublin workshop] [this page]