This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Jones, S. Articles by Robertson, S. Search for Related Content Social Bookmarking                         What's this?

A tool for comparative evaluation in an interactive environment

Centre for Interactive Systems Research, City University, London, UK, sa386{at}soi.city.ac.uk

Olga Vechtomova

Centre for Interactive Systems Research, City University, London, UK

Stephen Robertson

Centre for Interactive Systems Research, City University, London, UK

IR researchers need to collect comparative data to evaluate the worth of possible system improvements, for example new techniques for query enhancement. However it is sometimes difficult to achieve strict comparability in experiments designed for an interactive environment. We describe a method for merging results from different queries and collecting relevance feedback from users in comparative experiments. The method has been implemented in scripts supporting a Web-based front-end to a probabilistic retrieval system, using a relational database to log results. Its practical use is demonstrated in an investigation of initial query enhancement with collocate terms.

Journal of Information Science, Vol. 28, No. 6, 493-503 (2002)
DOI: 10.1177/016555150202800605


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?