On the role of user-centred evaluation in the advancement of interactive information retrieval

PETRELLI, Daniela (2008). On the role of user-centred evaluation in the advancement of interactive information retrieval. Information Processing & Management, 44 (1), p. 22.

[img]
Preview
PDF
IPM-IIRevaluation.pdf - Accepted Version

Download (214kB) | Preview
Link to published version:: https://doi.org/10.1016/j.ipm.2007.01.024
Related URLs:

    Abstract

    This paper discusses the role of user-centred evaluations as an essential method for researching interactive information retrieval. It draws mainly on the work carried out during the Clarity Project where different user-centred evaluations were run during the lifecycle of a cross-language information retrieval system. The iterative testing was not only instrumental to the development of a usable system, but it enhanced our knowledge of the potential, impact, and actual use of cross-language information retrieval technology. Indeed the role of the user evaluation was dual: by testing a specific prototype it was possible to gain a micro-view and assess the effectiveness of each component of the complex system; by cumulating the result of all the evaluations (in total 43 people were involved) it was possible to build a macro-view of how cross-language retrieval would impact on users and their tasks. By showing the richness of results that can be acquired, this paper aims at stimulating researchers into considering user-centred evaluations as a flexible, adaptable and comprehensive technique for investigating non-traditional information access systems.

    Item Type: Article
    Research Institute, Centre or Group - Does NOT include content added after October 2018: Cultural Communication and Computing Research Institute > Art and Design Research Centre
    Identification Number: https://doi.org/10.1016/j.ipm.2007.01.024
    Page Range: p. 22
    Depositing User: Daniela Petrelli
    Date Deposited: 05 Jan 2011 17:05
    Last Modified: 28 Mar 2020 15:20
    URI: http://shura.shu.ac.uk/id/eprint/2905

    Actions (login required)

    View Item View Item

    Downloads

    Downloads per month over past year

    View more statistics