Formative evaluation for complex interactive systems

This paper reports upon the design and use of a lightweight evaluation method, especially designed to examine complex interactive systems. The approach is illustrated through a case study involving an interactive tool designed to help enable users examine large scale data arising from authentication activity in higher education institutes. The evaluation approach illustrated is to enable the lightweight assessment of usability issues within complex interactive systems and identifying opportunities for significant design improvements. Specifically we argue that this method benefits from capturing key generic factors that underpin the effectiveness of tools for working with complex data. The paper concludes by reflecting upon the effectiveness of the lightweight structured assessment approach and how it supports to formative evaluation.