| Abstract: |
We report a case study on evaluating the downstream utility of user tests performed on a digital library with reference to the developer effect. ‘Downstream Utility’ is defined as
the effectiveness with which the resolution to a usability problem is implemented, and ‘Developer Effect’ is defined as developers’ bias towards fixing usability problems with
particular characteristics. To measure the effectiveness of the user tests, we analyze the actual impacts of fixing or not-fixing the usability problems identified. To address a theoretical void
in studying the persuasive power of usability evaluation results, we employ Information Integration Theory. We investigate six research questions that predict the persuasiveness of different
qualities of usability problems to induce fixes and the effectiveness of such fixes. Multi-perspective data have been collected from usability specialists, the development team of the digital
library, and its old as well as new users. Implications for reporting usability problems and future research are inferred. |
