Find Articles Usability Study (2005)

Overview

Usability tests were conducted on three separate web site types in May-June 2005 in order to determine the best way of designing a web site to help undergraduates find articles. In Phase 1 of the Find Articles usability tests, six undergraduates were given a set of tasks related to finding articles and asked to complete the tasks using the NCSU Libraries web site before it was redesigned. In Phase 2, six undergraduates were asked to complete the same tasks using Model A, which adopted a "side-by-side" approach, and six undergraduates were asked to complete the tasks using Model B, which adopted a "flowchart" approach.

Team and Partners

Kristin Antelman, task force chair
Kim Duckett
Karen Ciccone

Technical Details

Recordings were made in the NCSU Libraries Usability Research Lab using Morae usability testing software.

Results

Both redesigned models significantly outperformed the old web site in terms of time on task and task success, indicating that the "Find Articles" term and structure is indeed successful. In Phase 2, the "flowchart" approach of Model B was more successful than the "side-by-side" approach of Model A, because the web site itself was structured to guide undergraduates to the correct tool for their task. However, this approach ran into problems with tasks that fell outside the theoretical model of the site structure. Both Model A and Model B were constructed to differentiate between known-item and unknown-item searches, which created especial difficulties for task 4 and task 5. Citation Linker, classified as a "known-item" tool, could not be used at all for task 5, which asked students to find a known item. The testing also discovered design problems with other parts of the site, such as the E-Journal Finder search results page.

Project Links

Script - The test script with instructions and explanations for students.
Task List - The list of tasks presented to students.
Old Site - Screenshot of the former NCSU Libraries home page.
Model A - Screenshot of a Find Articles page with a "side-by-side" approach.
Model B - Sreenshot of a Find Articles page with a "flowchart" approach to two other pages.
Final Design - the Find Articles page design that was eventually implemented.

Reports and Presentations

Spreadsheets showing that the redesigned models performed better than the old web site, and that Model B performed better than Model A.
Problems with the old web site and suggestions for improvement.
Usability report for Models A and B listing and discussing things users did.
User Methods - A table showing all the different ways users succeeded in the tasks.
User Paths - All user paths for all tasks on Models A and B.

Videos

Note that all users in these recordings signed a release form that included the following language:

Recordings made during this study will be used for research and development. Therefore, I understand that my work during the test will be recorded and viewed by the staff of the NCSU Libraries. I further understand that the NCSU Libraries may wish to use segments of these recordings to illustrate presentations offered to professional audiences. I give my consent to the NCSU Libraries to use my recorded image and voice for these purposes, with the provision that my last name will not be associated with the recordings and that these recordings will not be released to any broadcast or publication media.

Last updated: October 2009