Thinking Aloud Test Plan

706.021 Human-Computer Interaction 3VU SS 2006

Group 1-03

Marco Breithuber
Benjamin Hopfer
Eghosa Omoniyi Ikulogun
Ulrich Krispel

Usability Test of the Web Site

http://www.billa.at/

Test Plan of 02nd May 2006

1 User Profile

Basically everyone cares where he is purchasing his consumer products. So the target group of the site www.billa.at is the whole population. Nevertheless only specific subset of the whole population has the knowledge or needs to use the site. We will concentrate on these specific groups and list them in order of importance:

We will test the first user group (Bargain Hunters) in our thinking aloud test, as it is the biggest.

2 Test Users

3 Test Environment

The test will take place at Marco Breithuber's appartment in the quiet living room. We will use a Intel Centrino Laptop with an attached external Monitor. The browser will be Internet Explorer 6.0 and the internet connection will be Inode XDSL@student.

Table 1: Hardware and software environment for the thinking aloud test.
Hardware Intel Centrine 1.7 Ghz , 1024MB RAM
Operating System Windows XP prof.
Web Browser Internet Explorer 6.0
Connection XDSL
Monitor Colours 32 bit
Monitor Resolution 1280 x 1024
Monitor Size 19'' TFT

4 Video Equipment

The camera we will be using is a JVC digital camera with Mini-DV-cartridges. The microphone will be a SONY clip-on microphone. The videos will be transfered to the PC from where a DVD is created. We have two "backup" cameras if needed.

5 Test Tasks

The following four test tasks will be given in increasing difficulty with a motivational task at the beginning. This are only candidates which may be replaced by better tasks later.

Table 1: Internal Task List.
Task No. Description Prerequisites Completion Criteria Timeout
1 Navigate to www.billa.at. Afterwards find and open the current special offer flyer. Open Internet Explorer with a neutral site. Installed Acrobat Reader. Installed Flash Plugin. The current special offer flyer is open (Flash or PDF) 2 minutes.
2 Find the opening times of the Billa store in the Plueddemanngasse in Graz. Homepage of www.billa.at Open browser window with information on the opening times of the requested store. 2 minutes.
3 Find and open the current recipe of the day ("Tagesrezept") from the TV show "Frisch gekocht ist halb gewonnen". Homepage of www.billa.at Open browser window with the identified recipe that was requested. 5 minutes.
4 You are planning a small party and want to order the following goods online:
  • A reasonable amount of "Extrawurst"
  • A reasonable amount of "Gouda" cheese
  • 10 rolls made by Anker
  • 10 bottles Corona
  • 1 bottle Eristoff
  • 6 cans Red Bull
  • 3 packs of Kelly's Chips classic
  • 1 bottle Eristoff
  • 6 litres Vöslauer mild mineral water
  • 3 litres of "Ja! Natürlich" orange juice
  • Change the amount of Kelly's Chips to 5 packs
Afterwards order the goods.
Homepage of Billa, not logged in and without having created an account Depending on the answer from Billa (if we can cancel orders afterwards) either the page with the last "Submit" Button (test person is interrupted by the facilitator) or submitted a correct order. 10 minutes.

Appendix A: Test Materials

Since all the test users are german the test will also take place in german. The test materials are in german too.

A.1 Orientation Script

The orientation script for the test facilitator can he found here: orient.html

A.2 Background Questionnaire

The background questionaire which is filled out by the test persons at the beginning of the test can be found here: hinter.html

A.3 Consent Form

The consent form, the test users have to sign before the test can be found here: einver.html

A.4 Data Collection Form

The data collection form for the data logger can be found here: testprot.pdf

A.5 Feedback Questionnaire

The feedback questionaire which is filled in by the test persons after the test can be found here: feedback.html