Date page last modified 04.02.98
Who maintains the web page: Edward Niescior.
Who has editorial responsibility: Clare Mc Govern, Lucinda Bailey and Edward Niescior.
Lecture 6 (week 3).
Topics: Incident Diaries, with an email discussion, and a Review of Psychological Instruments used in HCI.
eg network problems like printer queues.
During the iterative process of diary design, the problem may begin as fairly undefined, but gradually crystallises, as successive diaries allow you to hone in on the exact problem.
eg. To study Netscape problems:
First draft - "Fill in every time Netscape doesn't work."
Second draft - "Fill in every time Netscape says 'The server does not have a DNS entry' ".
A good incident diary should include:
eg. (From example given in lecture) "Diary of using e-mail"
eg. "The diary is designed to record each time you use e-mail in any way".
eg. "Please fill it in EVERY time you look at your e-mail, even if you only check it but do not read or send messages."
eg participants name, previous experience, if any, with the package/task.
how many incidents were recorded later and if so, how much
This allows the investigator to estimate accuracy of entries.
how many incidents were not recorded at all.
This gives the investigator an idea of how representative the results are.
Persuading participants to fill in the diary is crucial in obtaining meaningful results.
This can be achieved through :
We asked the class for feedback on various issues, and were inundated with copious replies for which we are most grateful.
We felt that under some circumstances, honesty could be an issue, although
it was not mentioned in the lectures.
"How great an issue do you feel honesty is in completing diaries?
For example, would you be too embarrassed to reveal that you hadn't received any mail in 3 days?! "
Wendy Thomas said:
"I would not be too embarrassed, but it's a good point - people will lie about things where it's a tad embarrassing to be different from the supposed norm. Especially happens when the diary is named - for example anonymous incident diaries might be more likely to get truthful answers than personally distributed ones."
Katrin Hartmann said:
"It's a great challenge for the evaluator to make the subjects aware of the importance of being honest...a few right sentences at the beginning can do a lot."
Roisin McGrath said:
"I don't think filling in the diary honestly or dishonestly is any big deal, folk tell you what they like!"
Mel Terras said:
"no, not embarrassed......but there is the chance to lie, after all......"
How accurate did those who filled in the email diary feel their answers could be if they completed their entries from memory?
"Did you fill the diary in after the event, and if so, do you think this affects the accuracy of your response?"
Martin Rutherford said:
"One of the instances I filled in after the event, and I found I couldn't remember how many emails I had received - so yes, it did affect the accuracy."
Katrin Hartmann said:
"I find it a good idea to put a field on the diary in which the subject can state when it was filled in so that the evaluator can work with this info."
Part two of this lecture
Back to Lecture Five
Forward to Lecture Seven
If you would like to add to this discussion, or if you have any other comments to make regarding the material on this web page, please mail us:Clare Mc Govern, Lucinda Bailey, Edward Niescior.