Ulla de Stricker and Barbie Keiser talked about how to carry out planned and well-executed audits of information services. Audit need not bear the name audit, but at bottom is a process of finding out who is doing what to whom with what, a regular systematic examination of practices and needs .
It helps provide evidence for services, but also builds relationships with clients. It's necessary to understand the client's working life and practices. Cultures may vary: some may be more used to audit questioning.
Ulla and Barbie had independently come to more or less the same conclusions about methodology. Ulla works almost as an anthropologist, watching what people actually do as well as listening to what they say they do.
They took the example of a library intranet: what defects must be addressed? What content and services would be priority for the clients? What functionality is essential and what is nice to have? Are there any sacred cows that could be sacrificed? What good practice is there elsewhere?
Data for these could include activities such as harvesting logs and statistics, face to face interviews, focus groups, Easter Egg hunts (where users are given questions to answer and observed as they try to find the answer), at-the-elbow sense-making (asking client to show the investigator how they carry out a task, slowing them down and ask questions about their behaviour), surveys, and usability-lite testing.
Barbie gave another case example of an audit of a library consortium's communications programme. The stages were:
• an initial orientation meeting
• survey
• focus groups
• usabiiity-lite testing (to determine what people actually do and what they want to do, what drives them to use a service, what incentives might attract them, what barriers there were and what solutions could there be).
• objective website review
• user and usage-centred review
How to conduct successful interviews and focus groups:
• facilitate and listen
• prime the pump (ie "others say" or "your colleagues have been commenting that..."
• people may be driven by culture and politics which may skew answers
• must be short, fast, easy
• open-ended questions
A final audit report then needs to bring all the work together, with findings, conclusions, recommendations. (cf 3-8-25 methodology for business cases: 3 pages for a summary, 8 for a more detailed version and 25 for the full report.


Recent Comments