Lessons learned from evaluation of the use of the National electronic Library of Infection

Abstract

The National electronic Library of Infection (NeLI: http://www.neli.org.uk) in the UK is a freely available portal to key evidence and guidelines in the infectious disease field. This paper discusses 5 years of evaluation of the pilot library and how this evaluation informed design of the new library website. The importance of combining qualitative and quantitative evaluation is highlighted and the results of web access logs analysis, free text search query analysis and an online user survey are compared. The paper concludes with a discussion of lessons learned for future development and evaluation of this Internet digital library.

Keywords

digital library evaluation Internet digital libraries National electronic Library of Infection user evaluation

References

Adams A , Blandford A. Acceptability of medical digital libraries . Health Informatics Journal 2002; 8 (2); 58–66 .

Gray M , de Lusignan S. National electronic Library for Health . British Medical Journal 1999; 319; 1476–1479 .

Kostkova P , Mani-Saada J , Weinberg J. Agent-based up-to-date data management in National electronic Library for Communicable Disease. In Nealon J , Moreno T eds Applications of Intelligent Agents in Health Care 103–122. Whitestein Series in Software Agent Technologies, 2003.

Smith K. The role of professional societies in the development of the National electronic Library for Communicable Disease. MSc thesis, City University, 2000.

Horby P , Rushdy A , Graham C , O’Mahony M , PHLS Overview of Communicable Diseases Committee. PHLS overview of communicable diseases 1999 . Communicable Diseases and Public Health 2001; 4 (1); 8–17 .

Rozic-Hristovski A , Hristovski D , Todorovski L. Users’information seeking behaviour on a medical library website . Journal of the Medical Library Association 2002; 90 (2); 210–217 .

Nicholas D , Huntington P , Williams P. Micromining log files: a method for enriching the data yield from Internet log files . Journal of Information Science 2003; 29 (5); 391–404 .

Madle G , Kostkova P , Mani-Saada J , Weinberg J. Evaluating the changes in knowledge and attitudes of digital library users. In Koch T , Torvik Sølveberg I eds Proceedings of the 7th European Conference on Research and Advanced Technologies for Digital Libraries (ECDL 2003), Trondheim. Berlin: Springer , 2003.

Madle G , Kostkova P , Mani-Saada J , Williams P , Weinberg J.

Changing public attitudes to antimicrobial prescribing: can the Internet help?

Informatics in Primary Care 2004; 12 (1); 19–26 .

10.

Roy A. Results of the online questionnaire evaluation of NeLI. August 2004 to September 2004. Available at http://topcat2.soi.city.ac.uk/Anjanareport3.nsf/Reportquest?OpenPage.

11.

Van den Brinka J L , Moormana P W , de Boerb M F , Pruync J F A , Verwoerdb C D A , van Bemmela J H. Involving the patient: a prospective study on use, appreciation and effectiveness of an information system in head and neck cancer care . International Journal of Medical Informatics 2005; 74 (10); 839–849 .

12.

http://www.staff.city.ac.uk/%7Ejane/weblogs.html.

13.

Jansen B. The effect of query complexity on web searching results . Information Research 2000; 6 (1); http://informationr.net/ir/6–1/paper87.html.

14.

Mani-Saada J , Madle G , Williams P. Initial experience with developing communities of practice around the National electronic Library for Communicable Disease . In Proceedings of the 1st Healthcare Digital Libraries Workshop (HDL 03) at ECDL 2003, Trondheim.

15.

D'souza S , Kostkova P. Agents in online healthcare digital library management of the National Resources for Infection Control . In Proceedings of the 3rd Healthcare Digital Libraries Workshop (HDL 05) at ECDL 2005, Vienna.

16.

Ammenworth E , Iller C , Mannsman U. Can evaluation studies benefit from triangulation? A case study . International Journal of Medical Informatics 2003; 70 (2–3); 237–248 .

17.

Patel N , Kostkova P. Design research: the deferred actions of the design of the National electronic Library of Infection (NeLI) . In Proceedings of the 3rd Healthcare Digital Libraries Workshop (HDL 05) at ECDL 2005, Vienna.