A Multi-Method Approach to Assess Usability and Acceptability

Abstract

The Patient-Reported Outcomes Measurement System (PROMIS) network, funded as part of the National Institute of Health's roadmap initiative, is in the process of developing a revolutionary computerized adaptive testing system for use in the clinical research community as a standardized method to select and implement patient-reported outcome measures. Soliciting end-user feedback on the system has posed logistical challenges, given the magnitude of the system's scope and the diversity of the target audience and their research needs. This case study presents the application of multiple qualitative methods—participant observation, usability testing, and focus groups—to determine end-users' acceptance of the system and its usability. Findings from these methods highlight the value in using a multifaceted approach to solicit end-user input to software development.

Keywords

usability testing focus groups participant observation patient-reported outcomes software development computerized adaptive testing

Get full access to this article

View all access options for this article.

References

Bailey, R.W. (2005). The value of iterative design. Available from www.webusability.com

Cella, D. , Yount, S. , Rothrock, N. , Gershon, R. , Cook, K. , & Reeve, B. , et al. (2007). The Patient Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap Cooperative Group during its first two years. Medical Care, 45, S3-11.

Chang, C.-H. (2007). Patient-reported outcomes measurement and management with innovative methodologies and technologies. Quality of Life Research, 16, 157-166.

Couper, M.P. (2000). Usability evaluation of computer-assisted survey instruments. Social Science Computer Review, 18, 384-396.

Lin, C. , Hu, P.J. , & Chen, H. (2004). Technology implementation management in law enforcement: COPLINK system usability and user acceptance evaluations. Social Science Computer Review, 22, 24-36.

Rogers, E.M. (2003). Diffusion of Innovations (5th ed.). New York: Free Press.

U.S. Department of Health and Human Services. ( 2006). Research based web design and usability guidelines. Retrieved June 9, 2008, from http://www.usability.gov/pdfs/guidelines.html#1 .