Background: Standardized instruments have been introduced for routine use within Victorian mental health services. The aim of routine outcome measurement (ROM) is to ensure the highest standard of service delivery as demonstrated through quality and accountability processes.
Aims: The aim is to determine the extent to which ROM measure against the 12 principles of outcome measurement described by Smith et al. (1997).
Method: The three ROM currently used in Victoria were critiqued according to the 12 principles, with the support of a review of the literature regarding outcome measurement.
Results: Of the 12 principles articulated, nine are not met by ROM currently used in Victoria. Only one is fully met, one partially met and one cannot be conclusively decided either way in light of current knowledge.
Conclusions: ROM currently utilized in Victoria do not reflect the areas considered of most relevance and importance to consumers of mental health services. Priority should therefore be given to developing an alternative consumer-derived approach to determining the effectiveness of mental health services according to those most affected by them.
Andrews, G., Peters, L. & Teesson, M. (1994) The measurement of consumer outcome in mental health . Sydney: University of New South Wales.
2.
Commonwealth of Australia (1997) National Standards for Mental Health Services. Canberra : Australian Government Publishing Service.
3.
Commonwealth of Australia (2003) National Mental Health Plan 2003-2008. Canberra: Australian Government.
4.
Coombs, T. & Meehan, T. (2003) Mental health outcomes in Australia: Issues for mental health nurses [Editorial]. International Journal of Mental Health Nursing, 12, 163-164.
5.
Coombs, T. & Meehan, T. (2005) Standardized routine outcome measurement: Response to Lakeman. International Journal of Mental Health Nursing , 14, 215-217.
6.
Department of Health (1998a) A first class service: Quality in the new NHS. London: Department of Health.
7.
Department of Health (1998b) Modernising mental health services: Safe, sound and supportive. London: Department of Health.
8.
Department of Health and Aged Care (1999) Mental Health Information Development: National Information Priorities and Strategies under the Second National Mental Health Plan 1998-2003 (First Edition June 1999). Canberra: Commonwealth of Australia.
9.
Department of Human Services (2002) New Directions for Victoria's Mental Health Services: The Next Five Years . Melbourne: Department of Human Services, Metropolitan Health and Aged Care Services Division.
10.
Eisen, S.V., Dill, D.L. & Grob, M.C. (1994) Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry, 45, 242-247.
11.
Fossey, E.M. & Harvey, C.A. (2001) A conceptual review of functioning: implications for the development of consumer outcome measures. Australian and New Zealand Journal of Psychiatry, 35, 91-98.
12.
Gilbody, S.M., House, A.O. & Sheldon, T.A. (2002) Outcome research in mental health: Systematic review . British Journal of Psychiatry, 181, 8-16.
13.
Gill, K.J., Pratt, C.W. & Librera, L.A. (1998) The effects of consumer vs. staff administration on the measurement of consumer satisfaction with psychiatric rehabilitation . Psychiatric Rehabilitation Journal, 21, 365-370.
14.
Goodwin, V. & Happell, B. (2006) In our own words: consumers' views on the reality of consumer participation in mental health care. Contemporary Nurse, 21, 4-13.
15.
Graham, C., Coombs, T., Buckingham, W., Eagar, K., Trauer, T. & Callaly, T. (2001) The Victorian Mental Health Outcomes Measurement Strategy: Consumer Perspectives on Future Directions for Outcome Self-Assessment . Report of the Consumer Consultation Project. Retrieved 7 April 2005 from: www.health.vic.gov.au/mentalhealth/outcomes/concare.htm
16.
Happell, B., Roper, C. & Gough, K. (2007) A User-Derived Evaluation Framework for Mental Health Services: Does routine outcome measurement satisfy the objectives of service users? Final Report. Rockhampton: Central Queensland University.
17.
Hunter, R., McLean, J., Peck, D., Pullen, I., Greenfield, A., McArthur, W. et al. (2004) The Scottish 700 Outcomes Study: a comparative evaluation of the Health of the Nation Outcome Scale (HoNOS), the Avon Mental Health Measure (AVON), and an idiographic scale (OPUS) in adult mental health . Journal of Mental Health, 13, 93-105.
18.
Lakeman, R. (2004) Standardized routine outcome measurement: Pot holes in the road to recovery. International Journal of Mental Health Nursing, 13, 210-215.
19.
Lammers, J. & Happell, B. (2003) Consumer participation in mental health services: looking from a consumer perspective. Journal of Psychiatric & Mental Health Nursing, 10, 385-392.
20.
Lammers, J. & Happell, B. (2004) Mental health reforms and their impact on consumer and carer participation: A perspective from Victoria, Australia. Issues in Mental Health Nursing, 25, 261-273.
21.
McPheeters, H.L. (1984) Statewide mental health outcome evaluation: A perspective of two southern states. Community Mental Health Journal, 20, 44-55.
22.
Mental Health Council of Australia (2005) Not for Service: Experiences of injustice and despair in mental health care in Australia. Canberra: Mental Health Council of Australia.
23.
Miller, M., Siggins, I., Kavanagh, D. & Donald, M. (2003) Consumer self-rated outcome measures in mental health. Melbourne: Mental Health Branch, Department of Human Services.
24.
Oades, L.G., Viney, L.L., Malins, G.L., Strang, J. & Eman, Y. (2005) Consumer evaluation of mental health services: the process and products. New Paradigm: The Australian Journal of Psychosocial Rehabilitation.
25.
Ohio Department of Mental Health (n.d.) Ohio Mental Health Consumer Outcomes System. Retrieved February 2 2008 from: www.mh.state.oh.us/oper/outcomes/outcomes.index.html
26.
Pirkis, J., Burgess, P., Kirk, P., Dodson, S. & Coombs, T. (2005) Review of Standardised Measures Used in the National Outcomes and Casemix Collection. Canberra: National Mental Health Strategy.
27.
Rosen, A., Hadzi-Pavlovic, D. & Parker, G. (1989) The Life Skills Profile: A measure assessing function and disability in schizophrenia. Schizophrenia Bulletin, 15, 325-337.
28.
Slade, M., McCrone, P., Kuipers, E., Leese, M., Cahill, S., Parabiaghi, A., Priebe, S. & Thornicroft, G. (2006) Use of standardised outcome measures in adult mental health services. British Journal of Psychiatry, 189, 330-336.
29.
Smith, G.R., Manderscheid, R.W., Flynn, L.M. & Steinwachs, D.M. (1997) Principles for assessment of patient outcomes in mental health care. Psychiatric Services , 48(8) 1003-1036.
Stedman, T., Yellowlees, P., Mellsop, G., Clarke, R. & Drake, S. (1997) Measuring Consumer Outcomes in Mental Health - Field testing of selected measures of consumer outcomes in mental health. St Lucia: University of Queensland.
32.
Veit, C.T. & Ware, J.E. (1983) The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology, 51, 730-742.
33.
Ware, J.E. & Sherbourne, C.D. (1992) The MOS 36-item Short-Form Health Survey (SF-36): I. Conceptual framework and item selection. Medical Care, 3, 473-483.
34.
Wing, J. (1994) Health of the Nation Outcome Scales: HoNOS field trials. London: Royal College of Psychiatrists Research Unit.
