Routine Outcome Measurement in Mental Health: Feasibility for Examining Effectiveness of an NGO

Abstract

Objective: The aim of this study was to examine the feasibility of using routine public mental health outcome data to measure the effectiveness of a non government organization (NGO), specifically Pioneer Clubhouse.

Method: We retrieved data from the NSW Mental Health Outcomes and Assessment Tools (MH-OAT) database, for 31 participants who joined Pioneer Clubhouse, NSW, in 2007. Data were also sought for 31 matched control participants from within the same Area Health Service. Data collected from the adult MH-OAT instruments, Health of the Nation Outcome Scales (HoNOS), Kessler-10 (K-10) and Abbreviated Life Skills Profile-16 (LSP-16), was retrieved for 13 weeks prior to joining date and compared with 13 weeks of data 6 months after joining.

Results: Twenty-four Clubhouse members were registered in the MH-OAT database. Only one of the 24 participants had data for both time periods requested. MH-OAT data collection was insufficient to allow their use for measuring effectiveness of a NGO.

Conclusion: Despite the National Mental Health Plan emphasis, and extensive and expensive support for routine data collection in public mental health services, such data collection has been unsuccessful. We discuss possible reasons for this.

Keywords

mental health non government organization outcome measurement.

Get full access to this article

View all access options for this article.

References

1. Pirkis

Burgess

Kirk

Dodson

Coombs

. Review of Standardised Measures Used in the National Outcomes and Casemix Collection (NOCC). Australian Mental Health Outcomes and Classification Network of Canberra, 2005.

Penrose-Wall

. Mapping the Difference We Make: Non-government Organisations Use of Routine Consumer Outcome Evaluation in Providing Mental Health Care in NSW. Rozelle: Mental Health Co-ordinating Council of New South Wales, 2006.

Burgess

Kym

Penrose-Wall

. State-wide Consumer Consultation on Routine Consumer Outcome Measurement by Non-government Organisations Providing Mental Health Programs in New South Wales: Report of Findings and Recommendations. Rozelle: Mental Health Co-ordinating Council of New South Wales, 2006.

Macleod

. Pioneer Spirit. The Story of Pioneer Clubhouse and its Partnership in Recovery from Mental Illness. Balgowlah: Pioneer Clubhouse, 2005.

5. International Center for Clubhouse Development. International Center for Clubhouse Development. Available from URL: http://iccd.org/default.aspx

NSW Department of Health. Framework for Rehabilitation for Mental Health. North Sydney: NSW Department of Health, Mental Health Implementation Group, 2002.

Wing

Beevor

Curtis

Park

SBG

Hadden

Burns

. Health of the Nation Outcomes Scales (HoNOS). Research and development. British Journal of Psychiatry 1998; 172: 11–18.

Kessler

Andrews

Colpe

. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine 2002; 32: 959–976.

Rosen

Hadzi-Pavlovic

Parker

. The Life Skills Profile: A measure assessing function and disability in schizophrenia. Schizophrenia Bulletin 1989; 15: 325–337.

10.

Mental Health Association of NSW. Mental Health Matters Awards. Available from URL: http://www.mentalhealth.asn.au/home.htm

11.

MH-OAT Centre for Mental Health. Standard Mental Health Outcomes and Assessment Collection Protocols. NSW: MH-OAT, Centre for Mental Health, 2002.

12.

Trauer

. Attitudes of clinicians to routine outcome measurement in mental health. European Psychiatry 2008; 23: S44.

13.

Patterson

Matthey

Baker

. Using mental health outcome measures in everyday clinical practice. Australasian Psychiatry 2006; 14: 133–136.

14.

Trauer

Duckmanton

Chiu

. The Life Skills Profile: a study of its psychometric properties. Australian and New Zealand Journal of Psychiatry 1995; 29: 492–499.

15.

Burgess

Pirkis

Coombs

. Do adults in contact with Australia's public sector mental health services get better? Australian and New Zealand Health Policy 2006; 3: 1–7.

16.

Browne

. Outcome measures: Do they fit with a recovery model? Australian and New Zealand Journal of Mental Health Nursing 2006; 15: 153–154.

17.

Happell

. The value of routine outcome measurement for consumers of mental health services: Master or servant? International Journal of Social Psychiatry 2008; 54: 317–327.

18.

Lakeman

. Standardized routine outcome measurement: Pot holes in the road to recovery. International Journal of Mental Health Nursing 2004; 13: 210–215.

19.

Australian Health Ministers. National Mental Health Plan 2003–2008. Canberra: Australian Government, 2003.