Evaluating the capacity building roles of the state and territory peak bodies in the Australian alcohol and other drug sector

Abstract

The Australian alcohol and other drugs (AOD) sector has a diverse range of actors, including the nongovernment (NGO) service providers. Representing these services in each of Australian states and territories are AOD sector peak bodies. Their national network commissioned an evaluation of their capacity building (CB) activities and outcomes. The network and the evaluator developed a working definition of CB: Capacity building is a strategy that improves the ability of AOD workers, services and/or the broader AOD system to achieve better AOD health and social outcomes. The utilisation-focused evaluation (UFE) model was adopted for this project. The evaluation found that sound outcomes have been produced by the peaks’ CB work, and that includes valued changes in the service delivery work of the NGO sector. The CB strategies that are particularly important for attaining the desired outcomes were identified. The CB strategies and activities have been implemented well, and have delivered value for money, though sustainability remains a concern. The evaluation concluded that the peak bodies are ideally placed to deliver CB initiatives. The evaluation’s recommendations have been implemented, and process utilisation of the evaluation has been observed among its participants.

Keywords

alcohol and other drugs capacity building peak bodies process use utilisation-focused evaluation

Get full access to this article

View all access options for this article.

References

Amo

Cousins

J. B.

(2007). Going through the process: An examination of the operationalization of process use in empirical research on evaluation. In Cousins

J. B.

(Ed.), Process use in theory, research, and practice (pp. 5–26). San Francisco, CA: Jossey-Bass (New Directions for Evaluation, no. 116).

Australian Institute of Health and Welfare. (2018). Alcohol and other drug treatment services in Australia 2016–17. Canberra, Australian Capital Territory, Australia: Author.

Cousins

Goh

S. C.

Clark

Lee

L. E.

(2004). Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base. The Canadian Journal of Program Evaluation, 19, 99–141.

Fixsen

D. L.

Naoom

S. F.

Blase

D. A.

Friedman

R. M.

Wallace

(2005). Implementation research: A synthesis of the literature (FMHI Publication #231). Tampa: University of South Florida. Retrieved from https://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-MonographFull-01-2005.pdf

Funnell

S. C.

Rogers

P. J.

(2011). Purposeful program theory: Effective use of theories of change and logic models. San Francisco, CA: Jossey-Bass.

Grudniewicz

Hedden

Kromm

Lavergne

Menear

Sivananthan

(2014). Capacity development in health systems and policy research: A survey of the Canadian context. Health Research Policy and Systems, 12, 9. doi:10.1186/1478-4505-12-9

Hamilton

Barwick

(1993). Scaling the peaks: A policy framework for the public funding of statewide non-government organisations in the community services industry: A paper prepared for the South Australian Serving Communities Implementaion Task Force. Adelaide, South Australia, Australia: The Task Force.

Industry Commission. (1995). Charitable organisations in Australia. Melbourne, Victoria, Australia: AGPS.

Kotvojs

(2015). An examination of evaluation of capacity development: Application of the capacity development evaluation framework (Doctor of Education). The University of Melbourne, Melbourne, Victoria, Australia.

10.

Kotvojs

(2017). The capacity development evaluation framework: Tested on three initiatives. Evaluation Journal of Australasia, 17, 13–24.

11.

LaFond

A. K.

Brown

Macintyre

(2002). Mapping capacity in the health sector: A conceptual framework. The International Journal of Health Planning and Management, 17, 3–22.

12.

McDonald

(2015). Evaluation of AOD peak bodies’ roles in building capacity in the Australian non-government alcohol and other drugs sector: Final report. Wamboin, New South Wales, Australia: Social Research & Evaluation. Retrieved from http://www.nada.org.au/media/76404/national_aod_peaks_cb_evaluation_final.pdf

13.

Melville

Perkins

(2003). Changing roles of community-sector peak bodies in a neo-liberal policy environment in Australia: An ARC funded study (2000–2002): Final report. Wollongong, New South Wales, Australia: Institute of Social Change and Critical Inquiry, University of Wollongong.

14.

NSW Health. (2001). A framework for building capacity to improve health. Sydney, New South Wales, Australia: Author.

15.

Patton

M. Q.

(1997). Utilization-focused evaluation: The new century text (3rd ed.). Thousand Oaks, CA: SAGE.

16.

Patton

M. Q.

(2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: SAGE.

17.

Productivity Commission. (2010). Contribution of the not-for-profit sector. Canberra, Australian Capital Territory, Australia: Author.

18.

Roche

A. M.

Pollard

(2006). Improved services for people with drug and alcohol problems and mental illness: Assisting alcohol and other drugs (AOD) non-government organisations to better respond to people with comorbid AOD and mental health issues. A Summary Report to the Australian Government Department of Health and Ageing. Adelaide, South Australia, Australia. Retrieved from: http://nceta.flinders.edu.au/files/3012/5548/2272/EN164.pdf

19.

Strickland

Goodes

, & 3P Consultancy. (2008). Review of Tasmanian DHHS-funded peak bodies and the development of a Peak Body Strategic Framework. Hobart, Tasmania, Australia: Office for the Community Sector, Department of Health and Human Services.

20.

Stufflebeam

D. L.

Coryn

C. L. S.

(2014). Evaluation theory, models, and applications (2nd ed.). San Francisco, CA: Jossey-Bass.

21.

Yarbrough

D. B.

Shulha

L. M.

Hopson

R. K.

Caruthers

F. A.

(2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: SAGE.