Abstract
Background
National organisational surveys and clinical audits to monitor and guide improvements to the delivery of evidence-based acute stroke care have been undertaken in Australia since 1999. This study aimed to determine the association between repeated national audit cycles on stroke service provision and care delivery from 1999 to 2019.
Methods
Cross-sectional study using data from organisational surveys (1999, 2004, 2007–2019) and clinical data from the biennial National Stroke Acute Audit (2007–2019). Age-, sex-, and stroke severity-adjusted proportions were reported for adherence to guideline-recommended care processes. Multivariable, logistic regression models were performed to determine the association between repeated audit cycles and service provision (organisational) and care delivery (clinical).
Results
Overall, 197 hospitals provided organisational survey data (1999–2019), with 24,996 clinical cases from 136 hospitals (around 40 cases per audit) (2007–2019). We found significant improvements in service organisation between 1999 and 2019 for access to stroke units (1999: 42%, 2019: 81%), thrombolysis services (1999: 6%, 2019: 85%), and rapid assessment/management for patients with transient ischaemic attack (1999: 11%, 2019: 61%). Analyses of patient-level audits for 2007 to 2019 found the odds of receiving care processes per audit cycle to have significantly increased for thrombolysis (2007: 3%, 2019: 11%; OR 1.15, 95% CI 1.13, 1.17), stroke unit access (2007: 52%, 2019: 69%; OR 1.15, 95% CI 1.14, 1.17), risk factor advice (2007: 40%, 2019: 63%; OR 1.10, 95% CI 1.09, 1.12), and carer training (2007: 24%, 2019: 51%; OR 1.12, 95% CI 1.10, 1.15).
Conclusions
Between 1999 and 2019, the quality of acute stroke care in Australia has improved in line with best practice evidence. Standardised monitoring of stroke care can inform targeted efforts to reduce identified gaps in best practice, and illustrate the evolution of the health system for stroke.
Introduction
Monitoring the quality of care provided in hospitals is important for patients, clinicians, executives, and funding agencies. Audit and clinical quality registry programmes provide standardised data collection systems to reliably monitor the clinical care of patients against guideline-recommended care processes, standards or frameworks. Evidence for stroke care suggests that adherence to these monitoring and reporting systems improves survival and reduces other adverse outcomes after stroke,1,2 highlighting their importance.
In Australia, the first national survey of acute hospital services was carried out by the Stroke Foundation in 1999 3 (and repeated in 2004). Adapted from a questionnaire used to evaluate stroke in the United Kingdom, 4 the survey provided a snapshot of stroke services in Australia. This was followed by the publication of the first national clinical guidelines for acute stroke in 2003, updated in 2007, coinciding with the establishment of the National Stroke Acute Audit programme (referred to as the Audit programme hereafter) to monitor adherence to these recommendations. The voluntary Audit programme, based on similar work in the United Kingdom, 5 has been conducted biennially since. It comprises two components: an organisational survey and a retrospective clinical medical record audit to collect patient-level data on select care processes received during admission, as well as in-hospital outcomes. 6
This study sought to determine the association between repeated cycles of audit (as a surrogate for time) from 1999 to 2019, access to organisational resources for acute stroke (e.g. workforce, bed numbers, stroke units), and adherence to evidence-based care processes recommended in the national guidelines.
Methods
Cross-sectional study using data from (i) self-reported organisational surveys undertaken in 1999, 2004 and biennially since 2007; and (ii) clinical audit of up to 40 consecutive medical records collected biennially since 2007 (Figure 1). A dedicated coordinator from the Stroke Foundation provided training and support to hospital clinicians collecting these data. Reporting of this study adheres to the Strengthening the Reporting of Observational studies in Epidemiology (STROBE) statement.
7
Timelines for the collection of survey and audit data.
Eligibility criteria and hospital participation
Acute hospitals that were invited to participate in the survey and clinical audit varied over cycles, with eligibility based largely on stroke admission numbers (Online Supplement Table S1). Invited hospitals were followed-up by email and phone call by the Stroke Foundation coordinator to improve the response rate. Hospitals choosing not to participate in the clinical audit were still encouraged to complete the organisational survey. As service characteristics in hospitals admitting fewer patients with stroke differ from those treating more patients, recruitment from 2015 onwards primarily included those admitting at least 40–50 patients with stroke annually.
Data collection
Details on data collection have been previously published.6,8 In brief, the survey collected information on the characteristics and resources of the hospitals (e.g. bed and admission numbers) with data gathered by health professionals with a responsibility for stroke management (medical leads and stroke coordinators).
Clinical audit data were collected retrospectively from the medical records of approximately 40 consecutive patients with stroke (ICD-10 codes: I61, I62.9, I63, I64) admitted throughout the previous year. Hospitals with larger annual stroke admissions (e.g. > 400 admissions) were invited to audit more medical records, aiming for 10% of total admissions. Hospitals were de-identified, and no patient-identifying data were collected. Up to five records from each hospital were re-audited by a second staff member to allow monitoring of inter-rater reliability, with a procedure manual and training provided by Stroke Foundation coordinators.
The 1999 and 2004 organisation surveys used paper forms and data were manually entered into a database by project staff. The Audit programme (2007–2019) used a web-based data collection system, with programmed logic checks to minimise erroneous data. Records with missing responses were considered incomplete and excluded. Organisational survey and clinical audit questions were revised over time in response to changes to the Australian Clinical Guidelines for Stroke Management and the Acute Stroke Services Framework.9,10
Data analyses
Analyses included only questions consistently reported across all audits, and pooled data from hospitals with >40 annual stroke admissions to ensure reliable comparisons over time.
Organisational survey: Analyses used descriptive statistics to summarise survey data for 1999–2019. We ran multivariable logistic regression models to determine the association between repeated audit cycles (indicated by successive years of audit) and availability of acute stroke services; regression models excluded 1999 and 2004 survey data to allow for more robust analysis from similar data collection methods/questions from the Audit programme (2007–2019). Models were multilevel to account for hospital-level variation and included year of audit cycle.
Clinical audit: Only valid responses were included for questions relating to clinical impairments (e.g. arm weakness present). Not documented and unknown responses were assumed to be negative (i.e. the process did not occur) and included in the denominator for analyses of care processes. 11 Time metrics were calculated from emergency department (ED) presentation, with the start of the day (00:00:00) imputed if the ED date was known, but time was missing. For relevant time-related care processes with known dates, but missing times, the end of the day (23:59:59) was imputed. Descriptive statistics were used to summarise patient characteristics. The proportion of eligible patients who received each care process determined adherence. Proportions were adjusted for age, sex and inability to walk on admission (a proxy measure for stroke severity), 12 and significant trends in proportions over time were determined.
Multivariable, multilevel logistic regression models were used to determine the association between repeated audit cycles (indicated by successive years of audit) and provision of evidence-based care processes. Models were adjusted for patient variables, such as age, sex, independence prior to admission, stroke type, and validated severity factors (ability to walk, speech disturbance, arm weakness on admission and incontinence). 13 Secondary analyses were performed to determine adherence to care processes from 2015 to 2019, reflecting more recent relevant changes in care delivery.
Results of multivariable models were reported as odds ratios (ORs) and 95% confidence intervals (CIs). All statistical tests were two sided, and a p-value <0.05 was considered to be statistically significant. Data were analysed using Stata SE 15.0 (www.stata.com).
Ethics
The Heads of Stroke Services of participating hospitals provided consent to participate in the audits. Specific approvals for this project were received from the Stroke Foundation and the Human Research Ethics Committee from Monash University (Project ID 8842).
Results
Overall, 25/129 of the organisational variables, and 73/174 of the clinical variables from the audit cycle in 2019 could be mapped across all the surveys and audits undertaken between 1999 and 2019.
Organisational survey
Between 1999 and 2019, a total of 197 hospitals, each reporting >40 stroke admissions annually, provided data for the organisational survey (Online Supplement Table S2). A total of 149 hospitals completed the 1999 and/or 2004 surveys, and 122 of these also participated in more than one of the subsequent cycles in the Audit programme. Over 90% of hospitals participating in each cycle were public hospitals; the only exception was the 1999 survey, which had a relatively greater number of private hospitals (17%). Between 1999 and 2019, there was a 93% increase in the proportion of hospitals with a stroke unit (2019: 42%, 2019: 81%), a 13-fold increase in hospitals providing intravenous thrombolysis (1999: 6%, 2019: 85%), and a 4-fold increase in hospitals offering rapid assessment and management of people with suspected transient ischaemic attack (1999: 11%, 2019: 61%; Online Supplement Table S3). Access to all allied health professionals for patients with stroke increased from 1999 to 2019 (Online Supplement Table S4). Since 2009, over 77% of hospitals reported access to physiotherapy, occupational therapy, speech pathology, social work, and dietetics.
Organisational resources reported for hospitals providing acute care for stroke in Australia, 2007–2019.
OR: odds ratio; CI: confidence interval; ED: Emergency Department; 24/7: 24 hours a day, 7 days a week.
ayear of cycle as independent variable, clustered by hospital.
bwithin 3 hours.
c2009–2019 year analysis.
dischaemic stroke.
eused in last 6 months.
Clinical audit
Characteristics of patients included in Audit programme cycles in Australia, 2007–2019.
Q1: 1st quartile; Q3: 3rd quartile; TIA: transient ischaemic attack; mRS: modified Rankin Scale.
astatistical test for trend 2007 to 2019.
bfrom stroke onset, except 2013 which was from emergency department presentation.
cmyocardial infarction.
d<1% unknown/missing responses.
e1–5% unknown/missing responses.
f6–10% unknown/missing responses.
g11–25% unknown/missing responses.
Figure 2 shows trends in adherence to recommended care processes in each cycle 2007–2019 and Figure 3 the odds for change over time (also Online Supplement Table S6 and Figure S1). For the majority of the recommended care processes, the odds of adherence increased per cycle, for example, stroke unit access (2007: 52%, 2019: 69%; OR 1.15 per cycle, 95% CI 1.14, 1.17), provision of intravenous thrombolysis for patients with ischaemic stroke (2007: 3%, 2019: 11%; OR 1.15 per cycle, 95% CI 1.13, 1.17) and carer training (2007: 24%, 2019: 51%; OR 1.12 per cycle, 95% CI 1.10, 1.15) (Figures 2 and 3). Conversely, the odds of adherence over time fell for prescription of antihypertensives on discharge (OR 0.98 per audit cycle, 95% CI 0.97, 0.99) and there was no difference in the provision of antithrombotic medications on discharge for patients with ischaemic stroke. Age-, sex-, and stroke severity-adjusted adherence to evidence-based care processes over time (2007–2019). Association between repeated audit cycles and adherence to evidence-based care processes over time (2007–2019).

Restricting analyses to the 2015–2019 period, we found significant increases in the odds for use of swallow screen/assessment prior to food, fluids or oral medication (2015: 58%, 2019: 64%; OR 1.08 per cycle, 95% CI 1.05, 1.11), provision of advice on risk factor modification (2015: 53%, 2019: 63%; OR 1.18 per cycle, 95% CI 1.13, 1.22), and care plan development (2015: 58%, 2019: 68%; OR 1.21 per cycle, 95% CI 1.17, 1.26 (Figure 3, Online Supplement Figure S1). There was no significant difference in stroke unit access or provision of aspirin within 48 hours for those with ischaemic stroke during this period.
Regardless of improvements over time, the 2019 audit findings indicated that three in four patients were not assessed for mood problems during their hospital admission (Online Supplement Table S6), and half of all carers had not received training.
Discussion
This study provides evidence of significant improvements in the organisation of acute stroke care and adherence to most guideline-recommended care processes over the period 1999–2019 in Australia. These included significant improvements in access to stroke units, thrombolysis services, and rapid assessment and management options for patients with transient ischaemic attack. The odds of patients receiving many recommended processes related to acute care, secondary prevention, interdisciplinary assessment and transition from hospital also improved from 2007 to 2019. However, gaps remained in other aspects of evidence-based care, particularly in relation to mood assessments.
Data from the Audit programme provide a snapshot of stroke care and a means for clinicians, health administrators, and government to monitor and guide improvements for acute stroke care. Although changes cannot be solely attributed to participation in the Audit programme, it can be considered an ‘audit and feedback’ intervention, with national and hospital reports distributed by the Stroke Foundation. Therefore, our findings compare favourably to the 4% absolute improvement (+0.5%, +16%) effects of ‘audit and feedback’ interventions reported elsewhere. 14 However, ongoing consideration of methods of feedback delivery is important. The current Stroke Foundation Strategy Plan is focused on how best to facilitate and support targeted quality improvement programmes, particularly in hospitals performing below standard, to maximise potential improvement and change. 15
While our findings for care improvements align with those reported in China, 16 they are more modest compared to similar programmes in the USA such as the Get-With-The-Guidelines-Stroke (GWTG-Stroke) 17 or the Paul Coverdell Stroke Program 18 , or the Sentinel Stroke National Audit Programme in the United Kingdom. 19 However, cross-country comparisons are challenging because of differences in nature and scope of programmes. 20 For example, GWTG-Stroke also involves a series of quality improvement cycles and collaborative workshops to develop hospital protocols and processes. 17 Multinational collaborations have been formed to develop a common set of process or performance measures to allow for cross-country comparison of stroke care quality. 21
Stroke unit care is the most universally applicable recommendation for improving stroke outcomes. 22 Patients treated in a stroke unit are more often provided with evidence-based care, 23 and have a reduced odds of death and disability of approximately 20%. 22 We found an increase in the odds of patients being treated in a stroke unit from 2007 to 2019, but adherence appears to have stalled in recent years, with only two in three patients accessing stroke unit care 2019. There is a need to ensure that there are systems, infrastructure, and resources in place for all patients with stroke to be treated in a stroke unit as recommended in the clinical guidelines and Acute Stroke Services Framework for Australia. 10
We found improvements in the delivery of intravenous thrombolysis, a time-critical therapy that reduces death and disability from ischaemic stroke, 24 over time. This improvement may have been influenced by increased use of telemedicine, shown to have increased thrombolysis rates in rural hospitals in Victoria (Australia). 25 Yet, only one in ten patients with ischaemic stroke received intravenous thrombolysis in the 2019 audit, and only a third received this within 60 minutes of arrival at hospital, 26 which is considerably lower than what has been reported in other countries.17,27 Wider improvements are thus needed, with the introduction of the Mobile Stroke Unit 28 promising to increase access to relevant interventions.
Observed improvements in stroke care may be explained by concurrent changes in the organisation of hospital services and resources with, for example, diagnostic scans now provided to almost all patients with stroke, enabling identification of eligible cases for reperfusion therapies, and minimising the proportion of undetermined stroke type. Also, the introduction of triage protocols for patients with stroke within EDs and wider availability of telehealth modalities all increased the chances of patients receiving time-sensitive reperfusion therapies. Other aspects of acute care delivery that have improved since 2007 include access to timely allied health, involvement of the patient and family in management decisions, education for risk factor management, and support for patients and carers returning to the community. Continued efforts are required to maintain improvements in the organisation of stroke care and ensure continued monitoring of performance in future audits.
Strengths and limitations
This study was able to draw on a large comprehensive national dataset including organisational and clinical care processes developed through analytical and consensus methods and evaluated using a standardised approach over many years. The audit has been relatively adaptable, with questions/response options changed and updated to reflect clinical practice recommendations at the time. While this meant that we were unable to investigate all potentially important care processes from recent guideline recommendations, the care processes included in this study cover most important areas of acute stroke care.
We previously reported between-hospital variations in stroke care according to state, rurality, and size, finding access to stroke unit care to be more likely in hospitals in urban areas and in hospitals with a larger number (350+) of annual stroke admissions. 11 While the introduction of telemedicine options has led to more equitable access to care including thrombolysis in regional/rural locations, 26 there remains a need for continued efforts to reduce disparities to ensure equitable care for patients with stroke.
Our analysis was limited to hospitals participating in the Audit programme and we cannot assume that the cases audited are representative of all patients with stroke. Contextual information was not available on hospitals that did not participate in the Audit programme-although over 80% of eligible hospitals identified participated in each cycle. 26 Missing data and other forms of bias associated with the quality of information may have influenced the data quality used in the analysis. To improve reporting practices, hospital staff received training prior to completion of the audits and had access to ongoing support from Stroke Foundation staff. In-built logic checks in the data collection tool also assisted in minimising data collection error, with the inter-reliability of responses between different auditors shown to be substantial or better in prior research. 29 Finally, a small number of care processes analysed (e.g. antihypertensive medications) appeared to follow a non-linear trend, which was not accounted for in our analysis of change over time. Further understanding the nuances as to why adherence to some care processes may have fluctuated over cycles is important.
Data from the biennial Audit programme have informed important clinical and policy initiatives, and quality improvement programmes in Australia. However, the establishment of the Australian Stroke Clinical Registry (AuSCR) in 2009 has facilitated prospective monitoring of the quality of acute stroke care beyond the standard reporting periods used for the Audit programme. While not all hospitals participate in the AuSCR, at an individual level, the AuSCR data are considered to be more representative for care processes that are provided in only a subset of patients such as thrombolysis and endovascular clot retrieval. As data for the Audit programme and the AuSCR are collected within the same integrated data management system, the Australian Stroke Data Tool, 30 data collection burden is minimised for clinicians regarding core variables (e.g. age, sex, type of stroke, access to stroke unit care). Overall, data from the Audit programme and the AuSCR are considered complimentary. The Audit contributes organisational details and a comprehensive snapshot of the care provided to patients with stroke, while the AuSCR provides ongoing, routinely collected minimum data, and additional information on patient outcomes post-discharge (mortality and health-related quality of life). 12 In future, it is important that there is continued monitoring of acute care for patients with stroke and that proactive efforts are made to reduce gaps identified in best-practice care using data from these two collection programmes.
Conclusion
Using data from the National Stroke Audit programme, we were able to reliably demonstrate the evolution of acute stroke services in Australia. Many aspects of stroke service provision and care delivery have improved over the period 1999–2019, but continued efforts are required to ensure further development and equity in access to best practice care. Investment in standardised monitoring of stroke care can provides insight for targeted efforts to reduce identified gaps in best-practice, and can enable the assessment of progress over time.
Supplemental Material
Supplemental Material - Twenty years of monitoring acute stroke care in Australia through the national stroke audit programme (1999–2019): A cross-sectional study
Supplemental Material for Twenty years of monitoring acute stroke care in Australia through the national stroke audit program (1999–2019): A cross-sectional study by Tara Purvis, Dominique A Cadilhac, Kelvin Hill, Megan Reyneke, Muideen T Olaiya, Lachlan L Dalli, Joosup Kim, Lisa Murphy, Bruce CV Campbell and Monique F Kilkenny in Journal of Health Services Research & Policy.
Footnotes
Acknowledgements
We thank the hospital clinicians and patients who contributed data to the audits. We acknowledge Justine Watkins, Patrick Young, Elizabeth Freeman, Jo Maxwell and Dawn Harris for their contributions as coordinators of the Audit programme over the years. In addition, we recognise the contributions of Toni Aslett in her role as the Executive Director of Stroke Services at the Stroke Foundation, Sharon McGowan as Chief Executive Officer, and Erin Lalor as prior Chief Executive Officer of the Stroke Foundation, and the Clinical Council members.
Author contributions
MFK, TP, DAC, and KH were involved in various aspects of the study design. TP, MTO, LLD, JK, MFK, and DAC contributed to the statistical analysis approach, data analysis and interpretation. TP drafted the paper, and all authors (DAC, KH, MR, MTO, LLD, JK, LM, BCVC, MFK) critically revised successive drafts of the manuscript. All authors have read and approved the final version of the manuscript.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Monash University researchers were commissioned by the Stroke Foundation to independently produce a report based on 1999–2017 data, which is publicly available (
). This paper provides a more contemporary understanding as it includes the 2019 audit cycle, with updated analysis methods included. DAC acknowledges research fellowships from the National Health and Medical Research Council (NMHRC) (1063761 co-funded by Heart Foundation; 1154273). MFK acknowledges support from an Early Career Fellowship from the NHMRC (1109426).
Ethical approval
The Heads of Stroke Services of participating hospitals provided consent to participate in the audits. Specific approvals for this project were received from the Stroke Foundation and the Human Research Ethics Committee from Monash University (Project ID 8842).
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
