Abstract
Priority-setting is a collective responsibility centred around inclusive engagement and alignment with the needs and desired outcomes of the community. In this study, we leveraged the collective expertise of stakeholders from the child and family service system, to identify priorities for supporting the health, education and wellbeing of children and families living in Logan, Queensland. A pragmatic approach combining a modified nominal group technique and consensus methodology was undertaken. Key system factors were identified and consolidated into 10 priority areas, which were ranked via an online questionnaire. The top three priority areas were identified by the service system as (i) early family and child support programs, (ii) support and resourcing of existing services, and (iii) recognition and support of a diverse community. These results present an opportunity to leverage the local knowledge and expertise of the service system to design solutions that address the greatest challenges for children and families in place.
Background
Impact of disadvantage on early childhood development
The geographical, spatial, and social context in which one lives is integral in enabling access to services, resources, and opportunities. In Australia, while most people are faring well, there are areas of growing concern where persistent inequitable conditions mean a subset of children and families experience profound deprivation that can deeply affect their outcomes in life (Noble et al., 2021; Tanton et al., 2021). Disadvantage affects a family’s ability to afford essential goods and services for themselves and their children, and to take part in society in the ways that many families take for granted (Committee for Economic Development of Australia, 2023; Productivity Commission, 2018). Consequently, these families are less able to access and engage with social, health and educational services, thus potentially widening the inequity gap (Renalds et al., 2010; Schule & Bolte, 2015).
Considerable research demonstrates the important links between early childhood experiences and long-term outcomes, with the formative years being one of the most sensitive periods of development and critical in setting a foundation for physical and mental health, as well as emotional and social development (Adamson, 2012; Nicholson et al., 2012; Victorino & Gauthier, 2009). By the time children begin school, they are already distributed along a social gradient and the window of opportunity to ameliorate these gaps has narrowed. As such, children who experience disadvantage, which manifests as the circumstances in which they live, learn, and develop, have poorer health and developmental outcomes than their more advantaged counterparts. Environments, where there is a geographical concentration of disadvantage, are often referred to as locationally disadvantaged; areas that may have overlapping and complex vulnerabilities such as limited access to services and facilities, poor employment, training and educational opportunities, and poor physical and social infrastructures (Crimeen et al., 2017). Failure to account for how disadvantage occurs and accumulates over time within specific geographic regions constitutes a significant and ongoing public health problem and can undermine well-intended public health and public policy interventions. Inconsistencies, gaps and lower resourcing in the services and support that families receive within these contexts further embed inequality, with strong associations between the characteristics of place and the quality of life and health of individuals, families, and whole communities (Centre for Policy Development, 2021).
Place-based approach
Place-based approaches are long-term, collaborative efforts to guide systemic change, and contribute to a cycle of learning, predominantly within areas facing locational disadvantage (Amobi et al., 2019; Dupre et al., 2016). They focus on driving cross-sector collaboration to integrate service delivery in pursuit of long-term outcomes; shared accountability, decision-making, funding and service delivery to the local level to facilitate strategically targeted solutions tailored to community needs; building community capacity and social infrastructure; and, promoting community engagement and participation (Kamener et al., 2019). This can vary from bringing the community voice into the government prioritisation process to local coordination of centrally funded programmes. Some argue there is a strong evidence base for place-based initiatives, showing that connecting and integrating services that are planned and delivered in defined socio-geographical areas improves outcomes for high-risk families (Moore & Fry, 2011). Others have questioned this notion pointing out that a major challenge is in the setting of realistic and achievable outcomes and goals and not overestimating what place-based approaches can achieve; the latter being a fundamental principle (Bynner, 2016). One of the ways that we can ensure the efficacy of place-based approaches is by engaging in priority-setting processes to assess what are the most important places where resources can be allocated to have the highest likelihood of making long-lasting change.
Priority-setting for decision-making
Priority-setting is a decision making tool that in recent years, has become the foundation for determining strategic directions or guiding practice and policy as well as a key part of the allocation of limited financial resources (Viergever et al., 2010). The process of priority-setting encompasses any activity that involves identifying, prioritising, and reaching a consensus on areas, topics, or questions that reflect a joint value or vision (Tan et al., 2022; Tong et al., 2019). They are especially useful in the early stages of priority-setting when the generation of ideas in a short amount of time and input from multiple stakeholders is necessary. The nominal group technique (NGT), selected for this study, is a consensus method which is a structured, multistep, facilitated, group meeting technique used to generate and prioritise responses to a specific question by a group of people who have expert insight into a particular area of interest (Cowan, 2010; Harb et al., 2021; McMillan et al., 2014). Traditionally, NGT comprises of four key stages: generating ideas, recording ideas, evaluating ideas, and prioritising ideas; with the potential for an additional re-ranking step or an interpretation and extension of ranking to be included (McMillan et al., 2014; McMillan et al., 2014). A key strength of NGT is that it allows balanced participation from group members, meaning that bias raised by dominant personalities or vested interests is minimised. NGT has demonstrated validity across studies with highly complex issues and can be used flexibly to enable problem identification, generation of research questions, development of solutions, and establishing priorities for action (Campbell, 2002). The technique also allows comparisons of priorities between different groups which can identify areas of divergence and convergence (McMillan et al., 2014).
Historically, priority-setting has been led by discipline experts and researchers and is not typically informed by the views and/or experiences of non-research stakeholders. Leading international bodies, like the European Commission, the Organisation for Economic Co-Operation and Development, and the World Health Organisation provide guidance to actively involve non-research stakeholders in setting their research agendas, acknowledging that better alignment is needed between the allocation of limited resources and the priorities of those in a position to implement findings (Mazzucato, 2019; OECD, 2017; WHO, 2013). This is shown to foster ownership of the established priorities among those involved in the priority-setting approach, meaning that priorities are more relevant, more likely to be accepted and efficacious (Alqahtani et al., 2021; Hanney et al., 2020; Roche et al., 2021). Pratt (2019) argues that where research projects and services do not give voice to non-research stakeholders in setting priorities, they are less relevant and are likely to be less informed by evidence-based research, make smaller contributions to improving community health, and/or have less impact on reducing health disparities - which is a key issue of concern, particularly for place-based programs.
Theoretical foundation
Five core principles foundational to our theoretical foundation.
In this study, health and wellbeing are broadly understood as the dynamic relationships between children and their environments that produce positive outcomes across physical, mental, and social domains. We aimed to leverage the collective expertise of stakeholders from various sectors within the child and family service system, to identify top priorities to support the health, education and wellbeing of children and families living in Logan, Queensland.
Methods
Research setting
As one of Australia’s largest Local Government Areas, the City of Logan in South-East Queensland is made up of over 60 suburbs or 13 electoral divisions with varying concentrations of disadvantage (.idcommunity, 2021). Home to more than 360,000 people (estimated resident population 30 June 2022), Logan is fast growing (3.53% since the previous year) in comparison to South-East Queensland, Queensland, and Australia (2.23%, 2.01% and 1.25% respectively) (Australia Bureau of Statistics [ABS], (2022)). Logan is one of the most culturally diverse cities in the country, with 27.6% of people born overseas, 18.1% speak a language other than English in the home, and 3.3% of people with Maori ancestry live in Logan (3.3%), compared to South-East (1.5%), Queensland (1.3%) and Australia (0.7%). Aboriginal and Torres Strait Islander people represent 4.2% of the population, a substantial difference when compared to South-East Queensland (2.8%) and Australia (3.2%) (ABS, 2022). In 2021, Logan had a higher proportion of children (under 18) and a lower proportion of persons aged 60 or older than Australia (26.6% and 18.3% vs. 23% and 21.7%). The median age of residents is 34 years, which is 4 years younger than the national average. Notably, there is a higher concentration of children under 15, and a greater proportion of these children reside in single-parent households compared to the broader state demographics (ABS, 2022).
Research design
This study employed a multistep priority-setting approach based on the NGT (Figure 1). First, a series of workshops (structured and non-hierarchical) to understand core areas of concern within the service system were hosted by the research team. This stage corresponds to the NGT stages of generating and recording ideas and is detailed in (Stuart et al., 2023). Next, key system factors were evaluated and refined through expert review and consolidated into a list. This step corresponds to the NGT stages of evaluating and refining ideas. Finally, these system factors were redistributed for ranking via an online priority-setting questionnaire, resulting in a ranked list (corresponding to the NGT stage of prioritisation) by the service system. This approach was both practical and maximised participation to ensure balanced input while using each participant’s experience and expertise to reach a consensus on the complex topic under investigation. Ethics approval for this study was granted by Griffith University Human Research Ethics Committee (2021/505). Three stages of the priority-setting process used in this study and how they align to the four stages of NGT.
Research team
The study described herein was designed and implemented by researchers with complementary expertise in community research methodologies, community development, guiding collaboration and community facilitation. Additionally, a Community Advisory Group (CAG) comprised of individuals with knowledge and experience in key segments of the community and service system, including a First Nations advisor and frontline practitioners and leaders from local government and community-led organisations, were involved. These individuals were also residents of the community and as such also represented potential end-users of the service system.
Identification of stakeholders
A multistep approach was used to identify stakeholders who were experts in the service system that supports the health, education and wellbeing of children and families living in Logan, Queensland. The service system included agencies and providers of current activities within the community, such as programs, services, organisations, and the networks, coordination efforts and other non-tangible community assets, that together exist to achieve shared outcomes for this community. We recognise that these individuals have deep extant knowledge about the system in this place that should be specifically drawn upon to assist in setting priorities. We used three strategies to identify and recruit stakeholders, with a focus on including members of typically under-represented groups who have deep and diverse knowledge. First, a comprehensive online review of all community services, assets and resources for children and families in Logan, Queensland was conducted. Information about the community infrastructure (i.e., places, spaces, resources, and physical assets) and service system assets and resources were compiled into an online database (Aicken et al., 2010). From this review, unique service system programs, groups, and organisations were defined, and a stakeholder register was created. This was complemented by submissions from the project’s Steering Committee and CAG. Throughout this process, we aimed to recruit at least one individual from each service provider or agency who had specific experience working in place. Specifically, we invited leaders from government and non-governmental organisations who advocate support for the health, education and wellbeing of children and families living in Logan, Queensland.
Study procedure
Stage 1: Workshops with service system experts
Stakeholders from the child and family service system were invited to attend one four-hour workshop; two were hosted on the university campus and one at a community centre. All three workshops were conducted in person (October and November 2021) and moderated by two members of the research team (SB & MG) with experience in group facilitation and community engagement, as well as one observer (JS) who collected field notes. In addition, members of the CAG assisted with the facilitation of group activities that included mind-mapping and semi-structured discussions. Each workshop employed a participatory system mapping methodology and used consensus-building and shared decision-making strategies to identify emergent factors related to the experience and knowledge of service system experts (Barbrook-Johnson & Penn, 2021). The workshop methodology and system mapping are extensively detailed in (Stuart et al., 2023). In summary, participants were asked to independently brainstorm factors (positive or negative) related to the question: “According to your experience and knowledge, what do you consider the most important factors in the system, to support the health, education and wellbeing of children and families living [in place]?” This was followed by small group consolidation, and an activity that enabled participants to share their ideas and discuss: (i) why it is important, (ii) whether are there any connections between factors, and (iii) what is working well/not working well (within the service system). Groups then selected two to four system factors and using the round-robin technique, the facilitator solicited one factor from each group. These were listed on a whiteboard for the whole group to view and were further refined through facilitated discussion seeking clarification, elaboration and/or removal of duplication. The explicit purpose of this activity was to elicit the diverse viewpoints of participants and to develop a deeper understanding of key system factors. This method was chosen as it has the advantage of preventing certain individuals from dominating the conversation or influencing the voting. A total of 52 factors and 179 ideas were generated across the three workshops.
Stage 2: Refining and verifying system factors
10 priority areas identified by the service system that influence the health, education, and wellbeing of children, and families living in Logan, Queensland.
alisted in alphabetical order.
Stage 3: Ranking of priority areas
Ranking of the 10 priority areas was completed via an online survey (LimeSurvey GmbH v.2.59.1), created by the lead researchers who had expertise in questionnaire design; members of the CAG reviewed the survey for comprehension and refinement. A link was distributed via email to individuals identified on our stakeholder register, regardless of whether they participated in a workshop (survey was active from 13 December 2021 to 21 January 2022). Two reminder emails were sent three and six weeks after the initial invitation. The average time to completion was 22.5 ± 16.7 minutes. Participant demographics, community work experience, and service sector practice were collected, followed by selecting their top three priority areas (from the list of 10 presented in random order to omit selection bias). Additionally, feedback on the priority-setting process was sought using a five-point Likert scale (strongly disagree to strongly agree).
Data analysis
Data were assessed using descriptive statistics expressed as counts and frequencies, in aggregate form. The main outcome measure was the ranked priority list, using weighted rank order analysis. Values were summed and ordered consecutively, where a higher score indicated greater priority. Analyses were performed using the SPSS statistical software package (IBM, version 25). Questions rated on a five-point Likert scale are presented as diverging stacked bar charts with weighted mean ± standard deviation (SD).
Results
Characteristics of study participants.
aIndividuals who identify as Aboriginal and/or Torres Strait Islander persons.
bIndividuals who identify as Māori or Samoan.
cMore than one response possible. Abbreviations: TAFE, Technical and Further Education; MD, Medical Degree; LGA, Local Government Area.
The proportional ranking of the 10 priority areas is presented in Figure 2. Of these, six were ranked as the top priority, eight as the second priority, and nine as the third priority. The top three priority areas ranked as the most important for supporting the health, education and wellbeing of children and families by the service system were (i) early family and child support programs (weighted rank 26.2%), (ii) support and resourcing of existing services (weighted rank 14.3%), and (iii) recognition and support of a diverse community (weighted rank 12.7%). Despite ‘spaces and places for children and families’ receiving 43% of the total votes, once weighted for first, second and third priority, it was ranked fifth. Similarly, the priority areas of champion community and children’s voice, evidence to support the services system and connection with community were equally placed sixth at 6.3% weighted rank. Table 4 lists ideas related to the top three priority areas that were generated by the service system experts across the three workshops. Ranking of top 10 priority areas, as distributed by proportion ranked as the first, second and third priority and in order from most important to least important priority. A selection of ideas generated from service system experts, to address the top three priority areas for improving the health, education and wellbeing of children and families living in Logan, Queensland.
Overall, participants were highly satisfied with their experience of the priority-setting process (4.13 ± 0.26). For those who attended a workshop, most ‘agreed’ or ‘strongly agreed’ that it achieved its aims (4.00 ± 0.25) and were very satisfied with the priority-setting experience (4.17 ± 0.31). One participant advised ‘I think you did brilliantly, and I walked away feeling inspired and hopeful’ and ‘[It] will be really great if something actually comes of it and there is change made in area for children’. All participants responded positively when asked if they were given the opportunity to contribute at the workshops (4.33 ± 0.26), whether they felt that their contributions were valued (4.33 ± 0.26) and were represented in the final research and action areas (4.17 ± 0.27). Five of the eight attributes received 100% positive feedback, with respect (i.e., the priority-setting process treated workshop participants in a positive and supportive manner) being the highest-ranked attribute (4.50 ± 0.25) (Figure 3). The lowest ranked attribute, albeit still high, was whether the process was inclusive (i.e., of services, people and organisations required and others who might otherwise be excluded or marginalised) (3.83 ± 0.19). Evaluation of attributes related to the priority-setting process.
Discussion
This priority-setting study makes several important contributions and provides valuable guidance to the service system and researchers in this field. Using a rigorous multistep process, we identify 10 priority areas and articulate the top three from the perspective of the child and family service system for supporting the health, education and wellbeing of children and families living in Logan, Queensland.
Our results indicate a clear set of priorities, as well as a high degree of consensus among participants of where efforts should be focused. Specifically, early intervention and prevention efforts were highlighted as critical importance, which is well-aligned with the extant research demonstrating that investing in the early years of children and families who are at risk of poor outcomes can build a strong foundation for long-term positive physical, social/emotional, behavioural and cognitive health outcomes (Adamson, 2012; Homel et al., 2015; Membride, 2016; Nicholson et al., 2012; Victorino & Gauthier, 2009). This supports previous reports that an absence of effective early intervention options contributes to widening disparities in outcomes. Furthermore, supporting the functioning of existing services, creating spaces and places for community and service collaboration, and supporting a diverse community were also found to be activities to support better outcomes for children and families.
This study follows a modified NGT methodology which offers a unique and highly validated approach to setting research priorities through an equal partnership between researchers and service system experts. In this study, we sought to build consensus concerning the areas where limited investments and scarce resources could be mobilised to be the most beneficial.
Our findings share some similarities with recent research conducted by Brockway and colleagues (Brockway et al., 2021) where families in Canada similarly identified issues of early child development as two of their top eleven priorities. However, our study is novel in that the focus for consensus building was on research and action priorities within a specific, disadvantaged region among service providers with ongoing experience in supporting families within complex systems and institutional knowledge of the strategies programs previously trialled in this community context. While involving service users has been argued to be a critical issue in making the most impactful choices for research in many previous priority-setting studies (Jacobson et al., 2003), the inclusion of user voices will tend to elicit individually relevant issues as compared to issues relevant at a system level. Therefore, by focusing on service providers who report considerable lived experience in navigating the system, we were able to identify unique areas of need that are highly likely to initiate service system reform which, in turn, will benefit end-users of the service system.
Priorities identified by the child and family service system
Priority 1: Early family and child support programs
In Logan, Queensland the commitment to early family and child support programs reflects a dedication to nurturing the foundation of future generations, fostering positive development and equitable opportunities for all. Such programs play a pivotal role in fostering the wellbeing and development of children and families. Specifically, stakeholders in our study wanted investment in programs that are evidence-based, effective, evaluated, are community designed, and most importantly, are ‘needed by the community’.
Priority 2: Support and resourcing of existing services
The support and resourcing of existing services was a fundamental priority to child and family support services. Adequate support and building capacity, ensure the sustainability and effectiveness of these services, allowing them to meet the diverse needs of the community. Stakeholders were in support of ‘tailored spaces’ that were unstructured, welcoming and could be a safe space to reside. Resourcing existing services would involve continuous evaluation and adaptation, since properly supported services contribute to long-term positive outcomes.
Priority 3: Recognition and support of a diverse community
Recognition and support of a diverse community are essential components of effective child and family support services. Acknowledging and celebrating the diversity within a community is paramount in tailoring services to meet the unique needs of every family. Stakeholders wanted to see inclusive and culturally sensitive approaches, to create an environment where families from diverse backgrounds feel understood, respected, and empowered.
The identification and ranking of the 10 priority areas is not the end of the process and while these priorities represent a ‘snapshot in time’ of the areas that matter the most to the child and family service system they can be refreshed at a future date to reflect changes in the management or service system reform. They can also be explored with end-users or community members to ensure their voices are heard in identifying and planning actions within their community. In recent work undertaken by Finlay-Jones and colleagues (Finlay-Jones et al., 2020) priority-setting was followed up by rapid reviews of the evidence to better inform the subsequent research and action. It is also important to move beyond the high-level priority areas identified here to create a series of focused research questions and actions aligned to each of the themes that are disseminated broadly to enable planning and future research and application to be coordinated and directed to areas of the highest priority. Evidence-based approaches that engage stakeholders in decision-making are becoming more commonplace, and in situations where there are complex issues of vulnerability, it is crucial to undertake these methods to allocate limited resources in transparent and credible ways (Fadlallah et al., 2020; Viergever et al., 2010).
Strengths and limitations
This study represents a novel application of the priority-setting process adhering to best practice guidelines. Introducing complexity in the focus on a disadvantaged context and specificity in seeking consensus among service providers, the findings from this study should be considered in the context of its strengths and limitations. Of note, both a limitation and strength of this study was the focus on one defined region and while this is likely to limit the transferability of our findings to other geographical areas, it has produced an evidence base for which place-based programs, research and activities may be informed and strengthened within the region of focus. Furthermore, our results are likely to have high levels of external validity as diverse stakeholders from across the service sectors representing different cultural backgrounds, areas of expertise and roles were included, as well as the community advisors who were an integral part of our review and piloting process. Indeed, involving a diverse range of stakeholders in the priority-setting process has been suggested to increase the legitimacy and acceptability of the identified priorities, yet engaging authentically can be challenging in terms of resources, capacity, and feasibility (Fadlallah et al., 2020). To the best of our ability, we created a safe environment for participants to discuss their priorities within a group setting. There are, however, topics that people are likely to find uncomfortable to talk about, and perhaps authentic discussions about barriers related to relationships between different stakeholder organisations may be contentious. To overcome this barrier, we employed both workshop and individual surveys. While this study provides a good overview of priorities, not all topics that were suggested in the workshops could be included in the final list, and we recognise that the resulting list reflects the background and motivations of the service system that participated. We also acknowledge that ranking surveys are subject to a potential lack of reliability, and empirical results suggest that the stability of ranking information decreases with decreasing rank. To mitigate this potential limitation, we asked respondents to select their top three priorities. Further, the implications of COVID-19 during our study were mostly associated with the increased social distancing and mask-wearing requirements, which made it challenging for our workshops. As such, we did not achieve our target sample size, but we did achieve diversity of participation across our stakeholder group who we consider having sufficient expertise to achieve the objectives and reflected with our CAG on methodology, process, and interpretation. The results of this priority-setting study will enable funders to prioritise research and action within the child and family service system and hopefully will provide new, much-needed knowledge in this domain.
Future implications
We intend that the results of this study are the first step in the dialogue and co-design process with the child and family service system in Logan, Queensland. Further work to strengthen relationships and stimulate conversations with relevant stakeholders to ensure applicability at the local and system levels have since taken place. Interviews were held with community leaders overseeing organisations, services, or programs dedicated to supporting children and families in Logan. These interviews were crucial to the extant knowledge these individuals possess about the service system (unpublished manuscript). Together, with the findings from this study, we will consolidate the research and actions ideas, review these against existing research gaps and community need, to ultimately inform targeted actions and foster a more comprehensive and impactful approach to supporting children and families. In this respect, a systems approach to address complex multilevel evidence-based priorities will require multisector interagency collaboration.
Conclusion
This study provides the much-needed guidance to align future efforts and allocate limited resources to areas identified by the service system in efforts to improve the health, education and wellbeing of children and families living in Logan, Queensland. The service system called for early support programs for young children and their families, resourcing of existing services, and the recognition and support of diversity in the community.
Footnotes
Acknowledgements
The authors would like to thank members of the Community Advisory Group and all individuals who participated in the study. We acknowledge S. Zanus for conducting the community assets and resources review, and G. Leeming and E. Searle for helping to facilitate the small group workshops.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Paul Ramsay Foundation (grant number 681). Any opinions, findings, or conclusions expressed in this report are those of the author(s) and do not necessarily reflect the views of the Foundation.
