Self-administered digital vaccination decision-aids in primary care: A pilot study of COVID-19 vaccination in Atlanta,GA

Abstract

Objective

Our objective was to develop and test a digital decision-aid tool to help vaccine-hesitant participants make informed decisions regarding COVID-19 vaccination.

Methods

A multidisciplinary team at Emory University developed an online decision-aid tool that presented information about the virus, vaccine risks/benefits, and vaccination resources. This tool was provided to patients in an Atlanta primary care clinic who were not fully vaccinated/boosted. Participants were then surveyed to assess their knowledge and opinions.

Results

The tool was administered to 40 patients (55% Black, 70% female, and 45% aged 50 – 69) between January-June2024. Nearly all (97.5%) found the tool useful for improving their understanding of vaccine risks and benefits, with 70% rating it “very” or “extremely” useful. After using the tool, 47.5% of participants reported that the tool had increased their willingness to get vaccinated, and 37.5% indicated they had decided to get vaccinated/boosted. Notably, 22.2% of participants who had never previously received a COVID-19 vaccine stated their intent to get vaccinated after using the tool.

Conclusions

This pilot study demonstrated that a digital decision-aid tool can improve knowledge and perceptions surrounding COVID-19 vaccination to encourage healthy decision-making. As such, the tool represents a promising adaptable model for self-administered decision aids in broader healthcare contexts.

Keywords

vaccine hesitancy COVID-19 decision-aid digital health mHealth web-based applications

Introduction

Improving COVID-19 vaccination rates is urgent due to the unique transmission dynamics of the SARS-CoV-2 virus. COVID-19 is caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which can be transmitted through contact, droplet, and airborne routes. SARS-CoV-2 readily spreads through aerosols in poorly ventilated indoor environments, contributing to prolonged community transmission.¹ Aerosol transmission occurs for SARS-CoV-2 via small respiratory droplets (less than 10 μm) that remain airborne and viable for up to 3 hours and 4.8 meters away.¹ This aerosol transmission paradox, where particles of various sizes remain airborne, renders traditional public health guidance less effective, as it primarily targets larger droplet transmission. Thus, conventional prevention measures such as social distancing alone are insufficient, and vaccination remains an essential mitigation strategy, especially in indoor healthcare and community settings with airborne transmission risk.¹

Beyond its rapid spread, vaccine uptake was further hindered by the novel nature of mRNA-based vaccines. Unlike conventional vaccines, mRNA vaccines function by administering a small amount of mRNA that codes for a specific viral protein. Cells use this mRNA to produce the viral antigen, which the immune system recognizes and responds to by producing antibodies and developing immunological memory for rapid response upon future exposure to the virus.² While mRNA vaccines offer considerable advantages, this novel mechanism of action represented a significant departure from traditional vaccine approaches. Despite robust safety and efficacy data, the unfamiliarity of mRNA technology became a point of skepticism and contributed to vaccine hesitancy, uncertainty, and decreased uptake in some populations.²

Digital health tools are transforming primary care by enhancing patient engagement, personalizing health interventions, and reducing clinician burden.^3–5 The increasing integration of web-based decision-aids, mobile health (mHealth) applications, and telemedicine platforms into clinical workflows has already demonstrated significant potential for improving healthcare accessibility and equity.^6–8 The use of digital health approaches in healthcare delivery has been found to improve information sharing between patients and providers, as well as to treat hard-to-reach populations.⁹ Further, scoping reviews have found digital health tools to have tangible positive impacts on health outcomes, such as chronic disease management.¹⁰

Vaccine hesitancy is a pressing challenge within primary care and was identified as one of the top ten threats to global health by the WHO in 2019.¹¹ While traditional in-person counselling remains critical, digital tools offer an opportunity to provide patients with accurate, tailored vaccine information in a scalable and efficient manner to combat hesitancy. This study introduces a novel, self-administered digital decision-aid tool designed to support patients in a primary care setting who express hesitancy regarding COVID-19 vaccines. COVID-19 vaccine hesitancy persists in the United States, with only 22.6% of the adult population having received the updated 2024-25 COVID-19 vaccine as of February 2025.¹² This lack of uptake is particularly stark when compared to the flu vaccination rate of 44.3% for the same period.¹² The issue is even more pronounced among certain racial and ethnic minority groups, with only 15.3% uptake among Hispanic Americans and 17.2% among non-Hispanic Black Americans.¹³ Further, regional disparities in vaccination trends also exist. For example, Georgia, where this study takes place, has one of the lowest rates of COVID-19 vaccination in the country, with only 13.8% of residents having received any dose of the updated 2024-25 COVID-19 vaccine.¹³

Unlike conventional vaccine communication strategies that typically rely on clinician-led discussions, this decision-aid tool enables patients to independently engage with structured, evidence-based vaccine information. Designed to address the empirically supported drivers of vaccine hesitancy, such as fear of side effects, doubts about vaccine effectiveness, and skepticism about vaccine necessity, patients can interact with the decision-aid via their own devices in the waiting room before their medical appointment.¹⁴ This approach has the potential to improve patient decision-making while minimizing the burden on healthcare providers.

This study evaluates the decision-aid’s impact on COVID-19 vaccine knowledge, perceptions, and intent to vaccinate among primary care patients in Atlanta, Georgia. The immediate goal was to decrease COVID-19 vaccine hesitancy, with the broader objective of advancing digital health solutions to address primary care challenges. By exploring this intervention within the context of digital primary care, we examine how self-administered decision-support tools can enhance vaccine literacy and empower individuals to make informed health choices. The findings contribute to the growing body of evidence supporting the integration of digital health tools in primary care and their role in reducing vaccine hesitancy.

Methods

Tool development

From December 2022 to December 2023, a multidisciplinary team with expertise in computer science, epidemiology, and clinical medicine at Emory University developed an online visual COVID-19 decision-aid tool. The tool drew inspiration from the Australian National Centre for Immunization Research and Surveillance’s tool - “Decision aid: Should I get the COVID-19 vaccine?” which launched in 2021.¹⁵ That decision-aid and the one developed in this project were guided by International Patient Decision Aid Standards, which stress that the primary goal of such tools is to reduce decisional conflict and that decision-aids are successful when patients feel they have made the right decision for their circumstances, based on their values.¹⁶ Following these guidelines, the tool was designed to present facts about COVID-19 and vaccination that are unbiased, giving equal attention to benefits and risks associated with all options, as well as helping patients clarify how their values related to each option and providing a way for patients to communicate these values with their healthcare practitioners.¹⁷

The design of the tool was also guided by evidence and research from a combination of the fields of epidemiology, behavioral psychology, and marketing. For example, the decision to use a multi-tier final option for vaccine decision-making, rather than the traditional two-option choice of either accepting or refusing the vaccine, was derived from marketing research on the efficacy of promoting compromise options to increase decision confidence in health settings.¹⁸

Epidemiological data for the tool was sourced through an internal systematic review of studies on COVID-19 vaccine risks and benefits. This included data from vaccine manufacturers, post-marketing surveillance on side effects, FDA reports on efficacy, and community prevalence rates. These data sources were cross-validated and integrated into a live system to create personalized risk and benefit models. However, the final version was not based on a previously validated questionnaire. Given the pilot nature of the study, the survey was designed specifically for this tool and has not undergone formal psychometric validation. Computer scientists on the research team developed the tool and subsequently integrated it into Emory’s COVID-19 Health Equity Dashboard, using open-source libraries like React JS for front-end development. The tool featured several interactive modules: information on COVID-19 risks, a personalized risk assessment calculator, details on approved vaccines, and the advantages and disadvantages of vaccination. Each module was developed in parallel and equipped with anonymized interaction logs for future research on its effectiveness. Formative user feedback was gathered to iteratively refine the tool’s interface and content.

Participants, setting, & study design

This study was a cross-sectional, one-group post-test-only design conducted at the Emory Dunwoody Family Clinic in Atlanta, Georgia, from January to June 2024. Adult patients of the clinic were recruited in person via flyers posted and distributed in the clinic’s waiting room.

Inclusion and exclusion criteria

Eligible participants were (1) 18 years or older, (2) English-speaking, and (3) not fully vaccinated and boosted for COVID-19 at the time of participation, according to Centers for Disease Control and Prevention (CDC) recommendations. Individuals were excluded if they had known contraindications to COVID-19 vaccination or were unable to provide informed consent.

Procedure

Potential participants independently screened, consented, viewed the decision-aid, and completed a survey via QR code included on flyers in the waiting room of the clinic. The QR code first directed patients to a consent form and eligibility screening questionnaire, and participants who met all criteria were then taken to the web-based decision-aid tool (available at https://covid19.emory.edu/decision-aid/about and in Supplementary Material). Participants were guided to independently navigate the site as per on-screen instructions. Figure 1 provides a visual of the first four webpages of the decision-aid tool as experienced by participants. Once finished moving through the decision-aid tool, they completed a 15-question survey that assessed their knowledge and opinions about COVID-19 vaccines and a demographic survey.

Figure 1.

Screen captures from the decision-aid tool (desktop version).

Measures

Two primary survey instruments were used to assess the tool’s impact. The 15-question post-tool survey asked participants about the tool’s impact on their beliefs and plans related to COVID-19 vaccination, their vaccine knowledge after using the tool, and the general usability of the tool. The questionnaire specifically asked participants if they decided to get the COVID-19 booster or vaccine after using the tool to evaluate the tool’s ability to reduce vaccine hesitancy. A range of question types was used, including multiple choice, open response, and sliding-scale questions. A 16-question demographic survey that followed the primary questionnaire asked about participant characteristics such as age, gender, race, and occupation. Additionally, this section included questions about participants’ general experiences and beliefs surrounding healthcare authorities and vaccinations. Both survey instruments can be viewed at https://covid19.emory.edu/decision-aid/about. (See Supplemental Material).

Data analysis

Descriptive statistical analysis was conducted using Microsoft Excel, summarizing categorical variables through frequencies and percentages. Given the cross-sectional nature of the study, inferential statistical testing was not performed. As such, potential confounders, such as other previous belief-influencing experiences and factors, were acknowledged as study limitations. Missing data were handled by excluding incomplete responses, with three participants removed from the final analysis.

Results

Participant characteristics

After excluding incomplete submissions, the final sample size of this study was 40 participants. The participants’ demographic information is summarized in Table 1. The majority of participants were female (70.0%), and 55.0% identified as African American or Black. Most participants were between 50 and 69 (45.0%). The most common occupations of participants were self-employment (25.0%), business (20.0%), and medical or healthcare occupations (15.0%).

Table 1.

Demographic characteristics of participants.

Variable	%	Variable	%
Gender		Occupation
Male	30.0%	Business	20.0%
Female	70.0%	Self-Employed	25.0%
Age		Medical/Healthcare Professional	15.0%
18-29	17.5%	Government/Civil Service	2.5%
30-49	32.5%	Clerical	2.5%
50-69	45.0%	Technology	5.0%
70+	5.0%	Transportation	7.5%
Racial/Ethnic Group		Homemaker	2.5%
Asian/Pacific Islander	5.0%	Retired	12.5%
White	32.5%	Other	7.5%
African American/Black	55.0%
Hispanic	5.0%
Other	2.5%

The majority of participants agreed that vaccines, in general, are important for the health of others in their communities (80.0%) and found childhood vaccines to be important and effective (72.5%). However, nearly half of the participants (47.5%) reported having heard negative stories about the COVID-19 vaccination that caused them to worry about receiving the vaccine, and 40.0% noted that they had serious concerns about possible reactions they might have after receiving the COVID-19 vaccine. Trust in information sources varied, with only 57.5% of participants stating that they trust the information they receive from healthcare authorities and experts regarding the COVID-19 vaccine. Further, survey responses indicated a gap in COVID-19 vaccine education, as 40.0% of participants indicated they had not received information or education about COVID-19 vaccines before participating in this study.

Participants had varying levels of vaccination, with 40.0% only having received one booster, 37.5% having received the primary vaccine series but no boosters, and 22.5% having never received any vaccination against COVID-19.

Decision-aid effectiveness

After using the decision-aid tool, participants were asked whether they had reached any decisions regarding COVID-19 vaccination. Fifteen participants (37.5%) indicated they had decided to get vaccinated or boosted, while 8 participants (20.0%) stated they had made the decision not to.

Fifteen participants (37.5%) had not yet reached a decision, with 27.5% stating they needed to discuss the decision further with family or healthcare providers and 10.0% indicating they needed more information before deciding. While these responses do not necessarily indicate movement toward vaccination, they do reflect continued engagement with the decision-making process rather than outright rejection of future vaccination. The remaining two participants (5%) responded “other” to this question.

Among those who were completely unvaccinated before using the tool, 22.2% reported deciding to get vaccinated, while 44.4% were still deliberating. Although it is unclear whether these participants will ultimately pursue vaccination, their responses suggest the tool at a minimum played a role in prompting reflection on the decision. Figure 2 provides an overview of decisions to vaccinate by vaccination level.

Figure 2.

COVID-19 Vaccination Decisions After using Decision-aid Tool by Previous Level 2 of Vaccination.

In a similar vein to the question on decision-making, participants ranked the likelihood that they would become fully vaccinated on a scale from 0 to 10 after using the tool. The average of the responses was 7.4, indicating that many participants were more likely than not to receive the next booster or vaccine after using the tool.

Assessing the impact of the decision-aid tool on participants’ willingness to receive COVID-19 vaccination presents inherent challenges due to the study’s design. Without a pre-test or control group, it is not possible to definitively attribute decisions made or changes in willingness solely to participants’ interaction with the decision-aid tool. However, data does suggest that the tool played a role in shaping participants’ decision-making process, whether by increasing willingness, reinforcing existing stances, or prompting further consideration. Participants were asked to identify if and to what degree using the decision-aid tool specifically had changed their willingness to get vaccinated. Nineteen participants (47.5%) stated that the tool had increased their willingness to get vaccinated, while one individual (2.5%) reported decreased willingness. Half of the participants (50%) reported that their willingness had remained the same. It is important to note that a stable willingness to vaccinate does not necessarily indicate that the tool was ineffective. It is possible that the tool reinforced participants’ existing stance, helping them reach a confident decision – even if that decision did not change.

Other responses offer further insights into the tool’s effectiveness. Thirty-five participants (87.5%) affirmed that the tool provided enough information to make an informed decision, including 17 (85%) of those who reported no change in their willingness to vaccinate after using the tool. Similarly, 85% of all participants stated that the tool successfully addressed their concerns or questions about COVID-19 vaccination, with 52.5% reporting that all their questions were fully answered.

Participants’ likelihood to recommend the tool to others is another meaningful measure of its perceived value. More than half (52.5%) stated they would be very likely to recommend the decision-aid tool, including 33% of those whose personal decision remained unchanged. This suggests that even individuals who did not alter their own stance found the tool to be a useful resource generally.

Tool utility and user-friendliness

Beyond influencing vaccination decisions, the tool was widely recognized as useful for improving participants’ understanding of COVID-19 vaccination risks and benefits. Nearly all participants (97.5%) found the tool to be useful, with 70% rating it as either “extremely” or “very” useful. Information about the risks of remaining unvaccinated was particularly compelling, with 70% of participants identifying this information as impactful. Additionally, 11 participants cited risk-related data as the most influential factor in their vaccination decision-making, with one participant specifically noting that the “ratio showing hospitalization rates for unvaccinated versus fully vaccinated individuals” was particularly persuasive.

Lastly, participants generally found the tool user-friendly and clear, giving it an average usability rating of 7.8 out of 10. On average, participants indicated the pacing of the tool was appropriate, it was not overly difficult to reason through, they didn’t feel negative emotions while using it, and that they were successful in achieving understanding of risks and benefits of COVID-19 vaccination through the tool. This positive feedback on usability highlights tool characteristics that were successful and should be considered for future iterations and broader implementation. Further insight on user-experience, as well as other summarized survey results are displayed in Table 2.

Table 2.

Post decision-aid survey questions & responses.

Question	Response options	# of participants	% of participants
We hope the information presented here has helped you to make an informed decision regarding COVID-19 vaccines:	I have decided to get the COVID-19 vaccine or booster	15	37.5%
	I have decided not to get the COVID-19 vaccine or booster	8	20.0%
	I need to discuss the decision further with my family and doctor	11	27.5%
	I need to learn more about COVID-19 and the COVID-19 vaccine (or booster)	4	10.0%
	Other	2	5.0%
How useful did you find the decision-aid tool in understanding the risks and potential benefits of COVID-19 vaccines?	Extremely Useful	12	30.0%
	Very Useful	16	40.0%
	Moderately Useful	7	17.5%
	Slightly Useful	4	10.0%
	Not At All Useful	1	2.5%
Compared to before using the decision-aid tool, has your willingness to get vaccinated changed?	Increased Significantly	8	20.0%
	Increased Slightly	11	27.5%
	Stayed the Same	20	50.0%
	Decreased Slightly	1	2.5%
	Decreased Significantly	0	0.0%
Did the decision-aid tool provide enough information to make an informed decision about COVID-19 vaccination?	Yes	35	87.5%
	No	5	12.5%
Did the decision-aid tool address your concerns or questions about COVID-19 vaccines?	Yes, completely	21	52.5%
	Yes, to some extent	13	32.5%
	No, not at all	6	15.0%
Did you find the potential risk information of not getting vaccinated	Yes	28	70.0%
presented in the decision-aid tool compelling?	No	12	30.0%
How likely are you to recommend this decision-aid tool to others who may be hesitant to get the COVID-19 vaccine?	Very Likely	21	52.5%
	Neutral	15	37.5%
	Unlikely	4	10.0%
How would you rate the user-friendliness and clarity of the decision-aid tool? (1 = Very poor, 10 = Excellent)	Average	7.8
	Range	2 - 10
The following questions asked about their experience with the ease of using the decision-aid tool. Participants rated the following questions on a scale of 0 to 20 (0 = very low, 20 = very high)
Question		Average Response
How much thinking, deciding, or calculating was required to finish using this tool?		10.4
How hurried or rushed was the pace of using this tool?		7.9
How hard did you have to work to accomplish your level of understanding?		7.5
How successful were you in understanding the risks and benefits of the COVID-19 vaccine?		16.1
How insecure, discouraged, irritated, stressed, and annoyed were you while using this tool?		6.9

Discussion

In terms of the immediate goal of reducing COVID-19 vaccine hesitancy and keeping in mind the limitations of the study, these results are promising. The findings suggest that the self-administered digital decision-aid tool helped reduce decisional conflict regarding COVID-19 vaccination for this user group, and this reduction trended favorably toward acceptance or interest in further consideration of COVID-19 vaccination. By providing a structured, interactive format for exploring unbiased epidemiological information, participants were able to make informed decisions independently, potentially reducing reliance on clinician-led discussions. This approach aligns with broader trends in digital primary care, where tools such as telemedicine platforms and mobile health applications are increasingly leveraged to improve healthcare accessibility and outcomes.¹⁹

The decision-aid demonstrated promising usability and effectiveness, with most participants reporting increased knowledge of the COVID-19 vaccine and 19 participants expressing increased willingness to get vaccinated as a direct result of using the tool. The integration of personalized risk assessments and real-time vaccine efficacy data proved particularly impactful in addressing participant concerns, according to participant feedback.

Reducing vaccine hesitancy is often not an immediate process; rather, it involves addressing concerns, building trust, and providing accessible, reliable information.²⁰ Decision-aid tools like this can play a key role in that process by helping patients clarify their questions and concerns over time. While not all participants reached a final decision on vaccination immediately after using the tool, the structured engagement with evidence-based information represents a meaningful step toward informed decision-making. Additionally, tools like this may serve as a starting point for critical discussions between patients and healthcare providers, allowing for more productive conversations about vaccination in a clinical setting. The fact that many participants indicated a desire to further discuss their concerns with their provider suggests that the decision-aid may function to facilitate deeper engagement and enhance patient-provider interactions.

The tool also proved to be a valuable asset in terms of time efficiency. Participants were able to complete the decision-aid in the waiting room, often spending well under 30 minutes in total, which likely reduced the need for extensive clinician time. At the same time, many users indicated a desire to discuss their concerns further with a healthcare provider after using the tool. This suggests that the tool prompted important conversations that may not have otherwise occurred. These conversations are likely to be informed by the information presented in the decision-aid, sparking more tailored lines of questioning and ultimately improving both the efficiency and quality of patient-provider communication.

This study contributes to a growing body of research on decision-aids for vaccination. Previous studies have demonstrated the efficacy of decision-aid tools for HPV vaccination and other immunizations, with notable success in engaging diverse populations.^21–23 Our study expands on these efforts by demonstrating the potential of digital decision-aids in addressing COVID-19 vaccine hesitancy among adults in primary care settings, providing further evidence of their value in improving vaccination rates across various demographics. A critical element of this decision-aid is its focus on the consideration of patient values. It is a core principle in decision-aid discourse that users make decisions they find right for them, grounded in their personal values and context. This was an essential consideration in the design of our tool, as reflected in the survey instruments we included. Questions prompting participants to reflect on topics such as the efficacy of childhood vaccines or the importance of vaccines for community health gave users an opportunity to consider their values while using the decision-aid. This process may help ensure they reach decisions they feel confident in, while also generating data that can inform future iterations of the tool and create additional opportunities for customization.²⁴ Our neutral approach to presenting information and response options is something other tools may look to adopt, as it enables individuals to make informed, healthy decisions without influence that can result from the perception of a designed agenda. Beyond COVID-19 vaccination, personalized digital health interventions may be particularly effective in reaching populations with longstanding vaccine concerns. The structure of this decision-aid tool – incorporating risk assessment, interactive learning, and unbiased information – could be adapted for other vaccines, including influenza, HPV, and childhood immunizations. Given the increasing role of digital health solutions in primary care, decision aids like this could be expanded to promote a range of preventative health measures and public health interventions. With further development, such tools could be customized to provide guidance on other medical decisions, ensuring their continued relevance in patient-centered healthcare.

This tool represents a valuable addition to the digital health space, not only as a vaccine-related intervention but also as part of a broader movement toward using technology to improve patient engagement and decision-making. The results highlight the potential efficacy and usability of such tools, reinforcing the role of digital health interventions in enhancing preventative care and supporting healthcare systems that are more efficient and patient-centered.

It is also important to note the demographics of this study, which provide insight into historically underrepresented patient populations, such as Black Americans. It is crucial to inform future advancements in digital health interventions with the perspectives of understudied populations to ensure equitable healthcare delivery in an increasingly tech-centered healthcare landscape.

Given the increasing adoption of digital health solutions in primary care, the early successes of this tool can inform the development and implementation of other technology-based decision-making tools for promoting positive health behaviors.

Future decision-aids

Looking ahead, as vaccine technology evolves, the materials to enhance literacy in primary care settings must change as well. One such strategy for COVID-19 is the heterologous prime-boost vaccination approach, where patients receive different COVID-19 vaccines for their initial and booster doses. Research demonstrates that when individuals primed with AstraZeneca vaccine received a Moderna booster, neutralizing antibody levels increased 115-fold and showed greater effectiveness against variants such as Beta.²⁵ Furthermore, the development of nanovaccines, much like mRNA vaccines, will require comprehensive decision-aid education. Nanovaccines utilize nanoparticles and enable rapid and long-lasting immunity while offering site-specific delivery, increased bioavailability, and reduced adverse effects.²⁶ Thus, nanovaccines can be tailored to individual immune profiles, and be combined with other vaccines to target multiple pathogens.²⁶ These aforementioned advancements will require future decision-aids to include clear explanations to help vaccine-hesitant individuals understand the scientific rationale, address concerns, and reduce hesitancy by demonstrating the effectiveness of modern vaccination strategies/technology.

Finally, the growing role of artificial intelligence (AI) in health communication presents both opportunities and challenges for decision-aid development. Tools like ChatGPT demonstrate capacity to provide health information but have significant limitations: lack of medical citations, outdated training data, inability to account for individual patient factors, and absence of clinical oversight.²⁷ Currently, evidence-based approaches like decision-aids offer distinct advantages over unstructured AI tools, however, as AI advances, decision-aids must evolve and potentially integrate validated AI capabilities while maintaining rigorous evidence-based frameworks to remain relevant.

Limitations

While the results of this study are encouraging, several limitations must be considered. First, the sample size was relatively small, which limits the generalizability of the findings. Additionally, besides basic vaccination status, the study lacked a detailed pre-test measurement to establish the other factors that may have influenced participants’ thought processes related to vaccination, making it difficult to isolate the tool’s specific impact. The inability to verify participants’ actual vaccination status post-decision also presents a challenge, as it is unclear whether participants who expressed intent to vaccinate followed through on their decision.²⁷

Another limitation was the absence of a control group, which would have helped isolate the effects of the decision-aid from other confounding variables. The study was conducted in a clinic setting among individuals already engaged in the healthcare system, which may not be representative of the broader community population, particularly those who are not regularly in contact with healthcare providers.

Lastly, the questionnaires were not formally validated instruments, which may limit the reliability and generalizability of our measured outcomes. However, the questions were developed with input from clinical staff, informed by prior studies on COVID-19 vaccine hesitancy, and designed to align with the tool’s underlying behavioral framework.

Despite these limitations, the study still provides valuable insights into the potential of digital decision-aids in reducing vaccine hesitancy. The findings suggest that such tools can be effective in improving vaccine literacy, encouraging informed decision-making, and sparking important conversations between patients and healthcare providers. Future iterations of this tool, with larger and more diverse sample sizes and control environments, will help further validate its effectiveness and expand its applicability to other vaccination campaigns or preventative health measures.

Conclusion

This pilot study shows that a self-administered digital decision-aid can support vaccine-hesitant patients in making informed choices about COVID-19 vaccination. Most participants (97.5%) reported improved understanding of vaccine risks and benefits, and 22.2% of previously unvaccinated individuals chose to pursue vaccination after using the tool. The high engagement among a predominantly Black population in a low-uptake region highlights the potential of such interventions to reach underserved communities. While limited by sample size and design, these findings demonstrate the feasibility of scalable digital decision-support tools as complements to clinical counseling. Future studies should assess their long-term impact and adaptability to emerging vaccine technologies.

Supplemental material

Supplemental material -Self-administered digital vaccination decision-aids in primary care: A pilot study of COVID-19 vaccination in Atlanta, GA

Supplemental material for Self-administered digital vaccination decision-aids in primary care: A pilot study of COVID-19 vaccination in Atlanta, GA by Jera White, Tej Shah, Emily Wall, Shivani A. Patel, Kevin Wu, Yuxuan Shi, Yuxi Zhang, Ziwei Dong and Ambar Kulshreshtha in Digital Health.

Footnotes

Acknowledgements

The authors thank all participating clinicians and patients for their time and invaluable input. Additionally, we thank Dr. Jane Frawley from the Sydney University of Technology School of Public Health for her foundational work on this subject.

ORCID iD

Jera White

Ethical considerations

Approval was obtained from the Institutional Review Board of Emory University (STUDY00004904).

Consent to participate

Written informed consent was received before the participants viewed the tool or completed any associated study questionnaires.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by Emory University’s Health Innovation Grant Program, supported by the National Center for Advancing Translational Science of the National Institutes of Health under Award Number UL1TRoo2378. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Supplemental material

Supplemental material for this article is available online.

References

Priyanka

COP

Singh

Patra

, et al. Aerosol transmission of SARS-CoV-2: The unresolved paradox. Travel Med Infect Dis 2020; 37: 101869. https://doi.org/10.1016/j.tmaid.2020.101869

Priyanka

Choudhary

. mRNA vaccines as an armor to combat the infectious diseases. Travel Med Infect Dis 2023; 52: 102550. https://doi.org/10.1016/j.tmaid.2023.102550

Erku

Khatri

Endalamaw

, et al. Digital health interventions to improve access to and quality of primary health care services: a scoping review. Int J Environ Res Public Health 2023; 20(19): 6854. https://doi.org/10.3390/ijerph20196854

Dongmo

FLN

Pang

Shieh

. How is mobile health technology transforming physician-nurse collaboration? Intern Med J 2021; 51(9): 1522–1525. https://doi.org/10.1111/imj.15484

Pennell

Dillmon

Levit

, et al. mHealth: mobile technologies to virtually bring the patient into an oncology practice. Am Soc Clin Oncol Educ Book 2017; 37: 144–154. https://doi.org/10.1200/EDBK_176093

Willems

Rao

Bhambere

, et al. Digital solutions to alleviate the burden on health systems during a public health care crisis: COVID-19 as an opportunity. JMIR Mhealth Uhealth 2021; 9(6): e25021. https://doi.org/10.2196/25021

World Health Organization, Regional Office for the Western Pacific . Regional action agenda on harnessing e-health for improved health service delivery in the Western Pacific. WHO.

Tong

Geng

Wang

, et al. Web-based decision-aids for cancer clinical decisions: a systematic review and meta-analysis. Support Care Cancer 2021; 29: 6929–6941. https://doi.org/10.1007/s00520-021-06184-y

Barbosa

Zhou

Waddell

, et al. Improving access to care: telemedicine across medical domains. Annu Rev Public Health 2021; 42: 463–481. https://doi.org/10.1146/annurev-publhealth-090519-093711

10.

Marcolino

Oliveira

JAQ

D'Agostino

, et al. The impact of mHealth interventions: systematic review of systematic reviews. JMIR Mhealth Uhealth 2018; 6(1): e23. https://doi.org/10.2196/mhealth.8873

11.

World Health Organization . Ten threats to global health in 2019. WHO, 2019.

12.

Centers for Disease Control and Prevention . Respiratory illness vaccination trends. CDC, 2025.

13.

Centers for Disease Control and Prevention . RespVaxView vaccine uptake, intent, and confidence. CDC, 2025.

14.

Shengelia

Verulava

. Factors associated with COVID-19 vaccine hesitancy in Georgia. J Health Sci Med Res 2024; 42(3): 127–135.

15.

Frawley

Wiley

Leask

, et al. Decision-aid (16+ years): should I get the COVID-19 vaccine? Sydney. National Centre for Immunisation Research and Surveillance, 2024.

16.

International Patient Decision Aid Standards (IPDAS) Collaboration . IPDAS versions and use [Internet], 2020. [cited 2025 Sep 14]. Available from. https://ipdas.ohri.ca/using.html

17.

Frawley

McKenzie

Forssman

, et al. Exploring complementary medicine practitioners' attitudes towards the use of an immunization decision-aid, and its potential acceptability for use with clients to reduce vaccine-related decisional conflict. Hum Vaccin Immunother 2020; 17(2): 588–591. https://doi.org/10.1080/21645515.2020.1787069

18.

Wood

Schulman

. Beyond politics—promoting COVID-19 vaccination in the United States. N Engl J Med 2021; 384(7): e23. https://doi.org/10.1056/NEJMms2033790

19.

Bizimana

. The impact of digital health on improving patient outcomes. Newport Int J Res Med Sci 2024; 5(3): 38–41. https://doi.org/10.59298/nijrms/2024/5.3.3841

20.

Tuckerman

Kaufman

Danchin

. Effective approaches to combat vaccine hesitancy. Pediatr Infect Dis J 2022; 41(5): e243–e245. https://doi.org/10.1097/INF.0000000000003499

21.

Wheldon

Grace

Zimet

, et al. Development and evaluation of a decision-aid for HPV vaccination among adults aged 27–45 years old in the United States. Comput Biol Med 2025; 185: 109557. https://doi.org/10.1016/j.compbiomed.2024.109557

22.

Gendler

. Development and appraisal of a web-based decision-aid for HPV vaccination for young adults and parents of children in Israel—a quasi-experimental study. Vaccines 2023; 11(6): 1038. https://doi.org/10.3390/vaccines11061038

23.

Vujovich-Dunn

Kaufman

King

, et al. A systematic review and meta-analysis of effectiveness of decision-aids for vaccination decision-making. Vaccine 2021; 39(28): 3655–3665. https://doi.org/10.1016/j.vaccine.2021.05.021

24.

Witteman

Ndjaboue

Vaisson

, et al. Clarifying values: an updated and expanded systematic review and meta-analysis. Med Decis Making 2021; 41(7): 801–820. https://doi.org/10.1177/0272989X211037946

25.

Choudhary

Priyanka

AJQ

Mohammed

, et al.

Heterologous prime-boost vaccination against COVID-19: is it safe and reliable?

Hum Vaccin Immunother 2021; 17(12): 5135–5138. https://doi.org/10.1080/21645515.2021.2007015

26.

Priyanka

AMAH

Chopra

Sharma

, et al. Nanovaccines: A game changing approach in the fight against infectious diseases. Biomed Pharmacother 2023; 167: 115597. https://doi.org/10.1016/j.biopha.2023.115597

27.

Choudhary

Priyanka . ChatGPT in travel medicine: A friend or foe? Travel Med Infect Dis 2023; 54: 102615. https://doi.org/10.1016/j.tmaid.2023.102615

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.15 MB