Abstract
Objective:
This study assessed the immediate effects of edutainment modules on changes in knowledge and perceptions towards the Expanded Programme for Immunisation (EPI) among an under served minority (Lisu) population.
Method:
An edutainment module was developed on mobile tablets for use by village health volunteers. As the study was conducted among a vulnerable population in a low-resource setting, it was designed as a simple pre–post assessment without a comparison group.
Results:
Participating Lisu mothers accepted and understood the edutainment module, and the intervention appears to have successfully improved their knowledge and perceptions of EPI. Tests showed a significant immediate improvement in knowledge, and an increasing proportion of participants reported having positive perceptions of the EPI process. The edutainment module may be an effective tool for highlighting the importance of appropriate practices and addressing misconceptions.
Conclusion:
The edutainment modules were considered user-friendly and attractive health-promotion tools by both health-care providers and villagers. This initiative’s effect on knowledge and perceptions towards child immunisation programmes among this group showed the positive potential of using modern technology when approaching hard-to-reach, under-vaccinated populations.
Introduction
A report by the National Immunisation Program in Thailand found that although the vaccine coverage rates among children aged <5 years were quite high, at 94%–98% for the overall immunisation programme, reported cases of vaccine-preventable diseases remained (Sasiwongsaroj et al., 2008). In 2011, 110 cases of rubella were reported – a disease with a morbidity rate of 0.17 per 100,000. Statistics from the Ministry of Public Health have revealed that 32% of children aged between 9 months and 7 years are at high risk of measles infection (Bureau of Epidemiology of the Department of Disease Control, Thailand Ministry of Public Health, 2011). A study conducted among Thai children found that the overall trend of measles morbidity is decreasing, but is still high among children aged <9 years compared with other age groups (Bureau of Epidemiology of the Department of Disease Control, Thailand Ministry of Public Health, 2012). In 2012, the Bureau of Disease Control reported 243 cases of Japanese encephalitis in 46 provinces of Thailand. The highest number of cases was among those aged 45–54 years, and children aged <5 years.
While health conditions are improving in many parts of the world, health deficits among indigenous peoples remain, and are often severe. Such minorities are more vulnerable to disease and less likely to seek out or access basic health care services. Evidence from both developed and developing regions indicates that maternal and child mortality rates are highest among minority ethnic groups (Brearley and Mathieson, 2012). Thailand contains many indigenous people and communities, including Karen, Hmong or Miao, Lahu, Lisu, Yao or Mien and Akha. Each has its own language(s), culture(s) and lifestyle(s), but many members face limited access to health care services. A Ministry of Public Health report from 2004 found an immunisation coverage of hilltribe children aged 1–5 years in 20 provinces, as follows: 80% for Bacillus Calmette–Guérin (BCG) vaccine, 75% for diphtheria–tetanus–pertussis (DTP) vaccine, 76% for polio vaccine, 72% for measles vaccine, 60% for Japanese encephalitis vaccine and 74% for hepatitis B vaccine (Highland Health Development Center of the Department of Health, Thailand Ministry of Public Health, 2004).
High numbers of non-immunised children prompt research into the underlying causes. A study reported that 43% of the causes are due to problems of supply of and access to services, followed by the knowledge and attitudes of parents (28%), family characteristics (23%) and communication (6%) (Brearley and Mathieson, 2012). Even in locations where immunisation services are available, the attitudes and knowledge of parents towards vaccines and diseases affect whether they decide to immunise their children or not. Parents are more likely to immunise their children if they recognise the health benefits of doing so (Bofarraj, 2011).
To increase knowledge and raise awareness, health information has traditionally been passed on in clinical or one-to-one settings, doctor or nurse to patient, and mother to child. Initial immunisation campaigns took the form of limited-reach print media, such as brochures, pamphlets, posters and small-circulation newssheets. However, electronic media, information technology and a better understanding of the communication process have increased the scope of health communication, from providing health information to attempting to persuade individuals to adopt healthy behaviours. Several studies have documented the potential of mobile technology as an effective tool for behaviour change, using SMS, text messaging and voice communication (Hart et al., 2011; Hofstetter et al., 2013), for example. The concept of ‘edutainment’ expands on this by using entertainment – stories and drama – to educate the audience. Evidence suggests that when used effectively, edutainment can improve health by changing health attitudes and practices in various settings, such as promoting positive reproductive-health behaviours in women (Cole-Lewis and Kershaw, 2010; Donovan and Carter, 2003; Jones, 2008; Strong and Brown, 2011; Zin and Nasir, 2007).
In this study, an edutainment module for the Expanded Programme for Immunisation (EPI) was developed on mobile tablets for use by village health volunteers during their routine home visits. The goal was to improve the knowledge and practices among the Lisu, a minority ethnic group inhabiting the hard-to-reach mountainous regions of northern Thailand. The group’s members tend to be of low-socio-economic status with limited literacy. The main objective of this study was to assess the immediate effect of edutainment on individual knowledge and perceptions towards EPI immunisation.
Methodology
Study population
The study was conducted in Chiang Dao District in Chiang Mai Province, Northern Thailand. Chiang Dao is composed of 83 villages, located in thick forest and mountain terrain. The target participants were ethnic Lisu mothers, aged 18–50 years, with children aged ⩿6 years, and who were willing to participate in the study. Assuming the knowledge and perceptions of mothers could be improved from 50% to 75%, with a power of 80% and a limit of 95% confidence interval, a sample size of 64 mothers was needed in the one-group pre-test/post-test study. The sample was selected by stratified sampling technique among mothers from 10 Lisu villages in Chiang Dao District. From each village, 7 mothers who had a child aged ⩿6 years were randomly selected.
Edutainment on EPI
The edutainment module was created by the Center of Excellence for Biomedical and Public Health Informatics (BIOPHICS) in the Faculty of Tropical Medicine at Mahidol University, as part of the StatelessVac Project funded by the Bill & Melinda Gates Foundation (2011). For this study, an edutainment animation in Lisu language was used as an intervention. The edutainment animation comprised a series of 11 EPI stories, with a story about preparations before and after immunisation, and 10 stories about the following 10 EPI-targeted childhood diseases: BCG, measles, hepatitis B, polio, diphtheria, pertussis, tetanus, mumps, rubella and Japanese encephalitis.
Based on the concepts of the health belief model and behaviour change communication, the edutainment module was planned as a teaching–learning process carried out in a fun and relaxed environment. Animation was used in the form of cartoons conveying the desired messages. Animated stories presented a conversation between a Lisu mother, a village health volunteer and Mr. Vaccine (presented as a needle man) (Figure 1). The village health volunteer and/or Mr Vaccine would generally talk to the mother who raises some questions and concerns about her baby or the child health situation in her village. The focus of each story was the importance of each vaccine, and the number of immunisations throughout the course of the EPI schedule. The stories also included the reasons each vaccine was needed, what kind of disease(s) it protects from, the signs and symptoms of the disease(s), some preventive measures and what to expect after vaccination. Each story lasted about 5 minutes.

Screen shots of mobile-phone–based animations.
Data-collection tool
The study used mobile technology to collect data and educate Lisu mothers. To avoid bias – a common problem due to language barriers and interpretation, or translation errors in traditional paper-based data collection – an electronically voiced questionnaire was developed and used for data collection in this study. The voiced questionnaire was administered by a trained research assistant or village health volunteer during regular home visits to the participants’ households.
Twenty-eight questions measuring the knowledge and perceptions of mothers regarding EPI were developed, taking the literacy levels of the study participants into account. The content of the questionnaire was informed by findings based on previous studies (Jandee et al., 2014) and knowledge of the culture and beliefs of hilltribe communities towards health services. The questionnaire was originally developed in English and then translated and recorded into the Lisu language by local Lisu native speakers. Responses to the voiced questionnaire were captured on a mobile tablet by a research assistant (Figure 2).

Screen shots of voiced questionnaire.
Before use in the target areas, the voiced-questioning data-collection tool was piloted in two other Lisu villages, to ensure that the target mothers could understand and answer questions spoken in their own language (as there are usually variations in certain terms spoken even within the same ethnic group). During home visits, the research assistant simply pressed the button on each questionnaire item, then the question and options (if any) would be spoken in the Lisu language and prompt the study participant to respond.
Data collection and analysis
Since the study was conducted among vulnerable populations in low-resource settings, the study design used a simple one-group pre-test/post-test approach. The baseline knowledge and perceptions of mothers regarding EPI were assessed before introducing the intervention. Employing the routine monthly health-promotion mechanism performed by village health volunteers, the trained research assistants approached mothers in their households, telling them about the project. Baseline information was collected using the voiced questionnaire on an off-line mobile tablet, then the interviewer checked for the completeness of the data and synchronised the data to the server via a telephone connection.
To make it easier for participants to understand and absorb the edutainment module, the animated EPI stories were divided into three sessions, with three to four stories shown per visit. The education intervention was delivered on three consecutive days; four stories (BCG, measles, hepatitis B and general immunisation matters) on day 1, four stories (polio, diphtheria, pertussis and tetanus) on day 2, and three stories (mumps, rubella and Japanese encephalitis) on day 3. One week after the final education session, at the post-intervention data collection, the same voiced questionnaire was administered to the mothers.
The knowledge and perceptions of the mothers’ pre- and post-edutainment intervention were compared using a paired t-test and the McNemar Chi-square test. Some potential confounding factors linked to mothers’ characteristics were explored, including education status, length of residence in Thailand, history of immunisation of previous children and ability to speak Thai.
Ethical considerations
The study was approved by the Ethics Committee of the Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand. Participants were well-informed about the aims and objectives of the study and the nature of the investigation, and were then invited to participate. They were informed in the Lisu language that participation was voluntary and refusing to participate in the study would not affect their routine health-care services in any way. Written informed consent was then obtained from all participants, and they were also told that they had the right to withdraw from the study at any time without giving a reason. The names of the participants were not recorded, and individual information was kept completely confidential.
Results
Characteristics of the mothers
As shown in Table 1, of the 69 mothers participating in this study, about half (49%) had no formal education and 30% had completed primary education. A majority of mothers (88%) had been staying in Thailand for >10 years, and 62% could speak Thai. A total of 62% gave birth to their last child in a hospital. About 77% of mothers thought that their monthly income was not enough. In the self-reported immunisation status of their current baby, 54% reported their children were not completely vaccinated.
Mothers’ demographic characteristics (n = 69).
Mothers’ knowledge about EPI immunisation and EPI-targeted diseases
The mothers’ knowledge of EPI vaccines and EPI-targeted diseases was assessed using seven questions. As shown in Table 2, after seeing the EPI edutainment module, the number of mothers who could give correct answers significantly increased over the week. Before the edutainment intervention was provided, 42 mothers (61%) knew that the measles vaccine was given to children about 1-year old, but after the intervention, 65 (94%) answered correctly. The number of participants who knew that diphtheria caused breathing difficulties increased from 38 (55%) to 56 (61%). The percentages changed slightly on the question related to total numbers of polio immunisations, from 16 (23%) to 25 (36%). As for the questions about which vaccines were included in the EPI programme, at the beginning only 40 (58%) were aware of the tuberculosis (TB) vaccine and 42 (61%) knew about the hepatitis B vaccine; after the edutainment intervention, 63 (91%) and 68 (96%) were aware of these vaccines.
Respondents’ knowledge by correct answers towards EPI (n = 69).
McNemar Chi-square test.
Negative statement.
Regarding overall knowledge about EPI before the edutainment intervention, 4 mothers (5%) were categorised as ‘need to improve’ (<3 correct answers out of 7), 48 (70%) were classed as moderately knowledgeable (3–5 correct answers out of 7) and 17 (25%) were categorised as having a good level (>6 correct answers). After three consecutive days of viewing the edutainment module, none were classed as ‘need to improve’, 17 (25%) were categorised as moderately knowledgeable and 52 (75%) were considered to have good knowledge.
Perceptions of mothers towards EPI immunisation
The perception of mothers towards EPI immunisation was measured by seven questions on the voiced-questioning questionnaires. Again, the perceptions of mothers reveal significant changes after seeing the edutainment module. As shown in Table 3, after seeing the videos, mothers who perceived that they should not go to a health centre to have their children vaccinated when the child was sick increased from 31 (45%) to 57 (83%). Mothers who would not take their children for immunisation when they were busy fell from 40 (58%) to 19 (28%). Regarding negative perceptions, mothers who perceived that the side-effects of immunisation were not serious rose from 23 (33%) to 39 (57%), and those who thought that immunisation would not cause physical disability increased from 17 (25%) to 33 (48%). Interestingly, the number of mothers who agreed with the statement that immunisation was not essential only fell from 21 (30%) to 17 (25%). Overall, mothers having an overall good overall perception of EPI increased from 44 (64%) to 57 (83%).
Mothers’ perceptions of EPI (n = 69).
EPI: Expanded Programme for Immunisation.
McNemar chi-square test.
Negative statements.
Perceptions of mothers towards correct practices during the EPI process
Table 4 presents the perceived correct practices of mothers during the EPI process. Generally, Lisu mothers had appropriate practices regarding childhood immunisation activities: >95% of respondents reported bringing the Maternal and Child Handbook (for recording immunisation history) whenever they went to a health centre, having their children immunised without missing any visit, having proper practices in terms of preparation for their children to be ready for immunisation when visiting a health centre, helping the health-care providers during immunisation, and giving appropriate treatment for any vaccine side-effects. Significant changes were found in certain practices after edutainment: mothers who used cold compression to relieve the swelling at the injection sites increased from 33 (48%) to 51 (74%). Mothers who took their children to health centres when the fever had not eased within 2 days post-immunisation increased from 41 (59%) to 56 (81%). Overall, the number of mothers who were categorised as having good perceived correct practices increased from an initial 46 (67%) to 58 (84%).
Perceived correct practices towards EPI (n = 69).
McNemar Chi-square test.
Discussion
Although in Thailand EPI is provided free regardless of nationality, and whether or not individuals are initially registered with the health centre responsible for the population in the designated village, only about half of the Lisu mothers’ children had completed their children’s immunisations without missing a visit. It should be noted, however, that this was a self-reported number, which could be biased, as other studies have found when comparing the differences between memory recall and immunisation card records (Bofarraj, 2011; Caingles and Lobo, 2011; Tadesse et al., 2009).
In this study, 30% of participants had delivered their children at home. Mothers had resided in the area for several years (most >10 years), where they had access to free government health facilities; nevertheless, a high rate of home deliveries persisted. This may be partially due to their treatment-seeking behaviours, including difficulties travelling the distance required to the health facilities, not perceiving the importance of utilising government facilities, and/or traditional health beliefs. In addition, it reflects, in part, the issues described in the literature in terms of legal status, limited access to health services, and communication and language barriers (Jandee et al., 2014; Kingston et al., 2010; Sawhney and Favin, 2009; United Nations Educational, Scientific and Cultural Organization [UNESCO] Bangkok, 2006).
Immediately after taking part in the edutainment programme, EPI knowledge among the study participants improved significantly. In general, mothers were more knowledgeable about the childhood immunisation programme. After the intervention, the number who knew the specific names of the vaccines in the EPI schedule increased from about 60% to >90%. However, as reflected by the question about total number of oral polio vaccine doses, it was found that even after the intervention, mothers’ knowledge was rather limited about the scheduled doses of individual vaccines. It seems that it is easier to remember vaccine names and their associated diseases, while schedule and dosages might be too detailed to remember, especially when exposed to the information only once. Mothers may also think memorising the schedule was unnecessary because the village health volunteers would normally remind them during the routine monthly home visit.
The findings from this study suggest that Lisu mothers altered their perceptions of the childhood immunisation programme after viewing the edutainment module. Edutainment, when used as a tool in individual teaching, had an immediate effect on each mother, increasing knowledge of vaccines and diseases and changing perceptions of the immunisation process. Apart from two statements concerning the perceived importance of immunisation, a higher proportion of mothers had positive perceptions about the immunisation process and activities post-intervention. To explore potential confounding variables that may be related to knowledge and perceptions in this population (including the educational levels of the mothers, length of stay in Thailand, ability to speak Thai, and self-reported history of completing an immunisation course for their children), regression analyses were conducted. No significant associations were found between those variables with either the knowledge or perceptions of the mothers in this study. However, the total post-edutainment score for perceptions of immunisation was significantly higher among mothers who had stayed in Thailand for >10 years. It may be that long-stay mothers would have had greater exposure to health-care campaigns and be more familiar with/trust village health volunteers and health officials than their short-stay counterparts.
After the edutainment intervention, most Lisu mothers (84%) reported possessing a good understanding of the appropriate practices vis-a-vis the EPI process. Even before implementation of the edutainment intervention, most mothers (>95%) were correctly taking care of and preparing their children before and during the EPI immunisation period. There were two areas, however, in which the appropriate post-immunisation child-care knowledge and practices were deficient pre-edutainment: only 48% attempted to relieve swelling at the injection site, and only 59% took their child to a health centre when the child suffered from fever for >2 days, as a likely side-effect of immunisation. These percentages increased to 74% and 81%, respectively, after viewing the EPI animations.
The results of the study suggest that edutainment modules using mobile tablets provide an acceptable and understandable means of communication for Lisu mothers. The nature of such programmes is both educational and entertaining, an effect observed in several other studies employing edutainment to promote health care services (Braa and Purkayastha, 2010; Clark et al., 2011; Hart et al., 2011; Rotheram-Borus et al., 2012). It is important to recognise that content development for the behaviour-change-communication package involved experts and local stakeholders, to ensure the delivery of effective key messages and presentations. Local stakeholders also conducted in-depth interviews and focus-group discussions to better understand the mothers’ beliefs and perceptions about EPI immunisation. During these focus groups, some mothers suggested the use of real human actors telling the story rather than animations, as real people would make for more effective education. Some mothers also requested that more information be provided in the edutainment packages for pregnant women, and for other caretakers of the child, such as fathers, grandparents and siblings. This reflects an overall positive attitude towards using mobile technology such as that employed in this study for health-promotion purposes in remote areas.
Limitations of the study
This was a simple one-group pre–post study. No other EPI-related education or similar programmes were conducted during the edutainment intervention period. Thus, changes in knowledge and perceptions could reasonably be attributed to the edutainment intervention itself. The pre–post time-points were, however, quite close together, and a sustainable effect cannot be assumed. The impact of the edutainment itself should also be treated with caution, due to the potential for instructor effect. All volunteer interviewers came from the same community, thus the participants were easily approachable. According to the Thai Ministry of Public Health, most health volunteers performing monthly home visits belong to the same tribe as the villages/households for whom they are responsible. However, the findings of this study may vary if conducted by non-Lisu interviewers. Were the study to be repeated to test the effectiveness of edutainment in locations/populations where EPI coverage is still low, it would be better to adopt a two-parallel-group design, in which the baseline backgrounds of the two communities are similar. The study outcomes measured should also be over a longer duration to assess long-term impact on changes in EPI coverage.
Conclusion
This study explored the potential of using edutainment for behaviour change among a specific population in a remote area. Overall, the edutainment module was found to be user-friendly, and it was seen as an attractive health-promotion tool to both health-care providers and villagers. The beneficial effects of this initiative on knowledge and perceptions towards child immunisation programmes suggest that the use of modern technology may be valuable in reaching other hard-to-reach, under-vaccinated populations, elsewhere.
Footnotes
Acknowledgements
This study was part of the StatelessVac Project, funded by the Bill & Melinda Gates Foundation through the Grand Challenges Explorations initiative; we would like to thank the Foundation for funding and supporting us throughout the project. Thanks to the Rockefeller Foundation for supporting graduate students in the informatics programme at Mahidol University. We wish to acknowledge the support of health care personnel and village health volunteers in Chiang Dao district, Chiang Mai Province, for their efforts in implementing the edutainment and collecting data in remote areas. Thanks also to the management-information-systems and data-management teams at BIOPHICS for their contributions to system development. Special thanks to Paul Adams and Glad Rotaru at the Office of Research Services, Faculty of Tropical Medicine, Mahidol University, for language editing of the manuscript.
Funding
The StatelessVac Project was supported by Bill & Melinda Gates Foundation’s Grand Challenges Explorations (Round 7 – Grant Number OPP1046158). The project also received in-kind support from the Faculty of Tropical Medicine, Mahidol University, Thailand. Faculty members of the university were actively involved in planning and implementing the project in the study locations.
