Abstract
The age of information and communication technology (ICT) has witnessed the prevalence of computer-based reading. Previous studies yielded mixed results concerning the relationship between ICT perceived competence, ICT use and digital reading performance, and the underlying mechanism was rarely explored. This study aimed to explore the relationship between ICT perceived competence and adolescents’ digital reading performance and the potential mediating roles of three types of ICT use. Multilevel mediation analyses were conducted for 199,646 15-year-old students from 29 OECD countries/regions in the Programme for International Student Assessment (PISA) 2018, in which digital reading performance was assessed by multistage adaptive computer-based testing. The results revealed that a) ICT perceived competence and digital reading performance were positively correlated; b) ICT use significantly mediated the relationship; c) students with higher-level ICT perceived competence tended to use ICT for leisure at home more frequently, which led to better digital reading performance; d) the suppression effects were revealed, indicating the need to consider the interrelationship between ICT perceived competence and ICT use. These findings provided new evidence for the self-determination theory and the ICT engagement model, suggesting that appropriate ICT use driven by high-level ICT perceived competence might help improve adolescents’ digital reading performance.
Keywords
Introduction
In the age of information and communication technology (ICT), ICT users and digital readers are on the rise (Reimer et al., 2021; Sage et al., 2019). Furthermore, online learning has become much more prevalent especially in the post coronavirus disease 2019 (post-COVID-19) pandemic era (Silva et al., 2021). Reading texts on screen has been found to be different from on paper (Ackerman & Goldsmith, 2011). Since online platforms involve novel types of texts and sociocultural practices (OECD, 2011; Yu et al., 2022), it is important that students master digital reading skills such as navigating through ambiguity and assessing text credibility (OECD, 2011). Having witnessed the expansion of the medium of reading from paper to digital devices and the new requirement for students to read smoothly on digital platforms, the Programme for International Student Assessment (PISA), a triennial international survey conducted by the Organisation for Economic Co-operation and Development (OECD) to assess 15-year-olds’ academic achievement, redefined reading performance in its most recent cycle, PISA 2018, and conducted a large-scale computer-based reading assessment. Accordingly, in this study, digital reading performance refers to “understanding, using, evaluating, reflecting on and engaging with digital texts in order to achieve one’s goals, to develop one’s knowledge and potential and to participate in society” (see OECD, 2019b, p. 26).
In studying the significant determinants of students’ digital reading performance, existing studies have highlighted ICT perceived competence and frequency of ICT use. However, prior research has yielded inconsistent findings on the relationship between ICT perceived competence, ICT use, and digital reading performance, mostly positive (e.g., Hu et al., 2018; Lim & Jung, 2019; Skryabin et al., 2015) but several negative (e.g., Chen et al., Xiao et al., 2019). Additionally, PISA 2018 has renewed the measurement of the ICT use variables due to the emergence of new digital reading media such as social media and chatting apps (Hu & Yu, 2021), and it also encompassed more participating countries/regions in the digital reading assessment. Therefore, the data used by previous studies need to be updated, and the sample size could be enlarged (e.g., Meng et al., 2019; Xiao et al., 2019). Most importantly, the mechanism underlying the relationship between ICT perceived competence and digital reading performance remains largely uninvestigated (Goldhammer et al., 2016; Lee & Wu, 2012).
Insights into the roles of ICT perceived competence and ICT use in the development of students’ digital reading performance could further enhance the understanding of the underlying mechanism, inform theory, assist educators in guiding adolescents to regard and use ICT properly, and provide pedagogical implications for technology-assisted language learning (Costa et al., 2019).
Therefore, this study aims to reveal the relationship between ICT perceived competence and 15-year-old students’ digital reading performance and the potential mediating effects of three types of ICT use, i.e., recreational use of ICT at home, academic use of ICT at home, and ICT use at school. Specifically, 1-1-1 multilevel mediation analyses with three parallel mediators are conducted for each of the 29 OECD countries/regions, controlling for demographic information, including gender and socioeconomic status.
Literature Review
Information and Communication Technology Perceived Competence and Digital Reading Performance
The concept of ICT perceived competence is grounded in perceived competence. The term “perceived competence” is often used interchangeably with “self-concept”, “self-efficacy”, and “self-confidence” in the extant literature (Christoph et al., 2015; Marsh et al., 2019; Monique et al., 2013; Zylka et al., 2015). As proposed in the self-determination theory (SDT) of Deci and Ryan (2000), perceived competence refers to “the belief that one is capable of interacting effectively with the environment in order to obtain valued outcomes” (Marshik et al., 2017, p. 43) during the process of goal pursuit (Burkley et al., 2015), and it has shown to be an essential predictor of adolescent students’ academic performance in previous educational psychology studies (e.g., Chen et al., 2021; Geng et al., 2022; Hsu et al., 2022; Huang & Mayer, 2019; Usher et al., 2019). ICT perceived competence, a particular type of perceived competence, is conceptualized as “the individual’s perception of his or her own knowledge about ICT and about how to use it” (p. 342) in the SDT-based ICT engagement model devised by Goldhammer et al. (2016).
The potential relationship between ICT perceived competence and digital reading performance are demonstrated in several theories. Generally, as proposed in SDT, satisfaction of the need for competence could enhance intrinsic motivation, which in turn generates better learning and performance (Deci & Ryan, 2000). Specifically, in the ICT engagement model (Goldhammer et al., 2016), ICT perceived competence at a high level might leads to greater performance in ICT tasks, which may further support the learning outcomes of more general learning tasks involving ICT use.
In the context of PISA reading research focused on adolescents, ICT perceived competence has been found to be related to the development of 15-year-old students’ digital reading performance. Lim and Jung (2019) found that students’ self-confidence in completing high-level ICT tasks was positively related to their digital reading performance. Similarly, studies utilizing the PISA 2015 (Hu et al., 2018) and PISA 2018 database (Xiao & Hew, 2022) revealed that students who perceived themselves as competent in using ICT performed better in digital reading tasks. Moreover, when students perceive ICT as useful but uncontrollable, their performance in digital reading assessment deteriorates (Naumann & Saelzer, 2017). While the aforementioned studies indicated that ICT perceived competence might play a positive role in fostering reading activities on digital devices, a relatively small number of studies yielded negative results for Singapore, New Zealand, Australia, Finland, and France in PISA 2015 (Xiao et al., 2019), and for China and Germany in PISA 2015 (Meng et al., 2019). While Xiao et al. (2019) didn’t provide any possible reason for such a phenomenon, Meng et al. (2019) speculated that the use of self-report and the cultural differences between Eastern and Western countries might partially explain it. Students in Eastern countries, though being modest about their competence, were found to perform better in academic assessment including digital reading assessment. On the contrary, Western countries often support students’ confidence in their uniqueness, so they are more likely to deem themselves as highly competent so that their self-perception even becomes inflated, i.e., higher than their real competence (Liu & Meng, 2010). These findings suggested that more large-scale studies involving more countries/regions are in need to explore the replicability of such cultural differences.
Considering the important role of ICT perceived competence, the currently inconsistent findings on the effects of this factor, and the scarcity of studies that probe into the mechanism underlying the influential pattern, further studies with updated data are needed to shed light on the relationship between ICT perceived competence and adolescents’ digital reading performance.
Information and Communication Technology Use and Digital Reading Performance
Information and communication technology use concerns students’ physical involvement in ICT (Goldhammer et al., 2016). A host of studies have revealed that the frequency of ICT use is a determining factor for the development of adolescents’ digital reading performance. The use of ICT has been found to affect students’ reading performance in different use contexts (i.e., at school and outside of school) (Hammond, 2020) and with different use purposes (i.e., recreational and academic purposes) (Eger et al., 2020). Most studies found that using ICT at school was negatively correlated with students’ reading performance (e.g., Chen et al., 2021; Hu et al., 2018; Petko et al., 2017; Skryabin et al., 2015); however, mixed correlations were found with respect to the use of ICT outside of school and digital reading performance— recreational use could be either positively (e.g., Hu et al., 2018; Skryabin et al., 2015) or negatively correlated with performance (e.g., Petko et al., 2017; Xiao et al., 2019). Similarly, the relationship between academic use of ICT and digital reading performance were found to be either positive (e.g., Petko et al., 2017; Skryabin et al., 2015; Srijamdee & Pholphirul, 2020) or negative (e.g., Hu & Yu, 2021; Hu et al., 2018).
Despite the substantial efforts made by previous researchers to reveal the relationship between ICT use and digital reading performance, the currently inconsistent findings need further corroboration using more updated data from a large sample, especially in the post-COVID-19 era when learning becomes increasingly ICT-dependent (Sage et al., 2021).
Information and Communication Technology perceived competence, Information and communication Technology Use and Digital Reading Performance
The aforementioned studies were focused on the relationship between digital reading performance and ICT perceived competence or ICT use separately. However, few have investigated the interrelationship between these three factors concurrently.
In fact, ICT perceived competence and ICT use have been found to be interrelated both theoretically and empirically. As proposed in the ICT engagement model (Goldhammer et al., 2016), ICT perceived competence was deemed as one of the maintaining and enhancing factors of self-determined use of ICT. This proposition is underpinned by the SDT (Deci & Ryan, 2000), which assumed that people would continue to show certain behaviours if their needs to feel competent were satisfied. Empirically, on the one hand, ICT perceived competence has been shown to be an important antecedent of students’ ICT use (Chen & Hu, 2020); on the other hand, computer anxiety was found to be one possible reason for the long-term avoidance of computers (Monique et al., 2013). Hence, the correlation between ICT perceived competence and ICT use lays the foundation for studying the competence-use-performance link.
Furthermore, a notable study by Lee and Wu (2012) provided the impetus for the present study. Their study revealed the relationship between ICT-related psychological and behavioral factors and reading performance, as well as the mediating role of ICT-related behavioral factors. Specifically, by analysing data from 42 countries/regions in the PISA 2009, they found that the ICT inner state, which included ICT confidence, was found to be related to reading performance through the mediating role of online reading activities. In other words, the effects of ICT confidence on the development of reading performance were transmitted through the frequency of online reading activities. Although their study provided inspiration for the current one, such as the exploration of the mediating path, some improvements could be made to provide a more comprehensive view of the potential factors that are closely linked to digital reading performance and the influential pattern. First, the mediating variables were different. While the study of Lee and Wu (2012) revealed how involvement in different types of digital reading activities might take effect, focusing on different types and purposes of ICT use might provide educators with new ideas for improving computer-assisted reading education, both in the formal and informal learning contexts. Second, the study of Lee and Wu (2012) explored the relationship with traditional print reading performance instead of the digital one, which might be due to the data availability in PISA 2009. Thus, this study aimed to make an extension of their study based on the latest PISA digital reading assessment data, which might help provide a better understanding of how ICT-related factors related to ICT-based reading performance.
The Present Study
The aforementioned studies investigated the relationship between ICT perceived competence and ICT use and adolescents’ digital reading performance; however, more research on this subject is needed for four reasons. First, prior research has yielded mixed results, thus lacking a definitive answer to whether ICT perceived competence and ICT use could foster the development of digital reading proficiency. Second, scales measuring ICT perceived competence and ICT use have been continuously updated in the PISA assessment with the rapid development of ICT, necessitating an updated investigation of the influential pattern utilizing more comprehensive data. Third, in the vast majority of the previous studies, ICT perceived competence and ICT use were both treated as predictors of digital reading performance, but their intrarelationships and concurrent relationships with digital reading performance were rarely investigated directly. Fourth, although previous researchers have revealed some cultural differences in the relationship between ICT perceived competence and digital reading performance, whether a similar discrepancy exists in the relationship between ICT perceived competence, ICT use and digital reading performance remained to be investigated.
Accordingly, three research questions were addressed in this study: RQ 1: What is the relationship between ICT perceived competence and adolescents’ digital reading performance? RQ 2: Whether and to what extent are the relationship between ICT perceived competence and adolescents’ digital reading performance mediated by the frequency of three types of ICT use, i.e., ICT use at home for leisure, ICT use at home for schoolwork, and ICT use at school? RQ 3: Do the total effects and the mediating effects of ICT perceived competence on adolescents’ digital reading performance differ or are they similar across countries?
With respect to each research questions, three hypotheses were proposed.
H1: The relationship between ICT perceived competence and adolescents’ digital reading performance is significantly positive.
H2: A large proportion of the effects of ICT perceived competence on digital reading performance were mediated by ICT use at home for leisure, ICT use at home for schoolwork, and ICT use at school. In other words, a higher level of ICT perceived competence would lead to more frequent use of ICT, which would in turn result in greater digital reading performance.
H3: The total and mediating effects of ICT perceived competence on adolescents’ digital reading performance are different across countries.
Method
Participants
The data were extracted from the latest PISA database, i.e., the PISA 2018 database (URL: http://www.oecd.org/pisa/data/2018database/) released in December 2019. As a triennial international large-scale educational survey, PISA mainly assesses 15-year-old students’ reading, mathematics, and science competencies, with reading as the major domain in PISA 2018, which was assessed mainly through computers (OECD, 2019b). Within each participating country/region, two-stage sampling was conducted to obtain representative samples of students nearing the end of compulsory education (OECD, 2019c). With respect to the two-stage sampling, first, based on the participating country/region, schools were chosen in proportion to the number of 15-year-old students they had, with 150 such schools set as the minimum number. Second, within each selected school, at least 42 students with proper age were randomly selected as participants. To avoid sampling bias, survey weights for each student were involved in the dataset (OECD, 2019a).
Demographic Information of the Sample and the Descriptive Statistics of the Variables.
Note. Due to the limited space, only the mean of the ten PVs was presented in lieu of the value of each of the PVs. The values of all the PVs can be accessed through the publicly available database of PISA 2018 (http://www.oecd.org/pisa/data/2018database/).
Materials
Variable Description.
Source. PISA 2018 database.
The dependent variable was students’ digital reading performance in PISA 2018, represented by 10 plausible values (PVs). Due to the subset design of the assessment, the PVs were computed to provide multiple estimations of students’ reading performance. Correspondingly, all 10 PVs were utilized in each run of the analysis in this study. Across OECD countries/regions, the PVs were calibrated with means of approximately 500 and standard deviations of approximately 100 (OECD, 2019b). PISA 2018 digital reading assessment evaluates adolescents’ digital reading proficiency in the following aspects: reading fluently, understanding, and evaluating and reflecting upon manifold text format via computer. This assessment simulated the online-reading tasks and scenarios that students in engaged in by clicking on the links, browsing the Internet to retrieve information and evaluating documents. Furthermore, it employed a multistage adaptive design with three consecutive stages, including Core (7–10 items), Stage 1 (12–15 items), and Stage 2 (12–15 items) with a total of 245 items. Consequently, most students were tested 35–39 items in an hour, and the students’ proficiency in the previous stage was correlated to the testlet they were going to finish in the next stage (OECD, 2019b).
The independent variable was students’ perceived competence in using ICT. Coded as COMPICT, this variable was derived from five items concerning students’ perception of their competence in conducting ICT-related activities and applying ICT-related knowledge. Students provided their responses to the statements (e.g., “When I come across problems with digital devices, I think I can solve them”) on a four-point Likert scale ranging from “strongly disagree” to “strongly agree”, after which a composite score was calculated using item response theory (IRT) scaling, with an OECD mean of 0 and an OECD standard deviation of 1. Furthermore, the cross-country comparability of the variable was ensured by employing the IRT scaling methodology (OECD, 2009). For the detailed item wordings, see Supplementary Files Table S1.
The three potential mediating variables concerned students’ ICT use in different contexts and for different purposes: ICT use outside of school for entertainment (ENTUSE), ICT use outside of school for schoolwork (HOMESCH), and ICT use at school in general (USESCH). 12, eleven, and ten questions were asked, respectively, regarding the frequency of students’ involvement in these activities conducted on different types of ICT platforms and using various tools such as social media, digital games, and mobile devices. Students were required to respond on a five-point Likert scale, with the options of “never or hardly ever” “once or twice a month” “once or twice a week” “almost every day” and “every day”. Similarly, IRT scaling was utilized to derive the variables. For the detailed item wordings, see Supplementary Files Table S1.
In addition, two control variables were used throughout the analysis, student gender (Gender) and the index of economic, social, and cultural status (ESCS), because both were found to be related to students’ digital reading performance (Wu, 2014; Xiao & Hu, 2019), academic perceived competence especially ICT perceived competence (Cai et al., 2017; Cusso-Calabuig et al., 2018; Franzen et al., 2022; Vekiri, 2010), and frequency of ICT use (OECD, 2010; Qazi et al., 2022). The gender variable was converted to a dummy variable in this study, with female students coded as 0 and male students coded as 1.
The scale reliabilities of all the ICT-related derived variables were computed by the PISA data validation staff and all values exceeded 0.7. For COMPICT, ENTUSE, HOMESCH, and USESCH, the average values of the 29 countries/regions ranged from 0.8 to 0.9 (see Supplementary Files Table S2). Thus, acceptable internal consistency was demonstrated.
Procedure
The data were pre-processed prior to the main analysis. First, missing values were imputed with the expectation maximization algorithm in SPSS 20.0, which produced a single data point for each missing value by rendering maximum-likelihood estimates of the model parameters (Dempster et al., 1977). Second, the correlation matrices were computed for each country/region (see Supplementary Files Tables S2-S60). Since none of the correlation coefficients exceeded 0.80, no multicollinearity problem was detected (Field, 2009), and all variables were retained. Third, to obtain unbiased population-level parameters, the final student weight was normalized and used in the modelling (see OECD, 2009).
To investigate the relationship between ICT perceived competence and students’ digital reading performance and the potential mediating roles of three aspects of ICT use, this study conducted 1-1-1 multilevel mediation analyses with multiple parallel mediators.
The mediation analysis refers to a regression-based investigation of the means by which an independent variable (X) affects a dependent variable (Y) through one or more mediating variables (M), which aims to reveal the mechanism underlying the effects of X on Y. As demonstrated in the mediation model (Figure 1), this study is primarily concerned with the total effect (path The mediation model of the present study. For the simplicity of the diagram, the two control variables (Gender and ESCS) are not presented but were used throughout the analysis.
Furthermore, this study employed multilevel mediation to cope with the PISA data structure, i.e., the three-level data structure in which students are nested within schools and then within countries, resulting from the PISA two-stage sampling (OECD, 2009). While the nested structure of the data violates the independence assumption of ordinary least square regression, multilevel models could account for the substantial proportion of variance that exists between different schools, thus reducing the risk of statistical errors such as aggregation bias and unreliable standard errors (Hox, 2010). Furthermore, multilevel mediation has been employed in educational studies (e.g., Chiao & Chiu, 2018; Ieong et al., 2016; Liu et al., 2015) and found to be feasible. Specifically, 1-1-1 multilevel mediation analyses were conducted, in which all the variables including X, M, and Y, were measured at level 1 (i.e., the student level). In addition, to prevent potential confounding, the data were CWC (M) in the multilevel analyses; i.e., X and M were “centred within context”. In other words, the group mean was centered at the student level with the aggregated mean reintroduced to the school-level equations (Zhang et al., 2009).
Thus, prior to model building, the appropriateness of data aggregation is examined by calculating,
1-1-1 Multilevel Mediation Models with Three Parallel Mediators.
Note. Y refers to the dependent variable, students’ digital reading performance. X refers to the independent variable, students’ ICT perceived competence. M1, M2 and M3 refer to the three mediators ENTUSE, HOMSCH and USESCH. For the simplicity of the model, C stands for the two control variables, ESCS and Gender.
The mediating effects were tested by joint significance (Hayes, 2009) accompanied by the computation of Monte Carlo confidence intervals (Preacher & Selig, 2012; Veas et al., 2019) using the RMediation (Tofighi & MacKinnon, 2011) package in R (R Core Team, 2019). Regarding the effect size of the mediators, the proportion mediated (PM), i.e., the ratio of the indirect effect to the total effect, was computed as the main indicator (Wen & Fan, 2015).
Results
Necessity of Multilevel Modelling
ICC for Each of the 29 Countries/Regions.
Total Effect
First, a random intercept and fixed slope model was built to investigate the total effect. The model, with digital reading performance as the independent variable, COMPICT as the dependent variable, and Gender and ESCS as the control variables, was constructed for each country/region.
Within-School Total and Direct Effects of ICT Perceived Competence on Digital Reading Performance.
Note. *: p < .05, **: p < .01, ***: p < .001.
In addition, the effects of the control variables are presented in Supplementary Files Table S63. For student gender, the coefficients range from −52.2360 to −8.2990, all of which are significantly negative, indicating that male adolescents in general have a lower level of digital reading performance than their female counterparts. For ESCS, the coefficients range from 3.2952 to 34.6525, all of which are significantly positive, suggesting that students with higher levels of ESCS perform better in the digital reading assessment.
Indirect and Direct Effects
Following the null and total effect models, two sets of models were subsequently constructed to examine the direct and indirect effects of adolescents’ ICT perceived competence and their digital reading performance.
As for the direct effects, the coefficients for the within-school are significantly positive for all countries/regions, ranging from 3.2808 to 19.8346 (see Table 5). The between-school coefficients were significantly positive for 22 out of 29 countries/regions, ranging from 35.1991 to 110.1892 (see Supplementary Files Table S62).
Within-School Indirect Effects of ICT Perceived Competence on Digital Reading Performance and the Effect Size.
Note. Confidence intervals that contain zero are deemed nonsignificant. The significant indirect effects are highlighted in bold.
Discussion
This study aimed to investigate the relationship between adolescents’ ICT perceived competence and their digital reading performance and to examine the extent to which this relationship was mediated by three types of ICT use, including ICT use at home for leisure, ICT use at home for schoolwork, and ICT use at school. Accordingly, three research questions were addressed.
The Total Effects of ICT Perceived Competence
Research question 1 explored the relationship between ICT perceived competence and adolescents’ digital reading performance. This study revealed a significantly positive correlation between ICT perceived competence and digital reading performance in the vast majority of the sample, i.e., 27 out of 29 countries/regions. Theoretically, such a finding is congruent with the ICT engagement model (Goldhammer et al., 2016), which proposed that high ICT perceived competence might improve performance in learning tasks involving ICT use, in this case, reading activities via digital platforms. Empirically, the positive results were in alignment with the studies of Hu et al. (2018), Lim and Jung (2019), and Naumann and Saelzer (2017), all of which revealed better digital reading performance among the students who perceived themselves as competent in using ICT than those who were less confident in using digital devices or solving problems with computers, etc.
The finding that a higher level of ICT perceived competence might generate better digital reading performance could be explained in two ways. First, a substantial number of studies have revealed that perceiving oneself as competent in performing ICT-related tasks is predictive of performance in ICT tasks (e.g., Christoph et al., 2015; Hatlevik et al., 2015; Naumann & Saelzer, 2017; Senkbeil, 2022). Moreover, the mastery of basic ICT skills such as using hyperlinks or other navigation tools is indispensable for successful digital reading (OECD, 2019c) because students will frequently encounter these features while reading on digital devices. Thus, ICT perceived competence might foster digital reading performance by improving ICT-related task performance. Second, students perceiving themselves to be ICT competent might be less anxious in the PISA digital reading assessment environment, enabling them to be more focused on the reading task itself than on the test environment. A study of computer-based science assessment in the PISA 2000 in the U.S.A. (Papanastasiou et al., 2003) indicated that students with computer anxiety might be overwhelmed by their anxiety and the unfamiliar technology and thus be less focused on the computer-based task itself. A similar phenomenon was found in higher education, as the study of Deutsch et al. (2012) suggested that students’ academic performance in computer-based assessment might vary for students with different perceptions of their computer skills. Such impacts, however, might be mitigated by acquainting the students with the computer-based test-taking environment.
The Mediating Effects of ICT Use
Research question 2 explored whether and to which extent the effects of ICT perceived competence on adolescents’ digital reading performance were mediated by the frequency of three types of ICT use. The effect sizes of the within-school indirect effects indicated that mediation did exist and that a large proportion of the effect of ICT perceived competence on digital reading performance was mediated through ICT use. A closer investigation shows that using ICT at home for leisure, at home for schoolwork, and at school all significantly mediates the effects of ICT perceived competence on digital reading performance for most countries/regions.
Furthermore, a special type of mediating effect, the suppression effect, was detected in the present study. While adolescents considering themselves as competent in performing ICT-related tasks were more likely to perform better in the digital reading assessment, when the effects of ICT use on digital reading performance were considered simultaneously, the positive effects of ICT perceived competence tended to decrease. In other words, the positive effects of ICT perceived competence were offset by particular types of ICT use. While a higher level of ICT perceived competence led to frequent use of ICT, particular types of ICT use, especially ICT use outside of school for schoolwork and ICT use at school in general, in contrast, were found to result in poorer digital reading performance. This paradox could be explained by two reasons. First, the negative relationship between these types of ICT uses and digital reading performance are consistent with previous findings (e.g., Hu et al., 2018; Petko et al., 2017; Skryabin et al., 2015; Xiao et al., 2019; Zhu & Mok, 2020). Second, although students who are more confident in their ICT skills might be more active in engaging in ICT-related activities, students might unconsciously inflate their ICT abilities (Aesaert et al., 2017). Such overestimation indicates that actually, students might not fully master the ICT skills for digital reading (OECD, 2019c), which leads to poor digital reading performance.
Cross-Cultural Comparison
The present study answered research question three by revealing that the total effects of ICT perceived competence on adolescents’ digital reading performance were consistently positive for the vast majority of the sample, i.e., 27 out of 29 countries/regions. With respect to Japan and Korea, which showed nonsignificant results, one possible reason is that cultural differences do exist in the relationship between ICT perceived competence and digital reading performance. Such a finding partly resonates with the findings of Meng and partners (2019), which suggested that ICT perceived competence, as a characteristic construct of students’ self-concepts, was culturally specific. Specifically, since students in Eastern cultures tend to nurture dispositions that pursue modesty and in-depth knowledge exploration (Schutte, 2015), they were found to have better academic performance than students in Western countries, even though they did not perceive themselves to be competent (Liu & Meng, 2010). It is recommended that more studies be conducted in the future to explore this cultural difference in digital reading performance.
In addition, the results showed that the suppression effects of using ICT at home for academic purposes and using ICT at school were highly consistent for all of the countries/regions, with significant indirect effects, suggesting that the present study revealed an influential pattern with considerable generalizability. The mediating effects of using ICT at home for recreational purposes in the relationship between ICT perceived competence and digital reading performance were positive for 10 countries/regions and negative for 4 countries/regions. Such mixed results have already been shown in previous studies (e.g., Hu et al., 2018; Petko et al., 2017; Skryabin et al., 2015; Xiao et al., 2019) and the varying relationship might be due to different study samples and the relevant cultural differences.
Educational Implications
These findings have several pedagogical implications for improving digital reading education for adolescents. First, this study confirmed that when adolescents differ greatly in their self-perceived competence in using ICT, such differences may further deepen the achievement gaps in digital reading. Thus, appropriate steps need to be taken at school and at home to enhance students’ confidence in their ICT competence. On the one hand, schools are recommended to build a competence-supportive environment, for instance, to give positive feedback (Deci & Ryan, 2000), which could help satisfy students’ basic psychological needs for competence (Areepattamannil & Santos, 2019). Moreover, providing more quality-oriented support for technology-integrated instruction at school are likely to strengthen the positive effects of ICT perceived competence on students’ digital reading performance (Xiao & Hew, 2022). On the other hand, positive attitudes can derive from school use as well as from home use (Petko et al., 2017). Since students’ ICT use at home, either for recreational or academic purposes, might impact how well they develop their digital reading skills, parents’ support is also deemed helpful for the cultivation of ICT perceived competence at home. To improve adolescents’ digital reading performance through facilitating ICT perceived competence, students’ significant others, such as teachers and parents, are encouraged to be aware of students’ psychological needs of recognition from seniors and provide affirmative remarks constantly (Park, 2011).
Second, the current study, demonstrating the suppression effects, newly found that to improve digital reading performance simply boosting ICT perceived competence is not enough. Instead, the underlying effects of ICT use need cautious treatment. It is suggested that students with a high level of ICT perceived competence be encouraged to use ICT at home for leisure more frequently, as more frequent use was found to be positively correlated with digital reading performance, in line with previous studies (Hu et al., 2018; Skryabin et al., 2015; Srijamdee & Pholphirul, 2020). In contrast, further studies could explore the reasons for the negative effects of ICT use at home for schoolwork and ICT use at school to develop relevant measures to counteract such effects. For instance, efforts could be made to monitor students’ use of ICT (e.g., Holte, Giesen, & Ferraro, 2021; Tomte & Hatlevik, 2011), special attention is suggested to be paid to various ICT-based communication modes (Yu & Hu, 2022), the use of digital technology in classrooms need to be carefully “orchestrated” (Petko et al., 2017), and parents are suggested to guide students’ ICT use at home (Steinfeld, 2021). In this way, the positive relationship between ICT perceived competence and digital reading performance could be maximized. Overall, by exploring the relationship between ICT perceived competence and digital reading performance and the mediating role of ICT use, this study suggested that when striving to help adolescents perform better in digital reading, it is appropriate ICT use driven by a high-level perception of competence that matters.
Conclusions
Amid the post-COVID-19 era which witnesses more frequent ICT use and digital reading activities, this study investigated the relationship between ICT perceived competence and adolescents’ digital reading performance and the mediating effects of the frequency of three kinds of ICT use by conducting multilevel mediation analyses for 29 OECD countries/regions in the PISA 2018 computer-based reading assessment, encompassing 199,646 15-year-old students. The study revealed a significantly positive correlation between ICT perceived competence and adolescents’ digital reading performance for the vast majority of the countries/regions. Moreover, mediation did exist and a large proportion of the effect of ICT perceived competence on digital reading performance was mediated through the three types of ICT use, i.e., ICT use at home for leisure, ICT use at home for schoolwork, and ICT use at school. Specifically, one new finding is the “suppression effects” for a large proportion of the sample, suggesting that merely encouraging students to perceive themselves as competent in ICT tasks is not enough to improve digital reading performance; instead, it is appropriate ICT use driven by high ICT perceived competence that counts.
This study makes some contributions to the educational community especially the research field of digital reading. First, it adds to previous findings on the relationship between students’ ICT perceived competence and digital reading performance by providing comprehensive evidence utilizing updated data from a relatively large sample and revealing cross-cultural commonalities and disparities. Second, this study offers an in-depth exploration of the underlying mechanism of how the self-perception of ICT competence related to digital reading performance by examining the interrelation between the ICT perceived competence and ICT use. Third, the empirical findings of this study provide additional corroboration for existing theoretical models, including the SDT (Deci & Ryan, 2000) and the ICT engagement model (Goldhammer et al., 2016), which proposed a positive link between perceived competence and learning outcomes. Moreover, the findings build on SDT and delve deeper to link psychological and behavioral factors by showing that the effects of ICT perceived competence on digital reading performance are transmitted through ICT use in several settings and for various purposes. Last, based on large-scale quality data and multidimensional variables, the results might provide thorough insights to provoke efficient educational practices involving the use of ICT (e.g., Teo et al., 2019; Yang et al., 2022), especially in the post-COVID-19 era when ICT users and digital readers will be on the rise.
The limitations of this study are expected to inspire future studies. First, since this study focused on a particular psychological factor, ICT perceived competence, other factors at the cognitive-motivational level of the ICT engagement model, such as ICT interest and ICT perceived autonomy can be studied in the future. Second, although this study helps further the understanding of the underlying mechanism of the relationship between ICT perceived competence and digital reading performance, future researchers could search for other potential mediators, such as intrinsic motivation (Deci & Ryan, 2000), which could help build a more comprehensive model of the influential pattern supported by empirical findings.
Supplemental Material
Supplemental Material - The Relationship Between ICT Perceived Competence and Adolescents’ Digital Reading Performance: A Multilevel Mediation Study
Supplemental Material for The Relationship Between ICT Perceived Competence and Adolescents’ Digital Reading Performance: A Multilevel Mediation Study by Rushi Yu, Meishu Wang, and Jie Hu in Journal of Educational Computing Research
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Social Science Fund of China, “Construction and Research on the Multidimensional Evaluation of the Database of Chinese Second Language Students’ Reading Literacy” [grant number: 21BYY024].
Data Accessibility
Supplemental Material
Supplemental material for this article is available online.
Author Biographies
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
