Abstract
BACKGROUND:
Family involvement during the transition process is crucial. However, culturally and linguistically diverse (CLD) families report barriers to effective transition planning related to cultural misunderstandings with educators. Professionals need to be culturally competent when interacting with CLD families and youth.
OBJECTIVE:
The objective was to revise a CLD Transition Knowledge and Skills (CLDTKS) Evaluation Instrument and have special educators use the instrument to evaluate the levels of CLD transition knowledge and skills of their colleagues.
METHODS:
The CLDTKS Evaluation Instrument was revised following expert review. Participants included 206 special educators. Exploratory factor analysis was used to explore the factor structure of the instrument. Structural equation modeling was used to test construct validity, and confirmatory factor analyses were performed. Means were computed for all factors.
RESULTS:
The CLDTKS Evaluation Instrument consisted of four scales: Cultural Characteristics Related to Active Family Involvement, Family Norms and Communication Styles, Individualized Education Program (IEP) Meetings and Transition Policies, and Family Legal Status and Associated Prejudice. For all factors, there was a lower mean on skills than on knowledge.
CONCLUSIONS:
The CLDTKS Evaluation Instrument is a valid and reliable measure for evaluating transition knowledge and skills related to working with CLD youth and families, and it can be used for research and professional development needs.
Introduction
Much has been written and published over the past several decades attempting to explain the poorer transition outcomes of culturally and linguistically diverse (CLD) youth with disabilities, with a particular emphasis on the role of the family because family involvement during the transition process has long been recognized as crucial to a child’s post-school success (Kohler, 1996; Kohler et al., 2016; Landmark et al., 2010). Numerous authors have interviewed CLD families and/or commented about the challenges these families face during the transition planning process and transition years. CLD parents report a lack of culturally responsive communication from professionals during the transition assessment and planning process (Achola & Greene, 2016; Barrera & Corso, 2003; Gil-Kashiwabara et al., 2007; Greene, 2014; Kalyanpur & Harry, 2012; Kim & Morningstar, 2005; Landmark et al., 2007; Pewewardy & Fitzpatrick, 2009; Povenmire-Kirk et al., 2010; Yamamoto & Black, 2015), and they feel school personnel exhibit poor attitudes and stereotypes toward CLD families and youth with disabilities (Gil-Kashiwabara, 2012). CLD families have reported experiencing contextual and institutional barriers including poverty, stress, and lack of legal knowledge and information regarding the transition planning process (Geenen et al., 2005; Landmark et al., 2007). Additionally, CLD parents have reported differences in CLD family attitudes, norms, and values related to transition of their child to adulthood (Kalyanpur & Harry, 1999; Lai & Ishiyama, 2004).
Despite the research on the aforementioned challenges of collaborating with school personnel, youth with disabilities from CLD groups continue to have poorer transition outcomes compared to their European American peers (referred to as “White” peers in the National Longitudinal Transition Study-1 and -2; Blackorby & Wagner, 1996; Newman et al., 2009; Sanford et al., 2011). Specifically, African American, Hispanic, and Native American individuals with disabilities were found to be less likely to graduate from high school (Johnson, 2008), and African American young adults with disabilities were found to be less likely to be employed and live independently after high school compared to their European American peers with disabilities (Newman et al., 2009; Sanford et al., 2011). Finally, African American students were suspended or expelled at rates higher than Hispanic or European American students, thus negatively affecting African American students’ school completion and post-school transition outcomes (Porowski et al., 2014).
Special educators are typically responsible for planning and facilitating the transition from school to adult environments for students with disabilities (Morningstar & Clavenna-Deane, 2014), and special educators are predominantly White, female, and middle class (Institute for Education Sciences, 2013). Because transition services in the Individuals with Disabilities Education Improvement Act (IDEIA, 2004) is grounded in individualistic, Western-assumptions, it is important for special education teachers to be culturally competent when interacting with CLD families and youth with disabilities during the transition planning process, especially because the families and youth may not subscribe to IDEIA’s individualistic ideals (Leake et al., 2003/04). By engaging in culturally competent transition planning, as opposed to the more traditional transition planning approach, better transition outcomes for CLD youth may occur (Achola & Greene, 2016). Lynch and Hanson (2011) identified five critical aspects of cultural competence for optimizing communication with CLD individuals: (a) an awareness of one’s own cultural limitations; (b) openness, appreciation, and respect for cultural differences; (c) a view of intercultural interactions as a learning opportunity; (d) the ability to use cultural resources in interventions; and (e) acknowledgement of the integrity and values of all cultures.
Additionally, there is a need for researchers and policymakers to be able to determine the level of cultural competence in special educators who are assisting and guiding CLD families and youth with disabilities during the transition planning process. Most preservice special education teacher preparation programs do not provide adequate levels of training needed to effectively plan and deliver transition services to transition-aged students with disabilities in general (Anderson, 2003; Benitez et al., 2009), let alone to CLD students with disabilities. Because university teacher preparation programs are driven by federal and state policies and priorities, it is important to be able to evaluate special education teachers’ cultural competence for working with CLD families so policymakers can be informed of additional needs in their states (Morningstar & Clavenna-Deane, 2014). Culturally responsive transition planning has been identified as an important emerging competency area for transition specialists (Morningstar & Nix, 2012, as cited in Morningstar & Clavenna-Deane, 2014; Povenmire-Kirk et al., 2015). It is not enough for practitioners to simply possess knowledge about various CLD groups; they must also possess specific skills to effectively collaborate with CLD families during transition planning.
A number of authors have analyzed and discussed existing instruments and tools for measuring cultural competence in teachers (see Bustamante et al., 2016; Byrd & Olivieri, 2014; Center for Research on Learning and Teaching, 2016; Patel, 2017; Ramos et al., 2015). Examples of constructs measured in individuals who complete these various instruments include the following: cultural self-awareness, verbal and nonverbal communication strategies, attitudes and beliefs about other cultures, global perspectives, intercultural sensitivity and competence, and knowledge of cultural worldview frameworks. Some of the instruments measure both intercultural knowledge and skills in teacher respondents. However, none of these instruments were specifically designed evaluating special education teachers with a focus on the context of transition planning with CLD families and youth with disabilities. Because planning for a student’s future is culturally-dependent, it is vital special educators possess the knowledge and skills necessary to engage in culturally sensitive transition planning with the student and their family.
With these concerns in mind, the CLD Transition Knowledge and Skills (CLDTKS) Evaluation Instrument was designed to evaluate the quality of cultural competence, knowledge, and skills in special educators and transition personnel involved in transition planning with CLD families and youth with disabilities. The original version of the instrument was published in a book by Greene (2011) entitled Transition Planning for Culturally and Linguistically Diverse Youth. The structure and specific items on the instrument were based on three constructs that were derived from published literature on the topic of cultural competence in special educators. These constructs included (a) general characteristics of cultural and linguistic diversity (see publications by Barrera & Corso, 2003; Brandon, 2007; Brandon & Brown, 2009; Garcia et al., 2010; Harry, 1992 & 2008; Harry et al., 1995; Kalyanpur & Harry, 1997 & 1999, Lai & Ishiyama, 2004; Leake & Boone, 2007; Locust, 1988 & 1994; Lynch & Hanson, 2011; Pewardy & Fitzpatrick, 2009; and Zionts et al., 2003; b) quality of transition planning meeting practices with CLD family members (see publications by Geenan et al., 2003; Gil-Kashiwabara et al., 2007; Greene, 1996; Landmark et al., 2007; Leake & Black, 2005; Kim & Morningstar, 2005; Povenmire-Kirk et al., 2010; Rueda et al., 2005; Trainor, 2007; Valenzuela & Martin, 2005); and (c) quality for promoting CLD family knowledge of school or transition agency policies, practices, and procedures (see publications by Barrera & Corso, 2003; Blue-Banning et al., 2004; Brandon, 2007; Brandon & Brown, 2009; Greene, 1996; Harry, 1992 & 2008; Harry et al., 1995; Inger, 1992; Kalyanpur & Harry, 1997 & 1999; Kim & Morningstar, 2005; Lai & Ishiyama, 2004; Landmark et al., 2007; Liontos, 1991; Lynch & Hanson, 2011; Olivos, 2009; Pewardy & Fitzpatrick, 2009).
The original CLDTKS Evaluation Instrument was not designed to be a self-evaluation instrument. Rather, it was designed to be used by supervisory personnel to evaluate these capabilities in transition services personnel in their school districts or agencies. The instructions stated that the purpose of the survey was:
to determine the degree to which transition services personnel within your school or agency possess knowledge (i.e., awareness, information, understanding) and skills (ability to design, create, implement in practice) to effectively collaborate with culturally and linguistically diverse (CLD) families in the transition planning process for youth with disabilities. (Greene, 2011, Chapter 2 Appendix)
The rationale for designing the instrument as an evaluation tool versus a self-rating instrument was so schools and transition agency supervisory personnel could use the instrument to obtain data that could help them design targeted staff development on effectively collaborating with CLD families in the transition planning process.
When the CLDTKS Evaluation Instrument was published, it had not undergone field-testing for validity and reliability, nor had a study been conducted investigating the usefulness of the instrument. With these thoughts in mind, the purposes of this preliminary study were to (a) conduct an expert panel review of the CLDTKS Evaluation Instrument for content validity, (b) determine construct validity and reliability of the instrument, (c) revise the original instrument if needed, and (d) administer the survey to a sample group of secondary special educators and transition personnel. Our research questions were (a) To what extent is the CLDTKS Evaluation Instrument a valid and reliable measure of transition knowledge and skills in special education and transition personnel engaged in transition planning with CLD youth and families? and (b) What do special education and transition personnel perceive to be the level of knowledge and skills in their colleagues who work with CLD youth and their families, and is there a perceived gap between their colleagues’ levels of CLD transition knowledge and skills?
Method
Participants
A total of 314 secondary special education practitioners started the survey and 206 completed the survey, reflecting a 65.6% completion rate. Among the participants, 86.4% (n = 178) were females, 12.6% (n = 26) were males, less than 1% (n = 1) were transgender, and less than 1% (n = 1) did not report. The ethnicities of the participants included Caucasians (82.5%, n = 170), African Americans (4.4%, n = 9), Hispanics (2.4%, n = 5), American Indian or Alaska Native or Asian (2%, n = 4), those with two or more ethnicities (4.9%, n = 10), and seven participants (3.4%) who declined to state their ethnicity. The average years of experience working in special education was 18.02 years (SD = 15.32), and the average age was 47.19 years (ranged from 23– 70 years, SD = 10.77). Of the 197 participants who reported their highest degree level, 17.8% (n = 35) had a bachelor’s degree, 68.5% (n = 135) had a master’s degree, and 13.7% (n = 27) had a doctoral degree. Participants were from 31 states that covered all the regions in the nation, such as 28.6% (n = 59) from the Midwest, 9% (n = 19) from the Northeast, 8.7% (n = 18) from the Southeast, 41.7% (n = 86) from the Southwest, 10.7% (n = 22) from the West, and less than 1% (n = 2) unknown.
Instrument
The original CLDTKS Evaluation Instrument (see Greene, 2011) consisted of four sections: general characteristics of CLD; quality of transition planning meeting practices; quality for promoting CLD family knowledge of school or transition agency policies, practices, and procedures; and additional comments. Much of the content of the original CLDTKS Evaluation Instrument was based on recommended evidence-based instructional strategies for transition (Test, 2011) and Kohler’s Taxonomy for Transition Programming (Kohler, 1996; Kohler et al., 2016), with a focus on research on transition planning with CLD students and families (e.g., Geenen et al., 2005; Kim & Morningstar 2005; Landmark et al., 2010). The concepts included in the original instrument were chosen for a couple reasons. First, because special education is rooted in the medical model of disability and focuses on deficits, special educators need to have cultural competence to ensure positive and meaningful collaboration during transition planning with students and families of other cultures than the educator’s culture. Second, transition services as defined by the IDEA assume a Western, Eurocentric perspective. Special educators are to help students prepare for further education, employment, and independent living regardless of the family’s desires for the student, which may be influenced greatly by the family’s culture and views of disability.
Each section of the original instrument included a preface explaining key concepts. For example, in the section on general characteristics of CLD, there were examples of CLD family values, beliefs, and practices because there were questions about the knowledge and skills secondary special education and transition personnel possess regarding CLD family values, beliefs, and practices. Within the first sections of the instrument, there were a total of fifteen items participants could rate the knowledge and skills levels of special education and transition personnel in their school or agency for each of the items. Thus, for each item, participants needed to make two determinations: one for the degree to which they felt special education and transition personnel possessed knowledge and one for the degree to which they felt these individuals possessed skills.
The revised instrument, after expert review, consisted of demographic questions, 31 knowledge items, and 31 corresponding skill items. The concepts measured in the sections of the revised instrument included general characteristics of cultural and linguistic diversity; quality of meeting practices; and quality of promoting CLD family knowledge of transition polices, practices, and procedures. The general characteristics of cultural and linguistic diversity section included sub-sections on CLD family integration and acculturation status, CLD family attitudes and beliefs related to disabilities, CLD family interpersonal communication style, CLD family structure and norms, CLD family involvement in planning for adulthood, and CLD family experiences with prejudice and discrimination.
Procedures
Expert review of the instrument
To gauge the content validity of the original CLDTKS Evaluation Instrument and revise the CLDTKS Evaluation Instrument if needed, we solicited the feedback of a group of experts. The expert group was devised by searching the ERIC database for authors of publications that addressed at least two of the following topics: secondary transition, family or parent involvement, and cultural and/or linguistic diversity. We tallied the number of publications of the authors who published in at least two of these areas. Sixteen researchers who had at least three publications in the targeted topic areas were identified and invited to participate as expert reviewers, and ten researchers agreed to participate. There were two phases of expert review. After the first review, the instrument was revised and sent back to the expert group for a second review. After the second review, we did not send the revised instrument back to the expert group.
Data collection
Secondary special education teachers and transition specialists were invited via a convenience sampling method followed by snowball sampling. First, we contacted transition professionals across the US with whom we had professional relationships (e.g., professionals that one of the authors provided consultation services on transition issues, previous school district and higher education colleagues, professionals at the authors’ state education service centers). Second, we emailed attendees of the 2014 Council for Exceptional Children Division on Career Development and Transition (DCDT) conference. Third, we contacted the regional and state DCDT subdivisions (subdivisions: Northeast, Northwest, Southeast, Southwest; states: Florida, New York, North Carolina, Texas, Virginia). Finally, we posted a link to the survey instrument on the Council for Exceptional Children’s Community Forum and passed out flyers at the 2015 Council for Exceptional Children convention. We subsequently asked each group of individuals to complete the survey themselves and then forward the instrument to their contacts who work in secondary special education.
Participants completed the survey online through Qualtrics. The beginning of the survey presented the purpose of the study and a definition of CLD by Barrera and Corso (2003). The first section of the survey gathered demographic information. The knowledge and skills sections of the survey followed. Each of the 31 knowledge questions was presented immediately before its corresponding skills question, for a total of 62 questions to be answered by the participants. Participants rated their colleagues’ knowledge and skills using a Likert-like scale (i.e., inadequate, needs improvement, undecided, good, excellent).
Data analysis
The analyses are conducted to address two aforementioned research questions. First, we examined the validity and reliability of the CLDTK Evaluation Instrument and identified the same factor structures between CLD transition knowledge and skills, so we could compare them. Second, we compared the mean differences between the factors of transition knowledge and skills in order to detect perceived gaps between the two.
To explore the factor structure of the instrument itself, we first conducted an exploratory factor analysis (EFA) on the knowledge items. Parallel analysis (Velicer, 1976), which is a Monte Carlo simulation technique and has been recommended by methodological researchers (Henson & Roberts, 2006), was used to determine the number of factors based on the mean eigenvalue criterion; and the factors were extracted using principal axis factoring. To test the construct validity of the assessment, we utilized structural equation modeling (SEM) methodology. A series of confirmatory factor analyses (CFAs) were then performed to examine whether the measurement structure was comparable for the knowledge items and for the skills items (i.e., whether measurement items for knowledge are aligned with those for skills). Specifically, in order to identify any discrepancies between knowledge and skills among our participants, we first examined measurement invariance (specifically factorial invariance for CFA) between the knowledge items and the skills items to obtain meaningful comparisons of the latent factor means (Meredith, 1993; Millsap, 2011). In the second stage of factorial invariance testing, we fitted a metric invariance model, where the factor loadings of the items were constrained to be equal across knowledge and skills. In the final stage, we fitted a scalar invariance model where the measurement intercepts of the items were constrained to be equal. Through this approach, a measurement model for both knowledge and skills in the same structure was tested and validated.
As 45 out of 206 participants did not provide a response on at least one of the knowledge items, we handled data with full information maximum likelihood (i.e., missing data was treated within the analysis model without imputation or replacement) for the EFA and the CFA analyses, using age, gender, and educational level as auxiliary variables (Graham, 2003). All CFA models were fitted in Mplus 7.11, and model fit was deemed adequate with the comparative fit index (CFI)≥0.90, the root mean square error of approximation (RMSEA)≤0.06, and the standardized root mean squared residual≤0.08 (e.g., Hu & Bentler, 1999; Marsh, Hau, & Wen, 2004). Given that the knowledge and skills items were on a 5-point scale and the normality assumption for the analyses might not be fully met, we used the MLR estimator in Mplus to obtain robust χ2 statistic and standard errors of the parameter estimates.
Measurement invariance warrants the same construct is being measured between CLD transition knowledge and skills. The reliability and validity tests of the instrument indicated the test results are reliable and the interpretations of the results are warranted. After the constructs had been validated, means of retained items were calculated for each scale and used as the composite score. Mean differences and effect sizes were calculated for each scale based on composite scores.
Results
Validity and reliability of CLDTKS instrument
The EFA results with parallel analysis suggested a four factor model would be most appropriate for the data. For exploratory purposes, we used 0.30 as cutoff for standardized factor loadings. Then we conducted a series of CFAs to explore whether the same factor structure could be observed for the knowledge items and for the skill items. First, we fitted a confirmatory eight-factor measurement model (i.e., a baseline model), with the same assignment of items to factors as previously designed on both knowledge items and skills items. The baseline model did not show adequate fit, χ2(df = 1770, N = 206) = 3138.96, p < 0.001, RMSEA = 0.058, 90% CI [0.055, 0.061], CFI = 0.851, SRMR = 0.070. Consulting modification indices in a stepwise manner, we dropped items that had large loadings on more than one latent factor. If a knowledge item was dropped, the corresponding skill item was also dropped. This results in 25 total items for both knowledge and skills. We also freed the unique factor covariances between four pairs of items and across knowledge and skills. The resulting model showed acceptable fit with χ2(df = 1106, N = 206) = 1731.99, p < 0.001, RMSEA = 0.050, 90% CI [0.045, 0.054], CFI = 0.911, SRMR = 0.064. All factor loadings were statistically significant (p < 0.001) with standardized coefficients between 0.54 and 0.87.
After we identified a fitted model, we further tested whether constructs for knowledge and skills are the same. We tested metric invariance by constraining the factor loadings to be equal across knowledge and skills. The metric invariance model showed adequate fit with χ2(df = 1127, N = 206) = 1763.38, p < 0.001, RMSEA = 0.050, 90% CI [0.045, 0.054], CFI = 0.909, SRMR = 0.067. Comparing the metric invariance model with the previous configural invariance model, we had ΔCFI = 0.002 and ΔMNCI = 0.006, which were smaller than any of the cutoff values suggested by Cheung and Rensvold (2002), Kang et al. (2015), and Meade et al. (2008). The result suggested that metric invariance held for the data. Therefore, the CLDTKS instrument held the same factor structure for both knowledge and skills.
As a final step, in order to compare factor means between knowledge and skills, at least partial scalar invariance is needed (Millsap & Kwok, 2004). Therefore, we fitted a scalar invariance model with all the measurement intercepts constrained to be equal across knowledge and skills. The full scalar invariance model fitted the data relatively less well, with χ2(df = 1148, N = 206) = 1891.68, p < 0.001, RMSEA = 0.053, 90% CI [0.049, 0.057], CFI = 0.894, SRMR = 0.070. We followed the approach suggested by Yoon and Millsap (2007) to locate non-invariant items using modification indices in a stepwise manner to improve the partial scalar invariance model, with χ2(df = 1143, N = 206) = 1796.24, p < 0.001, RMSEA = 0.050, 90% CI [0.045, 0.054], CFI = 0.907, SRMR = 0.067. Comparing the partial scalar invariance model with the previous metric invariance model, we had ΔCFI = 0.002 and ΔMNCI = 0.009. Therefore, the result suggested that scalar invariance held for 20 out of 25 items, which allows us to compare the means between measurements of knowledge and skills. The coefficients for the partial scalar invariance model are shown in Table 1. Internal consistency reliability was examined for each construct and measured by Cronbach’s alpha (see Table 1), which ranged from 0.81 to 0.92.
Factor Loadings and Reliabilities
Factor Loadings and Reliabilities
Note: F1 = Cultural Characteristics Related to Active Family Involvement; F2 = CLD Family Norms and Communication Styles; F3 = IEP Meetings and Transition Policies; F4 = CLD Family Legal Status and Associated Prejudice.
The final knowledge and skills factors consisted of four scales (see Table 2 for item descriptions for each of the scales) including Cultural Characteristics Related to Active Family Involvement (F1, seven items), CLD Family Norms and Communication Styles (F2, seven items), Individualized Education Program (IEP) Meetings and Transition Policies (F3, seven items), and CLD Family Legal Status and Associated Prejudice (F4, four items). The means of and the interrelationships between knowledge and skills are presented in Table 3. CLD Family Legal Status and Associated Prejudice (F4) received the highest average ratings (knowledge: M = 3.78, SD = 0.15; skills: M = 3.61, SD = 0.29), while Cultural Characteristics Related to Active Family Involvement (F1) received the lowest average ratings (knowledge: M = 3.27, SD = 0.19; skills: M = 3.17, SD = 0.30), which means participants reported their personnel having lower knowledge and skills in the area of Cultural Characteristics Related to Active Family Involvement and having the most knowledge and skills in the area of CLD Family Legal Status and Associated Prejudice.
Finalized Scales and Item Descriptions for Knowledge and Skills
Finalized Scales and Item Descriptions for Knowledge and Skills
Note: 1 = Cultural Characteristics Related to Active Family Involvement (Factor 1); 2 = CLD Family Norms and Communication Styles (Factor 2); 3 = IEP Meetings and Transition Policies (Factor 3); CLD Family Legal Status and Associated Prejudice (Factor 4).
Interrelationships Between Knowledge and Skills
Note: F = Factor; K = Knowledge; S = Skills.
We compared mean differences on the four latent factors between knowledge and skills. For all four factors we observed a lower mean on skills than on knowledge, with a small mean difference of 0.08 on Cultural Characteristics Related to Active Family Involvement (F1, p < 0.01, Cohen’s d = 0.08), a medium difference of 0.31 on CLD Family Norms and Communication Styles (F2, p < 0.001, d = 0.31), a medium mean difference of 0.20 on IEP Meetings and Transition Policies (F3, p < 0.001, d = 0.19), and a statistically non-significant difference of 0.06 on CLD Family Legal Status and Associated Prejudice (F4, p = 0.29, d = 0.06). The results suggested there is a small gap between knowledge and skills in the area of Cultural Characteristics Related to Active Family Involvement (F1), larger gaps between knowledge and skills in the areas of CLD Family Norms and Communication Styles (F2) and IEP Meetings and Transition Policies (F3), and no gap in the area of CLD Family Legal Status and Associated Prejudice (F4).
Discussion
The purposes of this study were to improve a CLDTKS Evaluation Instrument and collect preliminary data focused on evaluating the levels of CLD transition knowledge and skills of special education and transition personnel. Our primary research questions addressed the extent to which the CLDTKS Evaluation Instrument was a valid and reliable measure for evaluating transition knowledge and skills related to working with CLD youth and families and investigated the peer-rated levels of transition knowledge and skills of special education and transition personnel who work with CLD youth and families. This study extends the research base by providing a CLDTKS Evaluation Instrument that can be used for research and professional development needs and by presenting preliminary data obtained from administering the instrument.
Validity and reliability of CLDTKS evaluation instrument
After revision of the CLDTKS Evaluation Instrument based upon expert reviews of the instrument and statistical analyses, the final instrument consisted of four factors comprised of 25 knowledge and 25 skill item statements that held the same item constructs for both knowledge and skills. For each knowledge level statement item on the instrument, there was a corresponding skill level statement item. The four factors of the instrument were Cultural Characteristics Related to Active Family Involvement (F1), CLD Family Norms and Communication Styles (F2), IEP Meetings and Transition Policies (F3), and CLD Family Legal Status and Associated Prejudice (F4).
Knowledge and skills of transition personnel
Participants rated the knowledge and skills of secondary special education and transition personnel in their schools or agencies. The knowledge levels of the factors were ranked in the same order as the skills levels of the factors. None of the means of the knowledge or skills of the four factors was in the excellent range. Indeed, the means indicated knowledge and skills of transition personnel were between undecided and good. The most knowledge and skills were reported for CLD Family Legal Status and Associated Prejudice (F4). Thus, participants reported that secondary special education transition personnel in their school or agency were most knowledgeable and skilled regarding immigration statuses, different family configurations (e.g., single parent, same sex), and personal and institutional racism of their students’ families. Initially, this finding seems to be in contrast to Povenmire-Kirk et al.’s (2010) study in which Latino youth with disabilities, their families, and special education teachers reported the concerns and difficulties surrounding documentation issues and transition planning. However, although the knowledge and skills levels of CLD Family Legal Status and Associated Prejudice (F4) were the highest among the factors, the mean scores were not very high.
The least knowledge and skills were reported for Cultural Characteristics Related to Active Family Involvement (F1). Participants reported that secondary special education and transition personnel in their school or agency were the least knowledgeable and least skilled regarding CLD family values, beliefs, and practices pertinent to transition planning; cultural identification; and cultural perceptions of disability. This finding is consistent with what African American parents in Zionts et al. (2003) study reported regarding a greater need for cultural understanding by their children’s special educators and with what most of the Latino families and their students’ special education teachers in Povenmire-Kirk et al.’s (2010) study conveyed regarding culturally-biased services.
Gaps between knowledge and skills
As we hypothesized, the levels of skills for all of the factors were lower than the levels of knowledge for all of the factors. However, the gap between knowledge and skills for CLD Family Legal Status and Associated Prejudice (F4) was not statistically significant. Cultural Characteristics Related to Active Family Involvement (F1) had the smallest mean difference among the statistically significant gaps between knowledge and skills of the factors. This finding may be associated with the finding that participants reported that secondary special education and transition personnel in their school or agency also had the least amount of knowledge and skills for F1. Medium mean differences between knowledge and skills related to CLD Family Norms and Communication Styles (F2) and IEP Meetings and Transition Policies (F3) indicate the transition personnel in the participants’ school or agency may have some technical knowledge needed for working with CLD youth and their families during the transition process, but still need to strengthen their skills in those areas.
Our findings are consistent with the national picture of how well secondary special educators and transition specialists are prepared in implementing transition practices. Research findings indicated that special educators were aware of whether they have adequate transition knowledge, and secondary special educators felt they were poorly prepared to implement transition practices (Anderson et al., 2003; Blanchett, 2001; Morningstar & Clavenna-Deane, 2014). A most recent national survey examined secondary special educators’ competencies to implement transition practices and revealed that special educators might not be adequately prepared in delivering effective transition services (Benitez et al, 2009). Teachers indicated that they felt the least prepared in the competency domain including items targeting multicultural competencies (Benitez et al., 2009).
Limitations
Although we systematically chose and invited experts to participate in the content validity review of the instrument, some experts declined to participate or did not participate in each round of review. Their input may have resulted in changes to the instrument that was presented to the participants. Convenience sampling was used to collect data from transition personnel, and there was a substantial incompletion rate we attributed to the length of the instrument. We do not know if the characteristics of the participants who completed the instrument are representative of the greater population of transition personnel. In addition, due to the small sample size, we used the same data for the EFA (with knowledge items) and CFA (with knowledge and skills items) to avoid having highly unstable parameter estimates (e.g., Gorsuch, 1983, suggested at least five participants per item), but with increased risk on capitalizing on chance (MacCallum et al., 1992). Future research should attempt to replicate our results on an independent sample. Finally, participants were asked to rate the knowledge and skills of special education and transition personnel in their school or agency rather than to self-rate their own knowledge and skills. This was because the original instrument was designed to be used by supervisory personnel in school districts and adult agencies to determine their constituents’ CLDTKS and use this information to identify areas of staff development on this topic. We recognize that respondents to the survey may have lacked first-hand knowledge (e.g., direct observation) that could potentially impact the veracity of the ratings of their colleagues’ CLDTKS. If participants had been instructed to self-rate their transition knowledge and skills for working with CLD students and their families, the results regarding the mean levels of knowledge and skills may have differed. Likewise, this approach would likely have provided more direct and valid results in this regard. Therefore future research involving self-ratings is clearly warranted; however, it would require revalidation of the CLDTKS Evaluation Instrument.
Implications
For practice
Although a preliminary study, the findings reiterate the need for increased CLD transition knowledge and skills for secondary special education and transition personnel (Trainor et al., 2008). Because there were lower levels of skills than knowledge in each of the factors, special attention must be made to increase skill development in additional to knowledge. As noted by Greene and Kochhar-Bryant (2003), secondary special educators indicate training on transition planning usually occurs on-the-job. Greene (2011) made a number of practical suggestions regarding professional development activities to address this issue including creating quality staff development training programs on the topic of transition of CLD youth with disabilities, creating professional learning communities in schools focused on this subject, and implementing action research projects in secondary schools designed to improve CLD transition knowledge and skills. The CLDTKS Evaluation Instrument can be useful in these endeavors because the instrument can be used for self-assessment by transition personnel, practitioner assessment by families, and/or peer assessment by school personnel as a part of a peer assistance and review (PAR) program (Darling-Hammond, 2013; Humphrey et al., 2011). The instrument could be used as a part of a PAR program designed to improve educator capacities, for pre- and post-assessment of the effectiveness of professional development activities, for self-reflection by secondary level special education and transition personnel, and for obtaining the perceptions of CLD parents.
For policy
Active family involvement appears to be a persistent problem for CLD families (Kim & Morningstar, 2005; Landmark et al., 2013). Our finding that secondary special education and transition personnel are reported to have the least knowledge and skills in the area of Cultural Characteristics Related to Active Family Involvement (F1) supports this previously identified problem. It is important for policy makers and school administrators to reinforce the legal requirement in Individuals with Disabilities Education Improvement Act (IDEIA) of 2004 that schools attempt to involve parents in their children’s transition planning, with particular attention paid to involving CLD families because active family involvement appears to be a persistent problem for CLD families (Kim & Morningstar, 2005; Landmark et al., 2013). Although one of the compliance indicators in the Effective Transition monitoring priority, Indicator 13, requires the student be invited to any IEP meeting that transition services are to be discussed, there is no specific criterion on the level of student and parental involvement during transition planning, other than being invited and taking into consideration the students’ strengths, preferences, interests, and needs. Additionally, the Every Student Succeeds Act (2015; previously the No Child Left Behind Act of 2001) requires districts and schools who receive Title I funding to have a formal, written family engagement policy detailing how the district and its schools will use at least 1% of its Title I funds to involve parents in increasing achievement of low-income or disadvantaged students. However, there is not an explicit focus on parent involvement in IEP planning, and thus, transition planning. School districts should be responsible for providing training to teachers to develop the relationships with families necessary for improving active family involvement during transition planning. Teachers must utilize multiple means to communicate with CLD parents, gain understanding of family culture characteristics, and involve parents as partners in transition planning. Additional recommendations include developing parental advocacy through programs such as parent support groups and CLD parent education workshops. Finally, because teacher preparation programs and state teacher licensure requirements are driven by federal and state policies and priorities, it is necessary to illuminate the problem of inadequate preparation needed for effectively engaging in transition planning with CLD youth and their families so that preparation programs and professional development activities have a stronger focus on transition planning for all youth with disabilities, but especially for CLD youth.
Conflict of interest
None to report.
Funding
This research was not funded by a grant.
