Abstract
Introduction
In rheumatoid arthritis, a reduction in hand function can lead to a decrease in health, with a consequent limitation of daily life activities and restriction in social participation. Evaluation plays a decisive role in the functional recovery process and in rehabilitation programs. The Jebsen–Taylor Hand Function Test is one of the most widely used non-diagnosis-specific assessment tools in rehabilitation. The aim of the study was to evaluate the intra-rater and inter-rater reliability and concurrent validity of the Italian version of the Jebsen–Taylor Hand Function Test (JTHFT-IT) in a population with rheumatoid arthritis.
Methods
The test’s reliability and validity were assessed by following international guidelines. Its internal consistency and intra- and inter-rater reliability were examined using Cronbach’s alpha coefficient and the intraclass correlation coefficient, respectively. Its concurrent validity was evaluated using Pearson’s correlation coefficient with a dynamometer instrument.
Results
The test was given to 108 people with rheumatoid arthritis. Cronbach’s alpha reported a value of 0.91 for the dominant hand and 0.87 for the non-dominant hand. Intra- and inter-rater reliability were evaluated with a subgroup of 30 individuals. Intraclass correlation coefficients ranged from 0.46 to 1.00 in the dominant and non-dominant hands. Pearson’s correlation between subtests and the dynamometer ranged from –0.14 to –0.59.
Conclusions
The present study supports the use of the JTHFT-IT as a measure of hand functionality in people with rheumatoid arthritis. It is an important tool for Italian professionals and it can be useful both in clinical practice to evaluate improvement after rehabilitation treatments and for research in hand rehabilitation.
Introduction
According to the World Health Organization, the prevalence of rheumatoid arthritis (RA) in the world is between 0.3 and 1%, with a greater presence among women and in rich countries. 1 RA most commonly affects the joints of the hands, feet, wrists, elbows, knees, and ankles. A reduction in hand function can lead to a decrease in health, with a consequent limitation of daily life activities and restriction in social participation. Hand rehabilitation is therefore of primary importance to ensure the maintenance of autonomy and independence, with the aim of achieving the highest degree of social and work integration. 2 Early diagnosis and treatment can make a difference in controlling RA and preventing deformity. Evaluation plays a decisive role in the functional recovery process and must be carried out at regular intervals throughout the treatment period in order to record progress and modify the rehabilitation program, if necessary. 2
Functional abilities depend on anatomical integrity, muscle strength, sensation, and dexterity; these elements are influenced by age, gender, and mental state.2,3 In a recent article titled “Systematic Review of Measures of Impairment and Activity Limitation for Persons With Upper Limb Trauma and Amputation,” 4 five tools were assessed as the highest rated performance measures; of these, the Jebsen–Taylor Hand Function Test (JTHFT) was one of the most widely used non-diagnosis-specific assessment tools in rehabilitation due to its simplicity, convenience, and speed of administration. The JTHFT provides objective measurement of standardized tasks relative to norms; it evaluates broad aspects of those hand functions commonly used in everyday activities, and it can be administered in a short time by using readily available materials. It was designed in 1969 by Jebsen et al. as a performance-based measure that assesses fine and manual finger dexterity through the use of seven timed subtests related to functional tasks. 5 From the perspective of the International Classification of Functioning categories, it is classified as an activity scale, as it measures changes in functional activities. 6 The JTHFT is very versatile for the assessment of the upper limb and is widely used in many countries in the world; it has been translated and validated in Australian-English, 7 Chinese, 8 Portuguese, 9 and Italian. 10 The JTHFT has also been validated for different disorders affecting the upper limbs, including hemiparesis, 9 muscular dystrophies, 11 stroke, 12 Parkinson’s disease, 13 and carpal tunnel syndrome. 14
The main advantage of the JTHFT is to provide an objective measure of hand function by employing functionally relevant tasks that have good intra- and inter-rater reliability. It was originally tested on an RA population; therefore, the aim of this study was to test the validity and reliability of the Italian version in Italian individuals with RA.
Methods
This study was conducted by a research group composed of medical doctors and rehabilitation professionals from the Sapienza University of Rome and from the Rehabilitation & Outcome Measure Assessment Association. 15
Participants
The sample was recruited from January to October 2016 in the national territory from the National Association of Rheumatic Disease and the hand surgery and rheumatology clinics of two university hospitals in Rome, Italy. The people with RA that accessed the hospital were screened and adults with a confirmed diagnosis were informed about the procedures and purposes of the study and were asked to participate. The following inclusion/exclusion criteria were applied to the eligible and interested persons: a diagnosis of RA, age over 18 years old, a primary education level at minimum, the ability to understand instructions and perform the scale activities, and a signed informed consent document.16,17 People with severe deformities or high level of pain, as determined by clinical screening, were excluded because of their inability to perform the activities of the JTHFT.
Validation procedures
Three clinicians (two occupational therapists and one physical therapist) screened all patients for their recruitment and applied the inclusion/exclusion criteria. Once enrolled, these clinicians collected demographic and clinical variables, and at the rheumatology clinics of two university hospitals in Rome, they administered the outcome measures to all patients included. The first testing session included the JTHFT-IT administration and the dynamometer measurement. After two days, a subsample was tested again by a different clinician in order to evaluate inter-rater reliability. Finally, to study the intra-rater reliability, the JTHFT-IT was re-administered after seven days in a subsample by the same assessor of the first administration. The tests were always administered in the same order: first JTHFT and then Jamar.
Instruments
The JTHFT consists of seven unilateral items that are administered using standardized procedures and verbal instructions and performed first with the non-dominant hand and then with the dominant hand. The functional tasks include writing a 24-letter, third-grade reading difficulty sentence; turning 3″ × 5″ (7.62 cm × 12.7 cm) cards in simulated page turning; picking up small common objects including pennies, paper clips, and bottle caps and placing them in a container; stacking checkers; simulated feeding; and moving light cans and heavier (1 pound) cans. The subtests are scored by recording the number of seconds required to complete each task. Increased time to complete the test is related to decreased hand function. A stopwatch was used to time the completion of each. The JTHFT-IT showed in the Italian validation on healthy population an intraclass correlation coefficient (ICC) for intra-rater reliability ranging from 0.297 to 0.715 for the dominant hand and 0.584 to 0.892 for the non-dominant hand. Normative data from the original scoring system are available for dominant and non-dominant hands. 10 In the same study, the Pearson’s test revealed a strong correlation between all items and between the items and the gold standard (Jamar dynamometer), represented by gripping force. Consistent with previous studies, the instrument used in this study was the Jamar J00105, 18 a dynamometer model that calculates the strength of the flexor muscles of the hand. When grip is measured, the arm should be at the patient’s side with elbow flexed at approximately 90° and the forearm in neutral. The wrist should be at neutral but no more than 30° of extension or 15° of ulnar deviation. When ready the patient is encouraged to squeeze the dynamometer with maximum isometric effort, which is maintained for about 5 s. This instrument is scored using force production in kilograms (0–90) or pounds (0–200).
Data analyses
The reliability of the JTHFT-IT was assessed by following international guidelines 19 in terms of internal consistency and test–retest reliability. Internal consistency was determined by calculating Cronbach’s alpha, which was considered acceptable if >0.7. Test–retest reliability was calculated by using the ICC with a 95% confidence interval. ICC values greater than 0.75 are a minimum requirement to use the instrument in group measurements. The concurrent validity of the JTHFT-IT was studied by calculating the Pearson’s correlation coefficient when comparing the JTHFT-IT with the dynamometer instruments. 18 Concurrent validity is one approach of construct validity that estimates individual performance on different tests at approximately the same time; it can tell how accurately a measurement can predict criteria or indicators of a construct in the real world. The following ranges were considered in interpreting the results: ρ > 0.70 = strong correlation, 0.50 < ρ < 0.70 = moderate correlation, and ρ < 0.50 = weak correlation.
All statistical analyses were performed using the Statistical Package for the Social Sciences (SPSS) version 20.0 for Windows. The descriptions of the variables were carried out using frequency tables, means, and standard deviations. The significance level was set as a p-value less than or equal to 0.05.
Results
Sample characteristics
For this study, 126 individuals were considered eligible by the researchers after the first screening using inclusion and exclusion criteria, of these five were excluded because they had severe deformities or a high level of pain. Out of the 121 remaining, 108 people agreed to participate and were included in this study. The demographic and clinical characteristics of the participants are reported in Table 1.
Demographic characteristics of the 108 participants in the reliability study JTHFT-IT in rheumatoid arthritis population.
Reliability and validity
The internal consistency of the JTHFT-IT, that assesses the interrelatedness of the items, was calculated with Cronbach’s alpha and showed values of 0.53 for the dominant hand and 0.46 for the non-dominant hand. From the evaluation of the weight of the items (item-total), item 1 (writing) was found to be unrelated to the others. When the first item was eliminated, Cronbach’s alpha was 0.91 for the dominant hand and 0.87 for the non-dominant hand as reported in Table 2. Intra- and inter-rater reliability were assessed in a subsample of 30 individuals. A high degree of reliability, that means a high degree of agreement among repeated administrations performed by a single rater (intra-rater) or different raters (inter-rater), was observed for the JTHFT-IT as reported in Tables 3 and 4. Taking into account the comparisons between the JTHFT-IT and the other instrument related to strength (the dynamometer), Pearson’s coefficient showed statistically significant values ranging between –0.14 and –0.59 for the dominant hand and between –0.23 and –0.59 for the non-dominant hand (see Table 5).
Item-total analysis: Cronbach’s alpha for each item in the reliability study JTHFT-I in rheumatoid arthritis population.
Intra-rater analysis: range of ICC parameters of each item in the reliability study JTHFT-I in rheumatoid arthritis population.
ICC: intra-class correlation coefficient; CI: confidence interval.
Inter-rater analysis: range of ICC parameters of each item in the reliability study JTHFT-I in rheumatoid arthritis population.
ICC: intra-class correlation coefficient; CI: confidence interval.
Gold standard analysis: Pearson’s correlation coefficient between the JTHFT-I and the dynamometer.
Correlation is significant at the 0.05 level (two-tailed).
Correlation is significant at the 00.01 level (two-tailed).
Discussion
The aim of the study was to evaluate the psychometric properties of the JTHFT-IT in a population diagnosed with RA. The results of our study show that the JTHFT-IT is a reliable and valid instrument for the Italian population with RA. To evaluate the consistency of the scale, Cronbach’s alpha coefficient was used, reporting a value of 0.53 for the dominant hand and 0.46 for the non-dominant hand. From the evaluation of the item-total correlation, it was observed that the first item of the test (writing a 24-letter sentence) had a different weight compared to the others. The results of this study are in line with previous studies; for example, in a Portuguese study, the writing item was slightly less consistent than the others. 9 The authors attributed this result to the levels of education and language disorders associated with the post-stroke population analyzed in their study. It has been demonstrated that this item requires the longest time for the participant to finish the task, either with the dominant or non-dominant hand. Indeed, in the same Portuguese study from Ferreiro et al., it was reported that there were no significant differences between the scores obtained in the item “writing a sentence” for the participants with lower and higher levels of education or in the participants performing the task with the paretic, dominant hand compared to those performing the test with the paretic, non-dominant hand. This item obviously has a greater temporal importance than the others. If we decide to eliminate the first item, for both the dominant and non-dominant hands, the Cronbach’s alpha values would reach 0.91 and 0.87, respectively. To evaluate the test–retest reliability, ICC (95%) was used with an average result of 0.85 (range: 0.81–0.91). Among the seven subtests, the writing subtest had relatively lower intra-rater (0.34–0.62) reliability.
Another aspect to consider is that nowadays very few people write, especially if they have a hand condition that limits this. This could have affected the writing item. However, even though these days we have technological tools that assist with writing and this item no longer represents a modern key functional item, writing cannot be totally avoided and the writing task is still one of the most complete activities for the upper limb including a wide variety of movement. This is an important aspect to consider as many of these objective functional tests were developed long ago before we had access to technology.
To assess the validity of the scale, Pearson’s correlation was also calculated and showed a strong negative association between the total score of the JTHFT-IT with the dynamometer, confirming as expected that increased time is associated with lower grip strength. “Picking up small common objects” for the dominant hand and “simulated page turning” for the non-dominant hand showed no association. This is likely related to the fact that grip strength is not as relevant for the completion of these activities; however, from the evaluation with the dynamometer, it is possible to state that the JTHFT-IT shows concurrent validity with the Jamar dynamometer.
We agree with previous authors by acknowledging that the JTHFT has some limitations.11,12,14 The test rates speed, but does not rate different strategies of task performance. Different compensation mechanisms for positioning the upper limb during the JTHFT will not be reflected in the scores. Hence, it is important to provide appropriate instructions before starting the test and to ask patients to not change their strategy while being tested or, in clinical trials that use the JTHFT score as an endpoint, to not change strategies in follow-up evaluations. Furthermore, patients with moderate to severe functional impairment are often not testable with the JTHFT. Therefore, the test is appropriate for evaluating dexterity only in patients with slight to moderate hand disability. The main advantage of the JTHFT is to provide an objective measure of hand function by employing functionally relevant tasks that have good intra- and inter-rater reliability. Thanks to the results obtained by the current study, it is possible to state that the JTHFT-IT scale is a reliable test for assessing hand skills for daily life activities in people diagnosed with RA with a slight to moderate hand disability.
The present study has some limitations. Consistent with previous studies grip strength has been tested with the Jamar but bearing in mind that we were assessing fine hand use, inclusion of the pinch gauge could have been interesting. Furthermore, the time that participants had suffered from RA was not considered, and excluding those who had high level of pain could have compromised the generalization of results. In addition, it would have been interesting to analyze the JTHFT-IT’s concurrent validity by comparing it with another outcome measure for hand function, such as the Wolf Motor Function Test or the Disabilities of the Arm, Shoulder and Hand Outcome Measure. 20 Moreover, further study could analyze the JTHFT-IT’s construct validity, comparing it with performance outcome measures on responsiveness after rehabilitation treatment. Furthermore, it was not possible to compare timed performance between people with RA and healthy participants due to the absence of a control group. However, the normative data for the JTHFT-IT is available in the literature 10 for such comparisons and analyses.
Conclusion
In conclusion, it is possible to state that the JTHFT-IT is a useful scale for assessing the functioning of the hand in everyday activities in people with RA. However, based on our results, the authors recommend paying attention in choosing this tool for individuals with RA. The time used to complete the first task “write a letter” should be considered when using this tool in this population. The weight of this item compared to the others makes this tool not very recommendable for research. However, despite many authors claiming that timed performance tests alone should not be used to assess efficacy of treatments in hand surgery, the authors think that the JTHFT-IT is very suitable for clinic assessments because the objects used in the test can be easily purchased, and the implementation of the JTHFT-IT is inexpensive. Whilst no test used in isolation can provide a realistic assessment of hand function, it is important to consider the potential usefulness of JTHFT in a battery of tests. 21 The instructions are simple and straightforward, and expertise in administering 9 the test is not time-consuming. Another important advantage of the JTHFT scale is the evaluation of movements related to activities of daily living, which makes it a perfect tool to use in a rehabilitation program for people with RA to assess the individual at baseline, register improvements, and as an outcome measure.
Footnotes
Acknowledgments
None.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethical approval
We certify that all applicable institutional and governmental regulations concerning the ethical use of human volunteers were followed during the course of this research. All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2008.
Guarantor
GG.
Contributorship
GG, AS, LF, MS: conception and design of the study, analysis and interpretation of data; AB, MN, GC: analysis and interpretation of data, drafted the manuscript. MT, AnS: revised the manuscript. All authors read and approved the final manuscript.
Informed consent
Written informed consent was obtained from the patient(s) for their anonymized information to be published in this article.
