Abstract
INTRODUCTION:
This study compared the inter-instrument reliability of the Jamar Hand Dynamometer (Jamar) to the BTE EVJ Handgrip tool (EVJ). The EVJ is a new digital handgrip instrument designed by BTE Technologies Inc. (BTE Tech) utilizing Bluetooth technology to automatically upload data to a computer or electronic health record.
METHOD:
This repeated measure study engaged 338 participants (
RESULTS:
Comparative statistics included ICC values (0.81–0.84), Pearson R (correlation coefficient) (0.68–0.77), and Bland Altman plots (93–95% of data within 2 SD), indicating good inter-instrument agreement.
CONCLUSIONS:
The EVJ Handgrip, developed by BTE Technologies, demonstrated good inter-instrument reliability with the Jamar Hand Dynamometer and may be reliable to use when referencing the published normative values in the clinical environment.
Keywords
Introduction
Grip strength is defined as a measurement of the maximum isometric contraction of the intrinsic and extrinsic hand and forearm muscles [1, 2, 3]. Accurate grip strength measurements may be a strong indicator of the extent of an injury, post-operative health, rehabilitation progress, ability to return to work, survival rate, disease, disability, and overall well-being [1, 4, 5, 6]. Normative standards also allow for additional interpretations of grip strength measurements by allowing comparison to others within the same age group [3]. In a clinical setting, these measurements facilitate the clinical reasoning process, ultimately allowing clinical practitioners to further understand their clients’ abilities and determine appropriate intervention strategies [7]. Additionally, when re-evaluating clients, new measurements may be taken and compared to baseline data and normative standards, to assess intervention progress, determine the need for plan of care modifications, and predict discharge disposition.
Grip strength is effectively measured utilizing a handgrip dynamometer, such as the Jamar Hand Dynamometer (Jamar) [1, 2, 3]. The American Society for Hand Therapists (ASHT) and American Society for Surgery of the Hand (ASSH) recommend the Jamar as the gold standard due to its consistent demonstration of high validity, test-retest reliability, and inter-rater reliability [8, 9, 10, 11, 12, 13, 14]. Several dynamometer variants are available for clinical use; however not all have been tested to establish reliability as compared to the Jamar [15]. Devices that do not undergo rigorous testing may provide unreliable results that may compromise the clinical outcomes of clinical interventions [1]. In addition, practitioners utilizing dynamometers that have not been tested may not assume that the results are comparable to the normative values established using the Jamar [16].
Numerous dynamometers have been compared to the Jamar to establish reliability of these devices. Amaral et al. [1] compared the accuracy and reliability of the Jamar to dynamometers with varying handle shapes and sizes. Results indicated that the tested dynamometers were not interchangeable with the Jamar and that handle shape and positioning affect grip strength scores. Allen and Barnett [15] demonstrated that a digital dynamometer, the Biometrics E-LINK EP9 is valid, reliable, and comparable to the Jamar. The study also emphasized the significance of electronic dynamometers for clinical use, as they provide precise digital measurements, ultimately reducing the risk of reading errors.
The purpose of this study was to compare the inter-instrument reliability of the EVJ Handgrip (EVJ), a new digital dynamometer developed by BTE Technologies, Inc. (BTE Tech), to the Jamar Hand Dynamometer (Jamar). The handle design and overall operation of the EVJ is similar to the Jamar, therefore, the developers expected the device to have good intraclass correlation when compared to the Jamar. Bland-Altman Plots [17] were also calculated to assist in determining the confidence. High levels of confidence with these measures may indicate that the EVJ is reliable as compared to the Jamar and that the handgrip normative standards may be applied when evaluating their clients [3]. In addition to determination of reliability, use of Bland-Altman Plots may also allow practitioners to determine if the devices can be used interchangeably and demonstrate agreeable results [12] .
Methods
Approval for the study was received from the Florida Gulf Coast University Institutional Review Board and was assigned protocol #2018-28.
Design
This reliability study used a repeated measures design as well as accumulation of qualitative data regarding participant opinions on the comfort of the EVJ versus the Jamar. Following ASHT protocol, left and right grip strength measurements were taken with each device [7]. To control for fatigue, participants were randomly assigned to initiate the study with either the EVJ or the Jamar then provided a 5-minute break before switching devices. Each participant returned for two additional trials. The design of this study was consistent with previous comparison studies of the Jamar to other grip strength devices [16, 18].
Participants
A convenience adult population of 199 females (mean age 25) and 139 males (mean age 26) was recruited Southwest Florida. Inclusion criteria required that participants be healthy, not pregnant, between 20–50 years old, and with no known history of upper extremity pathology that may affect hand strength. Ninety-one percent of females (
EVJ handgrip.
BTE Tech EVJ Handgrip in use.
The EVJ Handgrip is a digital dynamometer that was recently developed by BTE Technologies, Inc (Figs 1 and 2). The EVJ is adjustable with five frets to accommodate varying hand sizes. Measurements are obtained through Wheatstone bridge transducers that are embedded in the handle of each device and allow for a minor deflection of the handle while it is being squeezed. A microprocessor then converts the electrical signal into a force reading which is displayed on a computer using provided software (
The Jamar Hand Dynamometer is considered the gold standard in measuring static grip strength [10, 11]. As with the EVJ, the Jamar has a 90-kilogram (200 pound) limit and five frets [18]. The Jamar provides an analog display built into the handle in intervals of two kilograms or five pounds. It is recommended that the Jamar be recalibrated either by the manufacturer or an independent engineering lab as needed [19].
Performance comparison of the BTE EVJ Handgrip to the Jamar Hand Dynamometer for females (
199) and males (
139). All measurements recorded in kilograms
Performance comparison of the BTE EVJ Handgrip to the Jamar Hand Dynamometer for females (
NS
Five Jamar dynamometers and five EVJ Handgrips were utilized for data collection. Each EVJ device was numbered from one to five and paired with a Jamar with the corresponding number. Only corresponding devices were utilized together throughout the study. Prior to the beginning of the study, the Jamar devices were calibrated by an independent engineering lab while the EVJ Handgrips were bench checked by BTE Tech engineers. To maximize reliability and consistency, each device handle was set to the second fret throughout the study [20]. To reduce the risk of bias and effects of fatigue, the order in which instruments were administered to the participants was determined using a random number generator.
Assessment of grip strength was conducted according to ASHT protocol, which includes: Participants seated with feet flat on the floor, shoulder adducted, forearm in neutral, elbow flexed to 90
After the completion of the trial, participants were asked to complete a post-participation survey. Participants were asked to identify which device was preferable and describe aspects of each device they found comfortable or uncomfortable. Results were analyzed to determine whether a correlation existed between device preference and grip strength measurements.
Data analysis
For each device, the average of the three trials and standard deviation (SD) were calculated using Microsoft Excel which was utilized to calculate the coefficient of variation (CV). IBM SPSS version 25.0 was utilized to complete Pearson’s correlation coefficients for concurrent validity (
Results
Inter-instrument reliability
Table 1 provides descriptive data comparing the performance of the EVJ Handgrip to the Jamar dynamometer. Intraclass correlation coefficients (ICC) compare two sets of data and determines the degree of relatedness the measurements are to each other. ICC is a “widely used reliability index in test-retest, intrarater, and interrater reliability analyses” [16]. Values between 0.75 to 0.9 indicate good reliability and values greater than 0.90 indicate excellent reliability [21]. The ICC between the two devices ranged from 0.81 to 0.84 indicating good reliability that the measures can be replicated.
Concurrent validity
Cohen’s calculations indicate a small effect size for comparison of right hand to left hand for female and male populations. The greatest difference was noted with the left hand of the female participants, though this was minor, and agreed with some female participants’ comments that discomfort with the devices may have affected their ability to provide consistent measurements. Paired
Bland-Altman plots
Figure 3 provides a graphic representation of Bland-Altman plots [17], which describes the agreement between the EVJ handgrip to the Jamar dynamometer by constructing a limit of agreement. The Bland–Altman method calculates the mean difference between two methods of measurement (the ‘bias’), and 95% limits of agreement as the mean difference (2 SD) providing a visual judgement of how well two methods of measurement agree [12]. This statistic plots the difference between both scores being compared by the mean of both scores together. The greater amount of data that falls within the two SD plot, and the tighter the data is packed, the more comparable the data is. The results indicated ninety-five percent of female right and 93% of female left measures lie within two SD of the mean difference while 94% of male right and left data points lie within two SD of the mean difference. This indicates a high confidence when comparing the two devices.
In a post-participation questionnaire, participants were asked to compare the comfort of the two devices. Thirty-six percent of female participants cited the EVJ device was of greater comfort, 34% felt the Jamar was more comfortable, while 30% gave no preference. Forty percent of males felt the Jamar device was more comfortable, while 29% favored the EVJ Handgrip, and 30% had no preference. There was no consistency on which features were preferred on each device with ergonomic fit, weight, and material composition (i.e. plastic or metal) cited as common areas. For example, one participant indicated the EVJ Handgrip felt “comfortable compared to the Jamar’s handle that added additional strain when adding pressure” while another noted, “The BTE initially gave less force (at first) …but toward the end of the duration became uncomfortable. The Jamar gave equal comfort/discomfort throughout. Both were sized appropriately and easy to grasp”.
Discussion
Digital dynamometers may provide numerous benefits over an analog gauge, some of which include: Eliminating the need to estimate grip strength measures, increasing inter-rater reliability, and increasing sensitivity to applied force [15]. This study was focused on determining the reliability and reproducibility of the EVJ Handgrip developed by BTE Tech. by comparing its performance to the Jamar Hand Dynamometer.
The EVJ Handgrip indicated good inter-instrument reliability to the Jamar device with both male and female populations. Previous studies indicate that devices that can demonstrate equivalent measurements to the Jamar device can use published normative data in clinical use [10, 17]. Though complete agreement between the two devices was not achieved, the EVJ Handgrip demonstrates good comparability to the Jamar device, and the EVJ device utilizes a similar design and the same units of measurement (pounds or kilograms), it may be suitable that the EVJ Handgrip can use the normative data [24].
At the conclusion of the study, the Jamar devices were returned to the independent engineering firm for recalibration. The calibration report indicated that four-of-five devices required minor adjustments to return to their design specifications. The EVJ Handgrips were each run through the internal calibration process with each device indicating no need for adjustments. The degradation in the performance of the Jamar devices may have slightly affected the overall results. However, the researchers feel this was countered by using five of each device and having a large sample for the study. The need for external calibration for the Jamar devices provides an additional strength for the EVJ Handgrip which is equipped with its own calibration tools.
As previously noted, when the participants were queried regarding comfort and preference of the device, the results varied greatly. Male participants tended to prefer the fit of the Jamar Device while females preferred the EVJ Handgrip. Participants expressed varying opinions regarding the comfort of both devices, noting aspects such as weight, handle shape, handle size, and handle material.
Limitations to this study include the use of a healthy convenience population with 83% of participants between the ages of 20–29 years with no known upper extremity conditions. To ensure generalizability of the device across the lifespan, future studies are planned to include a broader age range as well as individuals with lower grip strength scores and those with disabilities affecting grip strength. Another limiting factor may have been related to participants’ feelings of discomfort when utilizing one or both devices. Participants generally expressed a preference for one device over the other, however, there was no one device that was significantly more preferred than the other. Further concern was expressed regarding the shape and material composition of each handle. The developers have been informed of these results and recommend to continue to monitor reports from clinicians and modify the grip if necessary.
Author contributions
CONCEPTION: Edwin J. Myers
PERFORMANCE OF WORK: Edwin J. Myers David S. Dominguez, Melissa E. Guigliano and Melissa G. Mallory
INTERPRETATION OR ANALYSIS OF DATA: Edwin J. Myers, David S. Dominguez, Melissa E. Guigliano and Melissa G. Mallory
PREPARATION OF THE MANUSCRIPT: Edwin J. Myers, David S. Dominguez, Melissa E. Guigliano and Melissa G. Mallory
REVISION FOR IMPORTANT INTELLECTUAL CONTENT: Edwin J. Myers
SUPERVISION: Edwin J. Myers
Ethical considerations
Approval for the study was received from the Florida Gulf Coast University Institutional Review Board and was assigned protocol #2018-28. All data collected from 2018 Apr through 2019 Dec.
Footnotes
Acknowledgments
The authors have no acknowledgments or statement of funding.
Conflict of interest
This research received no specific grant from any funding agency, commercial or not-for-profit sectors. The authors declare no conflict of interest in the completion of this study.
