Intra-rater reliability and repeatability of pulse oximetry values obtained before,between sets,and after resistive exercise

Abstract

BACKGROUND:

Pulse oximetry measures heart rate (HR) and percent oxygen saturation (SpO ${}_{2}$ ). For aerobic exercise, whereby cellular oxygen demand and delivery are elevated and maintained for extended periods, HR and SpO ${}_{2}$ values are consistent when measured by pulse oximetry. Yet due to its intermittent nature, HR and SpO ${}_{2}$ values from resistive exercise may exhibit lower data reliability and repeatability.

OBJECTIVE:

Assess intra-rater reliability and repeatability of pulse oximetry HR and SpO ${}_{2}$ values from two identical resistive exercise protocols.

METHODS:

Subjects ( $n=$ 32) performed two calf press workouts on a flywheel-based ergometer as HR and SpO ${}_{2}$ were measured before, between sets, and after exercise. Workouts entailed a 4-set 15-repetition protocol separated by 120-second rests. Intra-rater reliability was assessed with intraclass correlation coefficients (ICC). Repeatability was measured by the smallest real difference in absolute and relative terms.

RESULTS:

ICC and standard error of estimate results for HR ranged from 0.60–0.79 and 9.1–13.0 respectively. SpO ${}_{2}$ ICC and standard error of estimate results ranged from 0.16–0.71 and 1.44–4.33 respectively. Between sets, smallest real difference values tended to be less for HR.

CONCLUSIONS:

Results demonstrate acceptable intra-rater reliability and repeatability for HR, but not SpO ${}_{2}$ which we attribute to the exercise mode and protocol examined.

Keywords

Heart rate percent oxygen saturation steady state

1. Introduction

Pulse oximetry is a quick and simple to use tool to measure heart rate (HR) and percent oxygen saturation (SpO ${}_{2}$ ) values within the blood [1]. While traditionally used clinically to aid detection of numerous cardiorespiratory ailments that now include the COVID-19 virus, pulse oximetry was also examined as persons exercised at sea level and altitude; the latter usage assessed acclimatization and aided diagnoses of acute mountain sickness [2, 3]. For exercise it is assumed steady-state activity, whereby cellular oxygen demand and delivery are elevated and maintained over extended time periods, yield consistent HR and SpO ${}_{2}$ values when measured by pulse oximetry [4, 5, 6]. Yet non-steady state activity such as resistance exercise has been largely ignored. In addition, resistive exercise may also see considerable contributions from oxidative phosphorylation and other aerobic metabolic pathways, particularly when done by women [7, 8].

Greater use of aerobic energy systems during resistive exercise may be indicative of heightened usage of oxidative phosphorylation to meet the body’s energy demands, while such a reliance between sets suggest the metabolic pathway plays a greater role in ATP resynthesis as the body recovers from the prior exercise effort. Resistive exercise SpO ${}_{2}$ values obtained by pulse oximetry may offer insights on oxygen demand and delivery for this non-steady state modality. Due to the intermittent nature of resistive exercise, it is assumed HR and SpO ${}_{2}$ values from this exercise modality would exhibit lower data reliability and repeatability. Despite the popularity of pulse oximetry, arterial catheterization is still considered the gold standard for SpO ${}_{2}$ measurements [4].

As it pertains to HR and SpO ${}_{2}$ values obtained from exercise, there are measurement limitations to pulse oximeters, particularly those that feature fingertip probes. They include finger movement as that produces motion artifacts, gripping objects as the measurement is concurrently attained, and poor perfusion states when skin temperatures are low such as when collected at altitude [1]. Others site light-emitting diode (LED) variability, hypoxemia, skin pigment and signal response as additional measurement limitations seen with pulse oximeters [5]. In addition, pulse oximetry use during exercise sees SpO ${}_{2}$ values impacted by body temperature and pH [1]. It is assumed the variety of potential measurement limitations seen from pulse oximeters equipped with fingertip probes, combined with the intermittent nature of resistive exercise, may yield lower reliability and repeatability values for HR and SpO ${}_{2}$ measurements than seen previously.

Several pulse oximetry studies did not quantify intra-rater reliability and repeatability, but instead used statistical tests such as Pearson correlations to note the level of agreement between measurements [3, 6, 9, 10]. Few papers examined HR and SpO ${}_{2}$ data reliability and repeatability from pulse oximeters [11, 12, 13]. None of those studies entailed data collection during exercise [11, 12, 13]. Results suggest pulse oximetry exhibits highly reliable HR values, while those for SpO ${}_{2}$ may be considerably less [11, 12, 13]. Since there is limited information on HR and SpO ${}_{2}$ reliability and repeatability from pulse oximetry, which includes no papers on data obtained during exercise, this issue warrants further inquiry [11, 12, 13]. Thus, the current study quantifies intra-rater reliability and repeatability from pulse oximetry HR and SpO ${}_{2}$ values obtained before, between sets, and after resistive exercise workouts. Subjects performed two identical workouts from which HR and SpO ${}_{2}$ values were collected and subsequently examined for intra-rater reliability and repeatability. We hypothesize current HR and SpO ${}_{2}$ values will yield results unlike those seen previously, but are nonetheless acceptable in accordance with established standards.

2. Methods

2.1 Subjects and their first visits

This research project received approval for the collection of human subject data from a university-based institutional review board that was compliant with ICMJE requirements. College-age subjects (15 men, 17 women) first gave informed written consent, and then filled out a medical questionnaire which stated they were free of conditions that could compromise their participation, prior to their project involvement. Subjects were healthy non-smokers who each made three laboratory visits close to the same times of day in order to limit the impact of circadian influences on our results. Their data were collected at sea level within a thermoneutral (21–22 ${}^{\circ}$ C, 40–45% humidity) exercise laboratory.

Subject’s first visits entailed their anthropometric data collection and familiarization to our resistive exercise device (YoYo Inertial Technologies; Stockholm, Sweden). Anthropometric values from our female subjects (mean $\pm$ sem) were as follows: height 169.0 $\pm$ 1.8 cm, mass 65.5 $\pm$ 2.5 kg, body fat percentage 25.2 $\pm$ 1.8. Values for their male counterparts were: height 180.0 $\pm$ 1.5 cm, mass 82 $\pm$ 4.4 kg, body fat percentage 13.8 $\pm$ 1.8. Height and mass were recorded with a stadiometer (Saltner Brecknell; Brooklyn NY) as subjects stood barefoot. Bioimpedance (Model BF-350, Tanita Corporation; Tokyo, Japan) measured body fat percentage estimates while subjects were in a euhydrated state. Subjects first visits lasted approximately 45 minutes.

2.2 Pulse oximeter

At their second and third visits, subjects wore a fingertip pulse oximeter (American Diagnostics Corporation; Happauge, NY) before, between sets, and after exercise. They wore the pulse oximeter on their right hand’s index finger. It was used and operated in accordance with the manufacturer’s specifications. When not in use, it was stored in accordance with guidelines (temperature, humidity, etc.) provided by the manufacturer. Figure 1 depicts how the pulse oximeter was worn when current data were collected.

Figure 1.

Current study pulse oximeter (American Diagnostics Corporation; Happauge, NY) as it was worn when data were collected.

2.3 Second and third visits

Second and third visits entailed identical workout protocols, which allowed subject’s HR and SpO ${}_{2}$ data to be compared statistically for their intra-rater reliability and repeatability. Per subject, the time between workouts averaged 17.8 $\pm$ 2.6 days. For each workout subjects were instructed to arrive at our laboratory well rested. They began their second and third visits with a warm-up on a stationary cycle ergometer (Model 812E, Ergotest; Stockholm, Sweden) in which they pedaled for five minutes at a low (75–90 watt) workload. After the warm-up concluded, subjects sat on a flywheel-based ergometer for ten continuous minutes. Upon completion of the ten-minute period, subjects performed a 4-set 15-repetition seated calf press protocol on the ergometer. Subjects were encouraged to exert maximal voluntary effort throughout each set. Each repetition required exertion of concentric and eccentric torque provided by the subject’s plantar flexors. Subjects rested 120 seconds between sets. Per workout, HR and SpO ${}_{2}$ data were collected before exercise (after ten continuous minutes of sitting), 60 seconds after sets 1–3, as well as at 0-, 5- and 15-minutes post-exercise.

2.4 Ergometer design and instrumentation

For the current study’s exercise mode, we chose to examine seated calf presses on the flywheel ergometer in order to limit finger movement artifacts that could impact results [1, 2, 5]. As subjects sat against the ergometer’s padded chair and backrest, inertial resistance provided by the flywheels was imparted to the footplate through a nylon strap, that alternately wrapped and unwrapped around the axle that connect the ergometer’s flywheels. With subject’s knees fully extended and their ankles dorsiflexed 10–15 degrees, they aligned the balls of their feet against the lower edge of the ergometer’s footplate at the start of each set. Torque imparted by concentric plantar flexor forces overcame the flywheel resistance and caused their rotation at rates proportionate to the torque exerted. Upon full ankle extension, the footplates’ movement was instantly reversed as eccentric forces were exerted and immediately slowed flywheel rotation rates. As the plantar flexors resisted the footplates’ returning motion, 10–15 degrees of dorsiflexion pre-stretched the plantar flexors before the next concentric action.

HR and SpO ${}_{2}$ data were collected 60 seconds after sets 1–3 concluded as subjects sat passively on the ergometer without gripping its handlebars to limit the risk of data artifact [1]. To quantify exercise performance, flywheel rotation rates were recorded at 10 Hz with software (Labview Model 8.1; Austin, TX). Concentric, eccentric, and total work values were derived from the following formula: $E_{\textit{kin}}=1/2\cdot J\cdot\omega^{2}$ where by $J=$ rotation inertia and $\omega=$ angular velocity. Our instrumentation procedures and validity of data they measure were previously reported as acceptable [14, 15, 16]. Figure 2 depicts the position of subjects as they performed the seated calf press exercise on the flywheel ergometer.

Figure 2.

Subject’s position as they performed seated calf presses on the flywheel ergometer (YoYo Inertial Technologies; Stockholm, Sweden).

2.5 Statistics

From the two workouts concentric, eccentric, and total work values were compared with $t$ -tests for paired samples, as significant differences may impact the intra-rater reliability and repeatability of the current study results. Dependent variable (HR, SpO ${}_{2}$ ) values were each examined for intra-rater reliability with intraclass correlation coefficients (ICC) for each of the seven time periods (pre-exercise, 60 seconds after sets 1–3, at 0-, 5- and 15-minutes post-exercise) in which data were collected. ICC analyses were done with a two-way mixed single measures model. Studies show ICC values in excess of 0.75 [17, 18] and 0.80 [19] signify excellent intra-rater reliability. Though subject measurements were collected and compared from two workouts, intra-rater reliability is applied within a context whereby, per subject, a single measure of one rater was performed. To assess intra-rater repeatability, HR and SpO ${}_{2}$ were each calculated with the smallest real difference (SRD) over the seven time periods. SRD%, defined as SRD/mean $\times$ 100, was also quantified, since SRD is impacted by the magnitude of absolute values.

3. Results

No subjects were injured from their project participation. Table 1 shows non-significant differences for inter-workout concentric, eccentric and total work values. Raw HR and SpO ${}_{2}$ values appear in Tables 2 and 3 respectively, per time point, workout and subject. Average intra-rater reliability results appear in Table 4. They include ICC values for the seven time points examined at subject’s second and third laboratory visits. Associated with ICC, we included $\eta^{2}$ values in Table 4 to reflect on-average differences seen with the 32 sets of subject’s measures. Table 4 also includes standard error of the estimate (SEE) results, which equal the square root of the variance for deviations of observed values for a given variable from those predicted by linear regression [20].

Table 1
Concentric, eccentric and total work values (mean $\pm$ sem) and results

	1 ${}^{\text{st}}$ workout	2 ${}^{\text{nd}}$ workout	$t$ -test score
CTW (joules)	8639 $\pm$ 513	9041 $\pm$ 550	$-$ 1.8
ETW (joules)	8091 $\pm$ 495	8322 $\pm$ 500	$-$ 0.3
TW (joules)	16731 $\pm$ 1007	17363 $\pm$ 1049	$-$ 0.4

CTW: concentric total work. ETW: eccentric total work. TW: total work.

Table 2

Raw HR data. Per column heading, final digits denote workout (1 ${}^{\text{st}}$ or 2 ${}^{\text{nd}}$ )

Subj	pre1	pre2	pst11	pst12	pst21	pst22	pst31	pst32	0pst1	0pst2	5pst1	5pst2	15pst1	15pst2
1	85	87	101	90	97	85	100	87	122	112	90	71	84	74
2	59	78	73	78	77	88	81	101	90	112	68	88	68	77
3	64	51	64	52	60	48	59	48	74	41	58	52	60	47
4	74	74	65	91	73	82	91	85	84	98	83	68	60	65
5	99	75	102	85	75	83	82	82	128	104	74	73	74	74
6	86	70	95	84	109	81	101	76	117	82	112	70	94	76
7	113	110	134	101	139	109	145	113	161	137	119	108	112	105
8	100	99	109	118	115	113	117	117	153	136	107	108	100	98
9	70	69	71	75	84	77	86	84	108	119	67	91	64	80
10	68	78	95	106	108	94	98	116	126	127	81	87	85	83
11	68	74	84	82	88	63	92	84	88	86	85	76	78	81
12	95	93	97	105	107	98	122	97	111	127	89	85	78	82
13	85	67	78	71	77	74	88	73	125	92	79	71	67	71
14	95	97	126	134	127	124	121	133	121	132	86	73	86	74
15	60	56	82	75	78	77	81	80	95	86	61	65	58	66
16	78	73	100	93	102	93	107	100	154	125	91	81	86	79
17	64	69	78	76	81	79	83	88	80	93	74	72	67	72
18	58	56	78	64	74	73	78	77	109	81	71	55	70	64
19	74	95	90	103	90	97	89	103	84	114	84	98	82	96
20	72	76	100	95	107	96	103	95	123	116	87	79	88	77
21	81	81	92	95	95	92	95	89	110	112	80	81	86	85
22	81	76	81	90	87	95	92	96	103	102	78	79	85	83
23	72	79	89	91	81	92	73	93	100	103	73	95	71	72
24	72	67	69	87	91	90	90	96	93	97	73	66	73	71
25	109	100	120	112	120	105	118	111	142	129	103	106	93	92
26	64	78	76	79	67	77	71	79	98	116	66	75	56	78
27	88	76	104	87	115	107	113	118	133	136	107	105	85	92
28	68	71	72	78	75	64	70	76	89	87	61	70	62	70
29	75	64	76	62	76	66	84	67	99	84	75	64	67	58
30	89	82	110	93	108	102	119	90	104	95	87	79	86	102
31	74	78	84	90	109	118	121	116	115	102	91	82	80	76
32	72	73	83	86	106	110	118	120	104	99	82	75	73	70
Mean	78.5	77.3	89.9	88.4	93.7	89.1	96.5	93.4	110.7	105.7	82.6	79.6	77.4	77.8
Sem	2.5	2.3	3.1	2.9	3.4	3.1	3.4	3.2	3.9	3.7	2.6	2.6	2.3	2.2

pre: pre-exercise; pst1: post-set 1; pst2: post-set 2; pst3: post-set 3; 0pst: 0 minutes post; 5pst: 5 minutes post 15pst: 15 minutes post.

Table 3

Raw SpO ${}_{2}$ data. Per column heading, final digits denote workout (1 ${}^{\text{st}}$ or 2 ${}^{\text{nd}}$ )

Subj	pre1	pre2	pst11	pst12	pst21	pst22	pst31	pst32	0pst1	0pst2	5pst1	5pst2	15pst1	15pst2
1	97	98	95	97	93	97	96	97	94	98	94	93	94	96
2	90	96	97	96	91	96	93	93	91	93	97	91	90	91
3	98	96	98	97	98	98	97	97	98	97	98	98	98	94
4	97	96	98	95	98	96	98	95	87	95	97	98	98	98
5	98	97	95	95	95	97	88	94	93	96	90	95	98	96
6	91	95	91	96	94	98	91	95	94	95	92	93	94	94
7	97	97	97	98	96	98	96	97	93	95	96	97	96	96
8	94	97	95	96	96	96	96	95	88	93	96	96	96	95
9	97	95	98	97	98	98	98	97	97	94	96	95	98	97
10	98	97	89	95	94	97	95	97	92	96	96	95	96	94
11	94	92	90	88	93	78	95	82	88	83	92	71	90	96
12	97	95	96	92	90	93	94	93	98	93	87	96	95	96
13	97	96	97	96	98	96	97	96	97	97	96	95	97	94
14	95	96	90	90	92	96	90	92	91	91	96	98	92	90
15	97	96	96	97	97	97	97	97	94	95	96	97	96	96
16	96	96	97	96	96	95	97	95	95	91	94	94	96	91
17	96	93	96	95	95	95	98	93	98	96	96	95	95	96
18	97	98	97	97	96	96	96	97	96	96	96	97	96	97
19	86	93	92	94	88	92	92	91	93	94	90	92	91	92
20	93	96	96	96	96	96	96	96	95	92	96	98	97	97
21	96	95	96	95	96	95	97	93	97	93	96	98	96	96
22	95	95	92	90	93	88	95	93	93	91	97	95	91	91
23	93	95	96	95	93	95	95	96	96	93	92	92	95	97
24	98	96	96	96	98	99	93	98	98	93	93	98	97	95
25	93	92	96	95	96	94	95	94	94	95	94	93	91	94
26	93	94	97	95	92	94	93	94	93	93	95	92	95	91
27	99	95	97	94	95	93	95	92	86	97	96	92	94	90
28	98	99	98	98	98	85	96	90	97	86	96	97	85	82
29	99	95	98	96	98	96	98	96	96	95	97	96	97	96
30	96	95	91	98	97	95	98	94	96	98	96	96	95	97
31	95	93	92	90	94	91	91	89	89	94	94	95	93	94
32	95	94	92	91	93	90	91	88	90	94	94	95	95	96
Mean	95.5	95.4	95.0	94.9	94.9	94.4	94.9	93.9	93.7	93.8	94.8	94.5	94.6	94.2
Sem	0.5	0.3	0.5	0.5	0.5	0.8	0.5	0.6	0.6	0.6	0.4	0.8	0.5	0.6

pre: pre-exercise; pst1: post-set 1; pst2: post-set 2; pst3: post-set 3; 0pst: 0 minutes post; 5pst: 5 minutes post 15pst: 15 minutes post.

Table 4

Average intra-rater reliability results obtained from our subjects ( $n=$ 32)

Measure	pre-ex.	post set 1	post set 2	post set 3	0-post	5-post	15-post
ICC
HR	0.74	0.74	0.79	0.74	0.67	0.60	0.74
SpO ${}_{2}$	0.40	0.59	0.26	0.31	0.16	0.27	0.71
$\eta^{2}$
HR	0.87	0.87	0.89	0.87	0.83	0.80	0.87
SpO ${}_{2}$	0.70	0.79	0.62	0.65	0.57	0.62	0.85
SEE
HR	9.87	10.33	9.7	13.0	16.2	11.8	9.1
SpO ${}_{2}$	1.44	1.88	4.33	3.2	3.3	4.9	2.4

ICC: intraclass correlation coefficient. $\eta^{2}$ : eta squared. SEE: standard error of the estimate. 0-post, 5-post, 15-post: 0, 5 and 15 minutes post-exercise.

Table 4 includes higher absolute SEE values for HR as compared to SpO ${}_{2}$ , which may simply be a function of score magnitude, as HR typically produces higher absolute values and exhibits a larger range of values, particularly during exercise. $\eta^{2}$ results also demonstrate higher values for HR. ICC results exhibit far greater intra-rater reliability for HR, as compared to SpO ${}_{2}$ , values. For SpO ${}_{2}$ changes there is a temporal component to current results, as ICC results were lowest following sets 1–3, but rose during post-exercise recovery. Table 5 shows our intra-rater SRD and SRD% repeatability results. SpO ${}_{2}$ had lower values at the initial and final time points of data collection, and greater score dispersion after sets 2–3 and immediately post exercise (0-post). In contrast, SRD and SRD% HR results were lowest after sets 1 and 2. Administration of the same exercise protocol evoked similar HR changes, and data collection before and after workouts inherently may have elicited more score dispersion for intra-subject HR responses.

Table 5

Average intra-rater repeatability results obtained from our subjects ( $n=$ 32)

Measure	pre-ex.	post set 1	post set 2	post set 3	0-post	5-post	15-post
SRD
HR	4.2	3.5	2.7	4.6	5.7	5.6	3.7
SpO ${}_{2}$	2.2	2.5	5.8	5.4	5.4	4.6	2.1
SRD%
HR	5.4	3.9	3.0	5.0	5.2	7.0	4.8
SpO ${}_{2}$	2.4	2.7	6.1	5.7	5.8	4.9	2.2

SRD: smallest real difference. SRD%: smallest real difference percentage. 0-post, 5-post, 15-post: 0, 5 and 15 minutes post-exercise.

4. Discussion

Intra-rater reliability detects differences among persons tested repeatedly over time [21, 22, 23]. Tables 4 and 5 results suggest we can partly affirm our hypothesis, as pulse oximetry produced acceptable intra-rater reliability and repeatability results for HR, but not SpO ${}_{2}$ . It is important to explain current results in relation to prior outcomes. Prior research assessed the reliability and repeatability of HR and SpO ${}_{2}$ data obtained by pulse oximetry. Many of those prior outcomes concur with current HR and SpO ${}_{2}$ results [11, 12, 13]. A study that did not entail exercise compared pulse oximetry HR data to values from two other measurement modes [11]. Pulse oximetry yielded ICC values in excess of 0.93, and was concluded to produce highly reliable HR values [11]. Yet like the current study, pulse oximetry SpO ${}_{2}$ values, measured at multiple PaCO ${}_{2}$ levels, were not as reliable [12]. Pulse oximetry HR and SpO ${}_{2}$ values were measured as subjects sat comfortably under normobaric hypoxic conditions [13]. Much like the current study, HR reliability was high, but SpO ${}_{2}$ values were biased by up to 3.3% [13]. Pulse oximetry probes equipped with a sensor that enabled contact force detection offered SpO ${}_{2}$ errors less than 2%, and was concluded they had the potential to improve SpO ${}_{2}$ reliability [24]. Thus like pulse oximetry studies collected from non-exercising subjects, our intra-rater reliability and repeatability HR and SpO ${}_{2}$ results are like those seen previously [11, 12, 13].

Other pulse oximetry studies assessed data reliability and repeatability for SpO ${}_{2}$ values with different statistical analyses than those used in the current study [12, 25, 26]. With pulse oximetry data collected from subjects at different arterial CO ${}_{2}$ pressure levels, results showed low reliability as assessed by Bland-Altman plots, particularly in hypercapnic patients [12]. In similar fashion, Bland-Altman plots also showed low SpO ${}_{2}$ repeatability and reproducibility from pulse oximetry in critically ill patients [25, 26]. Despite use of different statistical tests, current SpO ${}_{2}$ repeatability and reproducibility values concur with data from prior pulse oximetry studies [12, 25, 26]. Smyth et al. saw higher (4.1–5.4%) SEE values for SpO ${}_{2}$ data collected under normoxic and hypoxic conditions [27]. With an ear probe pulse oximeter, the hypoxic condition produced higher SEE values [27]. Current SEE values are similar to Smyth et al., and imply current SpO ${}_{2}$ data are not accurate during non-steady state activity [27]. Yet some still question O ${}_{2}$ saturation data, even from trained subjects during high-intensity exercise [6, 9].

Current ICC results for SpO ${}_{2}$ are generally lower than those for HR. In addition, SpO ${}_{2}$ had higher SRD% results for data obtained between sets. SpO ${}_{2}$ values obtained during exercise are impacted by body temperature and blood pH which may deviate by up to 4% [1]. Another exercise study saw a similar SpO ${}_{2}$ results in subjects similar to those of the current study [28]. Healthy men were divided into an exercise or control group with no crossover to assess aerobic exercise’s impact on O ${}_{2}$ saturation and pulmonary ventilation [28]. It was hypothesized lower hyperventilation in trained subjects during testing would evoke smaller alveolar-arterial PO ${}_{2}$ differences, while testing control subjects would lead to greater differences in O ${}_{2}$ saturation [28]. Their hypothesis was affirmed by a two-way ANOVA with repeated measures, as trained subjects achieved VO ${}_{2}$ gains through improved cardiorespiratory efficiency, while the untrained group’s O ${}_{2}$ desaturation values were seen to be dependent upon VO ${}_{2}$ levels and subject’s training status [28].

An examination of the repeatability of three different pulse oximeters was studied in male cyclists before and after they performed steady-state graded exercise [4]. Tests were done as cyclists wore a pulse oximeter on each ear lobe, while a third was attached to a fingertip. SpO ${}_{2}$ values were compared to those from arterial catheterization, which was concurrently collected throughout testing. Results showed the fingertip pulse oximeter had higher data repeatability and values closest to those of arterial catheterization. In addition, in contrast to the notion intense exercise elicits lower O ${}_{2}$ saturation, cyclists did not see a drop in that variable, even when tests caused their percent hemoglobin saturation to vary from 72–99% [4]. Differences between the Martin et al. and current studies were likely from the types of subjects and exercise protocols examined [4].

Yet pulse oximetry has produced mixed reliability and repeatability results from data obtained during or after aerobic exercise with fingertip probes [1]. Powers et al. collected SpO ${}_{2}$ data with low SEE (1.4–2.0%) values and concluded pulse oximetry had sufficient accuracy and were useful during exercise tests, which are in contrast to the higher SEE values obtained by Smyth et al. [27, 29]. Perhaps the most comprehensive study on SpO ${}_{2}$ values used three different groups of subjects and a variety of pulse oximeter models [1]. Subjects included healthy non-smoking adults, trained cyclists, and hospital patients with either CHF or COPD [1]. Subjects completed a cycle ergometer VO ${}_{2}$ max test under normoxic conditions at which time their SpO ${}_{2}$ data were collected. They concluded fingertip pulse oximetry produces conservative SpO ${}_{2}$ results that underestimate actual values when used during exercise [1]. Disparities in SEE results for SpO ${}_{2}$ values obtained during or after exercise among various investigations suggest the types of subjects and exercise modes examined may impact data reliability and repeatability [1, 4, 27, 29].

Other factors that may have also contributed to the current study’s low SpO ${}_{2}$ intra-rater reliability and repeatability include carboxyhemoglobin and methemoglobin levels within the blood. Pulse oximetry utilizes multi-wavelength light to project onto a specific area of interest, and then photodetectors identify which wavelengths of light return to derive SpO ${}_{2}$ values [5]. Carboxyhemoglobin and methemoglobin each absorb at similar light wavelengths as oxyhemoglobin, thus they could potentially inflate SpO ${}_{2}$ values. Yet current study SpO ${}_{2}$ values do not imply this was a major cause for the low intra-rater reliability and repeatability results, as Table 3 data from our subjects demonstrate no signs of inflated values, particularly those obtained between resistive exercise sets.

Many [1, 4, 29, 30], but not all [6, 9, 27], studies showed pulse oximetry SpO ${}_{2}$ data collected across multiple workouts exhibited small amounts of data dispersion. Studies that noted low data dispersion used healthy trained subjects as they exercised under steady-state conditions [1, 4, 29, 30]. Such exercise protocols require and demand the delivery of a continual supply of oxygen, particularly during incremental exercise done against progressively heavier workloads [4, 29]. Such was not the case during the current exercise protocol, as some of our SpO ${}_{2}$ data were collected between resistive exercise sets, which makes our investigation unique among pulse oximetry studies. During resistive exercise sets, there’s a modest energy contribution from aerobic metabolism [7, 8]. Yet between sets when ATP replenishment is a high priority, oxygen delivery and transport rise dramatically. Such large and transient changes in oxygen transport and delivery from non-steady state activity across multiple workouts are likely a big contributor to the current study’s greater SpO ${}_{2}$ data dispersion and lower intra-rater results.

To achieve higher SpO ${}_{2}$ intra-rater reliability and repeatability values, basic principles of pulse oximetry operation must be adhered to, such as ensuring probes are securely fastened to a subject’s fingertip, and data should not be obtained from smokers as they have higher carboxyhemoglobin levels [5]. Current results suggest fingertip pulse oximetry values collected before, between sets, and after resistive exercise workouts yield HR values with acceptable levels of intra-rater reliability and repeatability. Yet that was not the case for our SpO ${}_{2}$ values, which we primarily attribute to the exercise mode and protocol examined. While current workouts examined a relatively small muscle group (plantar flexors) as the prime mover, it is anticipated as larger muscles engage in non-steady state exercise there would be even greater SpO ${}_{2}$ data dispersion from higher fluctuations in oxygen delivery and transport.

Author contributions

CONCEPTION: John F. Caruso.

PERFORMANCE OF WORK: Alex C.S. Shefflette.

DATA ANALYSIS: John F. Caruso.

MANUSCRIPT PREPARATION: John F. Caruso.

SUPERVISION: John F. Caruso.

Ethical considerations

Funding

Funds came from an internal research grant.

Footnotes

Acknowledgments

We thank our subjects for their participation.

Conflict of interest

The authors have no conflicts of interest to declare. Given his role as an Editorial Board Member, John F. Caruso had no involvement nor access to information regarding the peer review of this article.

References

Yamaya

Boggard

Wagner

Niizeki

Hopkins

. Validity of pulse oximetry during maximal exercise in normoxia, hypoxia, and hyperoxia. J Appl Physiol. 2002; 92: 162-168.

Tannheimer

. The use of pulse oximetry at high altitude. Res Invest Sports Med. 2020; 6: 481-483.

Tannheimer

Kirsten

Treff

Lechner

. Usability of pulse oximetry during severe physical exercise at high altitude. Ger J Sports Med. 2018; 69: 351-353.

Martin

Powers

Cicale

Collop

Huang

Criswell

. Validity of pulse oximetry during exercise in elite endurance athletes. J Appl Physiol. 1992; 72: 455-458.

Mengelkoch

Martin

Lawler

. A review of the principles and accuracy of pulse oximeter estimates during exercise. Phys Ther. 1994; 74: 46-54.

Warren

Cureton

Middendorf

. Validity and reliability of pulse oximetry in highly trained endurance athletes. In: Proceedings of the Southeast Chapter of the American College of Sports Medicine Annual Meeting. 1990: 38. Abstract.

Davison

Rumpler

Barbosa

Gutierrez

Caruso

. Metabolic responses to high-speed exercise measured via whole room calorimetry. Med Sportiva. 2014; 18: 185-191.

Morgan

Woodruff

Tiidus

. Aerobic energy expenditure during recreational weight training in females and males. J Sport Sci Med. 2003; 2: 117-122.

Hansen

Casaburi

. Validity of ear oximetry in clinical exercise testing. Chest. 1991; 91: 333-337.

10.

Macoun

Botek

Krejci

McKune

. Vagal activity and oxygen saturation response to hypoxia: Effects of aerobic fitness and rating of hypoxia tolerance. Acta Gymnica 2017; 47: 112-121.

11.

Losa-Iglesias

Beccero-de-Bengoa-Vallejo

. Reliability and concurrent validity of a peripheral pulse oximeter and health-app system for the quantification of heart rate in healthy adults. Health Informatics. 2016; 22(2): 151-159.

12.

Muñoz

Torres

Sampol

Rios

Marti

Escrich

. Accuracy and reliability of pulse oximetry at different arterial carbon dioxide pressure levels. Eur Respir J. 2008; 32: 1053-1059.

13.

Lauterbach

Romano

Greisler

Brindle

Ford

Kuennen

. Accuracy and reliability of commercial wrist-worn pulse oximeter during normobaric hypoxia exposure under resting conditions. Res Quart Exerc Sport. doi: 10.1080/02701367.2020.1759768.

14.

Alkner

Tesch

. Efficacy of a gravity-independent resistance exercise device as a countermeasure to muscle atrophy during 29-day bed rest. Acta Physiol. Scand. 2004; 181: 345-357.

15.

Caruso

Hernandez

Porter

Schweikert

Saito

Cho

, et al. Integrated electromyography and performance outcomes to inertial resistance exercise. J Stren Cond Res. 2006; 20: 151-156.

16.

Caruso

Williams

Hari

McCoy

Coday

Ramsey

, et al. Data reproducibility from the instrumentation of an inertial resistance exercise device suggested for use during space travel. Isok Exerc Sci. 2006; 14: 371-382.

17.

Flansbjer

Homback

Downham

Patten

Lexall

. Reliability of gait performance tests in men and women with hemiparesis after stroke. J Rehabil Med. 2005; 37: 75-82.

18.

Kovelski

Ingersoll

Knight

Mahar

. Reliability of the BTE dynatrack isotonic dynamometer. Isok Exerc Sci. 1996; 14: 53-62.

19.

Kovelski

Heitman

Gurichek

Erdmann

Trundle

. Reliability and effects of leg dominance on lower extremity isokinetic force and work using the closed chain rider system. J Sports Rehabil. 1997; 6: 319-326.

20.

Morgan

Woodruff

Tiidus

. Aerobic energy expenditure during recreational weight training in females and males. J Sport Sci Med. 2003; 2: 117-122.

21.

Kropohl

Shaw

. Fundamentals of Polygraph Practice, 2015.

22.

Marino

Jones

Kirshblum

Tal

Dasgupta

. Reliability and repeatability of the motor and sensory examination of the international standards for neurological classification of spinal cord injury. J Spinal Cord Med. 2008; 31: 166-170.

23.

Mokkink

Terwee

Patrick

Alonso

Stratford

Knol

, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international delphi study. Qual Life Res. 2010; 19(4): 539-549.

24.

Liu

Correia

Ballaji

Korposh

Hayes-Gill

Morgan

. Optical Fibre-based pulse oximetry sensor with contact force detection. Sensors. 2018; 18: 3632.

25.

Seifi

Khatony

Moradi

Abdi

Najafi

. Accuracy of pulse oximetry in detection of oxygen saturation in patients admitted to the intensive care unit of heart surgery: comparison of finger, toe, forehead and earlobe probes. BMC Nursing. 2018; 17: 15.

26.

Van de Louw

Cracco

Cerf

HArf

Duvaldestin

Lemaire

Brochard

. Accuracy of pulse oximetry in the intensive care unit. Intensive Care Med. 2001; 27: 1606-1613.

27.

Smyth

D’Urzo

Slutsky

Galko

Rebuck

. Ear oximetry during combined hypoxia and exercise. J Appl Physiol. 1986; 60: 716-719.

28.

Miyachi

Katayama

. Effects of maximal interval training on arterial oxygen desaturation and ventilation during heavy exercise. Jpn J Physiol. 1999; 49: 401-407.

29.

Powers

Dodd

Freeman

Ayers

Samson

McKnight

. Accuracy of pulse oximetry to estimate HbO2 fraction of total Hb during exercise. J Appl Physiol. 1989; 67: 300-304.

30.

Hadeli

Siegel

Sherrill

Beck

Enright

. Predictors of oxygen desaturation during submaximal exercise in 8,000 patients. Chest. 2001; 120: 88-92.

Intra-rater reliability and repeatability of pulse oximetry values obtained before,between sets,and after resistive exercise

Abstract

BACKGROUND:

OBJECTIVE:

METHODS:

RESULTS:

CONCLUSIONS:

Keywords

1. Introduction

2. Methods

2.1 Subjects and their first visits

2.2 Pulse oximeter

2.4 Ergometer design and instrumentation

3. Results

Table 1 Concentric, eccentric and total work values (mean ± sem) and results

Author contributions

Ethical considerations

Funding

Footnotes

Acknowledgments

Conflict of interest

References

Table 1
Concentric, eccentric and total work values (mean $\pm$ sem) and results