Abstract
Objective
This research investigated whether the psychoacoustics of simultaneous masking, which are integral to a model-checking-based method, previously developed for detecting perceivability problems in alarm configurations, could predict when IEC 60601-1-8-compliant medical alarm sounds are audible.
Background
The tonal nature of sounds prescribed by IEC 60601-1-8 makes them potentially susceptible to simultaneous masking: where concurrent sounds render one or more inaudible due to human sensory limitations. No work has experimentally assessed whether the psychoacoustics of simultaneous masking accurately predict IEC 60601-1-8 alarm perceivability.
Method
In two signal detection experiments, 28 nursing students judged whether alarm sounds were present in collections of concurrently sounding standard-compliant tones. The first experiment used alarm sounds with single-frequency (primary harmonic) tones. The second experiment’s sounds included the additional, standard-required frequencies (often called subharmonics). T tests compared miss, false alarm, sensitivity, and bias measures between masking and nonmasking conditions and between the two experiments.
Results
Miss rates were significantly higher and sensitivity was significantly lower for the masking condition than for the nonmasking one. There were no significant differences between the measures of the two experiments.
Conclusion
These results validate the predictions of the psychoacoustics of simultaneous masking for medical alarms and the masking detection capabilities of our method that relies on them. The results also show that masking of an alarm’s primary harmonic is sufficient to make an alarm sound indistinguishable.
Application
Findings have profound implications for medical alarm design, the international standard, and masking detection methods.
Keywords
Introduction
In modern medical environments, a single patient produces hundreds of alarms per day and thus tens of thousands of alarms are generated a day in any given hospital (The Joint Commission, 2013a). Health professionals do not always respond to these alarms, and this is a very dangerous problem. The Pennsylvania Patient Safety Authority (2009) reported 194 problems (12 that resulted in fatalities) with medical personnel failing to react to telemetry monitoring alarms from June 2004 through December 2008. Similarly, 98 alarm nonresponses (five extended patient hospital stays, 13 produced “permanent loss of function,” and eight ended in patient death) were documented in a Sentinel Event Alert (The Joint Commission, 2013a) that covered a period from January 2009 to June 2012. Because of these types of problems, the Emergency Care Research Institute (ECRI) has consistently named medical alarms one of the most important technological hazards to patient safety for more than a decade (ECRI Institute, 2018; Stead & Lin, 2009).
There are many reasons why humans may fail to respond to medical alarms including the number of false alarms, the lack of consistent design philosophies between alarms and medical devices, and designs that do not facilitate alarm learnability and discernibility (see reviews by Edworthy, 2013; Edworthy et al., 2018). The perceivability of the alarms in the presence of other alarms is at least partially responsible for this problem (ECRI Institute, 2014; The Joint Commission, 2013a, 2013b; Vockley, 2014).
One issue that can affect the perceivability of medical alarms is simultaneous masking. In simultaneous masking, limits of the human sensory system prevent humans from hearing one or more concurrent sounds (Fastl & Zwicker, 2006). A number of researchers have generally speculated that simultaneous masking could be a problem with medical alarms (Edworthy & Hellier, 2005, 2006; Edworthy & Meredith, 1994; Konkani, Oakley, & Bauld, 2012; Meredith & Edworthy, 1995; Patterson, 1982; Patterson & Mayfield, 1990). This is because medical alarms are often represented as melodies of tonal sounds, including alarms that are compatible with the International Electrotechnical Commission’s (IEC) international standard (IEC 60601-1-8:2006/AMD1:2012, 2012). This makes them especially prone to simultaneous masking (Bosi & Goldberg, 2003; Fastl & Zwicker, 2006). There is also empirical evidence that simultaneous masking does occur for medical alarms in modern hospitals. Momtahan, Hetu, and Tansley (1993) analyzed 49 medical alarms and found 25 pairs in which one could be completely masked by the other. Toor, Ryan, and Richard (2008) discovered several instances where high priority alarms could be masked by lower priority operating room sounds including other alarms, telephone rings, and beeper sounds. Both of these studies involved recording sounds in a medical environment and then using the psychoacoustics of simultaneous masking (mathematical formulations that predict whether simultaneous masking occurs based on the volumes and frequencies of the sounds; Bosi & Goldberg, 2003) to identify pairs of alarms where masking could occur.
Despite these findings, medical alarm safety has mostly focused on other problems (Edworthy, 2013). This is likely due to the complexity of simultaneous masking. Masking can manifest as a result of multiple simultaneously sounding alarms (not just pairs) and may only occur for particular timings of the overlaps between the alarms. It is thus almost impossible for analysts to experimentally determine how masking could manifest in alarm configurations. Given the sheer number of medical alarms and possible different overlaps between them in a given hospital (The Joint Commission, 2013a), it is likely that masking is an important factor in alarm nonresponse.
To address this situation, we developed a computational method (Bolton, Edworthy, & Boyd, 2018; Bolton, Edworthy, Boyd, Wei, & Zheng, 2018; Bolton, Hasanain, Boyd, & Edworthy, 2016; Hasanain, Boyd, & Bolton, 2016, 2014; Hasanain, Boyd, Edworthy, & Bolton, 2017) that uses the psychoacoustics of simultaneous masking and model checking. Model checking is a formal method that allows an analyst to automatically, mathematically prove properties against models of concurrent systems (a process called formal verification; Clarke, Grumberg, & Peled, 1999). In our method, an analyst models the behavior of alarms and runs model checking to prove if the represented alarms can ever mask each other. This method has been used to analyze real medical alarm configurations (Bolton et al., 2018; Bolton et al., 2016; Hasanain et al., 2017) and the reserved alarm sounds of the IEC 60601-1-8 international standard (Bolton et al., 2018).
This method is powerful and offers unprecedented masking detection capabilities. However, the method has limitations. First, like the experimental results presented by Momtahan et al. (1993) and Toor et al. (2008), the method relies on the psychoacoustics of simultaneous masking. Although these psychoacoustics have been well tested over the years (Bosi & Goldberg, 2003), they have not been explicitly experimentally validated for medical alarm sounds. Second, many tonal medical alarms are consistent with the IEC 60601-1-8 standard. This means that they contain a primary harmonic (frequency) as well as several additional harmonics (usually the minimum of 4) that are multiples of the primary that are at lower volumes. Although our method is capable of accounting for the masking effects of both primary and additional harmonics, including the additional harmonics can require orders of magnitude more computational time. Thus, if the masking of the primary harmonics was critical to alarm perceivability irrespective of the additional harmonics, this would profoundly improve the usefulness and relevance of our method.
We addressed both of these issues by conducting two signal detection theory (SDT) experiments. In the first, we validated the ability of our method to predict masking between primary harmonics of IEC 60601-1-8 medical alarm sounds. In the second, we assessed how well predictions about masking between the primary harmonics affect the perceivability of alarms with a full set of IEC 60601-1-8-required additional frequencies.
Review of Relevant Literature
Below we provide background on the alarms of IEC 60601-1-8, the psychoacoustics of simultaneous masking that are used by our method to predict masking, and the SDT experimental paradigm that we use in our research.
IEC 60601-1-8
The IEC 60601-1-8 international medical alarm standard is widely used across the medical industry. It was created to improve alarm discernibility and identification. As part of this, it provides instructions for designing new alarm sounds, which typically manifest as melodies (sequences) of tones separated by pauses. There are many details in the standard. For the work presented in this paper, we are primarily concerned with the specific requirements of the individual tones that compose alarm melodies. Each tone in a melody has a single primary frequency. It also has several additional harmonics (additional frequencies) designed to make the alarms more tonally rich and help listeners localize alarm sources. The standard does not require specific frequencies, volumes, and timings of the tones in alarm melodies. Rather, it provides ranges of acceptable values. These are summarized in Table 1.
IEC 60601-1-8 Alarm Tone Characteristics
Note. dBs = decibels.
A number of issues have been identified with the melodic alarm sounds prescribed in the standard that compromise the standard’s goal of making alarms discernable and identifiable (Edworthy et al., 2018). In this work, we are particularly concerned with the effect simultaneous masking has on alarm audibility.
Masking and the Psychoacoustics of Simultaneous Masking
Auditory masking describes a number of different phenomena where a sound is rendered inaudible due to the presence of one or more other (masking) sounds. For example, pressure waves of sounds can physically interact to cancel each other out or a given sound can be indistinguishable from environmental noise. In this work, we focus on simultaneous masking. This occurs when similar, simultaneous sounds render one or more imperceptible due to the way that the sounds affect the sensitivity of the human sensory system.
Our method uses the psychoacoustics of simultaneous masking to make predictions about whether any given alarm in a configuration will be audible. The psychoacoustics of simultaneous masking mathematically describe how the volumes and frequencies of sounds produce masking. In particular, the psychoacoustics are based on how masking sounds (maskers) stimulate the sensors of the basilar membrane: the spiral-shaped physical structure in the human inner ear that is responsible for the ability of humans to distinguish between sounds (Ambikairajah, Davis, & Wong, 1997; Baumgarte, Ferekidis, & Fuchs, 1995; Bosi & Goldberg, 2003; Brandenburg & Bosi, 1997; Brandenburg & Stoll, 1994; Schroeder, Atal, & Hall, 1979). This raises the absolute threshold (in decibels [dBs]) that the volume of another sound (a potential maskee) must exceed to be perceivable (Bosi & Goldberg, 2003).
These psychoacoustics render frequencies on the Bark scale (Zwicker & Feldtkeller, 1967): a scale that maps a frequency in Hertz to a position on the basilar membrane where that frequency most powerfully stimulates the receptors (see Figure 1). A frequency in Hertz (fsound) is converted into Barks using Equation 1.
The “masking curve” calculates how a given masker shifts the absolute threshold of hearing with Equation 2.
In this, vmasker is the masker’s volume in decibels and δz is calculated using
where zmaskee and zmasker are the Bark scale frequencies of the maskee and masker, respectively. Furthermore, the spreadmasker (Equation 2) function models how the magnitude/volume of the masking threshold changes with respect to δz. Finally, Δ is the minimum difference between the volumes of the masker and maskee that can result in masking.
There are multiple formulations of the psychoacoustic spreading function and Δ based on the characteristics of the masking and masker sounds. In this research, we use the formulation
where
These were used because they are universally regarded as the most accurate for modeling tonal sounds (Ambikairajah et al., 1997; Bosi & Goldberg, 2003; Brandenburg & Stoll, 1994). Figure 2 illustrates the shape of the masking curve described by Equation 2.

Depiction of how peak stimulation of sounds in Hertz occurs at different Bark locations along the basilar membrane.

The masking curve shape dictated by Equations 2 to 5. dB = decibel.
Furthermore, the combined masking threshold of multiple concurrent sounds can be greater than a simple sum of the effect of individual maskers (Bosi & Goldberg, 2003; Humes & Jesteadt, 1989). This effect is called additive masking. Because masking levels are measured in decibels (a logarithmic scale), these are transformed to the power scale to allow for arithmetic operations. A volume in decibels (v) can be converted to the power scale using Equation 6.
Then, for a given potential maskee and N potential maskers, the absolute value of hearing adjusted for the additive effect of masking (in decibels) is calculated using Equation 7.
In this, α is a positive constant (Green, 1967); absmaskee is the unaltered absolute threshold of hearing (in decibels) at the maskee’s frequency. This, using the maskee’s frequency in Hertz, is described using Equation 8 (Terhardt, 1979).
These psychoacoustics have been used successfully to predict masking for normal human hearing for decades (Bosi & Goldberg, 2003). They were employed by researchers to identify when masking could occur for sounds recorded in medical environments (Momtahan et al., 1993; Toor et al., 2008). They were also the basis for lossy audio compression techniques (like those used in MPEG [Moving Picture Experts Group] formats; Bosi & Goldberg, 2003), digital audio compression methods that allow reductions in the size of audio files by removing audio data that is predicted to be masked.
SDT
SDT models the detection of an event in a noisy environment. In a human judgment context, this captures both the state of the world (whether there is signal in the presence of noise or just noise) and the human’s response (“Yes” there is a signal or “No” there is no signal). Based on this representation, there are four possible classifications of the outcome (Figure 3). Two of these are correct. If the judge says “Yes” when there is signal, the outcome is a hit. If the judge says “No” when there is only noise, the outcome is a correct rejection. Two of the outcomes are incorrect. If the judge says “Yes” when there is only noise, the outcome is a false alarm. If the judge says “No” when there is a signal, the outcome is a miss.

A matrix describing how the different outcomes can manifest based on a “Yes” or “No” human response to a stimulus that is either signal or noise.
When a human performs a signal detection task and makes multiple judgments in response to different states of the world, rates can be calculated for each of the outcomes:
Hit Rate:
Miss Rate:
False Alarm Rate:
Correct Rejection Rate:
Note that because of the inverse relationships between hits and misses and between false alarms and correct rejections, analysts will typically only discuss results from one rate from each pair. For example, in the presented work, we only talk about miss and false alarm rates.
Two additional measures for modeling human judgment are typically calculated from the above rates: sensitivity and response bias (or simply bias). Sensitivity captures the judge’s ability to distinguish signal from noise. Response bias is a measure of whether a judge is more likely to respond one way or another.
When the signal and noise can be assumed to be normally distributed with equal variance, sensitivity is the distance between the means of the signal and the noise distributions. The response bias is the likelihood ratio that a response of “Yes” is due to the presence of signal as opposed to noise alone. However, for many judgment tasks, the distributions of signal and noise may not be normally distributed (as will be the case in the experiments presented in this paper) or the distributions may be unknown. Thus, there are nonparametric measures for computing sensitivity and response bias (Macmillan & Creelman, 1990; See, Warm, Dember, & Howe, 1997). In this work, we use the nonparametric calculations that have been shown to be appropriate in human subject experiments (See et al., 1997).
A′, based on concepts introduced by Pollack and Norman (1964), calculates nonparametric sensitivity by approximating the area under a receiver operating characteristic (ROC) curve defined by the observed hit (H; Equation 9) and false alarm (F; Equation 11) rates (Snodgrass & Corwin, 1988):
This produces a value between 0 and 1, where a higher value indicates that the judge was more sensitive (more readily able to distinguish between signal and noise).
A
Experiment 1
In our first experiment, we used a SDT procedure to assess how well the psychoacoustics of simultaneous masking that are used in our method predict the ability of humans to perceive the primary harmonics of alarm sounds from IEC 60601-1-8.
Method
Participants
A power analysis revealed that 80% power was achieved for detecting a moderate effect size (d = 0.55) with a two-tailed paired t test with 28 participants. Thus, 28 participants were recruited for this study. Nursing students from the University at Buffalo were used as the participant pool because it constituted members of the actual population that will experience medical alarm sounds in a natural environment. Twenty-one of the recruited students were female and seven were male. The experiment did not control for musical experience because we could find no research showing that musical ability had any impact on masking.
Materials and apparatus
The experiment was run in the Usability Laboratory at the University at Buffalo, a controlled, quiet, evenly lit environment. It was administered on a laptop computer resting on a computer desk (see Figure 4) in front of which a participant would sit. The laptop computer was connected to an external USB, 7.1 sound card. Four single-driver computer speakers were connected to the sound card so that each speaker only output sounds sent to a single channel of the sound card. The speakers were placed in line with each other on an elevated platform behind the laptop. The laptop computer was also connected to an optical computer mouse that the participant could use to interact with the software that administered the experiment.

The physical apparatus setup used in the reported experiments. Both depict ((a) in profile and (b) from above) a participant sitting in front of a computer desk on which a laptop computer, a computer mouse, and four speakers were placed.
The software used for administering the experiment was constructed specifically for this study. This was implemented as a Visual Basic for Applications program within a Microsoft Excel spreadsheet. This software was able to examine the experimental design (which was stored in the spreadsheet), administer a given participant’s experiment according to it, collect user responses, and store them in a separate Excel sheet. The interface that the software used for administering the experiment is shown in Figure 5. This told a participant which trial they were on, out of the total number of trials. It also gave participants instructions for how to perform the trial.

The interface to the software used to administer the experiment and collect participant responses. This was always displayed in full screen so that the user could not see or interact with the Excel spreadsheet running in the background.
In a given trial, participants were charged with determining whether a judgment sound was present in a test sound. The judgment sound represented a single alarm sound that was always played on the rightmost speaker (Figure 4). The test sound constituted a simulation of the simultaneous sounding of multiple alarm sounds (between one and three) from different devices. Thus, the alarm sounds of the test sound were each played on one of the three left-most speakers (one sound per speaker; Figure 4). When interacting with a trial in our software, a participant would first click on the “
Play the Judgment Sound” button to play the judgment sound. Participants would then click on the “
Play the Test Sound” button to play the test sound (Figure 4). Participants were allowed to play either of these sounds (one at a time) as many times as they wanted to until they felt like they could render a judgment. When participants were ready, they would indicate whether or not they thought the judgment sound was present in the test sound by clicking on the “Yes” (indicating they thought the sound was present) or “No” (indicating that they thought the sound was not present) radio buttons. When participants were satisfied with their answer, they would click on the “Next
” button. The interface would then present a dialogue box that would ask participants if they wanted to confirm their answer. If participants pressed a “No” button, they would stay on the current trial. If they pressed a “Yes” button, they would go to the next trial. Whenever this dialogue box was being displayed, the software played brown noise (signal noise naturally produced by Brownian motion; Vasseur & Yodzis, 2004) from the speakers to give participants a “palate cleanser” between trials.
A sound level meter, positioned at the ear position of a participant, was used to calibrate the laptop and speakers so that volumes matched the levels specified by the experiment.
A given trial was a pair of sounds: the judgment sound (a single alarm sound played on a single speaker in the apparatus) and the test sound (a collection of one to three alarm sounds, each played synchronously on a separate speaker in the apparatus). All of the sounds were designed to be consistent with the requirements of single tones from IEC 60601-1-8-compliant alarm sounds (Table 1), with only the primary harmonics. Each of the sounds was 0.25 s long. The tone in the judgment sound was 70 dB. One of the tones in all of the test sounds was 70 dB. The other tones in the test sound were 85 dB. If the judgment sound was in the test sound, the judgment sound was always the 70 dB sound in the test sound. These volumes were used because they were allowable by the standard (which specifies variations in volumes of any alarm sounds at the same priority be within 15 dB of each other; Table 1), are consistent with alarm volumes used in the field, and were not loud enough to cause hearing problems when combined together in the experiment. The set of frequencies used for tones were based on piano notes that fit within the allowable range of the standard (and are used to formulate the reserved alarm sounds in the standard; see Table 2). The frequencies used for the tones of the test sound were always different from each other.
The Frequencies Used in Tones Found in Judgment and Test Sounds
Independent variables
There were two inde-pendent within-subject variables in the experiment that enabled the use of a SDT experimental design. First, a trial was either a signal trial or a noise trial. In a signal trial, the judgment sound was one of the sounds output in the test sound. In a noise trial, the judgment sound was not part of the test sound. Second, a trial could either contain masking (where the 70 dB tone was masked by the other tones in the test sound according to the psychoacoustics of simultaneous masking) or not (where, according to the psychoacoustics, none of the tones in the test sound would be masked). In trials that were both signal and masking, the test sound would contain the judgment sound and the judgment sound would be the one predicted to be masked.
Dependent measures
For each trial, participants would indicate whether they thought the judgment sound was present in the test sound. This “Yes” (the judgment sound was present) or “No” (the judgment sound was absent) response was the only dependent measure in the experiment.
Procedure
In the experiment, a participant was admitted to the lab and sat in front of the apparatus as shown in Figure 4. The participant was then given an informed consent document which they read and signed. After this, participants were read instructions that told them how to interact with the software interface (Figure 5) to administer the experiment. The participants were given a copy of the instructions for their reference. The participant then interacted with the software’s interface to administer training and the experiment. When the experiment was completed, participants were given a US$20 Amazon gift card.
Training
Before the proper start of the experiment, all participants experienced the same 18 training trials that were designed to introduce them to the judgment task. This was done by presenting trials in blocks. All trials and blocks were always presented to participants in the same order. The first block of four trials were signal trials that did not contain masking. The second block of four trials were noise trials that also did not contain masking. The third block of four trials were signal trials that did contain masking. For all three of these blocks, dialogue boxes introduced the blocks and told patients whether he or she should or should not hear the judgment sound in the test sound. In the final block of six trials, the trials were a random ordering of two signal trials with masking, two signal trials without masking, one noise trial without masking, and one signal trial without masking. In this final block, participants were told it was up to them to determine if the test sound was in the judgment sound. Across all of the training trials, participants were given feedback, via a dialogue box, about the accuracy of each judgment after it was made.
Experimental design
Following training, each participant experienced the same 200 experimental trials. These trials were grouped in a single block and were arranged consistently with the standards for nonparametric, human subjects, SDT designs as outlined by McNicol (2005), who recommended 50 masking and 50 noise trials for each experimental condition considered in an experiment. As per these standards, trials contained 100 masking trials and 100 trials without masking, where there were 50 signal and 50 noise trials in each 100-trial designation. All 200 trials were presented to each participant in a unique, randomly generated order. In signal trials, the speaker on which the judgment sound was played as part of the test sound was counterbalanced between trials.
The number of tones included in the trial’s test sound could vary. In masking trials, test sounds could have either two or three tones (there were equal numbers of masking trials with each number of tones). In trials without masking, test sounds could have between one and three tones (there were equal numbers of nonmasking trials with each number of tones). Test sounds in masking trials were not allowed to have one tone because simultaneous masking could not occur in such a situation. Test sounds were allowed to have one tone in trials without masking because it could provide a nonmasking condition that was perceptually comparable to a masking condition with two tones.
Data analysis
Because simultaneous masking theoretically makes masked alarms inaudible, we hypothesized that we would observe a significantly higher miss rate (M) for the masked trials than the unmasked ones. Due to the nature of SDT rates (Equations 9 to 12), this would correspond to a significantly lower hit rate (H) for masked trials than the unmasked trials. Because the presence or absence of masking should not affect a human’s tendency to say “Yes” in noise trials, we did not hypothesize a significant difference in false alarm rates (F) (and thus correct rejection rates; C) between masked and unmasked trials.
Because the inability to hear alarms would suggest a drop in human sensitivity, we hypothesized that humans would exhibit a lower sensitivity that was significant for masked trials than for unmasked ones. We did not hypothesize that the presence of masking would affect participant response bias.
To test these hypotheses, we analyzed each participant’s responses in accordance with the SDT measures discussed in the background section. First, for each participant, the masking and nonmasking trials were analyzed separately and used to compute each of the SDT rates (H, F, M, and C; Equations 9 to 12) and their associated nonparametric measures of sensitivity (A′; Equation 13) and bias (
Note that to ensure that the assumptions for the t tests were valid, in all cases, an Anderson–Darling test was conducted to assess the normality of the difference between the paired rates of participants.
Results
The results of the comparisons of miss and false alarm rates (M and F, respectively) are reported in Figure 6. These analyses showed that miss rate (M) was significantly higher for masking trials than for trials without masking. There was no significant difference between false alarm rates (F) between masking and nonmasking trials.

Means (labeled circles) and 95% within-subject confidence intervals (horizontal bars; Cousineau & O’Brien, 2014) for miss rates (M), false alarm rates (F), sensitivity (A′), and bias (
The sensitivity (A′) and bias (
Discussion
These results are consistent with our hypotheses. We found that participants made more misses when the test sounds were masked than when they were not. In the nonmasking condition, participants had misses only roughly one third of the time while, in the masking condition, participants made misses on average 48.1% of the time, which is extremely close to 50% (which would be expected by random guessing). Conversely, there was no significant difference in false alarm rates between the two conditions, which happened roughly 30% of the time. Furthermore, participants had a lower sensitivity for masking trials than for nonmasking ones. Collectively, these results suggest that participants clearly had more trouble distinguishing between signal and noise in the masking condition than the nonmasking one, and that this was predominantly due to the fact that masking makes it more likely that humans will miss alarms. This is an important result because it validates that the psychoacoustics of simultaneous masking used in our method are able to accurately predict whether or not masking will contribute to alarm perceivability.
It is slightly concerning that the judgment error rates observed outside of the masking miss condition occurred roughly one third of the time and were not closer to 0. This is likely due to the fact that the judgment task was difficult and that there are higher perceptual, attentional, and cognitive factors that will influence it. Implications of this are explored in greater depth in the general discussion.
The results on bias did not strictly violate our hypothesis that there would be no statistically significant difference between the masking and nonmasking conditions. There does appear to be a trend that people were biased toward saying “Yes” more often in masking trials than in nonmasking ones. It is not entirely clear why this occurred. This will be explored in greater depth in the general discussion.
Experiment 2
Experiment 1 provided evidence for the validity of the psychoacoustics of simultaneous masking. However, because this experiment did not include any additional harmonics, it is not clear whether these results would generalize to complete alarm sounds as specified in the international standard (see Table 1). Thus, the second experiment we conducted was designed to see how well the masking of alarm sound primary harmonics affects the perceivability of more complex alarm sounds that include the requisite additional harmonics dictated by the standard (see Table 1).
Method
Experiment 2 was an almost identical replication of Experiment 1. It was performed with 28 new nursing student participants (this time with 24 females and four males) with the same apparatus, methods, and experimental design. There were two important differences.
First, while the alarm sounds represented the same set of 200 trials from the first experiment, the versions of the sounds used in Experiment 2 were extended to include four additional harmonics that played concurrently with the original primary harmonic of the sound. In all cases, these additional harmonics were computed as being 3, 5, 7, and 9 times the frequency of the primary harmonic (whole number multiples are typically used to avoid dissonance in the complex sound). Each additional harmonic had a volume 15 dB lower than the primary one. These parameters made the alarm sounds compliant with the standard (see Table 1) and were consistent with common recommendations for accomplishing this (Thompson, 2010).
The second difference from Experiment 1 came in the data analysis. While the results of Experiment 2 were evaluated using the same methods as Experiment 1, we also used standard (nonpaired) two-tailed t tests to determine if there were significant differences between comparable measures (M, F, A′, and
Results
Results and statistics for the miss rate (M) and false alarm rate (F) analyses are shown in Figure 7. These showed that miss rate was significantly higher for the masking condition than for the nonmasking one and that there were no statistically significant differences in false alarm rates.

Means (labeled circles) and 95% within-subjects confidence intervals (horizontal bars) for miss rates (M), false alarm rates (F), sensitivity (A′), and bias (
The results of the sensitivity (A′) and bias (
The comparison of these SDT statistics to the comparable ones from Experiment 1 (see Figure 8) revealed that there were no significant differences between any of them.

Comparisons of miss rate (M), false alarm rate (F), sensitivity (A′), and bias (
Discussion
The results for Experiment 2 effectively replicated the results seen for Experiment 1. It produces comparable values between the computed SDT measures and none of the comparable measures’ difference was statistically significant. These results show that the inclusion of additional harmonics does not affect the overall perceivability of alarms for any of the experimental conditions. Given the comparable rates and sensitivities across the masking and nonmasking conditions, this means that the additional harmonics neither counteract the effect of masking nor do they help improve the overall perceivability of the alarms. This is a compelling result that will be discussed further in the next section. It is important to note that because the frequencies of the additional harmonics were obtained by multiplying the primary harmonic by whole numbers, it is extremely unlikely that any of these harmonics would be masked due to the bark distances this multiplication creates. Thus, this effect is not due to simultaneous masking. It is our hypothesis that the masking of the primary harmonic reduces the salience of the alarms such that the additional frequencies are not enough for people to identify them. This will need to be investigated more deeply in future research.
The only slight discrepancy in the results between the two experiments was seen in the response bias measures, which did exhibit a significant difference in Experiment 2 (only a nonsignificant trend was seen in Experiment 1). As with Experiment 1, it is not entirely clear why participants would tend to say “Yes” in the masking condition. This is discussed more in the next section.
General Discussion and Conclusion
This research used human subject experiments to validate that the psychoacoustics of simultaneous masking are able to predict the perceivability of medical alarm sounds. To the best of our knowledge, this is the first research to empirically show that masking is a problem for the current IEC 60601-1-8 alarms. Furthermore, our research showed that the masking effect is strong enough to reduce the audibility of IEC 60601-1-8-compliant alarms by a statistically significant amount, even with the inclusion of the requisite additional harmonics. These are powerful results because they mean that the psychoacoustics of simultaneous masking can be used to make predictions about whether people will be able to hear alarms from the IEC 60601-1-8 international standard and that this can be done with only the primary harmonics of the alarms.
Our results are of import to our method (Bolton et al., 2018; Bolton et al., 2018; Bolton et al., 2016; Hasanain et al., 2014; Hasanain et al., 2016; Hasanain et al., 2017), which, in turn, has important implications for alarm design and masking in health care environments. First, by validating the predictive capabilities of the psychoacoustics that our method uses, we enable the predictive power of our method to be used effectively to design and evaluate medical alarms and its use in our ongoing effort to evaluate and improve the international medical alarm standard (Bolton et al., 2018). This has the potential to improve the perceivability of medical alarms across the industry and thus improve patient safety and outcomes. Second, although our method can account for additional harmonics, doing so requires more computational time and resources. So pronounced is this, that it has the potential to limit the applicability of the method. Thus, by showing that we only need to account for the primary harmonics in analyses, our results expand the potential usefulness and approachability of our method. This should help enable the use of our method in the analysis of the planned changes to the international standards and by medical device companies designing medical alarms. Third, our results validate the previous findings that have been made using our method. This includes evaluations of the standard’s reserved alarm sounds (Bolton et al., 2018) and standard-compliant alarms used in real telemetry monitoring systems (Bolton et al., 2018). These analyses found compelling problems with these alarms. Thus, the previous results along with the validation presented in this paper suggest that there could be serious masking problems with the alarms of IEC 60601-1-8. Future work should systematically explore when and how masking can manifest in the standard.
Beyond the masking results, our experiments also provide some troubling data about the standard. In particular, across both experiments, the minimum miss and false alarm rates (even in the absence of masking) was approximately 30%. This means that even without masking, the alarm sounds prescribed by the standard can be very difficult to distinguish from the others. Although we used a different experimental design, our results are consistent with research by Lacherez, Seah, and Sanderson (2007), who found that alarm sounds from the standard were very difficult to distinguish from each other when they played concurrently. As such, it is clear that changes will need to be made to the sounds of the alarm standard to make them more distinguishable. The work presented in this paper is being conducted concurrently with a number of other coordinated efforts (Edworthy et al., 2018) to address shortcomings in IEC 60601-1-8 and recommend improvements. Thus, results from the work presented in the paper will be used to help improve the general distinguishability of standard alarm sounds.
As with any study, there were some limitations to our experiments. These and future work are discussed in the following sections.
Additional Experimental Considerations
There are factors that limit the realism of our experiment: We only considered single tones from alarm melodies; experiments were conducted in a quiet controlled laboratory (not a realistic environment); and participants were able to give the experiment their undivided attention (something extremely unlikely in a health care scenario). All of these factors were intentionally chosen to allow the experiment to isolate the effect of masking and minimize the impact of other limits on human perception, attention, and cognition. However, future work could investigate the true impact masking would have on alarm identification in more realistic contexts. Given the strong impact masking had on detection in the ideal listening conditions in our experiment, we would expect even worse detection performance in more realistic settings. Future work should investigate what proportion of alarm perceivability is attributable to simultaneous masking in realistic medical environments.
Experiment 2 only considered one method for including additional frequencies in alarm sounds. Although the parameters for these that were used in our experiment followed common guidelines (Thompson, 2010), it is possible that different parameters could improve alarm distinguishability. In particular, alarms could possibly be made to be more salient by using additional harmonics that are not integer multiples of the primary one, thus creating harmonic dissonance. This should be the subject of future research.
Investigation of Bias
In both experiments, participants had a larger, positive bias in the masking condition than in the nonmasking condition (although this difference was only statistically significant in Experiment 2). This means that they tended to say “Yes” in masking trials more often than in the nonmasking ones. It is not clear why this occurred. One possibility has to do with the fact that in trials with masking, masking sounds could sometimes sound slightly “warbly” (trilling or quavering). This may be caused by physical interactions (called beating; see Levitin, 2006) between the frequencies of the masking and masked sounds. It is possible that this “warbliness” was used by some participants as a cue that the judgment sound was present. This should be investigated in future research.
Additional Alarm Sounds
As part of the larger effort to revise the standard (Edworthy et al., 2018), researchers are designing new alarms that are more complex and harmonically rich than the current melodies of tones, though the melodic patterns will likely remain through legacy support. Thus, while the results presented here will remain topical, the psychoacoustics of simultaneous masking validated in this work are not appropriate for the new alarm sounds. However, there are other masking curves that use different formulations of spreading functions and Δ than those shown in Equations 4 and 5, respectively, that can represent the masking effect of more complex sounds (Bosi & Goldberg, 2003; You, 2010). Future work should investigate which of these is most appropriate for the new sounds and use experimental validation (like the one presented here) to assess their predictive power.
Additional Application Domains
The focus of the presented research is exclusively on medical alarms. However, alarms are used to alert humans to problems in many other safety critical domains including aviation (Bliss & Acton, 2003), industrial control rooms (Rothenberg, 2009), and driving (Bliss, 2003). Many of the same problems that affect medical alarms can also manifest in these other areas. In fact, there have been a few instances of design recommendations for avoiding the effects of masking in these industries (Begault, Godfroy, Sandor, & Holden, 2007; Patterson, 1982; Patterson & Mayfield, 1990; Wolfman, Miller, & Volanth, 1996). However, to the best of our knowledge, nobody has investigated whether simultaneous masking does in fact manifest in these environments. Thus, future work should determine whether simultaneous masking is occurring and, if so, how our methods could be used to assess its potential risks.
Key Points
The alarms prescribed by the IEC 60601-1-8 international standard are theoretically susceptible to simultaneous masking.
This work validates that the psychoacoustics of simultaneous masking can accurately predict the perceivability of standard-compliant medical alarm sounds using two signal detection experiments.
The experiments showed that the psychoacoustics did accurately predict the perceivability of alarm sounds based on whether their primary harmonics were masked.
The results further validate that a formal methods model developed in previous work can accurately predict whether humans will hear IEC 60601-1-8-compliant alarms.
The results will influence methods for detecting masking in medical alarm designs as well as updates to the international standard.
Footnotes
Acknowledgments
The research reported in this paper was supported by the Agency for Healthcare Research and Quality under award number R18HS024679. This research complied with the American Psychological Association Code of Ethics and was approved by the Institutional Review Board at the University at Buffalo. Informed consent was obtained from each participant.
Author Biographies
Matthew L. Bolton is an associate professor of industrial and system engineering at the University at Buffalo, The State University of New York. He received the PhD in systems engineering in 2010 from the University of Virginia, Charlottesville, USA.
Xi Zheng is a PhD student in industrial and systems engineering at the University at Buffalo, The State University of New York. She received the BS in electronic commerce in 2011 from Southwest University, Chongqing, China.
Meng Li is a human factors engineer and UX designer intern at Medtronic. He received the PhD in industrial and systems engineering in 2018 from the University at Buffalo, The State University of New York, USA.
Judy Reed Edworthy is the director of the Cognition Institute and a professor of applied psychology at the University of Plymouth. She received the PhD in experimental psychology in 1984 from the University of Warwick, UK.
Andrew D. Boyd is an associate professor of biomedical and health information sciences at the University of Illinois Chicago. He received the MD in 2002 from the University of Texas Southwestern Medical School, Dallas, USA.
