Validity and Reliability of Visual Analog Scaling for Assessment of Hypernasality and Audible Nasal Emission in Children with Repaired Cleft Palate

Baylis A.L. Munson B. Moller K.T. Audible nasal emission in speakers with cleft palate: a comparative study of listener judgments. Cleft Palate Craniofac J. 2011; 48: 399–411.

Brancamp T.U. Lewis K.E. Watterson T. The relationship between nasalance scores and nasality ratings obtained with equal appearing interval and direct magnitude estimation scaling methods. Cleft Palate Craniofac J. 2010; 47: 631–637.

Chapman K.L. Baylis A. Trost-Cardamone J. Nett Cordero K. Dixon A. Dobbelsteyn C. Thurmes A. Wilson K. Harding-Bell A. Sweeney T. . The Americleft Speech Project: A training and reliability study. Cleft Palate Craniofac J. In press.

Cheng D.T.H. Direct Magnitude Estimation Versus Visual Analogue Scaling in the Perceptual Rating of Hypernasality. Hong Kong: Division of Speech and Hearing Sciences, University of Hong Kong; 2006. Undergraduate dissertation.

Cicchetti D.V. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994; 6: 284–290.

Conley S.F. Gosain A.K. Marks S.M. Larson D.L. Identification and assessment of velopharyngeal inadequacy. Am J Otolaryngol. 1997; 18: 38–46.

Eadie T.L. Doyle P.C. Direct magnitude estimation and interval scaling of naturalness and severity in tracheoesophageal (TE) speakers. J Speech Lang Hear Res. 2002; 45: 1088–1096.

Eisler H. Magnitude scales, category scales, and Fechnerian integration. Psychol Rev. 1963; 70: 243–253.

Gescheider G.A. Psychophysics, Method, and Theory. Hillsdale, NJ: Lawrence Erlbaum; 1976.

Grant S. Aitchison T. Henderson E. Christie J. Zare S. McMurray J. Dargie H. A comparison of the reproducibility and the sensitivity to change of visual analogue scales, Borg scales, and Likert scales in normal subjects during submaximal exercise. Chest. 1999; 116: 1208–1217.

Hallgren K.A. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012; 8: 23–34.

Jamieson S. Likert scales: how to (ab)use them. Med Educ. 2004; 38: 1217–1218.

John A. Sell D. Sweeney T. Harding-Bell A. Williams A. The cleft audit protocol for speech-augmented: a validated and reliable measure for auditing cleft speech. Cleft Palate Craniofac J. 2006; 43: 272–288.

Kelchner L.N. Brehm S.B. Weinrich B. Middendorf J. deAlarcon A. Levin L. Elluru R. Perceptual evaluation of severe pediatric voice disorders: rater reliability using the consensus auditory perceptual evaluation of voice. J Voice. 2010; 24: 441–449.

Kuehn D.P. Moller K.T. Speech and language issues in the cleft palate population: the state of the art. Cleft Palate Craniofac J. 2000; 37: 348–383.

Kummer A.W. Briggs M. Lee L. The relationship between the characteristics of speech and velopharyngeal gap size. Cleft Palate Craniofac J. 2003; 40: 590–596.

Kummer A.W. Curtis C. Wiggs M. Lee L. Strife J.L. Comparison of velopharyngeal gap size in patients with hypernasality, hypernasality and nasal emission, or nasal turbulence (rustle) as the primary speech characteristic. Cleft Palate Craniofac J. 1992; 29: 152–156.

Landis J.R. Koch D.D. The measurement of observer agreement for categorical data. Biometrics. 1977; 33: 159–174.

Lohmander A. Olsson M. Methodology for perceptual assessment of speech in patients with cleft palate: a critical review of the literature. Cleft Palate Craniofac J. 2004; 41: 64–70.

Lohmander A. Willadsen E. Persson C. Henningsson G. Bowden M. Hutters B. Methodology for speech assessment in the Scandcleft project—an international randomized clinical trial on palatal surgery: experiences from a pilot study. Cleft Palate Craniofac J. 2009; 46: 347–362.

Metz D.E. Schiavetti N. Sacco P.R. Acoustic and psychophysical dimensions of the perceived speech naturalness of nonstutterers and posttreatment stutterers. J Speech Hear Disord. 1990; 55: 516–525.

Moller K.T. An approach to evaluation of velopharyngeal adequacy for speech. Clin Commun Disord. 1991; 1: 61–75.

Norman G. Likert scales, levels of measurement and the “laws” of statistics. Adv Health Sci Educ Theory Pract. 2010; 15: 625–632.

Norman G.R. Streiner D.L. Biostatistics: The Bare Essentials. Hamilton, Ontario: BC Decker: 2008.

Ohde R.N. Sharf D.J. Jacobson P.F. Phonetic analysis of normal and abnormal speech. J Acoust Soc Am. 1992; 92: 3452.

Pereira V. Sell D. Tuomainen J. The relationship between equal appearing interval scales (EAI) and visual analog scales (VAS) for rating hypernasality: findings from an osteotomy study. Abstract presented at the 9th European Craniofacial Congress; September 2011; Salzburg, Austria.

Peterson-Falzone S.J. Hardin-Jones M.A. Karnell M.P. Cleft Palate Speech. 3rd ed. St. Louis: Mosby; 2001.

Price D.D. McGrath P.A. Rafii A. Buckingham B. The validation of visual analogue scales as ratio scale measures for chronic and experimental pain. Pain. 1983; 17: 45–56.

Reips U.D. Funke F. Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator. Behav Res Methods. 2008; 40: 699–704.

Schiavetti N. Martin R.R. Haroldson S.K. Metz D.E. Psychophysical analysis of audiovisual judgments of speech naturalness of nonstutterers and stutterers. J Speech Hear Res. 1994; 37: 46–52.

Schiavetti N. Metz D.E. Orlikoff R.F. Evaluating Research in Communicative Disorders. Boston: Pearson; 2011.

Sell D. John A. Harding-Bell A. Sweeney T. Hegarty F. Freeman J. Cleft audit protocol for speech (CAPS-A): a comprehensive training package for speech analysis. Int J Lang Commun Disord. 2009; 44: 529–548.

Shaw W. Semb G. Nelson P. Brattstrom V. Molstedd K. Prahl-Andersen B. Gundlach K.H. The Eurocleft Project 1996–2000: overview. J Craniomaxillofac Surg. 2001; 29: 131–140.

Shrout P.E. Fleiss J.L. Intraclass correlations. Uses in assessing rater reliability. Psychol Bull. 1979; 86: 420–428.

Southwood H.P. Weismer G. Listener judgments of the bizarreness, acceptability, naturalness, and normalcy of the dysarthria associated with amyotrophic lateral sclerosis. J Med Speech Lang Pathol. 1993; 1: 151–161.

Stevens S.S. Perceptual magnitude and its measurement. In: Caterette E.C. Friedman M.P. , eds. Handbook of Perception. Vol. 2. New York: Academic Press; 1974: 22–40.

Stevens S.S. Psychophysics: Introduction to its Perceptual, Neural, and Social Prospects. New York: Wiley; 1975.

Toner M.A. Emanuel E.H. Direct magnitude estimation and equal appearing interval scaling of vowel roughness. J Speech Hear Res. 1989; 32: 78–82.

Toner M.A. Emanuel F.W. Parker D. Relationship of spectral noise levels to psychophysical scaling of vowel roughness. J Speech Hear Res. 1990; 33: 238–244.

Trost-Cardamone J.E. A controlled sentence sample for assessing speech outcome. Poster presented at the annual meeting of the American Cleft Palate Craniofacial Association; April 18, 2012; San Jose, CA.

van Alphen A. Halfens R. Hasman A. Imbos T. Likert or Rasch? Nothing is more applicable than a good theory. J Adv Nurs. 1994; 20: 196–201.

Whitehill T.L. Cheng J. Jones D.L. Rating hypernasality: direct magnitude estimation (DME) versus visual analogue scaling (VAS). Abstract presented at the annual meeting of the American Cleft Palate Craniofacial Association; April 2007; Broomfield, CO.

Whitehill T.L. Lee A.S. Chun J.C. Direct magnitude estimation and interval scaling of hypernasality. J Speech Lang Hear Res. 2002; 45: 80–88.

Wuyts F.L. De Bodt M.S. Van de Heyning P.H. Is the reliability of a visual analog scale higher than an ordinal scale? An experiment with the GRBAS scale for the perceptual evaluation of dysphonia. J Voice. 1999; 13: 508–517.

Zraick R.I. Liss J.M. A comparison of equal-appearing interval scaling and direct magnitude estimation of nasal voice quality. J Speech Lang Hear Res. 2000; 43: 979–988.

Zraick R.I. Liss J.M. Dorman M.F. Case J.L. LaPointe L.L. Beals S.P. Multidimensional scaling of nasal voice quality. J Speech Lang Hear Res. 2000; 43: 989–996.