A conceptual framework employing the distinction between stimulus-centered and subject-centered scales is presented as a basis for reviewing 80 years of literature on the optimal number of response alternatives for a scale. Concepts and research from information theory and the absolute judgment paradigm of psychophysics are used. The author reviews the major factors influencing the quality of scaled information, points out areas in particular need of additional research, and makes some recommendations for the applied researcher.
Get full access to this article
View all access options for this article.
References
1.
AttneaveFred (1949), “A Method of Graded Dichotomies for the Scaling of Judgments,” Psychological Review, 56 (November), 334–40.
2.
AttneaveFred (1959), Applications of Information Theory to Psychology. New York: Holt, Rinehart and Winston.
3.
BartlettJ. C. and GreenCalvin G. (1966), “Clinical Prediction: Does One Sometimes Know Too Much?” Journal of Counseling Psychology, 13 (Fall), 267–70.
4.
BeharIsaac (1963), “On the Relation Between Response Uncertainty and Prediction Time in Category Judgments,” Perceptual and Motor Skills, 16 (April), 595–6.
5.
BendigA. W. (1953), “The Reliability of Self-Ratings as a Function of the Amount of Verbal Anchoring and of the Number of Categories on a Scale,” Journal of Applied Psychology, 37 (February), 38–41.
6.
BendigA. W. (1954a), “Reliability and the Number of Rating Categories,” Journal of Applied Psychology, 38 (February), 38–40.
7.
BendigA. W. (1954b), “Transmitted Information and the Length of Rating Scales,” Journal of Experimental Psychology, 47 (May), 303–8.
8.
BendigA. W. and HughesJ. B. (1953), “Effect of Amount of Verbal Anchoring and Number of Rating-Scale Categories Upon Transmitted Information,” Journal of Experimental Psychology, 46 (August), 87–90.
9.
BensonPurnell H. (1971), “How Many Scales and How Many Categories Shall We Use in Consumer Research?—A Comment,” Journal of Marketing, 35 (October), 59–61.
10.
BestRoger J., AlbaumGerald S., HawkinsDel I., and KenyonGeorgia (1978), “Number of Response Intervals and Reliability of Factor Analyzed Semantic Scale Data,” Southwestern Marketing Association.
11.
BevanWilliam and AvantLloyd L. (1968), “Response Latency, Response Uncertainty, Information Transmitted and the Number of Available Judgmental Categories,” Journal of Experimental Psychology, 76 (March), 394–7.
12.
BoyceArthur C. (1915), “Methods for Measuring Teachers' Efficiency,” in The Fourteenth Yearbook of the National Society for the Study of Education, Part II, ParkerS. Chester, ed. Chicago: University of Chicago Press.
13.
BrickerP. D. (1955), “The Identification of Redundant Stimulus Patterns,” Journal of Experimental Psychology49 (February), 73–81.
14.
CarrollJohn B. (1961), “The Nature of Data, or How to Choose a Correlation Coefficient,” Psychometrika, 26 (December), 347–72.
15.
CarrollJ. D. (1972), “Individual Differences and Multidimensional Scaling,” in Multidimensional Scaling: Theory and Application in the Behavioral Sciences, Volume 1, ShepardRoger N.et al., eds. New York: Seminar Press.
16.
ChampneyHorace and MarshallHelen (1939), “Optimal Refinement of the Rating Scale,” Journal of Applied Psychology, 23 (June), 323–31.
17.
ConklinEdmund S. (1923), “The Scale Values Method for Studies in Genetic Psychology,” University of Oregon Publication, 2, 3–36.
18.
ConnorRobert J. (1972), “Grouping for Tests of Trend in Categorical Data,” Journal of the American Statistical Association, 67 (September), 601–4.
19.
CoombsClyde H. (1964), A Theory of Data. New York: John Wiley & Sons, Inc.
20.
CronbachLee J. (1950), “Further Evidence on Response Sets and Test Design,” Educational and Psychological Measurement, 10 (Spring), 3–31.
21.
CronbachLee J. (1951), “Coefficient Alpha and the Internal Structure of Tests,” Psychometrika, 16 (September), 297–334.
22.
EbelRobert L. (1951), “Estimation of the Reliability of Ratings,” Psychometrika, 16 (December), 407–24.
23.
GarnerW. R. (1960), “Rating Scales, Discriminability, and Information Transmission,” Psychological Review, 67 (November), 343–52.
24.
GarnerW. R. and HakeH. W. (1951), “The Amount of Information in Absolute Judgments,” Psychological Review, 58 (November), 446–59.
25.
GhiselliEdwin E. (1939), “All or None Versus Graded Response Questionnaires,” Journal of Applied Psychology, 23 (June), 405–15.
26.
GhiselliEdwin E. (1964), The Theory of Psychological Measurement. New York: McGraw-Hill Book Company.
27.
GreenPaul E. and RaoVithala R. (1970), “Rating Scales and Information Recovery—How Many Scales and Response Categories to Use?” Journal of Marketing, 34 (July), 33–9.
28.
GuestLester (1962), “A Comparison of Two-Choice and Four-Choice Questions,” Journal of Advertising Research, 2 (March), 32–4.
29.
GuilfordJ. P. (1938), “The Computation of Psychological Values from Judgments in Absolute Categories,” Journal of Experimental Psychology, 22 (January), 32–42.
30.
GuilfordJ. P. (1954), Psychometric Methods, second edition. New York: McGraw-Hill Book Company.
31.
GuttmanLouis (1950), Chapters 2, 3, 6, 8, and 9 in Measure and Prediction, StoufferSamuel A.et al., eds. Princeton, New Jersey: Princeton University Press.
32.
HulbertJames (1975), “Information Processing Capacity and Attitude Measurement,” Journal of Marketing Research, 12 (February), 104–6.
33.
JacobyJacob and MatellMichael S. (1971), “Three-Point Scales are Good Enough,” Journal of Marketing Research, 8 (November), 495–500.
34.
JenkinsG. DouglasJr., and ThomasD.Taber (1977), “A Monte Carlo Study of Factors Affecting Three Indices of Composite Scale Reliability,” Journal of Applied Psychology, 62 (August), 392–8.
35.
JonesRichard R. (1968), “Differences in Response Consistency and Subjects' Preferences for Three Personality Inventory Response Formats,” Proceedings of the 76th Annual Convention of the American Psychological Association, 247–8.
36.
KassarjianHarold H. and NakanishiMasao (1967), “A Study of Selected Opinion Measurement Techniques,” Journal of Marketing Research, 4 (May), 148–53.
37.
KatzDaniel (1944), “The Measurement of Intensity,” in Gauging Public Opinion, CantrilHadley, ed. Princeton, New Jersey: Princeton University Press, 51–65.
38.
KelleyTruman L. (1923), Statistical Method. New York: Macmillan.
39.
KomoritaS. S. (1963), “Attitude Content, Intensity, and the Neutral Point on a Likert Scale,” Journal of Social Psychology, 61 (December), 327–34.
40.
KomoritaS. S. and WilliamK. Graham (1965), “Number of Scale Points and the Reliability of Scales,” Educational and Psychological Measurement, 25 (November), 987–95.
41.
LehmannDonald R. and HulbertJames (1972), “Are Three-Point Scales Always Good Enough?” Journal of Marketing Research, 9 (November), 444–6.
42.
LikertRensis (1932), “A Technique for the Measurement of Attitude,” Archives of Psychology, no. 140, 1–55.
43.
LissitzRobert W. and GreenSamuel B. (1975), “Effect of the Number of Scale Points on Reliability: A Monte Carlo Approach,” Journal of Applied Psychology, 60 (February), 10–3.
44.
LunneyGerald H. (1970), “Using Analysis of Variance with a Dichotomous Dependent Variable: An Empirical Study,” Journal of Educational Measurement, 7 (Winter), 263–9.
45.
MartinWarren S. (1973) “The Effects of Scaling on the Correlation Coefficient: A Test of Validity,” Journal of Marketing Research, 10 (August), 316–8.
46.
MartinWarren S. (1978), “Effects of Scaling on the Correlation Coefficient: Additional Considerations,” Journal of Marketing Research, 15 (May), 304–8.
47.
MartinWarren S., FruechterBenjamin, and MathisWilliam J. (1974), “An Investigation of the Effects of the Number of Scale Intervals on Principal Components Factor Analysis,” Educational and Psychological Measurement, 34 (Autumn), 537–45.
48.
MatellMichael S. and JacobyJacob (1971), “Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity,” Educational and Psychological Measurement, 31 (Autumn), 657–74.
49.
MatellMichael S. and JacobyJacob, (1972), “Is There an Optimal Number of Alternatives for Likert Scale Items?” Journal of Applied Psychology, 56 (December), 506–9.
50.
McGillWilliam J. (1954), “Multivariate Information Transmission,” Psychometrika, 19 (June), 97–116.
51.
MenezesDennis and ElberNorbert F.t(1979), “Alternative Semantic Scaling Formats for Measuring Store Image: An Evaluation,” Journal of Marketing Research, 16 (February), 80–7.
52.
MillerGeorge A. (1955), “A Note on the Bias of Information Estimates,” in Information Theory in Psychology: Problems and Methods, QuastlerHenry, ed. Glencoe, Illinois: The Free Press, 95–100.
53.
MillerGeorge A. (1956), “The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information,” Psychological Review, 63 (March), 81–97.
54.
MillerGeorge A. and FrederickC. Frick (1949), “Statistical Behavioristics and Sequences of Responses,” Psychological Review, 56 (November), 311–24.
55.
MorrisonDonald G. (1972), “Regression with Discrete Dependent Variables: The Effect on R2,” Journal of Marketing Research, 9 (August), 338–40.
56.
MurphyGardner and LikertRensis (1938), Public Opinion and the Individual. New York: Harper and Brothers Publishers.
57.
NishisatoShizuhiko and ToriiYukhiko (1971), “Effects of Categorizing Continuous Normal Variables,” Japanese Psychological Research, 13 (May), 45–9.
58.
OsgoodCharles E., SuciGeorge J., and TannenbaumPercy (1957), The Measurement of Meaning. Chicago: University of Chicago Press.
59.
PeabodyDean (1962), “Two Components in Bipolar Scales: Direction and Extremeness,” Psychological Review, 69 (March), 65–73.
60.
PembertonH. Earl (1933), “A Technique for Determining the Optimal Rating Scale for Opinion Measures,” Sociology and Social Research, 17 (May-June), 470–2.
61.
PeterJ. Paul (1979), “Reliability: A Review of Psychometric Basics and Recent Marketing Practices,” Journal of Marketing Research, 16 (February), 6–17.
62.
PetersonRobert A. and SharmaSubhash (1977a), “A Note on the Information Content of Rating Scales,” Proceedings of the American Marketing Association, 324–6.
63.
PetersonRobert A. and SharmaSubhash, (1977b), “Adjusting Correlation Coefficients for the Effects of Scaling,” Proceedings of the American Statistical Association.
64.
PollackIrwin (1952), “The Information of Elementary Auditory Displays,” Journal of the Acoustical Society of America, 24 (November), 745–9.
65.
RamsayJ. O. (1973), “The Effect of Number of Categories in Rating Scales on Precision of Estimation of Scale Values,” Psychometrika, 37 (December), 513–32.
66.
RundquistEdward A. and SlettoRaymond F. (1936), Personality in the Depression. Minneapolis: The University of Minnesota Press.
67.
SaffirMilton (1937), “A Comparative Study of Scales Constructed by Three Psychophysical Methods,” Psychometrika, 2 (September), 179–98.
68.
ShannonClaude and WeaverWarren (1949), The Mathematical Theory of Communication. Urbana: University of Illinois Press.
69.
SheppardW. F. (1898), “On the Calculation of the Most Probable Values of Frequency Constants for Data Arranged According to Equi-Distant Divisions of the Scale,” Proceedings of the London Mathematical Society, 29 (March), 353–80.
70.
StevensS. S. and DavisHallowell (1938), Hearing. New York: John Wiley & Sons, Inc.
71.
SymondsPercival M. (1924), “On the Loss of Reliability in Ratings Due to Coarseness of the Scale,” Journal of Experimental Psychology, 7 (December), 456–61.
72.
ThurstoneLouis Leon (1928), “Attitudes Can Be Measured,” American Journal of Sociology, 33 (January), 529–54.
73.
ThurstoneLouis Leon and ChaveE. J. (1929), The Measurement of Attitude. Chicago: University of Chicago Press.
74.
TorgersonWarren J. (1958), Theory and Methods of Scaling. New York: John Wiley & Sons, Inc.
75.
VolkmannJohn (1951), “Scales of Judgment and Their Implications for Sociology,” in Social Psychology at the Crossroads, RohrerJ. H. and SheriffM., eds. New York: Harper and Brothers, 272–94.
76.
YoungForrest W. (1970), “Nonmetric Multidimensional Scaling: Recovery of Metric Information,” Psychometrika, 35 (December), 455–73.
