Policy-capturing, conjoint analysis, and related techniques are all regression-based methods used in various areas of organizational research to determine the importance people attach to cues when they make decisions. Despite the widespread use of those methods, the organizational research literature lacks an integrated tutorial for researchers who are interested in studying decision making but who have little experience with the techniques required for this type of research. The authors use empirical findings and suggestions from a number of sources to offer a step-by-step tutorial covering the effective design, execution, analysis, interpretation, and reporting of policy-capturing studies.
Get full access to this article
View all access options for this article.
References
1.
Adamowicz, W., Louviere, L., & Williams, M. (1994). Combining revealed and stated preference methods for valuing environmental amenities. Journal of Environmental Economic Management, 26, 271-292.
2.
Barr, S., & Hitt, M. (1986). A comparison of selection decision models in manager versus student samples. Personnel Psychology, 39, 599-617.
3.
Brehmer, A., & Brehmer, B. (1988). What have we learned about human judgement from thirty years of policy-capturing? In B. Brehmer & C. R. B. Joyce (Eds.), Human judgement: The SJT view. Amsterdam: North-Holland Elsevier.
4.
Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models. Newbury Park, CA: Sage.
5.
Cable, D., & Judge, T. (1994). Pay preferences and job search decisions: A person-organization fit perspective. Personnel Psychology, 47, 317-348.
6.
Carroll, J. S., & Johnson, E. J. (1990). Decision research: A field guide. Newbury Park, CA: Sage.
7.
Cattin, P., & Wittink, D. (1983). Commercial use of conjoint analysis: A survey. Journal of Marketing, 46, 44-53.
8.
Cicchetti, D. V., Showalter, D., & Tyrer, P. J. (1985). The effect of number of rating scale categories on levels of interrater reliability: A Monte Carlo investigation. Applied Psychological Measurement, 9, 31-36.
9.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
10.
Cohen, J., & Cohen, P. (1983). Applied multiple regression-correlation analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
11.
Cooksey, R. (1996). Judgement analysis: Theory, methods, and applications. San Diego, CA: Academic Press.
12.
Gorman, C., Clover, W., & Doherty, M. (1978). Can we learn anything about interviewing real people from “interviews” of paper people? Two studies of the external validity of a paradigm. Organizational Behavior and Human Performance, 22, 165-192.
13.
Graham, M., & Cable, D. (2001). A comparison of full versus fractional factorial designs in policy-capturing studies. Organizational Research Methods, 4, 26-45.
14.
Graves, L., & Karren, R. (1992). Interviewer decision processes and effectiveness: An experimental policy-capturing investigation. Personnel Psychology, 45, 313-340.
15.
Green, P., & Srinivasan, V. (1990). Conjoint analysis in marketing: New developments with implications for research and practice. Journal of Marketing, 54, 3-19.
16.
Hair, J., Anderson, R., Tatham, R., & Black, W. (1992). Multivariate data analysis with readings. New York: Macmillan.
17.
Hammond, K. (1966). Probabilistic functionalism: Egon Brusnwik’s integration of the history, theory, and method of psychology. In K. Hammond (Ed.), The psychology of Egon Brusnwik. New York: Holt, Rinehart and Winston.
18.
Hardiman, P., Dufresne, R., & Mestre, J. (1989). The relation between problem categorization and problem solving among experts and novices. Memory & Cognition, 17, 627-638.
19.
Highhouse, S. (2001). Judgment and decision-making research: Relevance to industrial and organizational psychology. In N. Anderson, D. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), Handbook of industrial, work and organizational psychology (pp. 314-332). London: Sage.
20.
Highhouse, S., Luong, A., & Sarkar-Barney, S. (1999). Research design, measurement, and effects of attribute range on job choice: More than meets the eye. Organizational Research Methods, 2, 37-48.
21.
Hitt, M., & Barr, S. (1989). Managerial selection decision models: Examination of configural cue processing. Journal of Applied Psychology, 74, 53-61.
22.
Hobson, C., & Gibson, F. (1983). Policy-capturing as an approach to understanding and improving performance appraisal: A review of the literature. Academy of Management Review, 10, 640-649.
23.
Hoffman, P. (1960). The paramorphic representation of clinical judgement. Psychological Bulletin, 57, 116-131.
24.
Howell, D. (1992). Statistical methods for psychology. Boston: PWS-Kent Publishing.
25.
Hurt, J. L., Maver, J. A., & Hofmann, D. (1999). Situational and individual influences on judgments of hostile environment sexual harassment. Journal of Applied Social Psychology, 29, 1395-1415.
26.
Karren, R. J., & Barringer, M. W. (2002). A review and analysis of the policy-capturing methodology in organizational research: Guidelines for research and practice. Organizational Research Methods, 5, 337-361.
27.
Mackay, J., Barr, S., & Kletke, M. (1992). An empirical investigation of the effects of decision aids on problem-solving processes. Decision Sciences, 23, 648-672.
28.
MacKenzie, J. (1993). A comparison of contingent preference models. American Journal of Agricultural Economics, 75, 593-603.
29.
McGrath, J. E. (1982). Dilemmatics: The study of research choices and dilemmas. In J. E. McGrath, J. Martin, & R. A. Kulka (Eds.), Judgment calls in research (pp. 69-102). Beverly Hills, CA: Sage.
30.
Miller, G. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63, 81-97.
31.
Neter, J., Kutner, M., Nachtsheim, C., & Wasserman, W. (1996). Applied linear regression models. Chicago: Irwin.
32.
Neter, J., Wasserman, W., & Kutner, M. (1990). Applied linear statistical models: Regressional, analysis of variance, and experimental design. Homewood, IL: Irwin.
33.
Nunnally, J. (1978). Psychometric theory. New York: McGraw-Hill.
34.
Polson, P., & Jeffries, R. (1982). Problem-solving as search and understanding. In R. J. Sternberg (Ed.), Advances in the psychology of human intelligence. Hillsdale, NJ: Lawrence Erlbaum.
35.
Powell, G., & Mainiero, L. (1999). Managerial decision making regarding alternative work arrangements. Journal of Occupational and Organizational Psychology, 72, 41-56.
36.
Priem, R., & Harrison, D. (1994). Exploring strategic judgement: Methods for testing the assumptions of prescriptive contingency theories. Strategic Management Journal, 15, 311-324.
37.
Reilly, B., & Doherty, M. (1992). The assessment of self-insight in judgement policies. Organizational Behavior and Human Decision Processes, 53, 285-309.
38.
Russell, C. J., & Bobko, P. (1992). Moderated regression analysis and Likert scales: Too coarse for comfort. Journal of Applied Psychology, 77, 336-342.
39.
Russell, C. J., Pinto, J. K., & Bobko, P. (1991). Appropriate moderated regression an inappropriate research strategy: A demonstration of information loss due to scale coarseness. Applied Psychological Measurement, 15, 257-266.
40.
Rynes, S., & Lawler, J. (1983). A policy-capturing investigation of the role of expectancies in decision to pursue job alternatives. Journal of Applied Psychology, 68, 147-154.
41.
Rynes, S., & Miller, H. (1983). Recruiter and job influences on candidates for employment. Journal of Applied Psychology, 68, 147-154.
42.
SAS Institute. (1998). SAS/ETS users guide, version 7 [Computer software]. Cary, NC: Author.
43.
Shanteau, J., & Stewart, T. (1992). Why study expert decision making: Some historical perspectives and comments. Organizational Behavior and Human Decision Processes, 53, 95-106.
44.
Shimp, T. A., Hyatt, E. M., & Snyder, D. J. (1991). A critical appraisal of demand artifacts in consumer research. Journal of Consumer Research, 18, 273-283.
45.
SPSS. (2001). Product information sheet S11CMP-0901. In What’s new in SPSS 11.0 for Windows. Chicago: Author.
46.
STATA. (1999). STATA reference manual, release 6.0 [Computer software]. College Station, TX: STATA Press.
47.
Stewart, T. (1988). Judgement analysis: Procedures. In B. Brehmer & C. R. B. Joyce (Eds.), Human judgement: The SJT view. Amsterdam: North-Holland Elsevier.
48.
Tabachnick, B., & Fidell, L. (1996). Using multivariate statistics. New York: HarperCollins College.
49.
Thoms, P., McMasters, R., Roberts, M., & Dombkowski, D. (1999). Resume characteristics as predictors of an invitation to interview. Journal of Business and Psychology, 13, 339-356.
50.
Wedell, D., Parducci, A., & Lane, M. (1990). Reducing the dependence of clinical judgement on the immediate context: Effects of number of categories and types of anchors. Journal of Personality and Social Psychology, 58, 319-329.
51.
Zacharakis, A., & Meyer, G. (2000). The potential of actuarial decision models: Can they improve the venture capital investment decision? Journal of Business Venturing, 15, 323-346
