The Outcome Questionnaire (OQ) was developed by Lambert and colleagues (1994) as a standardized measure for assessing psychotherapy outcome. Although the instrument is already being widely used in managed health care quality control, further evidence of its psychometric properties is needed. This research evaluated the concurrent and construct validity of the OQ with three patient samples and a sample of community participants. Support was found for the construct and concurrent validity of the OQ with both patients (n = 183) and nonpatients (n = 210). The data show significant differences in scores between patients and community samples, as well as differences between the various clinical samples with varying levels of pathology. Although high correlations between the OQ Total (and subscale) scores and the criterion measures were found, high intercorrelations among subscales suggest considerable shared variance between subscales. The OQ Total score appears promising as a measure of general psychological distress, although further research is needed to justify the interpretation of subscale scores in clinical settings.
Get full access to this article
View all access options for this article.
References
1.
Ahmed, T., & Smith, R. (1991). Impacts of managed mental health care employee assistance programs on costs and utilization. Report prepared for Aetna Health Plans.
2.
American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., rev.). Washington, DC: Author.
3.
Andrews, F. W., & Withey, S. B. (1974). Developing measures of perceived life quality: Results from several national surveys. Social Indicators Research, 1, 1-26.
4.
Beiser, M. (1983). Components and correlates of mental well-being. Journal of Health and Social Behavior, 15, 320-327.
5.
Benjamin, L. (1974). Structural analysis of social behavior. Psychological Review, 81, 392-425.
6.
Benjamin, L. (1986). Adding social and intrapsychic descriptors to Axis I of DSM-IHf. In T. Millon & G. Klerman (Ed.), Contemporary issues in psychopathology (pp. 599-638). New York: Guilford Press.
7.
Blau, T. H. (1977). Quality of life, social interaction, and criteria of change. Professional Psychology: Research and Practice, 8, 464-473.
8.
Bloom, A. (1987). Liability concern of utilization review and quality assurance programs. HMO, 1, 128-133.
9.
Bolelouchy, Z., & Horvath, M. (1974). The SCL-90 rating scale: First experience with the Czech version in healthy male scientific workers. Activitas Nervose Superior, 16, 115-116.
10.
Boulet J., & Boss, M. W. (1991). Reliability and validity of the Brief Symptom Inventory. Journal of Consulting and Clinical Psychology, 3, 433-437.
11.
Brokowski, A. (1991). Current mental health care environments: Why managed care is necessary. Professional Psychology: Research and Practice, 2Z6-14.
12.
Brophy, C.J., Norvell, N. K., & Kiluk, D.J. (1988). An examination of the factor structure and convergent and discriminant validity of the SCL-90-R in an outpatient clinic population. Journal of Personality Assessment, 52, 334-340.
13.
Burlingame, G. M., Lambert, M. J., Reisinger, C. W., Neff, W. L., & Mosier, J. (1995). Pragmatics of tracking mental health outcome in a managed care setting. The Journal of Mental Health Administration, 2Z226-236.
14.
Butcher, J. N., Graham, J. R., Williams, C. L., & Ben-Porath, Y. S. (1989). Development and use of the MMPI-2 content scales. Minneapolis: University of Minnesota Press.
15.
Cochran, W. G., & Cox, G. (1957). Experimental designs (2nd ed.). New York: Wiley.
16.
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for behavioral sciences. Hillsdale, NJ: Erlbaum.
17.
Cyr, J. J., Doxey, N. C., & Vigna, C. M. (1988). Factorial composition of SCL-90-R. Journal of Social Behavior and Personality, 3, 245-252.
18.
Cyr, J. J., McKenna-Foley, J. M., & Peacock, E. (1985). Factor structure of the SCL-90-R: Is there one?Journal of Personality Assessment, 49, 571-578.
19.
Dahlstrom, W. G., Welsh, G. S., & Dahlstrom, L. E. (1972). An MMPI handbook: Vol. 1. Clinical interpretation. Minneapolis: University of Minnesota Press.
20.
Deane, F. P., Leathem, J., & Spicer, J. (1992). Clinical norms, reliability and validity for the Hopkins Symptom Checklist-21. Australian Journal of Psychology, 44(1), 21-25.
21.
Deiner, E. (1984). Subjective well-being. Psychological Bulletin, 95(3), 542-575.
22.
Derogatis, L. R. (1977). The SCL-90 manual: Scoring, administration and procedures for the SCL-90. Baltimore: Johns Hopkins University School of Medicine, Clinical Psychometrics Unit.
23.
Derogatis, L. R., & Cleary, P. A. (1977). Confirmation of the dimensional structure of the SCL-90: A study in construct validation. Journal of Clinical Psychology, 33, 981-989.
24.
Derogatis, L. R., Rickels, K., & Rock, A. F., (1976). The SCL-90 and the MMPI: A step in the validation of a new self-report scale. British Journal of Psychiatry, 128, 280-289.
25.
Edwards, D. W., Yarvis, R. M., Mueller, D. P., Zingdale, H. C., & Wagman, W. J. (1978). Test-taking and the stability of adjustment scales. Evaluation Quarterly, 2, 275-291.
26.
Frisch, M. B., Cornell, J., Villanueva, M., & Retzlaff, P. J. (1992). Clinical validation of the quality of life inventory: A measure of life satisfaction for use in treatment planning and outcome assessment. Psychological Assessment, 4, 92-101.
27.
Froyd, J. E., Lambert, M. J., & Froyd, E. (1996). A review of practices of psychotherapy outcome measurement. Journal of Mental Health, 5, 11-15.
28.
Hansen, N. B., & Lambert, M. J. (1996). Assessing clinical significance using the Inventory of Interpersonal Problems. Assessment, 3, 133-136.
29.
Hathaway, S. R., & McKinley, J. C. (1989). MJPI-2: Manual for administration and scoring. Minnesota: University of Minnesota Press.
30.
Horowitz, L. M. (1979). On the cognitive structure of interpersonal problems treated in psychotherapy.Journal of Consulting and Clinical Psychology, 47, 5-15.
31.
Horowitz, L. M., Lambert, M. J., & Strupp, H. H. (1994). Measuring changes in patients following psychological and pharmacological interventions. Unpublished manuscript, Vanderbilt University. Summary of APA Conference.
32.
Horowitz, L. M., Locke, K. D., Morse, M. B., Waikar, S. V., Dryer, D. C., Tarnow, E., & Ghannam, J. (1991). Self-derogations and the interpersonal theory. Journal of Personality and Social Psychology, 61, 68-79.
33.
Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureno, G., & Villasenor, V. S. (1988). Inventory of interpersonal problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885-892.
34.
Horowitz, L. M., Rosenberg, S. E., & Bartholomew, K. (1993). Interpersonal problems, attachment styles, and outcome in brief dynamic psychotherapy. Journal of Consulting and Clinical Psychology, 61, 549-560.
35.
Kadera, S. W., Lambert, M. J., & Andrews, A. A. (1996). How much therapy is really enough? A session-by-session analysis of the psychotherapy dose-effect relationship. Journal of Psychotherapy Practice and Research, 5, 132-151.
36.
Keppel, G. (1982). Design and analysis (2nd ed.). Engelwood Cliffs, NJ: Prentice Hall.
37.
Kiesler, D. J. (1983). The 1982 interpersonal circle: A taxonomy for complementarity in human transactions. Psychological Review, 90, 185-214.
38.
Lambert, M. J. (1983). Introduction to assessment of psychotherapy outcome: Historical perspective and current issues. In M. J. Lambert, E. R., Christensen, & S. S. DeJulio (Eds.), The assessment of psychotherapy outcome (pp. 3-32). New York: Wiley.
39.
Lambert, M. J., Burlingame, G. L., Umphress, V.J., Hansen, N. B., Vermeersch, D., Clouse, G., & Yanchar, S. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy, 3, 106-116.
40.
Lambert, M. J., & Hill, C. E. (1994). Assessing psychotherapy outcomes and processes. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (pp. 72-113). New York: Wiley.
41.
Lambert, M.J., Ogles, B. M., & Masters, K. S. (1992). Choosing outcome assessment devices: An organizational and conceptual scheme. Journal of Counseling and Development, 70(4), 527-532.
42.
Lambert, M. J., Shapiro, D. A., & Bergin, A. E. (1986). The effectiveness of psychotherapy. In S. L. Garfield & A. E. Bergin (Eds.), Handbook of psychotherapy and behavior change (3rd ed., pp. 157-212). New York: Wiley.
43.
McKinley, J. C., & Hathaway, S. R. (1944). The MMPI: Hysteria, hypomania, and psychopathic deviate. Journal of Applied Psychology, 28, 153-174.
44.
Millon, T. (1983). Millon Clinical Multiaxial Inventory manual (3rd ed.). Minneapolis: National Computer Systems.
45.
Mirin, S., & Namerow, M. (1991). Why study treatment outcome?Hospital and Community Psychiatry, 42, 1007-1013.
46.
Moses-Zirkes, S. (1994, March). Outcome research: Everybody wants it. American Psychological Association Monitor.
47.
Mueller, R. M., Lambert, M. J., & Burlingame, G. M. (in press). Construct validity of the Outcome Questionaire: A confirmatory factor analysis. Journal of Personality Assessment.
48.
Newman, F. L. (1983). Therapist's evaluation of psychotherapy. In M.J. Lambert, E. R. Christensen, & S. S. DeJulio (Eds.), The assessment of psychotherapy outcome (pp. 498-536). New York: Wiley.
49.
Regier, D. A., Boyd, J. H., Burke, Jr., J. D., Rae, D. S., Myers, J. K., Kramer, M., Robins, L. N., George, L. K., Karno, M., & Locke, B. Z. (1988). One-month prevalence of mental disorders in the United States. Archives of General Psychiatry, 45, 977-986.
50.
Richardson, L. M., & Austad, C. S. (1991). Realities of mental health practice in managed care settings. Professional Psychology: Research and Practice, 22(1), 52-59.
51.
Sabin, J. E. (1991). Clinical skills for the 1990's: Six lessons from HMO practice. Hospital and Community Psychiatry, 42(6), 605-608.
52.
Strupp, H. H., & Hadley, S. W. (1977). A tripartite model of mental health and therapeutic outcome: With special reference to negative effects in psychotherapy. American Psychologist, 32, 187-196.
53.
Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
54.
Veit, C. T., & Ware, J. E. (1983). The structure of psychological distress and well being in general populations. Journal of Consulting and Clinical Psychology, 51(5), 730-742.
55.
Weissman, M. M., & Bothwell, S. (1976). Assessment of social adjustment by patient self-report. Archives of General Psychiatry, 33, 1111-1115.
56.
Zautra, A. J. (1983). Social resources and the quality of life. American Journal of Community Psychology, 11, 275-290.
