Are Experiments Possible?

Abstract

The paper critically examines the inferential logic underlying Mill's methods of agreement and difference as it is applied in present-day behavioral science where the methods in question are embodied in the socalled `treatment-control random design' (Mayo, 1996). The reputed goal of the design is to be able to arrive at judgments of sufficient causation (e.g. `X is a sufficient cause of [condition for] Y'). This is accomplished by `neutralizing' the influence of the extraneous variables inherent in a particular (experimental) set of conditions by way of creating another (control) set of conditions which is identical to the experimental prototype in every way except for one element (the independent variable). Any difference between the effects of the two sets (the experimental effect) is, then, said to reflect or be a product of the independent variable in question. As I argue, the above-mentioned inference is rooted in the generally tacit assumption of effect independence, that is, the view that the `extraneous' and the `independent variable' components comprising the experimental condition end up exerting completely separate or isolated effects on the dependent variable under consideration. It is argued that the said assumption, given both the inherent conceivability and the empirical ubiquity of various interaction effects, has no logical foundation and, thus, cannot be affirmed with any degree of certainty. The non-acceptance of the assumption calls into question the logical viability of clinical process research.

Keywords

causation control group experiment interaction effects placebo process research

Get full access to this article

View all access options for this article.

References

Akhundov, M.D. , & Bazhenov, L.B. (1991). Evolution, the idea of non-linearity, and Marxism. Priroda, 908, 1-8.

Beecher, H.K. (1955). The powerful placebo. Journal of American Medical Asso-ciation, 159, 1602-1606.

Brady, J.V. (1958). Ulcers in `executive monkeys`. Scientific American, 199, 95-100.

Brice, G.C. , Gorey, K.M. , Hall, R.M. , & Angelino, S. (1996). The STAYWELL Program-maximizing elders' capacity for independent living through health promotion and disease prevention activities: A quasi-experimental evaluation of its efficacy. Research on Aging, 8, 202-218.

Brunswik, E. (1955). Representative design and probabilistic theory in a functional psychology. Psychological Review, 62, 193-217.

Christensen, L.B. (1994). Experimental methodology (6th ed.). Boston, MA: Allyn & Bacon.

Collingwood, R.G. (1991). On the so-called idea of causation. In A.B. Schoedinger (Ed.), Introduction to metaphysics: The fundamental questions (pp. 145-162). Buffalo, NY: Prometheus.

D'Esposito, M. , Zarahn, E. , & Aguirre, G.K. (1999). Event-related functional MRI: Implications for cognitive psychology. Psychological Bulletin, 125, 155-164.

Dunbar, R.I.M. (1995). The trouble with science. Cambridge, MA: Harvard Uni-versity Press.

10.

Edwards, K.J. , Devries, D.L. , & Snyder, J.P. (1973). Games and teams: A winning combination (Center for Social Organization of Schools Report, 34). Johns Hopkins University.

11.

Fisher, R.A. (1953). The design of experiments. New York: Hafner.

12.

Friston, K.J. , Price, C.J. , Fletcher, P. , Moore, C. , Frackowiak, R.S.J. , & Dolan, R.J. (1996). The trouble with cognitive subtraction. Neurolmage, 4, 97-104.

13.

Gale, G. (1979). Theory of science. Toronto: McGraw-Hill.

14.

Gleitman, H. (1995). Psychology (4th ed.). London/New York: Norton.

15.

Goodwin, C.J. (1995). Research in psychology: Methods and design. New York: Wiley.

16.

Gray, P. (1994). Psychology. Boston, MA: Worth.

17.

Hinrichs, J.M. , Mewaldt, S.P. , Ghoneim, M.M. , & Berie, J.L. (1982). Diazepam and learning: Assessment of acquisition deficits. Pharmacology, Biochemistry and Behavior, 17, 165-170.

18.

Horvath, P. (1988). Placebos and common factors in two decades of psychotherapy research. Psychological Bulletin, 104, 214-225.

19.

Kazdin, A.E. (1998). Research design in clinical psychology (3rd ed.). Boston, MA: Allyn & Bacon.

20.

Kirsch, I. , & Weixel, L.J. (1988). Double-blind versus deceptive administration of a placebo. Behavioral Neuroscience, 102, 319-323.

21.

Kleijnen, J. , de Craen, A.J.M. , van Everdingen, J. , & Krol, L. (1994). Placebo effect in double-blind clinical trials: A review of interactions with medications. Lancet, 344, 1347-1349.

22.

Lakatos, I. (1978). The methodology of scientific research programmes. New York: Cambridge University Press.

23.

Maier, S.F. (1984). Learned helplessness and animal models of depression. Progress in Neuropsychopharmacology and Biological Psychiatry, 8(3), 435-446.

24.

Mayo, D.G. (1996). Error and the growth of experimental knowledge. Chicago, IL: University of Chicago Press.

25.

Mill, J.S. (1978). A system of logic, ratiocinative and inductive: Being a connected view of the principles of evidence and the methods of scientific investigation, books Ill, VH-X. In J.M. Robson (Ed.), Collected works of John Stuart Mill, Vol. 7. Toronto: University of Toronto Press. (Original work published 1843.)

26.

Miller, R.W. (1987). Fact and method: Explanation, confirmation and reality in the natural and the social sciences. Princeton, NJ: Princeton University Press.

27.

Overmier, J.B. , & Seligman, M.E. (1967). Effects of inescapable shock upon subsequent escape and avoidance responding. Journal of Comparative & Physiological Psychology, 63, 28-33.

28.

Pesold, C. , & Treit, D. (1996). The neuroanatomical specificity of the anxiolytic effects of intra-septal infusions of midazolam. Brain Research, 710(1-2), 161-168.

29.

Peterson, C. , Maier, S.F. , & Seligman, M.E.P. (1993). Learned helplessness: A theory for the age of personal control. New York: Oxford University Press.

30.

Popper, K.R. (1959). The logic of scientific discovery. New York: Basic Books.

31.

Reber, A.S. (1985). The Penguin dictionary of psychology. London: Penguin.

32.

Rokeach, M. , & Rothman, G. (1965). The principle of belief congruence and the congruity principle as models of cognitive interaction. Psychological Review, 72, 128-142.

33.

Royzman, E.B. , & Baron, J. (1999). Preference for indirect harm and its relation to the omission bias. Unpublished manuscript, University of Pennsylvania.

34.

Ruch, F.L. , & Zimbardo, P.G. (1971). Psychology and life (8th ed.). London/New York: Norton.

35.

Seligman, M.E.P. (1975). Helplessness: On depression, development, and death. San Francisco, CA: Freeman.

36.

Seligman, M.E.P. , & Maier, S.F. (1967). Failure to escape traumatic shock. Journal of Experimental Psychology, 74, 1-10.

37.

Simeon, G. (1997). Issues in pharmacoeconomic studies with psychotropics: Some practical considerations. European Psychiatry, 12, 257-278.

38.

Slote, M.A. (1983). Goods and virtues. Oxford: Clarendon.

39.

Straus, J.L. , & Cavanaugh, S.A. (1996). Placebo effects. Psychosomatics, 37, 315-326.

40.

Suppes, P. (1969). Studies in methodology and foundations of science: Selected papers from 1951 to 1969. Dordrecht: Reidel.

41.

Tolstoy, L. (1983). What is art? In M.B. Chrapchenko (Ed.), Tolstoy's collected works, Vol. 15. Moscow: Fiction. (Original work published 1898.)

42.

Trammell, R. (1995). Saving life and taking life. In B. Steinbock & A. Norcross (Eds.), Killing and letting die (2nd ed.). New York: Fordham University Press.

43.

Treit, D. , & Menard, J. (1997). Dissociations among the anxiolytic effects of septal, hippocampal, and amygdaloid lesions. Behavioral Neuroscience, 111, 653-658.

44.

Wilkins, W. (1983). Failure of placebo groups to control for non-specific events in therapy outcome research. Psychotherapy: Theory, Research and Practice, 20, 31-37.

45.

Woodworth, R.S. (1938). Experimental psychology. New York: Holt.