The article focuses on informants’ interaction with questionnaires as a method of collecting data and analyzes how the informants struggle with the reality imposed on them by the instruments’ items. Focusing on a social psychological questionnaire used to explore experience, the authors challenge the link between the data that are collected and what is concluded from them, and particularly the notion that such conclusions offer insight into informants’ experiences. The data the article is based on come from a session in which informants were asked to complete a questionnaire designed to examine feelings and behaviors after a job loss and to “think aloud” while doing it. The authors describe three strategies of dealing with the questionnaire frame: rejecting it, constructing experience in a way that matches the instrument, and, finally, reformulating the questionnaire’s questions. The article concludes by arguing that the process of filling in a questionnaire results in the experiences that the instrument is designed to examine being made irrelevant and their complexity far too great for a-contextual quantification.
Aben, I., Verhey, F., Lousberg, R., Lodder, J., & Honig, A. ( 2002). Validity of the Beck Depression Inventory, Hospital Anxiety and Depression Scale, SCL-90, and Hamilton Depression Rating Scale as screening instruments for depression in stroke patients. Psychosomatics , 45, 386-393.
2.
Antaki, C. ( 2001). "D’you like a drink then do you?": Dissembling language and the construction of an impoverished life. Journal of Language and Social Psychology, 20, 196-213.
3.
Antaki, C., Houtkoop-Steenstra, H., & Rapley, M. ( 1996). "Quality of life" talk: The liberal paradox of psychological testing. Discourse and Society, 7, 293-316.
4.
Apple, M. W., & Christian-Smith, L. K. (Eds.). (1991). The politics of the textbook. London: Routledge.
5.
Baker, C. ( 1997). Membership categorization and interview accounts. In D. Silverman (Ed.), Qualitative research: Theory, method and practice (pp. 130-143). London: Sage.
6.
Barret, R.J. ( 1996). The psychiatric team and the social definition of schizophrenia: An anthropological study of person and illness. Cambridge : Cambridge University Press.
7.
Barroso, J., & Sandelowski, M. (2001). In the field with the Beck Depression Inventory. Qualitative Health Research, 11, 491-504.
8.
Beck, A.T., Steer, R.A., & Brown, G.K. ( 1996). Beck Depression Inventory II. Manual. San Antonio, TX: The Psychological Corporation.
9.
Beck, A.T., Ward, C.H., Mendelson, M., Mock, J., & Erbaugh, J. ( 1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571.
10.
Billig, M., Condor, S., Edwards, D., Gane, M., Middleton, D. & Radley, A. ( 1988). Ideological dilemmas. A social psychology of everyday thinking. London: Sage.
11.
Blair, J., & Presser, J. ( 1993). Survey procedures for conducting cognitive interviews to pretest questionnaires: A review of theory and practice. Proceedings of the section on survey research methods of the American Statistical Association, pp. 370-375.
12.
Bonilla-Silva, E., & Forman, T.A. ( 2000). "I am not a racist but . . . ": Mapping White college students’ racial ideology in the USA. Discourse and Society, 11, 50-85.
13.
Brown, P., & Levinson, S. ( 1987). Politeness: Some universals in language usage. Cambridge, UK: Cambridge University Press.
14.
Burns, R.B. ( 2000). Introduction to research methods. London: Sage.
15.
Chouliaraki, L., & Fairclough, N. (1999). Discourse in late modernity . Edinburgh, UK: Edinburgh University Press.
16.
Conrad, F., Blair, J., & Tracy, E. ( 1999). Verbal reports are data! A theoretical approach to cognitive interviews. Federal Committee on Statistical Methodology Research Conference in Arlington, VA, November.
17.
Coyne, J.C. ( 1994). Self-reported stress: Analog or ersatz depression. Psychological Bulletin, 118(1), 29-45.
18.
Crowe, M. ( 2000). Constructing normality: A discourse analysis of the DSM-IV . Journal of Psychiatric and Mental Health Nursing, 7, 69-77.
19.
Denscombe, M. ( 1998). The good research guide: For small-scale social research projects. Buckingham: Open University Press.
20.
Denzin, N.K. ( 1989). The research act: A theoretical introduction to social methods. Upper Saddle River, NJ: Prentice Hall.
21.
Denzin, N. K., & Lincoln, Y. S. (Eds.). (2000). Handbook of qualitative research. London: Sage .
22.
Donsbach, W. ( 1997). Survey research at the end of the twentieth century: Theses and antithesis. International Journal of Public Opinion Research, 9, 17-28.
23.
Drennan, G., Levett, A., & Swartz, L. ( 1991). Hidden dimensions of power and resistance in the translation process. Culture, Medicine and Psychiatry, 15, 361-381.
24.
Endler, N.S., Macrodimitris, S.D., & Kocovsky, N.L. (2000). Depression: The complexity of self-report measures. Journal of Applied Biobehavioral Research, 5(1), 26-46.
25.
Ericsson, A., & Simon, H. ( 1993). Protocol analysis: Verbal reports as data. Cambridge: MA: MIT Press.
26.
Fairclough, N. ( 1992). Discourse and social change. Cambridge , UK: Polity.
27.
Fowler, R. ( 1985). Power. In T. A. Van Dijk (Ed.), Handbook of discourse analysis (Vol. 4). San Diego, CA: Academic Press.
28.
Galasiński, D. ( 2000). The language of deception. A discourse analytic study . Thousands Oaks, CA: Sage.
29.
Galasiński, D. ( 2003, September). "There is simply no such option here!" Questionnaires and respondents’ construction of Identity. AILA Conference on "Multiliteracies and Cultural Literacy,"Ghent, Belgium, September.
30.
Galasiński, D. ( 2004). Men and the language of emotions. Basingstoke, UK: Palgrave Macmillan.
31.
Galasiński, D. ( 2008). Constructions of the self in interaction with the Beck Depression Inventory. Health: An Interdisciplinary Journal for the Social Study of Health, Illness and Medicine, 12, 515-533.
32.
Galasiński, D., & Meinhof, U.H. ( 2002). Looking across the river. German-Polish border communities and the construction of the other. Journal of Language and Politics, 1, 25-58.
33.
Gibbons, J. (1994). (Ed.). Language and the law. White Plains, NY: Longman.
34.
Gillham, B. ( 2000). Developing a questionnaire. London : Continuum.
35.
Gomm, R. ( 2004). Social research methodology. A critical introduction . Basingstoke, UK: Palgrave Macmillan .
36.
Gray, N.M., Sharp, P., Cotton, S.C., Avis, M., Philips, Z., Russell, I., et al. (2005). Developing a questionnaire to measure the psychosocial impact of an abnormal cervical smear result and its subsequent management: The TOMBOLA (trial of management of borderline and other low-grade abnormal smears) trial. Quality of Life Research, 14, 1553-1562.
37.
Hall, S. ( 1996). The problem of ideology: Marxism without guarantees. In D. Morley & D.-K. Chen (Eds.), Stuart Hall: Critical dialogues in cultural studies. London: Routledge.
38.
Halliday, M.A.K. ( 1994). Introduction to functional grammar. London: Arnold.
Heath, A. ( 1986). Do people have consistent attitudes? In R. Jowell, S. Whiterspoon , & L. Brook (Eds.), British social attitudes: The 3rd report. Aldershot, UK: Gower.
41.
Henn, M., Weinstein, M., & Foard, N. ( 2006). A short introduction to social research. London: Sage.
42.
Hodge, B., & Kress, G. ( 1993). Language as ideology. London: Routledge.
43.
Houtkoop-Steenstra, H. ( 2000). Interaction and the standardized survey interview: The living questionnaire. Cambridge, UK: Cambridge University Press.
44.
Katz, R., Shaw, B.F., Vallis, T.M., & Kaiser, A.S. ( 1995). The assessment of severity and symptom patterns in depression . In E. E. Beckham & W. R. Leber (Eds.), Handbook of depression (2nd ed., pp. 61-85). New York: Guilford.
45.
Kleinman, A. ( 1988). Rethinking psychiatry. New York: Free Press.
46.
Kozłowska, O. ( 2004). Żyć bezrobociem: analiza dyskursu bezrobotnych [Living unemployment. An analysis of the discourse of the unemployed]. MA dissertation, Institute of Psychology, University of Opole, Opole, Poland.
47.
Kress, G., & van Leeuwen, T. (1996). Reading images: The grammar of visual design. London: Routledge .
48.
Kvale, S. ( 1995). The social construction of validity. Qualitative Inquiry, 1, 19-40.
49.
Loftus, E.F. ( 1996). Eyewitness testimony. Cambridge, MA : Harvard University Press.
50.
Makselon-Kowalska, B. ( 1998). Atrybucje przyczyn utraty pracy a wybór strategii zaradczych przez osoby bezrobotne. In Z. Ratajczak (Ed.) Bezrobocie. Strategie zaradcze i wzorce pomocy psychologiczej [Unemployment. Coping strategies and models of psychological assistance.] (pp. 101-110). Katowice: Wydawnictwo Uniwersytetu Śląskiego .
51.
Makselon-Kowalska, B. ( 2001). Stereotypy związane z bezrobociem a poczucie własnej tożsamości u osób bezrobotnych. In Z. Ratajczak (Ed.), Bezrobocie: między bezradnością a nadzieją [Unemployment: between helplessness and hope.] (pp. 10-20). Katowice : Wydawnictwo Uniwersytetu Śląskiego.
52.
Marsh, C. ( 1979). Problems with surveys: Method or epistemology? Sociology, 13, 293-305.
53.
Masse, R. ( 2000). Qualitative and quantitative analyses of psychological distress: Methodological complementarity and ontological incommensurability . Qualitative Health Research, 10, 411-423.
54.
Maxwell, J.A. ( 1992). Understanding and validity in qualitative research. Harvard Educational Review, 62, 279-300.
55.
Meinhof, U.H. ( 1997). The most important event of my life. A comparison of male and female written narratives. In S. Johnson & U. H. Meinhof (Eds.), Language and masculinity (pp. 208-228). Cambridge, MA: Blackwell.
56.
Mishler, E.G. ( 1991). Research interviewing: Context and narrative. Cambridge, MA: Harvard University Press.
57.
Nielsen, J., Clemmensen, T., & Yssing, C. ( 2002). Getting access to what goes on in people’s heads?-Reflections on the think-aloud technique. NordiCHI Conference in Aarhus, Denmark, October.
58.
Page, S., & Bennesch, S. ( 1993). Gender and reporting differences in measures of depression . Canadian Journal of Behavioral Science, 25, 579-589.
59.
Parker, I., Gorgaca, E., Harper, D., McLaughlin, T., & Stowell-Smith, M. (1995). Deconstructing psychopathology . London: Sage.
60.
Payne, G., & Payne, J. ( 2004). Key concepts in social research. London: Sage.
61.
Potter, J. ( 1997). Discourse Analysis as a way of analysing naturally occurring talk. In D. Silverman (Ed.), Qualitative research: Theory, method and practice (pp. 146-160). London: Sage.
62.
Potter, J., & Wetherell, M. ( 1987). Discourse and social psychology. Beyond attitudes and behaviour. London: Sage.
63.
Robbins, C. ( 2002). Real world research. A resource for social scientists and practitioner-researchers. Cambridge, MA: Blackwell.
64.
Robinson, W.P. ( 2003). Language in social worlds. Cambridge, MA: Blackwell.
65.
Simpson, P. ( 1993). Language, ideology and point of view. London: Routledge.
66.
Speer, S. ( 2002). "Natural" and "contrived" data: A sustainable distinction ? Discourse Studies, 4, 511-525.
67.
Steer, R.A., Ball, R., Ranieri, W.F., & Beck, A.T. ( 1999). Dimensions of the Beck Depression Inventory-II in clinically depressed patients. Journal of Clinical Psychology, 55, 117-128.
68.
Suchman, L.A., & Jordan, B. ( 1990). Interactional troubles in face-to-face survey interviews . Journal of the American Statistical Association, 85, 232-241.
69.
Tischer, S., Meyer, M., Wodak, R., & Vetter, E. ( 2000). Methods of text and discourse analysis. London: Sage.
70.
van Dijk, T. ( 1993). Elite discourse and racism. Newbury Park, CA: Sage.
71.
van Dijk, T. ( 1998). Ideology: A Multidisciplinary approach. London: Sage.
72.
van Leeuwen, T., & Wodak, R. ( 1999). Legitimizing immigration control: A discourse-historical analysis. Discourse Studies, 1, 83-118.
73.
van Praag, H., & Plutchik, R. ( 1987). Interconvertability of five self-report measures of depression . Psychiatry Research, 22, 243-256.
74.
Wallace, J., & Pfohl, B. ( 1995). Age-related differences in the symptomatic expression of major depression. Journal of Nervous and Mental Disease , 183(2), 99-102.
75.
Wells, G.L., & Loftus, E.F. ( 2003). Eyewitness memory for people and events. In A. M. Goldstein (Ed.), Handbook of psychology: Vol. 11: Forensic psychology (I. B. Weiner, Editor in Chief; pp. 149-160). New York: John Wiley.
76.
Widdicombe, S., & Wooffitt, R. ( 1995). The language of youth subcultures: Social identity in action. London: Harvest Wheatsheaf . Wierzbicka, A. (1999). Emotions across languages and cultures. Diversity and universals. Cambridge, UK: Cambridge University Press.
77.
Wiggins, S. ( 2001). Construction and action in food evaluation. Conversational data. Journal of Language and Social Psychology, 20, 445-463.
