Reflecting the seen scene: Theorizing screenshots as multistable metapictures

Abstract

This paper develops contemporary theorizing of vernacular screenshots by positioning them as artifacts reflecting the technological design and individual choices that allow their content to be viewed. By situating them within metapicture theory, screenshots induce a multistable perception of static image content as visibly nested within an imaging process. Screenshots, then, infer causal reasoning over how and why they exist. Several examples of screenshots are given to exercise this contextually reflective reading. Analysis of each exemplifies the theoretical stance described and aids in two contributions for this paper to existing discourse on image ontology in New Media. First, the paper applies metapicture theory to increasingly contemporary cases of image remediation. Second, the paper provides a theoretical approach to assess screenshots as multistable metapictures where simultaneous content readings are possible. As a result, screenshots emerge to increasingly implicate a world of interaction behind the camera lens.

Keywords

explainability materialist semiotics media archeology metapicture multistability screenshot

Get full access to this article

View all access options for this article.

References

Adadi

Berrada

(2018) Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access 6: 52138–52160.

Azoulay

(2014) Aïm Deüelle Lüski and Horizontal Photography. Lieven Gevaert series vol. 16. Leuven (Belgium): Leuven University Press.

Barthes

(1977) Image, Music, Text: Essays. Heath

(ed). London: Fontana, 13.

Bock

(2020) Theorising visual framing: contingency, materiality and ideology. Visual Studies 35(1): 1–12.

Bolter

Grusin

(1999) Remediation: Understanding New Media. Cambridge, Mass: MIT Press.

Bourdieu

(1990) Photography: A Middle-Brow Art. Cambridge, UK: Polity Press.

Colombo

(2019) Studying digital images in groups: the folder of images. In: Mariani

Rampino

(eds) Advancements in Design Research: 11 PhD Theses on Design as We Do in Polimi. Milano: Angeli Open access, 185–195.

Colombo

Bounegru

Gray

(2023) Visual models for social media image analysis: groupings, engagement, trends, and rankings. International Journal of Communication 17: 1956–1983.

Condie

Costa

(2018) (Re-)exploring the practical and ethical contexts of digital research. In: Doing Research in and on the Digital Research Methods across Fields of Inquiry. Abingdon: Routledge, 205–212.

10.

Couldry

(2003) Passing ethnographies: rethinking the sites of agency and reflexivity in a mediated world. In: Global Media Studies: Ethnographic Perspectives. New York: Routledge, 40–56.

11.

Crary

(1992) Techniques of the Observer: On Vision and Modernity in the Nineteenth Century. Cambridge, Massachusetts: MIT Press. Available at: https://www-jstor-org-443.web.bisu.edu.cn/stable/779041?origin=crossref (accessed 14 November 2021).

12.

Deleuze

Guattari

(1987) A Thousand Plateaus: Capitalism and Schizophrenia (tran. B Massumi).

13.

Edwards

(2012) Objects of affect: photography beyond the image. Annual Review of Anthropology 41(1): 221–234.

14.

Favero

PSH

(2018) The Present Image. Cham: Springer International Publishing. Available at: https://link-springer-com-443.web.bisu.edu.cn/10.1007/978-3-319-69499-3 (accessed 12 March 2022).

15.

Flusser

(2000) Towards a Philosophy of Photography. London: Reaktion Books.

16.

Flusser

(2011) Into the Universe of Technical Images. Electronic mediations V. 32. Minneapolis, Minnesota: University of Minnesota Press.

17.

Flusser

(2014) Gestures. 3rd edition. Minneapolis, Minnesota: University of Minnesota Press.

18.

Frosh

(2019) The Poetics of Digital Media. 1st edition. Cambridge, UK: Polity Press.

19.

Gibbs

Meese

Arnold

, et al. (2015) #Funeral and Instagram: death, social media, and platform vernacular. Information, Communication & Society 18(3): 255–268.

20.

Gilpin

Bau

Yuan

, et al. (2019) Explaining explanations: an overview of interpretability of machine learning. arXiv:1806.00069. arXiv. Available at: https://arxiv.org/abs/1806.00069 (accessed 4 February 2024).

21.

Grønstad

Vågnes

(2017) Images and their incarnations: an interview with W.J.T. Mitchell. In: W.J.T Mitchell’s Image Theory: Living Pictures. Milton Park, UK: Routledge, 182–194.

22.

Gunthert

(2015) The Consecreation of the Selfie. A Cultural History [La consécration du selfie. Une histoire culturelle]. Études Photographiques 31(1): 1–21.

23.

Hand

Scarlett

(2020) Habitual photography. In: Durden

Tormey

(eds) The Routledge Companion to Photography Theory. 1st edition. New York: Routledge, 410–425.

24.

Hentschel

(2014) KippCity. In: Holzhey

CFE

(ed) Multistable Figures: On the Critical Potential of Ir/Reversible Aspect-Seeing. ‘Cultural inquiry’ with Turia + Kant. Berlin: Institute for Cultural Inquiry, 23–40.

25.

Hölzl

Marie

(2015) Softimage: Towards a New Theory of the Digital Image. Bristol: Intellect.

26.

Ihde

(2012) Postphenomenological re-embodiment. Foundations of Science 17(4): 373–377.

27.

Ihde

(2016) Husserl’s missing technologies. In: Perspectives in Continental Philosophy. 1st edition. New York: Fordham University Press.

28.

Kelso

JAS

(2012) Multistability and metastability: understanding dynamic coordination in the brain. Philosophical Transactions of the Royal Society 367: 906–918.

29.

Kress

Leeuwen

(2001) Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Arnold.

30.

Leys

(2007) The Droste effect image transformation. Computers & Graphics 31(3): 516–523.

31.

Manovich

(1999) Avant-garde as software. Artnodes (2): 1–11.

32.

Manovich

(2017) Instagram and contemporary image.

33.

Miller

(2023) Finding found photobooks. In: Creativity and Cognition. Virtual event USA, 2023. ACM, 223–229. Available at: https://dl.acm.org/doi/10.1145/3591196.3593334 (accessed 1 November 2023).

34.

Miller

(2024) Finding the local (meta)picture. In: Visual Studies. Routledge. Epub ahead of print 2024. DOI: 10.1080/1472586X.2024.2343380.

35.

Miller

Lee

(2022) Cell as framework: articulating interaction points through instinctive imaging practices. In: 25th international academic Mindtrek conference, Tampere Finland, 16 November 2022. ACM, 377–381. Available at: https://dl.acm.org/doi/10.1145/3569219.3569886 (accessed 24 January 2023).

36.

Miller

Lion

(2021) Reflecting through the photo’s (Un)making. In: Proceedings of the 2014 conference on international association of socieities of design research, Hong Kong, SAR, 2021. Springer.

37.

Mitchell

WJT

(1984) What is an Image.pdf. New Literary History 15(3): 503–537.

38.

Mitchell

WJT

(1987) Iconology: Image, Text, Ideology. 1st edition. Chicago: Univ. of Chicago Press.

39.

Mitchell

WJT

(1994) Picture Theory: Essays on Verbal and Visual Representation. Paperback edition. Chicago, Ill: University of Chicago Press, Vol. 6.

40.

Mitchell

WJT

(2015) Image Science: Iconology, Visual Culture, and Media Aesthetics. Chicago, IL: University of Chicago Press. Available at: https://www.bibliovault.org/BV.landing.epl?ISBN=9780226231334 (accessed 12 February 2024).

41.

Moore

(2014) Screenshots as virtual photography. In: Arthur

Bode

(eds) Advancing Digital Humanities: Research, Methods, Theory. New York, NY: Palgrave Macmillan, 141–160.

42.

Moreno

van Orden

(2001) Word recognition, cognitive psychology of. In: Smelser

Baltes

(eds) International Encyclopedia of the Social & Behavioral Sciences. Oxford: Pergamon.

43.

O’Neill

Smith

(2014) Climate change and visual imagery. WIREs Climate Change 5(1): 73–87.

44.

Paglen

(2019) Invisible images; your pictures are looking at you. Architectural Design 89(1): 22–27.

45.

Parikka

(2015) A Geology of Media. Electronic mediations volume 46. Minneapolis; London: University of Minnesota Press.

46.

Peirce

(1955). Philosophical Writings of Peirce. Buchler

(ed). New York: Dover.

47.

Pisarchik

Hramov

(2022) Multistability in physical and living systems: characterization and applications. In: Springer Series in Syergetics. New York, NY: Springer.

48.

Purgar

(2017) Iconology as cultural symptomatology: dinosaurs, clones and the golden calf in MItchell’s image theory. In: Purgar

(ed) W.J.T. Mitchell’s Image Theory: Living Pictures. Milton Park, UK: Routledge, 82–99.

49.

ResearchGate, n.d. ResearchGate (n.d) Fig 4. Available at: https://www.researchgate.net/figure/Duck-Rabbit-Ludwig-Wittgenstein-Philosophical-Investigations-p-194_fig4_338893714 (accessed 30 October 2023).

50.

Ricco

(2016) Reading Mitchell’s “queer” metapictures. In: W.J.T. Mitchell’s Image Theory Living Pictures. New York: Routledge, 251–263.

51.

Rogers

(2021) Visual media analysis for Instagram and other online platforms. Big Data & Society 8(1): 1–23.

52.

Rose

(2022) Visual Methodologies: An Introduction to Researching with Visual Materials. 4th edition. Thousand Oaks: Sage Publications, Inc.

53.

Rubinstein

(2020) Fragmentation of the Photographic Image in the Digital Age. Rubinstein

(ed). 1st edition. New York, NY: Routledge. Available at: https://www-taylorfrancis-com-443.web.bisu.edu.cn/books/9781000699203 (accessed 15 November 2021).

54.

Rubinstein

Sluis

(2008) A life more photographic: mapping the networked image. Photographies 1(1): 9–28.

55.

Sanneman

Shah

(2022) The situation awareness framework for explainable AI (SAFE-AI) and human factors considerations for XAI systems. International Journal of Human-Computer Interaction 38(18–20): 1772–1788.

56.

Sherman

Craig

(2018) Understanding Virtual Reality. Cambridge, Massachusetts: Morgan Kaufmann.

57.

Sinclair

Freitas

(2014) The haptic nature of gesture: rethinking gesture with new multitouch digital technologies. Gesture 14(3): 351–374.

58.

Slife

(2004) Taking practice seriously: toward a relational ontology. Journal of Theoretical & Philosophical Psychology 24(2): 157–178.

59.

Smith

(2013) At the Edge of Sight: Photography and the Unseen. Durham: Duke University Press.

60.

Švelch

(2021) Redefining screenshots: toward critical literacy of screen capture practices. Convergence: The International Journal of Research into New Media Technologies 27(2): 554–569.

61.

Thrift

(2008) Non-Representational Theory: Space, Politics, Affect. 1. Publ. International Library of Sociology. London: Routledge.

62.

Trentini

(2014) The meta as an aesthetic category. Journal of Aesthetics & Culture 6(1): 23009.

63.

van der Meulen

(2010) Between Benjamin and McLuhan: Vilém Flusser’s media theory. New German Critique 37(2): 180–207.

64.

Van Lier

(2008) Philosophy of Photography. Leuven (Belgium): Leuven University Press.

65.

Verbeek

P-P

(2007) Beyond the human eye: technological mediation and posthuman visions. In: Kockelkoren

Brand

(eds) Mediated Vision. Rotterdam: Veenman [u.a.], 43–53.

66.

Wittgenstein

(1968) Philosophical Investigations. Oxford: Basil Blackwell.

67.

Wojcieszak

(2009) Three dimensionality: taxonomy of iconic, linguistic, and audio messages in television news. Television & New Media 10(6): 459–481.

68.

Zhao

Zappavigna

(2018) Beyond the self: intersubjectivity and the social semiotic interpretation of the selfie. New Media & Society 20(5): 1735–1754.