Abstract

Not All Intelligence Is Artificial
For decades, automation was a key focus in manufacturing and industrial engineering. Life sciences and health care are now following suit. The advent of data science, embedded sensors, artificial intelligence (AI), wireless connectivity, and the Internet of Things throughout the planet have raised the prospects for automation, smart hospital design and the home health care industry for an aging population. Extreme automation in laboratory sciences and services across institutions, time zones, and geographical borders is a hot topic for research and health care administration.
Diverse health technology applications are being affected by extreme automation and data science. These include, for example, real-life Big Data collection for omics biomarker–phenotype association studies, digital drugs with embedded sensors to monitor patients' treatment adherence, and laboratory services to be delivered by AI-powered collaborative robots working together with health professionals (Gulland, 2017; Özdemir and Hekim, 2018). Also, automation is at the epicenter of customized manufacturing of biomarker test panels for precision medicine in various common and rare diseases worldwide.
We are submerged in a sea of Big Data, AI, and extreme digital connectivity at an unprecedented planetary scale, creating what has been recently termed the “Quantified Planet” (Özdemir, 2018a). But in the current AI and automation gold rush, we might also be drifting away from human intelligence (HI). If we are to harness the new technologies for robust, reproducible, and responsible innovation in biology and medicine, we need data science, automation, and AI working in tandem with HI, and so that they serve science and society, rather than vice versa.
What Is HI for Data Science and AI?
First, in a context of data science and AI, HI can be defined as a collection of contextual tacit knowledges on human values, responsibility, empathy, intuition, or care for another living being that cannot be readily described or executed by algorithms. I recognize that some avid AI technology fans might contest this point, perhaps suggesting that human empathy, compassion, or all tacit human knowledge can be codified in some algorithmic form and format. Still, I wish to present an alternative view that there is an upper limit to the extent to which tacit human qualities and contexts can be mimicked or engineered with AI. We need HI and its tacit qualities that in effect determine quality in science (Ravetz, 2016), and its applications in health care and society.
Second, HI in data science pertains to knowledge about the broader social and political context in which Big Data and its provenance and applications are situated. It is often falsely assumed that technologies bring about change in society. On the contrary, it is the value-loaded decisions made by funders, persons, and institutions that cause social change. It follows, therefore, that HI has much to do with the ability to excavate the tacit human values, politics, and power embedded in Big Data provenance and its AI-driven applications. To excavate the value-loaded backstage of science, technology, and innovation, we need, however, new kinds of societal literacy in critical political science so as to read the power-laden subtext embedded in daily laboratory life (Latour, 1987).
Third, HI requires interdisciplinary and boundary-crossing soft skills, beyond operating laboratory equipment, to allow for systems thinking over the entire trajectory of Big Data provenance, and so as to bridge the “two cultures” divides between science, and society and politics of innovation. For example, the following questions beg for answers concerning tacit HI knowledge on Big Data provenance and/or application context:
What and who are the sources of Big Data, who is generating them, and by what funding? Who has access to Big Data, and who does not? Which innovation governance models are chosen for AI applications, and to serve what ends? Who is included, or excluded in governance, and why? Which epistemological frames are being deployed for emerging technology governance (Özdemir, 2019; Özdemir and Springer, 2018; Rip, 2016; Stilgoe et al., 2014; von Schomberg, 2013)? To what extent are critical theory and critical governance taken into account to discern Big Data provenance and associated AI applications?
Why Is HI Important for AI and Data Science?
One of the first things I learned in graduate school was evidence “is” always used in singular form, whereas data “are” always plural. That piece of knowledge served me well as editor, author, and reviewer over the years. But there is another underappreciated dimension to data that seems to be overlooked in the gold rush for Big Data, automation, and AI. Data have a provenance: the assortment of technical, social, and political forces that enact on data in their trajectory from study design, funding, choice of laboratory technology platforms to transfer, and distribution of data across laboratories, analysts, and user communities. Big Data are no exception, and have a sociotechnical provenance that tends to be overlooked in data science applications.
Put in other words, data are never “just” data; science is never “just” science; technology is never “just” technology, and they are never free from provenance, human values, power, and politics (Collingridge, 1980; Didier et al., 2015; Feyerabend, 2011; Fisher, 2017; Özdemir et al., 2017; Özdemir, 2019; Sarewitz, 2016):
Decades of research on knowledge workers such as scientists and journalists have shown that production and communication of knowledge are inherently political (value-loaded) acts and cannot be otherwise. It is impossible to separate the knowledge from the knower and her/his social and political context. Yet, the dogma that knowledge is value-free continues to dominate. Old habits die hard. The initial leaders of the Enlightenment project (e.g., Francis Bacon) and their disciples have unquestioningly championed the assumption of value-free apolitical knowledge production for the last 400 years. Everyday life, for that matter, is political. Even a pleasant smile can be political if it is deployed as a commodity to garner social capital and influence (Özdemir, 2018b).
Without literacy on Big Data provenance and appreciation of the politics of innovation, quality in science can be compromised (Ravetz, 2016; Saltelli and Giampietro, 2017). By making the technical, social, and political dimensions of Big Data provenance transparent, HI makes AI accountable and responsible.
A recently recognized issue in online communities might further clarify the importance of HI and associated tacit knowledge and soft skills in discerning Big Data provenance, and by extension, assuring quality in AI science. The veracity of Big Data generated by online communities rests on the assumption that much of the Internet traffic is human. But some analysts are posing the following question: How much of the Internet is fake? Although the answers vary (Read, 2018), bots camouflaged as people to collect user data from humans are becoming difficult to ignore. Even more worrisome is the recent recognition of Big Data generated by bot-to-bot traffic. In this case, bots follow other bots to collect online data (Read, 2018). The bot-to-bot web traffic pushes the scale of threats to Big Data veracity further. These unprecedented emergent phenomena tell us that unless Big Data provenance is routinely taken into account, downstream AI-driven applications from Big Data may suffer from the “garbage in garbage out” predicament. Needless to say, these phenomena are not simply technical but also social and political. The online monopolies that create and harness Big Data add to these concerns (Özdemir, 2018a).
HI informed by critical social science and humanities can usefully shape the real-life context in which automation and other AI applications are currently emerging. For example, AI algorithms offer new prospects for prediction of disease and treatment outcomes, and by extension, empowering precision medicine. But the same advanced tools used for pattern recognition and predictive forecasting can also be deployed, for example, as facial recognition technologies that threaten global democracy and civil rights. That is, extreme digital connectivity, Big Data, and AI-driven automation create a fertile potential for new power structures for authoritarian governance and pansurveillance by one person in total control of knowledge networks in science and society, directly or through connected proxies (Larson, 2018; Özdemir, 2018b). HI knowledge, its tacit qualities, and soft skills are essential so as to “see through and beyond” new technologies, and identify the opaque human values driving technology and its regulation (Conley, 2011; Guston, 2014; Harris, 2019; Latour, 1987; Thoreau and Delvenne, 2012; White, 2018).
In sum, HI-informed Big Data provenance and mapping of AI application contexts are ultimately important to prevent the type 3 (framing) errors in data science, that is, “finding the right answers for the wrong questions.” Data science, automation, and AI would be served well and stand the test of time and context, if they were informed by the tacit qualities and knowledges of HI.
Outlook
Four ways to cultivate HI-informed innovation ecosystems
If HI offers the broader sociotechnical context on Big Data provenance and AI applications, how can we cultivate HI-informed innovation ecosystems?
The first idea is to routinely deploy metadata to boost Big Data provenance. Metadata are defined as “data about data,” and include the technical and social/political context in which Big Data are generated and valorized as products (Özdemir et al., 2014). In addition, metadata would bode well for inclusive credit attribution to data scientists for their important contributions to data generation and provenance in an innovation ecosystem.
The second idea is to promote new forms of social literacy on the “two cultures” divide, and so that engineers, physicians, and scientists are trained in critical theory and political science as part of their education. This would equip the next generation of innovators with skills to read the subtext, human values, power, and social context that shape the creation of scientific knowledge and innovations that stand the test of time and application contexts.
The third idea is to clarify a centuries-old misconception in science, engineering, medicine, and technology communities. Political science scholarship makes the politics in science, that is, creation and contestation of power, transparent and accountable, and thus contributes to responsible innovation and critical governance of emerging technologies. Political science expertise is an excellent antidote to opaque politics and unaccounted human power in science that threaten technology ethics, responsible innovation, and global democracy (Özdemir, 2018b).
The fourth, and perhaps the most important idea, is that the regimes of truth are inextricably linked to power (Foucault, 1980; Haraway, 1988). Many of the currently established fields such as pharmacogenomics, the study of gene-by-drug interactions (Kalow et al., 1999; Ozdemir et al., 2000), initially started out as fringe contested ideas outside the dominant scientific establishment in the mid 20th century (Ozdemir et al., 2009). As scientists, we ought to recognize that consensus over new technologies is for textbooks (Sarewitz, 2011), whereas science, technology, and innovation advance by contestation, dissent, and disagreements. HI could welcome and appreciate dissent and opposing views on emerging technologies. By broadening our approach to technology governance beyond the practice of forced consensus, HI tacit knowledges build reflexivity and resilience against uncertainties, ignorance, and unknowns in science and society, and thus help cultivate responsible innovation across AI, automation, and data science communities.
Footnotes
Disclaimer
No funding was received in support of this article. Views expressed are author's personal opinions only and do not necessarily reflect those of the affiliated institutions.
Author Disclosure Statement
The author declares that there are no competing financial interests.
