Abstract
This article focuses on principles of information aggregation in the presence of false, public reports (fake news). The analysis explores news has been having a public goods feature characterized by models of information and economic efficiency. The analysis is not tied to any particular theory about how or why unreliable news emerges. The reports could be purposeful deception, intentions to mislead or profit motivated responses to decision biases of readers. A well-known and widely studied “cascade” experiment is used to illustrate principles that provide links to standard economic models. News is modeled as an aggregation of a simple, fixed chain of decentralized observations and reports about an underlying, unknown state of nature. The personal value of an individual’s decision depends on both the decision and the underlying state of nature. The information about the state used in the decision can reflect private observations or the “news” about the decisions of others. The experiments demonstrate that aggregated information is dependent on accumulated trust in news sources and has value as a special form of public goods.
While fake news is not a newly emergent phenomenon, it is currently the focus of discussions and concerns about the implications. This article addresses the subject of fake news from a narrow perspective of standard economic models and the possible efficiency-enhancing, benefits-producing properties of news. The perspective abstracts from strategic intentions and possible perception bias of news producers or various possible news preferences of consumers. In contrast to the broad discussions found in popular literature, the analysis is constructed from a very simple, often-studied experiment and a model that connects the phenomenon to principles found in traditional economics. News is modeled as observations about an underlying state (of nature) that cannot be observed directly. The theory rests on the possibility that the value of news reflects the fact that multiple, independent observations can support a guess about a common “state of the world” based on information available. As such, the value of news can exceed the value of the private observations of a single decision maker and thus has economic properties recognized as a “public good.” A well-known laboratory economics experiment, typically used to illustrate “herding” or “cascading” decisions, is conducted to illustrate the model and explore its basic principles. The model is used to demonstrate the social, economic value of a well-functioning news system and how fake news can destroy that value.
This article is organized as follows. Information Aggregation and Efficiency from an Economics Perspective section is a discussion of the concepts and background theory. Experiments section is a discussion of the experiment, the experimental design, and the questions posed for testing. Results section is the statement of findings. Summary of Conclusions section is a summary of our contribution.
Information Aggregation and Efficiency from an Economics Perspective
The topic of fake news is very broad. By contrast, this article explores very simple and special case issues as an attempt to uncover some of the basic principles that are at work. Of course, news is a deep part of the social fabric, and policies that shape its role, such as freedom of the press, are widely recognized as a cornerstone of a free society. 1 Complex and important issues abound but are not addressed here. Omitted important topics include the vehicles that carry news, demand for news, rumors, propaganda, misinformation as well as those who benefit from fake news and the tools from advertising and strategies they might use. The question is how fake news might emerge and the consequences of fake news in the absence of such promotions.
This article is focused on very simple cases in which the detailed features of general, widely used models can be specified, studied, and connected to related phenomena in economics. The theory reflects the work of Hayek (1945), “The Use of Knowledge in Society,” and Hayek (1948) regarding how information is transmitted through market institutions and is applied widely to economic theory and finance as well as political theory. The basic principles apply to a world in which information is produced from decentralized sources of observation and are the key features of the experiment. Within that general model, information originates locally as a product of the actions of those close to the facts and with interests aligned with the use of the facts. In the Hayek model, the information becomes transferred and aggregated through publicly observed actions such as trades and trading prices in which good information and incentives to take actions are closely related. In a statistical sense, the information contained in scattered observations can become aggregated, pooled, and processed. 2 The resulting knowledge is a resource, a type of “public good,” that can be used multiple times and can produce economic value to the user by preventing costly mistakes. Often the accumulated information is regarded as “common sense” and is easily detected in everyday events and life-shaping decisions. For example, people normally visit a restaurant because they like the food, and thus, the number of customers is used as a source of information about the quality of the restaurant. Or, the location of fishermen is used as information about the location of fish. Analogously, in markets, the upward movement of a stock price suggests the possibility of favorable earnings because those who have uncovered favorable facts have an incentive to buy the stock before others do.
The existence and growth of fake news phenomena have motivated warnings. For example, Michael Bloomberg suggests the possibility of direct damages to wealth through the effect of fake news on the stock market (https://www.bloomberg.com/view/articles/2017-10-23/why-fake-news-is-so-harmful-to-investors). Others have expressed concerns about long-term consequences. For example, politician Hillary Clinton points to the possibility of systemic damage due to a leveling effect or “false equivalency” in which the unreliable news sources and reliable sources are regarded as equals. 3 The suggestion is that the information contained in the news and the use of the news would deteriorate.
The traditional economic theory of information aggregation suggests two classes of principles that shape the dynamics that influence the growth or decline of the value of news. One principle, a principle of “information-revealing choices/behavior,” points to the incentives of those whose actions can carry information. It is a type of “information-revealing invertibility.” When incentives and information-revealing actions are aligned, the actions of others can reveal information that can be trusted and used. On the other hand, if incentives and actions are not aligned, the information revealed can become a type of “fake news” that is misleading and can lead to costly mistakes. Of course, experience contributes to the reliability of information and can lead to recognition of the absence of information-revealing invertibility when the information should be modified or ignored. For instance, the diners and fishermen will ignore information if it is known to be unreliable. That is, if customers are known to be paid by the owner to sit at a restaurant, or if boats are known to be populated by sightseers as opposed to fishermen, the diners and fishermen will ignore the actions suspecting that no information is carried by observed behavior. If incentives and actions are not aligned to produce reliable information, the use and value of public news suffer.
A second principle applies when multiple observations or observers exist, and information can be accumulated with the possibility of multiple (independent) observations becoming aggregated in a statistical sense. It is a type of “principle of information aggregation.” Each step rests on the hypothesis that those who make earlier decisions have sufficient confidence in the decisions of those who come before them. Such links are part of the aggregation process that pools otherwise separate observations. The structure of the underlying network and the pattern of observations available to individuals in the network have theoretical implications for news performance and could differ according to the news accumulation and delivery process. Certainly, any aggregation phenomena would be sensitive to the social structures that channel information exposure, the sequence of observations, what is observed, the independence of observations, and other institutional features. News from “social news” or gossip could differ from the “mainstream press.” The aggregation of information and decisions might appear as a growth, cascading, or herding property that becomes stronger as the information builds even independent of accuracy. In the absence of an understanding of the role of the news, the social behavior could be interpreted as mindless mimicking, imitation, or conforming behavior as suggested by the terms “cascades” and “herds.” However, the theory suggests the possibility that the news system is an information-building process in which the value of the public information provided increases with additional observation. In that sense, the basic theory of news is tangentially connected to the basic theory of public goods provision processes in which the news constitutes a “public good” shared in common by all as a source of uncertainty reduction.
Experiments
The experiments listed in table 1 are structured from the implications of the two principles and the background literature. The experiments take place in a very simple, “one-dimensional” communication in which the predictions of the principles can be unambiguously specified. Each participant makes a decision under uncertainty. At the time of the decision, they have information from their private source and information implicit in the decisions of preceding participants, each of which gained relevant, but limited information. The reader will recognize the setting as the traditional cascading or herding experimental environment. 4
Experimental Design: Dates, Conditions, and Periods.
Note: EEPS = Experimental Economics and Political Science.
†For the first group (20180207), the first five paid practice rounds for “no fake news” were not conducted. For all of the other groups, these five practice rounds were conducted; therefore, to make comparisons, we haven't used data from these rounds from any group. So, we call the first actual round for group 20180207 the sixth round (to make it comparable with all the other groups).
The three conditions studied are all based on the same experimental setting. Under all settings, subjects are arranged in a randomized order. Two computerized urns have three balls each. One of the urns has two red balls and one white. Call this the red urn. The other urn has two white balls and one red. Call this the white urn. The experiment proceeds as a sequence of periods. One of these urns is chosen at random at the beginning of each period (50:50). The subject does not know which urn was chosen but is privately shown a random (independent) draw of one ball from the chosen urn. The subject gives a (public) report regarding the predicted chosen urn. The earnings of the subject depend on the subject’s report and the actual urn. Following the draw and choice of the first subject, the ball is replaced, and a second draw is randomly drawn from the same urn and revealed to the second subject who makes a public decision. The process continues until all subjects have made a choice. At the end, all subjects have seen all previous decisions. After all the decisions are made, the actual urn from which all draws were made is publicly announced. After subjects have checked their earnings for the period, a new urn is chosen, subjects are randomly ordered, and a subsequent period is initiated.
Three experimental conditions are studied as summarized in table 1 and analyzed as suggested by the principles outlined above. The first condition (no fake news) is a simple case in which news sources can be trusted in the sense that the decision maker’s incentives are clearly, similarly aligned. All subjects have an incentive to choose the urn representing the actual state (the urn from which the ball was drawn). In the no fake news condition, the subject earns a monetary reward (+US$1.50 in the experiment) if the report is correct and loses money (-US$0.50) if the report is incorrect. Since the urns are chosen with equal probability, the best report based on a single, isolated draw is the color of the revealed ball. That is, isolated subjects with normal incentives report red urn if the ball is red and report white urn if the ball is white.
The second is a condition (known fake news) in which pattern (number but not the exact sources) of inaccurate news is known to all. 5 In the known fake news condition, some subjects have normal incentives to report the actual urn used, and three randomly chosen subjects have incentives to report the urn NOT used. These three have “reverse” incentives. Given their information, those with reverse incentives can make their own determination about the actual urn and use that determination to form a report. Those with reverse incentives earn a monetary reward (+US$1.50 in the experiment) if the report is the urn not used and lose money (-US$0.50) if the report is the actual urn. Again, since the choice of the urn is 50/50, in the absence of additional information, the best report is the color of the revealed ball for those with normal incentives (draw x and report x) but the opposite color for those with reverse incentives (draw x and report y).
Notice that those who might create “fake news” produce incorrect information because they have different values conditional on the state of nature. They are not motivated to mislead or to fool others. Their purpose is not to cause others to make mistakes. Fraud and intentional deception are not a part of the motivations in the experiment. While such dimensions could be added, the addition would introduce theoretical complexities that, at this time, would obscure the basic principles that are the focus here, which are to explore how the consequences of fake news can emerge when such possibly dysfunctional motivations do not exist.
The third condition is an unknown fake news condition. All subjects know their own incentives but not the incentives of others. Subjects know that some subjects might have reverse incentives, but they do not know the number or location of subjects with reverse incentives. Thus, in the third condition, all subjects know about the possibility of fake news, but the pattern is not known, and sources are unknown. The reader of the news cannot reliably differentiate unreliable news from reliable news and knows nothing about the general reliability, that is, unknown fake news. Other features of the experiment are exactly the same as the other two conditions.
Experimental Procedures
Four experimental sessions were conducted on four different days. Each session used ten subjects for a total of forty subjects drawn from the Caltech student population. Each session started with five to ten practice periods and consisted of three experimental conditions. Subjects made fifteen reports under each of the conditions. The major features for all experiments are in table 1.
Subjects were Caltech students recruited using the recruiting system of the Caltech Laboratory for Experimental Economics and Political Science (EEPS) and reported to the Caltech EEPS laboratory. Upon arriving at the laboratory, subjects were randomly seated at a station with screening partitions and a computer and were instructed to not talk or communicate.
All experiments were conducted in the same manner. When participants walked into the room, they were given colored PowerPoint instructions (see Appendix), a table to fill out during the experiment (about information such as their incentive type and per-round payoffs), and a writing utensil. Each participant was guided to a seat with a computer, without a view of any other computers or individuals; no communication of any kind was allowed except for questions to experimenters. After all the ten subjects read the instructions, the instructions were summarized (specifically, incentive types and how to use the program), and initial questions were answered individually. Then, several simple examples were shown on the board in the style of the program to be used. In general, the examples were technical but the following was included to emphasize the random nature of the drawing process and focus on the importance of their own draw, the draws of others, and the incentive structure: (If I have normal incentives) (I) if the first two people chose red, and I drew red, then I should choose red; (II) if the first person chose white, the second chose red, and I drew red, then I should choose red; (III) if the first person chose red, and I drew white, then given slight confidence in my choice over someone else, I should choose white; (IV) if the first two people chose red, but the first two people have reverse incentives, and I drew white, then I should choose white; and (V) if I have reverse incentives, and the first two people (normal incentives) chose white, and I drew white, then I should choose red. The use of the word “should” might suggest experimenter “demand effects,” but the data across changing experimental conditions suggest that subjects were using their own judgments and that the instruction was successful eliminating confusion, misunderstandings, or misconceptions about the task, the role of randomness, and incentives.
After these examples, individual questions were answered. All programs were initiated for the practice rounds, during which people could ask final questions. After the practice rounds, no further questions were answered. People were reminded if parameters changed at the start of new periods. At the end of the experiment, participants calculated their total earnings, excluding the practice rounds, and were presented cash accordingly.
Measurements: Earnings and Efficiency
Subjects’ earnings and thus the efficiency of the news system depended on the incentive structure and the decisions subjects made. The subjects had incentives to make a correct report about either which urn was used to make the draw or the opposite, the urn that was NOT used to make the draw. The incentives differed across experimental conditions.
Normal incentive: If the subject reports the “correct urn,” the urn from which the ball was drawn, the subject earns US$1.50 and loses US$0.50 if the report is not the correct urn.
Reverse incentive: If the subject reports the “incorrect urn,” the urn from which the ball was not drawn, the subject earns US$1.50 and loses US$0.50 if the subject reports the correct urn (the urn from which the ball was drawn).
Efficiency measurements reflect the wealth produced by a process. In these types of experiments, it is the money earned by participants relative to the maximum that could have been earned. When earnings depend on the information, the measurement must be adjusted to the information possibilities.
Complete information standard: The complete information standard reports efficiency relative to the hypothetical case in which there is complete public sharing of all draws before any choices are made. From the actual draws used in the experiment, it was calculated that if all subjects are informed of all draws before making a choice, the expected value for a condition (fifteen rounds) is US$14.7 per person. 6 This means that in twelve of fifteen rounds, aggregating all the ten private signals would lead to the choice of the correct state of the world. For reference, there is 79 percent probability that six or more signals would be from the correct urn. Thus, 100 percent efficiency according to this measure is based on all available information even though potentially impossible to use due to the timing or incentives. 7
Results
Four classes of results are reported. In all cases, the movements of all measurements are in the direction suggested by theory, but the small number of periods, given conditions, limits statistical significance.
The first result demonstrates that the principles work by comparing measurements of the wealth created by a news delivery system to an identical economic environment in which no news system exists and all agents rely on private information. The second result is a demonstration that a reliable news source in the sense of no fake news creates social value through efficiency increases. The third result demonstrates that a news source with known biases toward fake news operates with equal efficiency as a news source with no fake news. The fourth and fifth results demonstrate that the introduction of unknown fake news removes the advantages of the news source, and the fifth result demonstrates that fake news can even do additional damage. Result 6 demonstrates that the results are consistent with a Bayes’s law model of individual decisions with the weight shifting between public and private information when making decisions using new sources with varying reliability.
Result 1. When individuals have only their private sources of information/news (observations), they follow Bayes’s law. They choose the state with the highest probability conditional on their information.
This result can be tested based on the reporting behavior of the subjects who make the first move. In our experiment, the first person, in each round, only observes a private draw and makes a decision solely based on this information. Since the prior belief about the urn being either color is “0.5,” a person who follows the Bayes’s rule should report the color of their private draw if they have normal preferences (and the opposite color of their draw if they have reverse preferences). The data show that 214 of 215
8
“first movers” actually report according to their private draw and preferences. Statistically, the probability that the choice of color matches (mismatches) the draw, if the person has normal (reverse) preferences when no other information exists, is essentially 1.
Result 2. Reliable news supports the creation of additional value compared to the case in which only private information exists, but the difference is not statistically significant. Relative to environments with no public news, the existence of public information increases earnings, efficiency, and the proportion of correct decisions relative to an environment with no public news, but the increase is not statistically significant at conventional levels.
Table 2 contains the data. From result 1, we conclude that in the absence of any public information, people use Bayes’s rule and make decisions according to their private signal. Therefore, based on actual draws from the experiment, we can simulate the environment with no public information, where each subject, regardless of their order in the experiment, only observes their private draw and makes the decision accordingly. Comparing this case to the treatment of reliable public information (no fake news) shows that people benefit from the existence of reliable public information in every aspect: more earnings, higher efficiency, and more accuracy. Having reliable public information comparing to only private information increases earnings from US$476 to US$498; the percentage of correct reports increases from 64.66 percent to 66.5 percent, while efficiency increases from 80.95 percent to 84.69 percent. We compared earnings between the two treatments using Wilcoxon signed-rank
9
two-sided test, and the difference in earnings between these two treatments is statistically weak with p value = .322, meaning that even though public information increases earnings, the difference is not statistically significant.
Result 3. If news sources have known biases, then individuals adjust for the biases. When biases exist and have known patterns, information aggregation tends to operate as if there were no biases by increasing efficiency, income, and percentage correct as compared to the condition when only private information exists.
Comparison of Private Information Condition and the No Fake News Condition.
Analysis from table 2 shows that, if people know about fake news, they can effectively adjust for it while making a final decision. To see the support of this property, we compare two treatments: no fake news and known fake news. For the two samples, we compare individual earnings. We use the two-sided Wilcoxon signed-rank test 10 on the difference between the means of these two samples. 11
We cannot effectively reject Hypothesis 0 against the alternative hypothesis, Hypothesis 1 (p value = .3982). The earnings tend to be the same under conditions of known patterns of fake news, and individuals adjust for the bias.
Overall, in the case of known patterns of fake news, the earnings increase from US$498 to US$528, the percentage of correct reports increases from 66.5% to 69%, and efficiency increases from 84.7% to 89.8%.
Result 4. The existence of possible fake news, or the existence of news with an unknown frequency of bias, removes the benefits of available information.
Previous results demonstrate that people benefit from the existence of reliable private information (result 2), and even if the information has known bias, people effectively adjust for it (result 3). Now, we examine the case when the information becomes unreliable. In the last treatment of our experiment (unknown fake news), people are told about the possibility of fake news, but they do not know the number of the identity of those with reversed preferences. Essentially, this treatment should make the public information (reports) a completely unreliable source, and the issue is the impact of the unreliability as compared to anticipated unreliability. We use the one-sided Wilcoxon signed-rank test.
We can reject Hypothesis 0 against the alternative hypothesis, Hypothesis 1 (p value = .01574). Therefore, the reliability (or known unreliability) of the information is important.
Unfortunately, the number of observations is not enough to make statistically significant inferences about the difference in earning separately for each order in the experiment. However, with naive analysis, there is still some indication that the order in the experiment has an effect. For comparison between unknown and known fake news, as expected, the difference in earnings between treatments is not statistically significant for individuals who move first in the sequence. Logically, since the first person only sees his or her private signal, the reliability of the public signal is completely irrelevant for them. In fact, the difference is not statistically significant up until the fifth member in the sequence. Moreover, the difference in earnings between the two treatments is again insignificant for the last mover in the sequence. There are two main forces at play here; the reliability of the information is more significant for people later in the sequence since they get more public information to rely on. On the other hand, the possibility of cascading also becomes more significant later in the sequence, and therefore, the public information might be less important for the last movers. Unfortunately, the lack of an effective measure of cascading as well as the limited number of observations makes it impossible to control.
Result 5. In the case of fake news with unknown reliability, people do even worse than in the case of only private information. System efficiency, incomes, and percentage correct were compared to the case of only private information.
The previous result 4 demonstrated a negative effect of unknown bias in public information on system efficiency and earnings. The next result illustrates that the reason for the negative impact is due to a tendency for people to simply ignore news that they think is unreliable and make decisions on the basis of private sources of information. To test for this property, we compare their performance under the condition of unknown fake news with the simulated case of only private information using the same sequence of private signals as in unknown fake news.
We can effectively reject Hypothesis 0 against our alternative hypothesis, Hypothesis 1 (p value = .005601), meaning that people do not just ignore unreliable public information. Moreover, we can do a one-sided test against:
We can effectively reject Hypothesis 0 against our alternative hypothesis, Hypothesis 1′ (p value = .0028), meaning people do even worse with unreliable public information than without any public information. In the case of unknown fake news compared to only private information, earnings decrease from US$476 to US$456, the percentage of correct reports decreases from 64.66% to 63%, while efficiency decreases from 80.95% to 77.56%.
A deeper view of individual decisions can be obtained through Bayes’s law and a model developed by Grether (1980, 1992). The following definitions are needed.
Let A be defined as the event that urn A is the actual urn, and let B be defined as the event that urn B is the actual urn. Let xit = (ait , dit ) be the information of individual i at position t, such that ait is defined as the information (the number of A and B choices made by those ahead) that individual i has observed from individuals at positions previous to t, and dit is defined as the private draw of individual i at position t. While ait and dit are correlated with each other, they are conditionally independent, given a particular state of the world (A or B). Using Bayes’s law, we obtain the following:
Taking logs and rearranging:
where
We want to determine whether
Define
With a simplifying assumption that the subjects believe that previous choices were made in accordance with private signals, we can use the difference in the number of publicly observed choices as a proxy for
Result 6. (i) Given the information contained in the public news, individuals do not weigh the public information enough relative to their private information. (ii) The relative weight on public information is reduced if the condition is changed from either no fake news or known patterns of fake news to the condition of unknown fake news.
Table 3 contains the result
13
of the regression using Bayes’s law as expressed in equation (1) as a model. In the treatment of no fake news, individuals place more decision weight on the private sources of information (.72) than on the public sources of information (.18). Overall, the regression coefficients are similar for no reverse and known reverse condition, meaning that under those two conditions, the weights individuals give to the public and private information do not change between treatments. Specifically,
Bayes’s Logit Regression.
Summary of Conclusions
The experiments reported here draw on research found in the information aggregation literature from economics, political science, and finance. Information dispersed across many observers becomes aggregated in the form of a signal that can be valuable in the worlds of decision-making under uncertainty. The experiments demonstrate that fake news can undermine the foundation of the information aggregation process when source reliability is unknown.
Three experiments were conducted. The first involved no fake news, and in this case, the experiments demonstrated that subjects learned to rely on public news sources and that such reliance improved their income (although improvement was not statistically significant). The second experiment introduced reverse incentives that gave some subjects (the news sources) the incentive to produce false reports. In this experiment, subjects knew very few reporters had reverse incentives, and as a consequence, subjects adjusted and translated the report, so the proper news was extracted. The report from a source suspected to be biased toward x was properly translated to y. The result was that fake news had no effect.
The third experiment removed information about relative source reliability. The possible existence of reverse incentives and thus fake news was known, but its concentration was not known. In response to the uncertainty, the information use shifted away from public sources to private sources. The public news was used less. As a result, this third experiment removed the benefits of public news sources and information aggregation. The profits made by participants decreased and were comparable to the condition in which they had only private information. News was published, but information aggregation was lost.
According to this model, some of the benefits of public news and possibly some damages of unreliable news are derived from known principles of behavior found operating in many places in the economy. In part, these principles depend on a trusted connection between reporters’ incentives and the information they are capable of reporting. Fake news destroys that relationship and can emerge even in the absence of intentions of some to mislead others. Consequently, the emergence of fake news carries implications beyond the fact that some people might be naive in forming beliefs or that people might lie.
While this article is narrowly focused on the basic principles of standard models and makes no attempt to capture or model the many variables active in the news industry or possible biases of news consumers or producers, some speculation about the lesson is unavoidable. Broad attention to fake news is visible in current network news where providers appear to be engaged in a war with each devoting resources to illustrate that the other side is guilty of producing fake news. Each provides evidence that the other side does not produce reliable news and that the other side uses subtle tools to avoid being detected. The “tweetstorms” and news reported in related social media seem to amplify the messages and accusations with verbal, punishing attacks on reports and the reporters of facts with which they disagree. In the presence of such forms of punishing accusations, the traditional model suggests that fake news and the discussion it stimulates can damage the news system itself, 14 a tragedy of the commons, as the public loses confidence in the reliability of information delivered through the news and the social value provided by confidence in the news is lost.
Footnotes
APPENDICIES I
Authors’ Note
All experimental programs were designed by Travis Maron.
Acknowledgments
The financial support of the John Templeton Foundation and the Rising Tide Foundation is gratefully acknowledged. The help of B. Atsavapranee is also gratefully acknowledged.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Funding was supplied by The John Templeton Foundation and The Rising Tide Foundation.
