Framing is among the most extensively used concepts in the field of communication science. The availability of digital data offers new possibilities for studying how specific aspects of social reality are made more salient in online communication, but also raises challenges related to the scaling of framing analysis and its adoption to new research areas (e.g. studying the impact of artificial intelligence-powered systems on the representation of societally relevant issues). To address these challenges, we introduce a transformer-based approach for generic news frame detection in Anglophone online content. While doing so, we discuss the composition of the training and test datasets, the model architecture, and the validation of the approach and reflect on the possibilities and limitations of the automated detection of generic news frames.
AkyürekA. F.GuoL.ElanwarR.IshwarP.BetkeM.WijayaD. T. (2020). Multi-label and multilingual news framing analysis. In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 8614–8624). ACL. https://doi.org/10.18653/v1/2020.acl-main.763
2.
AliM.HassanN. (2022). A survey of computational framing analysis approaches. In Proceedings of the 2022 conference on empirical methods in natural language processing (pp. 9335–9348). ACL. https://doi.org/10.18653/v1/2022.emnlp-main.633
3.
BatistaG. E. A. P. A.PratiR. C.MonardM. C. (2004). A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explorations Newsletter, 6(1), 20–29. https://doi.org/10.1145/1007730.1007735
BoydstunA. E.GrossJ. H.ResnikP.SmithN. A. (2013). Identifying media frames and frame dynamics within and across policy issues. In New directions in analyzing text as data workshop (pp. 1–13). London. https://faculty.washington.edu/jwilker/559/frames-2013.pdf.
6.
BurscherB.OdijkD.VliegenthartR.de RijkeM.de VreeseC. H. (2014). Teaching the computer to code frames in news: Comparing two supervised machine learning approaches to frame analysis. Communication Methods and Measures, 8(3), 190–206. https://doi.org/10.1080/19312458.2014.937527
7.
CacciatoreM. A.ScheufeleD. A.IyengarS. (2016). The end of framing as we know it… and the future of media effects. Mass Communication & Society, 19(1), 7–23. https://doi.org/10.1080/15205436.2015.1068811
8.
CardD.BoydstunA.GrossJ. H.ResnikP.SmithN. A. (2015). The media frames corpus: Annotations of frames across issues. In Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (pp. 438–444). ACL. https://doi.org/10.3115/v1/P15-2072
GruberJ. B. (2023). Troublemakers in the streets? A framing analysis of newspaper coverage of protests in the UK 1992–2017. The International Journal of Press/Politics, 28(2), 414–433. https://doi.org/10.1177/19401612221102058
13.
KhanehzarS.TurpinA.MikolajczakG. (2019). Modeling political framing across policy issues and contexts. In Proceedings of the 17th annual workshop of the australasian language technology association (pp. 61–66). ACL.
14.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
15.
LaneK.WilliamsY.HuntA. N.PaulkA. (2020). The framing of race: Trayvon martin and the black lives matter movement. Journal of Black Studies, 51(8), 790–812. https://doi.org/10.1177/0021934720946802
16.
LeeJ. K.KimE. (2017). Incidental exposure to news: Predictors in the social media setting and effects on information gain online. Computers in Human Behavior, 75, 1008–1015. https://doi.org/10.1016/j.chb.2017.02.018
17.
LiuS.GuoL.MaysK.BetkeM.WijayaD. T. (2019). Detecting frames in news headlines and its application to analyzing news framing trends surrounding US gun violence. In Proceedings of the 23rd conference on computational natural language learning (pp. 504–514). ACL. https://doi.org/10.18653/v1/K19-1047
18.
MessingS.WestwoodS. J. (2014). Selective exposure in the age of social media: Endorsements trump partisan source affiliation when selecting news online. Communication Research, 41(8), 1042–1063. https://doi.org/10.1177/0093650212466406
19.
NaderiN.HirstG. (2017). Classifying frames at the sentence level in news articles. In Proceedings of the international conference on recent advances in natural language processing (RANLP 2017) (pp. 536–542). INCOMA Ltd. https://doi.org/10.26615/978-954-452-049-6_070
20.
OganC.PenningtonR.VengerO.MetzD. (2018). Who drove the discourse? News coverage and policy framing of immigrants and refugees in the 2016 US presidential election. Communications, 43(3), 357–378. https://doi.org/10.1515/commun-2018-0014
21.
OlssonE. K.IhlenØ. (2018). Framing. In HeathR. L.JohansenW. (Eds.), The international encyclopedia of strategic communication (pp. 1–11). John Wiley & Sons Incorporated. https://doi.org/10.1002/9781119010722.iesc0076
22.
SemetkoH. A.ValkenburgP. M. (2000). Framing European politics: A content analysis of press and television news. Journal of Communication, 50(2), 93–109. https://doi.org/10.1111/j.1460-2466.2000.tb02843.x
23.
TourniI.GuoL.DaryantoT. H.ZhafransyahF.HalimE. E.JalalM.WijayaD. T. (2021). Detecting frames in news headlines and lead images in US gun violence coverage. In Findings of the association for computational linguistics: Emnlp 2021 (pp. 4037–4050). ACL. https://doi.org/10.18653/v1/2021.findings-emnlp.339
24.
TschirkyM.MakhortykhM. (2024). #Azovsteel: Comparing qualitative and quantitative approaches for studying framing of the siege of Mariupol on Twitter. Media, War & Conflict, 17(2), 163–178. https://doi.org/10.1177/17506352231184163
25.
UlloaR.MakhortykhM.UrmanA. (2024). Scaling up search engine audits: practical insights for algorithm auditing. Journal of Information Science, 50(2), 404–419. https://doi.org/10.1177/01655515221093029
26.
Van AelstP.StrömbäckJ.AalbergT.EsserF.De VreeseC.MatthesJ.HopmannD.SalgadoS.HubéN.StępińskaA.PapathanassopoulosS.BerganzaR.LegnanteG.ReinemannC.SheaferT.StanyerJ. (2017). Political communication in a high-choice media environment: A challenge for democracy?Annals of the International Communication Association, 41(1), 3–27. https://doi.org/10.1080/23808985.2017.1288551
27.
van HoofM.TrillingD.MeppelinkC.MöllerJ.LoecherbachF. (2024). Googling politics? Comparing five computational methods to identify political and news-related searches from web browser histories. Communication Methods and Measures, 19(1), 1–27. https://doi.org/10.1080/19312458.2024.2363776
28.
VuH. T.BlombergM.SeoH.LiuY.ShayestehF.DoH. V. (2021). Social media and environmental activism: Framing climate change on Facebook by global NGOs. Science Communication, 43(1), 91–115. https://doi.org/10.1177/1075547020971644
29.
VziatyshevaV.MakhortykhM.SydorovaM.JumleV. (2024). Google, How Should I Vote? How Users Formulate Search Queries to Find Political Information on Search Engines. arXiv. https://doi.org/10.48550/arXiv.2410.00778
30.
WalterD.OphirY. (2019). News frame analysis: An inductive mixed-method computational approach. Communication Methods and Measures, 13(4), 248–266. https://doi.org/10.1080/19312458.2019.1639145
31.
WolfT.DebutL.SanhV.ChaumondJ.DelangueC.MoiA.CistacP.RaultT.LoufR.FuntowiczM.BrewJ. (2020). Transformers: State-of-the-Art Natural Language Processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (pp. 38–45). ACL. https://aclanthology.org/2020.emnlp-demos.6/
