Story Tracker: Incremental visual text analytics of news story development

Abstract

Online news sources produce thousands of news articles every day, reporting on local and global real-world events. New information quickly replaces the old, making it difficult for readers to put current events in the context of the past. The stories about these events have complex relationships and characteristics that are difficult to model: they can be weakly or strongly related or they can merge or split over time. In this article, we present a visual analytics system for temporal analysis of news stories in dynamic information streams, which combines interactive visualization and text mining techniques to facilitate the analysis of similar topics that split and merge over time. Text clustering algorithms extract stories from online news streams in consecutive time windows and identify similar stories from the past. The stories are displayed in a visualization, which (1) sorts the stories by minimizing clutter and overlap from edge crossings, (2) shows their temporal characteristics in different time frames with different levels of detail, and (3) allows incremental updates of the display without recalculating the past data. Stories can be interactively filtered by their duration and connectivity in order to be explored in full detail. To demonstrate the system’s capabilities for detailed dynamic text stream exploration, we present a use case with real news data about the Arabic Uprising in 2011.

Keywords

News stream analysis topic evolution dynamic visualization text analytics

Get full access to this article

View all access options for this article.

References

Allan

(ed.). Topic detection and tracking: event-based information organization. Norwell, MA: Kluwer Academic Publishers, 2002.

Blei

Lafferty

. Dynamic topic models. In: Proceedings of the 23rd international conference on machine learning (ICML ’06), Pittsburgh, PA, USA, 25-29 June 2006, pp. 113–120. New York: ACM.

Wong

Foote

Adams

. Dynamic visualization of transient data streams. In: IEEE symposium on information visualization (INFOVIS 2003), Seattle, WA, USA, 19-21 October 2003, Los Alamitos, CA: IEEE Computer Society.

Havre

Hetzler

Nowell

. ThemeRiver: visualizing theme changes over time. In: Proceedings of the IEEE symposium on information visualization (INFOVIS ’00), Salt Lake City, UT, USA, 9-10 October 2000, pp. 115–123. Washington, DC: IEEE Computer Society.

Byron

Wattenberg

. Stacked graphs—geometry & aesthetics. IEEE T Vis Comput Gr 2008; 14(6): 1245–1252.

Dörk

Gruen

Williamson

. A visual backchannel for large-scale events. IEEE T Vis Comput Gr 2010; 16(6): 1129–1138.

Fisher

Hoff

Robertson

. Narratives: a visualization to track narrative events as they develop. In: IEEE symposium on visual analytics science and technology (VAST ’08), Columbus, OH, USA, 19-24 October 2008, pp. 115–122. Washington DC: IEEE.

Luo

Yang

Krstajić

. EventRiver: visually exploring text collections with temporal references. IEEE T Vis Comput Gr 2012; 18(1): 93–105.

Krstajić

Bertini

Keim

. CloudLines: compact display of event episodes in multiple time-series. IEEE T Vis Comput Gr 2011; 17: 2432–2439.

10.

Krstajić

Bertini

Mansmann

. Visual analysis of news streams with article threads. In: StreamKDD ’10: proceedings of the first international workshop on novel data stream pattern mining techniques, Washington DC, USA, 25-28 July 2010, pp. 39–46. New York: ACM.

11.

Aigner

Miksch

Schumann

. Visualization of time-oriented data. London, UK: Springer, 2011.

12.

Wei

Liu

Song

. TIARA: a visual exploratory text analytic system. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining (KDD ’10), Washington DC, USA, 25-28 July 2010, pp. 153–162. New York: ACM.

13.

Rose

Butner

Cowley

. Describing story evolution from dynamic information streams. In: IEEE symposium on visual analytics science and technology (VAST ’09), Atlantic City, NJ, USA, 11-16 October 2009, pp. 99–106. Washington DC, USA: IEEE.

14.

Atkinson

Van der Goot

. Near real time information mining in multilingual news. In: WWW ’09: proceedings of the 18th international conference on World Wide Web, Madrid, Spain, 20-24 April 2009, pp. 1153–1154. New York: ACM.

15.

Krstajić

Mansmann

Stoffel

. Processing online news streams for large-scale semantic analysis. In: 1st international workshop on data engineering meets the semantic web, ICDE 2010, Long Beach, CA, USA, 5-6 March 2010.

16.

Kleinberg

. Temporal dynamics of on-line information streams. In: Garofalakis

Gehrke

Rastogi

(eds) Data stream management: processing high-speed data streams. Heidelberg, Germany: Springer, 2006.

17.

Osinski

Weiss

. Carrot²: design of a flexible and efficient web information retrieval framework. In: AWIC, Lodz, Poland, 6-9 June 2005, pp. 439–444. Heidelberg: Springer.

18.

Osinski

Stefanowski

Weiss

. Lingo: search results clustering algorithm based on singular value decomposition. J Intell Inform Syst 2004; 4:359–368.

19.

Salton

Wong

Yang

. A vector space model for automatic indexing. Commun ACM 1975; 18: 613–620.

20.

Zamir

. Clustering web documents: a phrase-based method for grouping search engine results. Technical Report, Doctoral dissertation, University of Washington, 1999.

21.

Stefanowski

Weiss

. Carrot² and language properties in web search results clustering. In: AWIC, Madrid, Spain, 5-6 May 2003, pp. 240–249. Heidelberg: Springer.

22.

Heer

Kong

Agrawala

. Sizing the horizon: the effects of chart size and layering on the graphical perception of time series visualizations. In: Proceedings of the 27th international conference on human factors in computing systems (CHI ’09), 2009, pp. 1303–1312. New York: ACM.

23.

Harrower

Brewer

. ColorBrewer.org: an online tool for selecting colour schemes for maps. Chichester, UK: John Wiley & Sons, Ltd, 2011, pp. 261–268.

24.

Sugiyama

Tagawa

Toda

. Methods for visual understanding of hierarchical system structures. IEEE T Syst Man Cyb 1981; 11(2): 109–125.

25.

Inselberg

Dimsdale

. Parallel coordinates: a tool for visualizing multi-dimensional geometry. In: IEEE visualization, San Francisco, CA, 23-26 October 1990, pp. 361–378. Washington DC: IEEE.

26.

Bendix

Kosara

Hauser

. Parallel sets: visual analysis of categorical data. In: IEEE symposium on information visualization (INFOVIS 2005), Minneapolis, MA, USA: 23-25 October 2005, pp. 133–140. Washington DC: IEEE.

27.

Rosario

Rundensteiner

Brown

. Mapping nominal values to numbers for effective visualization. In: IEEE symposium on information visualization (INFOVIS 2003), Seattle, 19-21 October 2003. Los Alamitos, CA, USA: IEEE Computer Society.