Interactive Visualizations of Plot in Fiction (original) (raw)
This paper describes the design and evaluation of a branching comic to compare how readers recall a visual narrative when presented as an interactive, digital program, or as a linear sequence on paper. The layout of the comic is used to visualize this data as heat maps and explore patterns of users' recollections. We describe the theoretical justification for this based upon previous work in narrative visualizations, interactive stories and comics. Having tested the comic with school boys aged 11-12; we saw patterns in the data that complement other research in both interactive stories and visualizations. We argue that the heat maps helped identify these patterns, which have implications for future designs and analyses of interactive visual and/or narrative media.
Stories have long been used to convey information, cul-tural values, and experiences. Narratives not only have been the main way people make sense of the world, but also have been the easiest way humans found out to share com-plex information. However, today we are confronted with the problem of the amount of information available, which sometimes is hard to cope with. Combining storytelling with visualization has been pointed out as an efficient method to represent and make sense of data, at the same time allowing people to relate with the information. In this paper, we explore the benefits of adding story-telling to visualizations. Drawing on case studies from news media to visualization research websites, we identified possible strategies to introduce storytelling in visualiza-tions such as adding short stories or narrative elements using annotations and using time to introduce the feeling of storytelling or story-flow.
How to Tell Stories Using Visualization
The benefits of storytelling's are long-known and its po-tential to simplify concepts, create emotional connection, and capacity to help retain information has been explored in different areas, such as journalism, education, and others. The necessity to incorporate storytelling in visualizations arises from the need to share complex data in a way that is engaging. Advances in technology have enabled us to go beyond the traditional forms of storytelling and represent-ing data, giving us more attractive and sophisticated means to tell stories. In this paper, we present the results of a focus group study that was conducted with the purpose of collecting in-formation on the narrative elements in a collection of visual-izations and the possible inclusion of storytelling elements in those. In this study information about the visualizations in terms of comprehension, navigation, and likability was also collected with the intent of identifying elements that are appealing in the visualizations. Furthermore, we suggest strategies for storytelling in visualizations.
Narrelations - Visualizing Narrative Levels and their Correlations with Temporal Phenomena
Digit. Humanit. Q., 2019
We present findings from interdisciplinary research at the intersection between literary studies, information visualization, and interface design. Despite a growing interest in text visualization among literary scholars, so far, narrative visualizations are not designed to support the particular tasks involved in narratological analysis and often fail to reveal nuanced narratological features. One major outcome of our iterative research and design process is Narrelations, a novel visualization technique specifically suited for analyzing and interpreting narrative levels of a story and temporal aspects of its narrative representation. The visualization provides an overview of the nesting and distribution of narrative levels, integrates the representation of temporal phenomena, and facilitates the examination of correlations between these aspects. With this research we explore how collaboratively designed visual encodings and interaction techniques may allow for an insightful analysis...
Cinematic Techniques in Narrative Visualization
2023
The many genres of narrative visualization (e.g. data comics, data videos) each offer a unique set of affordances and constraints. To better understand a genre that we call cinematic visualizations-3D visualizations that make highly deliberate use of a camera to convey a narrative-we gathered 50 examples and analyzed their traditional cinematic aspects to identify the benefits and limitations of the form. While the cinematic visualization approach can violate traditional rules of visualization, we find that through careful control of the camera, cinematic visualizations enable immersion in data-driven, anthropocentric environments, and can naturally incorporate insitu narrators, concrete scales, and visual analogies. Our analysis guides our design of a series of cinematic visualizations, created for NASA's Earth Science Communications team. We present one as a case study to convey design guidelines covering cinematography, lighting, set design, and sound, and discuss challenges in creating cinematic visualizations.
Visualization of character’s intentions in dramatic media
"The representation of characters’ intentions in a story is of great importance for media scholars and analysts, and it is susceptible of applicative scenarios within the media industry. In this paper, we introduce an interactive system for the visualization of a story analysis based on a plan-based representation of the characters’ intentions. The system relies on an ontology of drama and builds upon the unrestricted annotation provided by narrative enthusiasts and media students. The system is able to build the mapping between a library of plans and the users’ annotation, and to visualize the contributions of the several characters’ intentions to the whole plot. The system was tested on the analysis of a short movie."
Employing Branching Comics to Design, Visualise and Evaluate Interactive Stories
This thesis presents the case for adopting comics in the design, visualisation and evaluation of interactive stories. The potential for comics to be employed in the representation of interactive story-driven material has been identified in previous work. However, there is a lack of theory or evidence upon which an informed approach can be based. Consequently, this thesis contributes a process for employing branching comics to design and visualise interactive stories informed by previous approaches to stories, interactive stories and visualisations. It is argued that comics have several advantages over previous methods of designing interactive stories due to their inherent structural compatibility with visualising hierarchies of abstraction of story content. A series of studies are conducted to demonstrate how comics can be employed to visualise abstraction levels, and how branching comics can be employed to evaluate interactive stories. Qualitative and quantitative methods related to both user experience and comprehension are employed, which demonstrate the advantages in the use of comics to explore a range of different phenomena related to creating, interpreting and using interactive stories.
Coupling Story to Visualization
23rd International Conference on Intelligent User Interfaces, 2018
Online writers and journalism media are increasingly combining visualization (and other multimedia content) with narrative text to create narrative visualizations. Often, however, the two elements are presented independently of one another. We propose an approach to automatically integrate text and visualization elements. We begin with a writer's narrative that presumably can be supported with visual data evidence. We leverage natural language processing, quantitative narrative analysis, and information visualization to (1) automatically extract narrative components (who, what, when, where) from data-rich stories, and (2) integrate the supporting data evidence with the text to develop a narrative visualization. We also employ bidirectional interaction from text to visualization and visualization to text to support reader exploration in both directions. We demonstrate the approach with a case study in the data-rich field of sports journalism.
Narrative Visualization: Sharing Insights into Complex Data
2012
This paper is a reflection on the emerging genre of narrative visualization, a creative response to the need to share complex data engagingly with the public. In it, we explain how narrative visualization offers authors the opportunity to communicate more effectively with their audience by reproducing and sharing an experience of insight similar to their own. To do so, we propose a two part model, derived from previous literature, in which insight is understood as both an experience and also the product of that experience. We then discuss how the design of narrative visualization should be informed by attempts elsewhere to track the provenance of insights and share them in a collaborative setting. Finally, we present a future direction for research that includes using EEG technology to record neurological patterns during episodes of insight experience as the basis for evaluation.