LRV: A Tool for Academic Text Visualization to Support the Literature Review Process (original) (raw)

Building for users not for experts: designing a visualization of the literature domain

2007

Abstract As researchers we are constantly working with academic literature. Literature data is growing exponentially. Interacting with this huge amount of information has been a challenge for the field of HCI for years. The goal is to assist users in making sense of this information by producing usable designs. Information Visualization (InfoVis) augments users' cognition when interacting with complex data structures.

Supporting the Exploration of Semantic Features in Academic Literature using Graph-based Visualizations

2020

Literature search and recommendation systems have traditionally focused on improving recommendation accuracy through new algorithmic approaches. Less research has focused on the crucial task of visualizing the retrieved results to the user. Today, the most common visualization for literature search and recommendation systems remains the ranked list. However, this format exhibits several shortcomings, especially for academic literature. We present an alternative visual interface for exploring the results of an academic literature retrieval system using a force-directed graph layout. The interactive information visualization techniques we describe allow for a higher resolution search and discovery space tailored to the unique feature-based similarity present among academic literature. RecVis - the visual interface we propose - supports academics in exploring the scientific literature beyond textual similarity alone, since it enables the rapid identification of other forms of similarit...

Bibliometric Visualization and Analysis Software: State of the Art, Workflows, and Best Practices

2019

Despite the demonstrated value of visualization-based modalities for measuring and mapping science, it remains common practice to search and explore the literature via databases that present lists of articles with little, if any, supplementary visual information. Identifying the desired item in a list is a familiar information retrieval paradigm with a low cognitive load. However, given the rapid emergence of the field of visual text analytics, it is time to challenge the notion that article lists should remain the dominant method to search and organize the scientific literature. One reason that visualization methods are applied relatively rarely in information retrieval may be that it is difficult to develop useful and user-friendly science mapping systems. This article summarizes key workflows for bibliometric mapping, a technique for visually representing information from scientific publications, including citation data, bibliographic metadata, and article content. It describes m...

PaperVis: Literature Review Made Easy

Computer Graphics Forum, 2011

Reviewing literatures for a certain research field is always important for academics. One could use Google-like information seeking tools, but oftentimes he/she would end up obtaining too many possibly related papers, as well as the papers in the associated citation network. During such a process, a user may easily get lost after following a few links for searching or cross-referencing. It is also difficult for the user to identify relevant/important papers from the resulting huge collection of papers. Our work, called PaperVis, endeavors to provide a user-friendly interface to help users quickly grasp the intrinsic complex citation-reference structures among a specific group of papers. We modify the existing Radial Space Filling (RSF) and Bullseye View techniques to arrange involved papers as a node-link graph that better depicts the relationships among them while saving the screen space at the same time. PaperVis applies visual cues to present node attributes and their transitions among interactions, and it categorizes papers into semantically meaningful hierarchies to facilitate ensuing literature exploration. We conduct experiments on the InfoVis 2004 Contest Dataset to demonstrate the effectiveness of PaperVis.

Visual Text Mining: Ensuring the Presence of Relevant Studies in Systematic Literature Reviews

International Journal of Software Engineering and Knowledge Engineering, 2015

One of the activities associated with the Systematic Literature Review (SLR) process is the selection review of primary studies. When the researcher faces large volumes of primary studies to be analyzed, the process used to select studies can be arduous. In a previous experiment, we conducted a pilot test to compare the performance and accuracy of PhD students in conducting the selection review activity manually and using Visual Text Mining (VTM) techniques. The goal of this paper is to describe a replication study involving PhD and Master students. The replication study uses the same experimental design and materials of the original experiment. This study also aims to investigate whether the researcher's level of experience with conducting SLRs and research in general impacts the outcome of the primary study selection step of the SLR process. The replication results have confirmed the outcomes of the original experiment, i.e., VTM is promising and can improve the performance of...

Using visual text mining to support the study selection activity in systematic literature reviews

2011

Background: A systematic literature review (SLR) is a methodology used to aggregate all relevant existing evidence to answer a research question of interest. Although crucial, the process used to select primary studies can be arduous, time consuming, and must often be conducted manually. Objective: We propose a novel approach, known as 'Systematic Literature Review based on Visual Text Mining' or simply SLR-VTM, to support the primary study selection activity using visual text mining (VTM) techniques. Method: We conducted a case study to compare the performance and effectiveness of four doctoral students in selecting primary studies manually and using the SLR-VTM approach. To enable the comparison, we also developed a VTM tool that implemented our approach. We hypothesized that students using SLR-VTM would present improved selection performance and effectiveness. Results: Our results show that incorporating VTM in the SLR study selection activity reduced the time spent in this activity and also increased the number of studies correctly included. Conclusions: Our pilot case study presents promising results suggesting that the use of VTM may indeed be beneficial during the study selection activity when performing an SLR.

Head Start: Improving Academic Literature Search with Overview Visualizations based on Readership Statistics

Web Science 2013, 2013

At the beginning of a scientific study, it is usually quite hard to get an overview of a research field. We aim to address this problem of classic literature search using web data. In this extended abstract, we present work-in-progress on an interactive visualization of research fields based on readership statistics from the social referencemanagement system Mendeley. To that end, we use library co-occurrences as a measure of subject similarity. In a first evaluation, we find that the visualization covers current research areas within educational technology but presents a view that is biased by the characteristics of readers. With our presentation, we hope to elicit feedback from theWebsci’13 audience on (1) the usefulness of the prototype, and (2) how to overcome the aforementioned biases using collaborative construction techniques.

Evaluating visual and statistical exploration of scientific literature networks

2011 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2011

Action Science Explorer (ASE) is a tool designed to support users in rapidly generating readily consumable summaries of academic literature. It uses citation network visualization, ranking and filtering papers by network statistics, and automatic clustering and summarization techniques. We describe how early formative evaluations of ASE led to a mature system evaluation, consisting of an in-depth empirical evaluation with four domain experts. The evaluation tasks were of two types: predefined tasks to test system performance in common scenarios, and user-defined tasks to test the system's usefulness for custom exploration goals. The primary contribution of this paper is a validation of the ASE design and recommendations to provide: easy-to-understand metrics for ranking and filtering documents, user control over which document sets to explore, and overviews of the document set in coordinated views along with detailson-demand of specific papers. We contribute a taxonomy of features for literature search and exploration tools and describe exploration goals identified by our participants.

Visualization to aid assessing of measures in the context of comparison tasks in digital text analysis

2023

In 2023 the project "(Ir)reproducibility of Scientific Research in the Digital Humanities?" started. The goal of the project is to promote reproducibility of methods used in the digital humanities and to develop basic guidelines for this purpose. A basis for reproducibility is the ability to distinguish between procedures or sub-procedures. One can find measures or distances, also costs or similarities at different points of the textual analysis pipeline. The intention of the calculation, which donates the name to the procedures, is always similar: to make a computational distinction between series of numbers. The series of numbers, also called multidimensional data or sometimes multivariate data, can stand for different things.-What they stand for, must be specified during the formalization of the research subject. The number of different measures is very big and confusing. The team designed a visualization that tries to show the effect of the measure. Through this we aim to support the selection of measures for text analysis tasks. The visualization includes a short description, a reference to the original source (where possible), and an interpretation in terms of simple textual heuristics and their distinction. This is a tool for both technical and non-technical staff. The visualizations provide the missing arguments in the formalization process, which helps to justify the methods. In the presentation we will introduce the online visualization and its usage. We will also talk about the implementation, the basic assumptions and the availability of the software on github.

README: A Literature Survey Assistant

2020

Literature review is an integral element of academic research, enabling researchers to learn about and build on existing work. Traditionally, this involves manually going through various published articles, either through following the citations in a reference paper, or via keywords on sites like Google Scholar. This process can often be tedious, and there is a high likelihood of missing out on certain related literature, owing to the sheer volume of publications every year. In addition, analyzing the advances and progression in a field requires a holistic view, which manual iteration over papers lacks. To this end, we propose README, an interactive tool aimed to aide with literature reviews. README would not only enables users to obtain a holistic view of various papers and topics, but also identifies and recommends relevant papers, given a reference paper the user is interested in. Additionally, it allows for chronological sorting of applicable papers, thus making analysis of tren...