Mapping Data Visualization to Timbral Sonification and Machine Listening (original) (raw)
Related papers
Timbral Data Sonification from Parallel Attribute Graphs
2016
Parallel coordinate plotting is an established data visualization technique that provides means for graphing and exploring multidimensional relational datasets on a two-dimensional display. Each vertical axis represents the range of values for one attribute, and each data tuple appears as a connected path traveling left-to-right across the plot, connecting attribute values for that tuple on the vertical axes. Parallel coordinate plots look like timedomain audio signal waveforms, and they can be translated into audio signals through straightforward mapping algorithms. This study looks at three data sonification algorithms, sonification being the mapping of data into sounds for perceptual exploration, similar to uses of data visualization. Sound-response survey results and subsequent analyses reveal that the most direct method for mapping parallel coordinates of data tuples to audio waveforms is the most accurate for generating sounds that listeners can use to classify data. Future wo...
2016
Parallel coordinate plotting is an established data visualization technique that provides means for graphing and exploring multidimensional relational datasets on a two-dimensional display. Each vertical axis represents the range of values for one attribute, and each data tuple appears as a connected path traveling left-to-right across the plot, connecting attribute values for that tuple on the vertical axes. Parallel coordinate plots look like timedomain audio signal waveforms, and they can be translated into audio signals through straightforward mapping algorithms. This study looks at three data sonification algorithms, sonification being the mapping of data into sounds for perceptual exploration, similar to uses of data visualization. Sound-response survey results and subsequent analyses reveal that the most direct method for mapping parallel coordinates of data tuples to audio waveforms is the most accurate for generating sounds that listeners can use to classify data. Future wo...
Listen to your data: Model-based sonification for data analysis
1999
Sonification is the use of non-speech audio to con-vey information. We are developing tools for interact-ive data exploration, which make use of sonification for data presentation. In this paper, model-based sonifica-tion is presented as a concept to design auditory displays. ...
AkuVis: Interactive Visualization of Acoustic Data
1998
Artificial Intelligence as well as the Visualization Laboratory at the University of Bielefeld, government researchers from the Institute of Public Health NRW and the Local Environmental Agency Bielefeld as well as the German TÜV (Börner 1997). The project seeks to create a highly interactive virtual environment of modelled acoustic data in order to sensitize and improve human decision-making in real world tasks.
Personify: a Toolkit for Perceptually Meaningful Sonification
ACMA'95, 1995
People naturally use their hearing to obtain information to support their everyday activities. Sonification is the application of hearing to support computer based information processing tasks where numerical or other data replaces the environment as a source of sounds. Turning numbers into sounds is easy with current music technology. But creating intuitive and informative sonification mappings is not. The auditory display of scientific data requires consideration of the task at hand, an understanding of data characteristics, and an expert knowledge of psychoacoustics. The display designer must depend on experience, a few heuristic guidelines, patience and luck - this is why successful examples are rare. Personify is a suite of software tools which enable a non-expert to quickly and easily craft meaningful and effective sonifications. Interaction with these tools is focused on what a person hears, rather than on how a device makes sounds. The toolkit provides a systematic framework which consists of a number of data sensitive mapping techniques based on a perceptually linearised sound space. The user is able to select sequences in the sound space using geometric paths such as lines, spirals and planes. Constrained guidance embodies the expert knowledge in the system. This paper will describe the Personify toolkit, its purpose, theoretical foundation, the component tools, and the multimedia user interface. Keywords: Sonification, auditory display, perceptual psychology, visualisation, human-computer interface