AMP: An Audiovisual Metadata Platform to Support Mass Description (original) (raw)
Related papers
Automatic Annotations and Enrichments for Audiovisual Archives
2021
The practical availability of Audiovisual Processing tools to media scholars and heritage institutions remains limited, despite all the technical advancements of recent years. In this article we present the approach chosen in the CLARIAH project to increase this availability, we discuss the challenges encountered, and introduce the technical solutions we are implementing. Through three use cases focused on the enrichment of AV archives, Pose Analysis, and Automatic Speech Recognition, we demonstrate the potential and breadth of using Audiovisual Processing for archives and Digital Humanities research.
University practice requires a high level output of publications and other evidence of scholarly productivity by its researchers and lecturers. Listed categories of efficient evidence show clearly which kind of output is accepted: namely those listed in 'so called' collections of 'citation indexed' journals such as Thompson Reuters' ISI web of knowledge, Scopus and Springer Link. Archived items of audiovisual material including metadata and further supplementary descriptions are not to be found in these sources and it seem they will never be; neither will journals connected to this kind of 'rare disciplines' that use audiovisual materials and metadata. My paper focuses on ways of knowledge communication in this field and on some reasons of their actual status embedded into the competitive thinking of institutionalised higher education. What role can audiovisual archives with their collections play in this context? A vision can emerge from the findings, which should be brought into a discussion that reaches beyond archive and university walls.
Journal of Film Music, 2016
Between 2005 and 2013, film-music composer Trevor Jones donated around 1000 items relating to his film and television scores to the University of Leeds. The collection includes audio and video materials alongside associated paperwork, and some musical sketches and scores. In order to undertake research into the Trevor Jones Archive, the entire collection required digitization and cataloguing, both to facilitate navigation of the materials, and enable understanding of the relationships between them and the processes that they document. This paper considers the practicalities of working with the archive including matters relating to the digitization of a range of analogue and paper-based items, the creation of appropriate metadata and repository structures, and the prioritization of some parts of the collection over others. It is hoped that the lessons learned through this activity highlight some of the issues and considerations of working with archival audiovisual materials, and provide a roadmap for those working with similar collections.
Joining Forces in Audiovisual Digitisation, Digital Preservation and Access
International Association of Sound and Audiovisual Archives (IASA) Journal, 2018
The paper presents the benefits of a collaborative approach in the domain of audiovisual archiving in two very different contexts: NCAA in India and VIAA in Flanders. Following an initial contextualisation in the respective countries, the authors share a detailed modus operandi, outlining the functionalities and traceability matrices of the implementation processes involved in the networks that they have managed to build. Especially critical are the insights and parallels between NCAA and VIAA in the domains of audiovisual digitisation, digital preservation and access. Concluding with a look to the future, the authors hope to put forward the idea that a well-defined collaborative approach has the potential of functioning as a possible solution to the needs and aspirations of all stakeholders - content providers, digitisation agencies, archival network and a wide range of potential users.
Automatic Annotation Suggestions for Audiovisual Archives: Evaluation Aspects
Interdisciplinary Science Reviews, 2009
In the context of large and ever growing archives, generating annotation suggestions automatically from textual resources related to the documents to be archived is an interesting option in theory. It could save a lot of work in the time-consuming and expensive task of manual annotation and it could help cataloguers attain a higher inter annotator agreement. However, some questions arise in practice: what is the quality of the automatically produced annotations? How do they compare with manual annotations and with the requirements for annotation that were defined in the archive? If different from the manual annotations, are the automatic annotations wrong? In the CHOICE project, partially hosted at the Netherlands Institute for Sound and Vision, the Dutch public archive for audiovisual broadcasts, we automatically generate annotation suggestions for cataloguers. In this paper, we define three types of evaluation of these annotation suggestions: (1) a classic and strict precision/recall measure expressing the overlap between automatically generated keywords and the manual annotations, (2) a loosened precision/recall measure for which semantically very similar annotations are also considered as relevant matches, (3) an in-use evaluation of the usefulness of manual versus automatic annotations in the context of Serendipitous Browsing. During serendipitous browsing the annotations (manual or automatic) are used to retrieve and visualize semantically related documents.
On the role of user-generated metadata in audio visual collections
Proceedings of the …, 2011
Recently, various crowdsourcing initiatives showed that targeted efforts of user communities result in massive amounts of tags. For example, the Netherlands Institute for Sound and Vision collected a large number of tags with the video labeling game Waisda?. To successfully utilize these tags, a better understanding of their characteristics is required. The goal of this paper is twofold: (i) to investigate the vocabulary that users employ when describing videos and compare it to the vocabularies used by professionals; and (ii) to establish which aspects of the video are typically described and what type of tags are used for this. We report on an analysis of the tags collected with Waisda?. With respect to the first goal, we compared the the tags with a typical domain thesaurus used by professionals, as well as with a more general vocabulary. With respect to the second goal, we compare the tags to the video subtitles to determine how many tags are derived from the audio signal. In addition, we perform a qualitative study in which a tag sample is interpreted in terms of an existing annotation classification framework. The results suggest that the tags complement the metadata provided by professional cataloguers, the tags describe both the audio and the visual aspects of the video, and the users primarily describe objects in the video using general descriptions.
Unified access to heterogeneous audiovisual archives
J. UCS, 2003
Abstract: In this paper, an integrated information system is presented that offers enhanced search and retrieval capabilities to users of heterogeneous digital audiovisual (a/v) archives. This innovative system exploits the advances in handlings a/v content and related metadata, as introduced by MPEG-4 and worked out by MPEG-7, to offer advanced services characterized by the tri-fold” semantic phrasing of the request (query)”,” unified handling” and” personalized response”. The proposed system is targeting the intelligent extraction of ...