Sonification of experimental parameters as a new method for efficient coding of behavior (original) (raw)

2012, Proceedings of Measuring Behavior 2012, 8th International Conference on Methods and Techniques in Behavioral Research (Utrecht, The Netherlands, August 28-31, 2012) Edited by A.J. Spink, F. Grieco, O.E. Krips, L.W.S. Loijens, L.P.J.J. Noldus, and P.H. Zimmerman ISBN 978-90-74821-87-2

Abstract

Cognitive research is often focused on experimental condition-driven reactions. Ethological studies frequently rely on the observation of naturally occurring specific behaviors. In both cases, subjects are filmed during the study, so that afterwards behaviors can be coded on video. Coding should typically be blind to experimental conditions, but often requires more information than that present on video. We introduce a method for blindcoding of behavioral videos that takes care of both issues via three main innovations. First, of particular significance for playback studies, it allows creation of a "soundtrack" of the study, that is, a track composed of synthesized sounds representing different aspects of the experimental conditions, or other events, over time. Second, it facilitates coding behavior using this audio track, together with the possibly muted original video. This enables coding blindly to conditions as required, but not ignoring other relevant events. Third, our method makes use of freely available, multi-platform software, including scripts we developed.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (3)

  1. Jones, R., Fitch, T. (2009). Playback 3.0. Copyright 2009. Download requires git (multi-platform and freely available at http://git-scm.com/) and typing the following command: git clone git://playback.git. sourceforge.net/gitroot/playback/playback Accessed September 2011.
  2. Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., Sloetjes, H. (2006). ELAN: a Professional Framework for Multimodality Research. Proceedings of LREC 2006, Fifth International Conference on Language Resources and Evaluation, 1556-1559.
  3. Cohen, J. (1960) A coefficient for agreement for nominal scales. Education and Psychological Measurement 20, 37-46.