Interactive sonification of neural activity (original) (raw)

Abstract

Abstract We discuss our ongoing research in sonification of neural activity as demonstrated in the" Fish and Chips" and" BrainWaves" projects. We argue that sonification can serve as an effective technique for the representation of complex spatial information such as neural activity due to the auditory system's ability to perceive stimuli at a wide spatial cover and its inclination to perceive spatial patterns in sonic input.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (16)

  1. REFERENCES
  2. Ben-Tal, O. and Berger, J. Creative aspects of sonification, Leonardo, 20 (3), MIT Press 2004, 229-232.
  3. Catts, O., Zurr, I. Growing Semi-Living Sculptures Leonardo 35(4), MIT Press 2002
  4. Derthick, M., Kolejejchick, J., Roth, S. F. An interactive visualization environment for data exploration. Proc. Of Knowledge Discovery in Databases. AAAI Press, August 1997, 2-9.
  5. Dibben, N. The Perception of Structural Stability in Atonal Music: The Influence of Salience, Stability, Horizontal Motion, Pitch Commonality, and Dissonance. Music Perception, 16(3), 1999, 265-294.
  6. Fry, B. (2002). Genome Valence. access at: http://acg.media.mit.edu/people/fry/valence/.
  7. Heer, J., Card, S. K., Landay, J. A. Prefuse: A toolkit for interactive information visualization. Proc. of the International Conference for Computer-Human Interaction (CHI 2005), ACM Press (2005), 421-430.
  8. Hunt, A. and Hermann, T. The importance of interaction in sonification. Proc. of the International Conference on Auditory Display (ICAD 2004) 61-64.
  9. Lodha, S. K., Beahan, J., Heppe, T., Joseph, A. J., and Zane-Ulman, B. Muse: A musical data sonification toolkit. Proc. of the International Conference on Auditory Display, ICAD 1997, 41-54.
  10. Paine, G. (2004). Reeds -a responsive sound installation. Proc. of the International Conference on Auditory Display (ICAD 2004)
  11. Paine, G., Ramakrishnan, C., Tydeman, J. (2005). Meterosonics. Access at: http://www.meterosonics.com
  12. Schmuckler, M. A. Testing Models of Melodic Contour Similarity. Music Perception, 16(3), 1999, 295-326.
  13. Sturm, B. L. Surf Music: Sonification of Ocean Buoy SpectralData. Proc. of the 2002 International Conference on Auditory Display, (ICAD 2002) Kyoto, Japan, 2002.
  14. Wagenaar, D. A., Madhavan, R., Pine, J., and Potter, S. M. Controlling bursting in cortical cultures with closed-loop multi-electrode stimulation. Journal of Neuroscience, 25(3), January 19, 2005, 680-688.
  15. Walker, B. and Cothran, J. Sonification sandbox: a graphical toolkit for auditory graphs. Proc. of the International Conference on Auditory Display (ICAD 2003).
  16. Yeo, W. S., Berger, J., and Zune Lee. SonART: A framework for data sonification, visualization and networked multimedia applications. Proc. of the International Computer Music Conference (ICMC 2004).