Audio stickies (visually-guided spatial audio annotations on a mobile augmented reality platform) (original) (raw)

Abstract

This paper describes spatially aligned user-generated audio annotations and the integration with visual augmentations into a single mobile AR system. Details of our prototype system are presented, along with an explorative usability study and technical evaluation of the design. Mobile Augmented Reality applications allow for visual augmentations as well as tagging and annotation of the surrounding environment. Texts and graphics are currently the media of choice for these applications with GPS coordinates used to determine spatial location. Our research demonstrates that the use of visually guided audio annotations that are positioned and orientated in augmented outdoor space successfully provides for additional, novel, and enhanced mobile user experience.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (23)

  1. Arth, C., Klopschitz, M., Reitmayr, G., and Schmalstieg, D. Real-time self-localization from panoramic images on mobile devices. 2011 10th IEEE International Symposium on Mixed and Augmented Reality, IEEE (2011), 37-46.
  2. Bederson, B.B. Audio augmented reality. Conference companion on Human factors in computing systems - CHI '95, ACM Press (1995), 210-211.
  3. Behringer, R., Chen, S., Sundareswaran, V., Wang, K., and Vassiliou, M. A novel interface for device diagnostics using speech recognition, augmented reality visualization, and 3D audio auralization. IEEE Comput. Soc, 1999.
  4. Dow, S., Lee, J., Oezbek, C., Maclntyre, B., Bolter, J.D., and Gandy, M. Exploring spatial narratives and mixed reality experiences in Oakland Cemetery. Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology -ACE '05, ACM Press (2005), 51-60.
  5. Feiner, S., MacIntyre, B., Höllerer, T., and Webster, A. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies 1, 4 (1997), 208-217.
  6. Haller, M., Dobler, D., and Stampfl, P. Augmenting the reality with 3D sound sources. ACM SIGGRAPH 2002 conference abstracts and applications on -SIGGRAPH '02, ACM Press (2002), 65.
  7. Langlotz, T., Degendorfer, C., Mulloni, A., Schall, G., Reitmayr, G., and Schmalstieg, D. Robust detection and tracking of annotations for outdoor augmented reality browsing. Computers & Graphics 35, 4 (2011), 831-840.
  8. Langlotz, T., Zingerle, M., Grasset, R., Kaufmann, H. and Reitmayr.
  9. G., AR Record&Replay: situated compositing of video content in mobile augmented reality. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI '12), (2012), 318-326,
  10. Lewis, J.R. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human- Computer Interaction 7, 1 (1995), 57-78.
  11. Magnusson, C., Molina, M., Rassmus-Gröhn, K., and Szymczak, D. Pointing for non-visual orientation and navigation. Proceedings of the 6th Nordic Conference on Human-Computer Interaction Extending Boundaries -NordiCHI '10, ACM Press (2010), 735.
  12. McGookin, D. and Brewster, S. PULSE. Proceedings of Interacting with Sound Workshop on Exploring Context-Aware, Local and Social Audio Applications - IwS '11, ACM Press (2011), 12-15.
  13. Mynatt, E.D., Back, M., Want, R., and Frederick, R. Audio aura. Proceedings of the 10th annual ACM symposium on User interface software and technology -UIST '97, ACM Press (1997), 211-212.
  14. Rekimoto, J. and Nagao, K. The World through the Computer: Computer Augmented Interaction with Real World Environments. Proceedings of the 8th annual ACM symposium on User interface and software technology -UIST '95, ACM Press (1995), 29-36.
  15. Rozier, J., Karahalios, K., and Donath, J. HearThere: An Augmented Reality System of Linked Audio, Proc of ICAD '00 (2000), 63-67.
  16. Schmalstieg, D. and Wagner, D. Mobile Phones as a Platform for Augmented Reality. Proceedings of the IEEE VR 2008 Workshop on Software Engineering and Architectures for Realtime Interactive Systems, (2008), 43-44.
  17. Spohrer, J.C. Information in places. IBM SYSTEMS JOURNAL 38, 4 (1999), 602-628.
  18. Sundareswaran, V., Wang, K., Chen, S., et al. 3D Audio Augmented Reality: Implementation and Experiments. (2003), 296.
  19. Vazquez-Alvarez, Y. Designing spatial audio interfaces for mobile devices. Proceedings of the 12th international conference on Human computer interaction with mobile devices and services - MobileHCI '10, ACM Press (2010), 481.
  20. Ville, P. and Karjalainen, M. Localization of Amplitude- Panned Virtual Sources I: Stereophonic Panning. Journal of the Audio Engineering Society 49, (2001), 739-752.
  21. Wagner, D., Mulloni, A., Langlotz, T., and Schmalstieg, D. Real-time panoramic mapping and tracking on mobile phones. 2010 IEEE Virtual Reality Conference (VR), Ieee (2010), 211-218.
  22. Wither, J., DiVerdi, S., and Höllerer, T. Annotation in outdoor augmented reality. Computers & Graphics 33, 6 (2009), 679-689.
  23. Woo, D., Mariette, N., Salter, J., Rizos, C., and Helyer, N. Audio Nomad. Proceedings ION GNSS 2006, (2006).