An augmented reality system for military operations in urban terrain (original) (raw)

Abstract

Many future military operations are expected to occur in urban environments. These complex, 3D battlefields introduce many challenges to the dismounted warfighter. Better situational awareness is required for effective operation in urban environments. However, delivering this information to the dismounted warfighter is extremely difficult. For example, maps draw a user's attention away from the environment and cannot directly represent the three-dimensional nature of the terrain. To overcome these difficulties, we are developing the Battlefield Augmented Reality System (BARS). The system consists of a wearable computer, a wireless network system, and a tracked see-through head-mounted display (HMD). The computer generates graphics that, from the user's perspective, appear to be aligned with the actual environment. For example, a building could be augmented to show its name, a plan of its interior, icons to represent reported sniper locations, and the names of adjacent streets. This paper surveys the current state of development of BARS and describes ongoing research efforts. We describe four major research areas. The first is the development of an effective, efficient user interface for displaying data and processing user inputs. The second is the capability for collaboration between multiple BARS users and other systems. Third, we describe the current hardware for both a mobile and indoor prototype system. Finally, we describe initial efforts to formally evaluate the capabilities of the system from a user's perspective through scenario analysis. We also will discuss the use of the BARS system in STRICOM's Embedded Training initiative. ABOUT THE AUTHORS MARK A. LIVINGSTON is a Research Scientist in the Virtual Reality Laboratory at the Naval Research Laboratory, where he works on the Battlefield Augmented Reality System (BARS). He received his Ph.D. from the University of North Carolina at Chapel Hill, where he helped develop a clinical augmented reality system for both ultrasound-guided and laparoscopic surgical procedures, focusing on tracking subsystems. His current research focuses on vision-based tracking algorithms and on user perception in augmented reality systems. Livingston is a member of IEEE, ACM, and SIGGRAPH, and is a member of the VR2003 conference committee.

Figures (3)

Figure 1: A remote BARS user is highlighted with a box shape. In this example, the user is also physically visible, but the position information is transmitted for all mobile users and can show the location of an occluded user. Mark A. Livingston, Lawrence J. Rosenblum, Simon J. Julier, Dennis Brown, Yohan Baillot, J. Edward Swan II, Joseph L. Gabbard, Deborah Hix, "An Augmented Reality System for Military Operations in Urban Terrain". Proceedings of Interservice / Industry Training, Simulation & Education Conference IATSEC) 2002, December 2-5, Orlando, Florida, page 89 (abstract only).

Figure 1: A remote BARS user is highlighted with a box shape. In this example, the user is also physically visible, but the position information is transmitted for all mobile users and can show the location of an occluded user. Mark A. Livingston, Lawrence J. Rosenblum, Simon J. Julier, Dennis Brown, Yohan Baillot, J. Edward Swan II, Joseph L. Gabbard, Deborah Hix, "An Augmented Reality System for Military Operations in Urban Terrain". Proceedings of Interservice / Industry Training, Simulation & Education Conference IATSEC) 2002, December 2-5, Orlando, Florida, page 89 (abstract only).

Figure 2: An annotated view of the hardware configuration of the current BARS prototype.

Figure 2: An annotated view of the hardware configuration of the current BARS prototype.

Figure 3: A sample protocol to show the location of occluded objects. The first three layers are shown with outlines of varying styles. The last three layers are shown with filled shapes of varying styles. Mark A. Livingston, Lawrence J. Rosenblum, Simon J. Julier, Dennis Brown, Yohan Baillot, J. Edward Swan II, Joseph L. Gabbard, Deborah Hix, "An Augmented Reality System for Military Operations in Urban Terrain". Proceedings of Interservice / Industry Training, Simulation & Education Conference IATSEC) 2002, December 2-5, Orlando, Florida, page 89 (abstract only).

Figure 3: A sample protocol to show the location of occluded objects. The first three layers are shown with outlines of varying styles. The last three layers are shown with filled shapes of varying styles. Mark A. Livingston, Lawrence J. Rosenblum, Simon J. Julier, Dennis Brown, Yohan Baillot, J. Edward Swan II, Joseph L. Gabbard, Deborah Hix, "An Augmented Reality System for Military Operations in Urban Terrain". Proceedings of Interservice / Industry Training, Simulation & Education Conference IATSEC) 2002, December 2-5, Orlando, Florida, page 89 (abstract only).

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (14)

  1. Baillot-02] "Wearable 3D Graphics for Augmented Reality: A Case Study of Two Experimental Backpack Computers", Y. Baillot, E. Gagas, T. Höllerer, S. Feiner and S. Julier, Unpublished manuscript (technical report in preparation).
  2. Bowman-02] Doug Bowman, Joseph L. Gabbard, Deborah Hix, "A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods". In Presence: Teleoperators and Virtual Environments. Volume 11, Number 4, 2002, pages 435-455. [CFMOUT-97] Concepts Division, Marine Corps Combat Development Command, "A Concept for Future Military Operations on Urbanized Terrain," approved July 1997
  3. DARPAWV-97] "Warfighter Visualization Program", http://web-ext2.darpa.mil/ETO/wv/index.html [Darken-99] R.P. Darken and H. Cevik, "Map Usage in Virtual Environments: Orientation Issues," Proceedings of IEEE Virtual Reality '99, Houston, TX, March 13-17, 1999, 133-140.
  4. Dumanoir-02] " Embedded Training for Dismounted Soldiers (ETDS)", P. Dumanoir, P. Garrity, B. Witmer, R. Lowe, submitted to 2002 IITSEC Orlando FL Dec 2002.
  5. Durbin-98] J. Durbin, S. J. Julier, B. Colbert, J. Crowe, R. Doyle, R. King, LCDR T. King, C. Scannell, Z. J. Wartell and T. Welsh, Proceedings of the SPIE AeroSense Conference, Orlando, FL, 1998 [Feiner-97] S. Feiner, B. MacIntyre, T. Höllerer and T. Webster "A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment", In Proceedings of ISWC '97 International Symposium on Wearable Computers, Cambridge, MA, 1997.
  6. FLEXIPC-98] "Specification of the ViA II Wearable Computer", http://www.flexipc.com [Gabbard-02] J.L. Gabbard, J.E. Swan, D. Hix, M. Lanzagorta, M.A. Livingston, D. Brown, S. Julier, "Usability Engineering: Domain Analysis Activities for Augmented Reality Systems," Proceedings of the Conference on The Engineering Reality of Virtual Reality 2002, SPIE (International Society for Optical Engineering) and IS&T (Society for Imaging Science and Technology) Electronic Imaging 2002, San Jose, CA, January 19-25, 2002.
  7. Gage-97] D. W. Gage, "Network Protocols for Mobile Robot Systems", SPIE AeroSense Conference Mobile Robotics XII, Vol. 3120, pp. 107-118, October 1997.
  8. Gold-93] R. Gold, B. Buxton, S. Feiner, C. Schmandt, P. Wellner and M. Weiser, "Ubiquitous Computing and Augmented Reality", Proceedings of SIGGRAPH-93: Computer Graphics, Anaheim, CA, 1993.
  9. Gumm-98] M.M.Gumm, W.P. Marshakm T.A. Branscome, M. McWesler, D.J. Patton and L.L. Mullins, "A Comparison of Solider Performance using Current Land Navigation Equipment with Information Integrated on a Helmet-Mounted Display," ARL Report ARL-TR-1604, DTIC Report 19980527081, April 1998.
  10. Hammel-68] E., Hammel, "Fire in the Streets: The Battle for Hue, Tet 1968", Pictorial Histories Pub. Co, 1968.
  11. Julier-99] S. Julier, S. Feiner and L. Rosenblum, "Augmented Reality as an Example of a Demanding Human-Centered System", First EC/NSF Advanced Research Workshop, 1-4 June 1999, France.
  12. Julier-00] S. Julier, M. Lanzagorta, Y. Baillot, L. Rosenblum, S. Feiner, T. Höllerer, S. Sestito, "Information Filtering for Mobile Augmented Reality", 2000 International Symposium on Augmented Reality.
  13. Julier-00a] S. Julier, Y. Baillot, D. Brown, and L. Rosenblum. "BARS: Battlefield Augmented Reality S ystem," NATO Symposium on Information Processing Techniques for Military Systems, 9-11 October 2000, Istanbul, Turkey. [Lanzagorta-98] M. Lanzagorta, E. Kuo and J. Uhlmann, "GROTTO Visualization for Decision Support", Proceedings of the SPIE 12th Annual International Symposium on Aerospace/Defense Sensing, Simulation, and Controls, Orlando, Fl., 1998. [MacIntyre-98] B. MacIntyre and S. Feiner, "A Distributed 3D Graphics Library", Proceedings of SIGGRAPH 1998, Orlando, FL, 1998
  14. SSCOMWL-98] "Land Warrior Home Page", http://www-sscom.army.mil/prodprog/lw/index.htm.