FlyAR: Augmented Reality Supported Micro Aerial Vehicle Navigation (original) (raw)

Abstract

Fig. 1. Augmented Reality supported flight management for aerial reconstruction. (Left) Aerial reconstruction of a building. (Middle) The depth estimation for a hovering MAV in the distance is complicated due to missing depth cues. (Right) Augmented Reality provides additional graphical cues for understanding the position of the vehicle.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (30)

  1. D. E. Breen, R. T. Whitaker, E. Rose, and M. Tuceryan. Interactive Occlu- sion and Automatic Object Placement for Augmented Reality. Computer Graphics Forum, 15(3):11-22, Aug. 1996.
  2. F. D. Crescenzio, G. Miranda, F. Persiani, and T. Bombardi. A First Implementation of an Advanced 3D Interface to Control and Supervise UAV (Uninhabited Aerial Vehicles) Missions. Presence: Teleoperators and Virtual Environments, 18(3):171-184, June 2009.
  3. J. E. Cutting. How the eye measures reality and virtual reality. Behavior Research Methods, Instruments, & Computers, 29(1):27-36, 1997.
  4. J. E. Cutting and P. M. Vishton. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different informa- tion about depth. Handbook of perception and cognition, 5:1-37, 1995.
  5. A. Dey, A. Cunningham, and C. Sandor. Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. In ACM Symposium on Virtual Reality, 2010.
  6. J. Engel, J. Sturm, and D. Cremers. Camera-based navigation of a low- cost quadrocopter. In 2012 IEEE/RSJ International Conference on Intel- ligent Robots and Systems, pages 2815-2821. IEEE, Oct. 2012.
  7. F. Fraundorfer, L. Heng, D. Honegger, G. H. Lee, L. Meier, P. Tanskanen, and M. Pollefeys. Vision-based autonomous mapping and exploration using a quadrotor MAV. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 4557-4564. IEEE, Oct. 2012.
  8. Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski. Towards Internet- scale multi-view stereo. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1434-1441, June 2010.
  9. A. Goektogan and S. Sukkarieh. An Augmented Reality System for Multi-UAV Missions. In SimTecT, 2005.
  10. S. Hashimoto and A. Ishida. TouchMe: An Augmented Reality Based Remote Robot Manipulation. In Proceedings of ICAT2011, 2011.
  11. C. Hoppe, M. Klopschitz, M. Donoser, and H. Bischof. Incremental Surface Extraction from Sparse Structure-from-Motion Point Clouds. In British Machine Vision Conference, pages 1-11, 2013.
  12. C. Hoppe, M. Klopschitz, M. Rumpler, A. Wendel, S. Kluckner, H. Bischof, and G. Reitmayr. Online Feedback for Structure-from- Motion Image Acquisition. In Procedings of the British Machine Vision Conference 2012, pages 70.1-70.12, 2012.
  13. C. Hoppe, A. Wendel, S. Zollmann, K. Pirker, A. Irschara, H. Bischof, and S. Kluckner. Photogrammetric Camera Network Design for Micro Aerial Vehicles. In Computer Vision Winter Workshop, 2012.
  14. A. Irschara, V. Kaufmann, and M. Klopschitz. Towards fully automatic photogrammetric reconstruction using digital images taken from uavs. In ISPRS -Advancing Remote Sensing Science, 2010.
  15. K. Ishii, S. Zhao, M. Inami, T. Igarashi, and M. Imai. Designing laser gesture interface for robot control. In INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interac- tion: Part II, pages 479-492, 2009.
  16. S. Julier, D. Brown, M. Livingston, and J. Thomas. Adaptive synthetic vision. In Proceedings of SPIE -The International Society for Optical Engineering, Oct. 2006.
  17. S. Kasahara, R. Niiyama, V. Heun, and H. Ishii. exTouch: spatially-aware embodied manipulation of actuated objects mediated by augmented re- ality. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, 2013.
  18. P. Labatut, J. Pons, and R. Keriven. Robust and efficient surface recon- struction from range data. Computer Graphics Forum, 28(8), 2009.
  19. M. Livingston, Z. Ai, K. Karsch, and G. O. Gibson. User interface de- sign for military AR applications. Virtual Reality -Special Issue on Aug- mented Reality, 15(2-3):175-184, Dec. 2011.
  20. A. Nawab, K. Chintamani, D. Ellis, G. Auner, and A. Pandya. Joy- stick mapped Augmented Reality Cues for End-Effector controlled Tele- operated Robots. Virtual Reality Conference, pages 263-266, 2007.
  21. M. Quigley. Semi-autonomous human-UAV interfaces for fixed-wing mini-UAVs. In Proceedings of IROS, 2004.
  22. G. Schall, D. Schmalstieg, and S. Junghanns. VIDENTE-3D Visual- ization of Underground Infrastructure using Handheld Augmented Real- ity. Geohydroinformatics-Integrating GIS and Water Engineering" CRC Press/Taylor and Francis Publisher: CRC, 1:1-17, 2010.
  23. J. Stöcklein, P. Pogscheba, C. Geiger, and V. Paelke. MiReAS. In Pro- ceedings of the 7th International Conference on Computer Graphics, Vir- tual Reality, Visualisation and Interaction in Africa -AFRIGRAPH '10, page 27, New York, New York, USA, June 2010. ACM Press.
  24. J. Ventura, C. Arth, G. Reitmayr, and D. Schmalstieg. Global Localiza- tion from Monocular SLAM on a Mobile Phone. In Submitted to VR 2014.
  25. J. Ventura and T. Hollerer. Wide-area scene mapping for mobile visual tracking. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2012), number November, pages 3-12, 2012.
  26. S. White. Interaction with the Environment: Sensor Data Visualization in Outdoor Augmented Reality. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2009), pages 5-6, 2009.
  27. J. Wither, S. Diverdi, and T. Hollerer. Using aerial photographs for im- proved mobile AR annotation. In International Symposium on Mixed and Augmented Reality, pages 159-162. IEEE, Oct. 2006.
  28. J. Wither and T. Hollerer. Pictorial depth cues for outdoor augmented reality. In Proceedings of the Ninth IEEE International Symposium on Wearable Computers (ISWC '05), 2005.
  29. S. Zollmann, D. Kalkofen, C. Hoppe, S. Kluckner, H. Bischof, and G. Re- itmayr. Interactive 4D overview and detail visualization in augmented reality. In International Symposium on Mixed and Augmented Reality, 2012.
  30. S. Zollmann, G. Schall, S. Junghanns, and G. Reitmayr. Comprehen- sible and Interactive Visualizations of GIS Data in Augmented Reality. Advances in Visual Computing, pages 675-685, 2012.