Development of Principles for Multimodal Displays in Army Human-Robot Operations (original) (raw)

Building a multimodal human-robot interface

IEEE Intelligent Systems, 2001

Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. 16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF ABSTRACT 18. NUMBER OF PAGES 6 19a. NAME OF RESPONSIBLE PERSON a. REPORT unclassified b. ABSTRACT unclassified c. THIS PAGE unclassified Standard Form 298 (Rev. 8-98) Prescribed by ANSI Std Z39-18

Speech-Based Robotic Control for Dismounted Soldiers: Evaluation of Visual Display Options

2014

Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing the burden, to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number.

Soldier-Based Assessment of a Dual-Row Tactor Display during Simultaneous Navigational and Robot-Monitoring Tasks

2015

Human factors of 3-D perspective displays for command and control

Robots on the Battlefield. Contemporary Perspectives and Implications for the Future

2014

Research-Based Display Design Guidelines for Vehicle Crewman and Ground Warrior Interfaces, Which Enhance Situational Understanding and Decision Cycle Performance

Human Factors Design Guidelines for the Army Tactical Command and Control System (ATTCS) Soldier-Machine Interface. Version 2.0

These guidelines provide a set of rules to assist the design of the interface between soldiers and computers. Interface is defined as the means by which the user inputs, manipulates, and retrieves data. The purpose of these guidelines is to introduce consistency in the look and feel of the soldier-computer interface across battlefield functional areas and between software revisions. Application of the guidelines should result in an interface that is easier to understand, learn, and use which should in turn lead to reduced training requirements and greater user acceptance. Document includes a glossary and index. 14. SUBJECT TERMS 15.

Usability Assessment of Displays for Dismounted Soldier Applications

Recent Human Factors Contributions to Improve Military Operations (Human Factors and Ergonomics Society Bulletin. Volume 46, Number 12, December 2003)

Design Approach for Investigating Multimodal Communication in Dismounted Soldier-Robot Interaction

HCI International 2019 – Late Breaking Papers, 2019

For several decades there has been continuous growth in the field of robotics, with recent trends driving towards a vision of humans collaborating in a cohesive unit with automated counterparts. Enabling true mixed-initiative teaming between a human and robot will require communication capabilities and cognition comparable to human teammates. Multimodal communication is a framework in which interfaces can be created supporting the flexible selection of different modalities (e.g. speech, gestures) for these transactions. A major challenge for human factors researchers investigating human robot collaboration with multimodal interfaces is the current limitations of robots. Therefore, simulations and wizard-of-oz type experiments are heavily employed to measure performance, workload, and other factors in future mixed-initiative scenarios. Although these techniques facilitate experimentation, it can be difficult to transition findings to working prototypes of today's robots. For example, a researcher finds an effective way to convey a robots decision making rationale in a simulation-based study, but has no working robot that can drive the content in reality. Furthermore, the literature regarding multimodal communication with robots applied to the military domain is limited. For example, evaluation of different modalities as part of an interrupting task has been explored in driving scenarios, but not between robot(s) and soldiers. In many cases there is conflict in findings across domains. To address this challenge, this paper describes how a multimodal interface for a real robotic platform developed under the U.S. Army Research Labs Robotics Collaborative Technology Alliance (RCTA) was extended to support standalone simulation of interactions and integration with simulated virtual environments. This functionality enables researchers to assess new interaction techniques using the same software that will interact with a real platform to facilitate transition of their research. Furthermore, experiment design approaches including theory-based tasks in a military relevant mission (Cordon and Search) are discussed.

Development of Principles for Multimodal Displays in Army Human-Robot Operations (original) (raw)

Related papers