Paul Feltovich - Academia.edu (original) (raw)

Papers by Paul Feltovich

Research paper thumbnail of An Agent-Based Framework for Cyber Situation Awareness

Abstract In this article, we describe how we augment human perception and cognition through Sol, ... more Abstract In this article, we describe how we augment human perception and cognition through Sol, an agentbased framework for distributed sensemaking. We describe how our visualization approach, based on IHMC's OZ flight display, has been leveraged and ...

Research paper thumbnail of Sol: An Agent-Based Framework for Cyber Situation Awareness

KI - Künstliche Intelligenz, 2012

In this article, we describe how we augment human perception and cognition through Sol, an agent-... more In this article, we describe how we augment human perception and cognition through Sol, an agent-based framework for distributed sensemaking. We describe how our visualization approach, based on IHMC's OZ flight display, has been leveraged and extended in our development of the Flow Capacitor, an analyst display for maintaining cyber situation awareness, and in the Parallel Coordinates 3D Observatory (PC3O or Observatory), a generalization of the Flow Capacitor that provides capabilities for developing and exploring lines of inquiry. We then introduce the primary implementation frameworks that provide the core capabilities of Sol: the Luna Software Agent Framework, the VIA Cross-Layer Communications Substrate, and the KAoS Policy Services Framework. We show how policy-governed agents can perform much of the tedious high-tempo tasks of analysts and facilitate collaboration. Much of the power of Sol lies in the concept of coactive emergence, whereby a comprehension of complex situations is achieved through the collaboration of analysts and agents working together in tandem. Not only can the approach embodied in Sol lead to a qualitative improvement in cyber situation awareness, but its approach is equally relevant to applications of distributed sensemaking for other kinds of complex high-tempo tasks.

Research paper thumbnail of From Tools to Teammates: Joint Activity in Human-Agent-Robot Teams

Coordination is an essential ingredient of joint activity in human-agent-robot teams. In this pap... more Coordination is an essential ingredient of joint activity in human-agent-robot teams. In this paper, we discuss some of the challenges and requirements for successful coordination, and briefly how we have used KAoS HART services framework to support coordination in a multi-team human-robot field exercise.

Research paper thumbnail of Policy-Based Governance within Luna: Why We Developed Yet Another Agent Framework

2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, 2012

In this article, we explain our rationale for the development of Luna, a software agent framework... more In this article, we explain our rationale for the development of Luna, a software agent framework. In particular, we focus on how we use capabilities for comprehensive policy-based governance to ensure that key requirements for security, declarative specification of taskwork, and built-in support for joint activity within mixed teams of humans and agents are satisfied. KAoS, IHMC's ontology-based policy services framework, enables the semantically-rich and extensible semantics and the operational power and flexibility needed to realize these capabilities within Luna. We show how Luna is specifically designed to allow developers and users to leverage different forms of policybased governance in an endless variety of ways.

Research paper thumbnail of Coordination in Human-Agent-Robot Teamwork

Coordination is an essential ingredient of a teamworkcentered approach to autonomy. In this paper... more Coordination is an essential ingredient of a teamworkcentered approach to autonomy. In this paper, we discuss some of the challenges and requirements for successful coordination, and briefly how we have used KAoS HART services to support coordination in a multi-team humanrobot field exercise.

Research paper thumbnail of Command and Control Requirements for Moving-Target Defense

IEEE Expert / IEEE Intelligent Systems, 2012

The macrocognitive workplace is constantly changing, and a work system can never match its enviro... more The macrocognitive workplace is constantly changing, and a work system can never match its environment completely; there are always gaps in fitness because the work is itself a moving target. This article looks at a domain where the workplace is a moving target in three ways: cyberdefense. New technology and work methods are continually being introduced, domain constraints are not constant; the work itself is changing in terms of its new goals and requirements, and anything can be surprising. The article presents a possible sensemaking strategy and implications for the design of intelligent systems founded on human-machine interdependence, semantically rich policy governance, and having the goal of achieving resilience in the cognitive work.

Research paper thumbnail of Human-Agent Teamwork in Cyber Operations: Supporting Co-evolution of Tasks and Artifacts with Luna

Lecture Notes in Computer Science, 2012

In this article, we outline the general concept of coactive emergence, an iterative process where... more In this article, we outline the general concept of coactive emergence, an iterative process whereby joint sensemaking and decision-making activities are undertaken by analysts and software agents. Then we explain our rationale for the development of the Luna software agent framework. In particular, we focus on how we use capabilities for comprehensive policy-based governance to ensure that key requirements for security, declarative specification of taskwork, and built-in support for joint activity within mixed teams of humans and agents are satisfied.

Research paper thumbnail of Coactive emergence as a sensemaking strategy for cyber operations

In this article we describe how we apply the concept of coactive emergence as a phenomenon of com... more In this article we describe how we apply the concept of coactive emergence as a phenomenon of complexity that has implications for the design of sensemaking support tools involving a combination of human analysts and software agents. We apply this concept in the design of work methods for distributed sensemaking in cyber operations. Sensemaking is a motivated, continuous effort to understand, anticipate, and act upon complex situations. We discuss selected results of a macrocognitive work analysis that informed our focus for design and development of support tools. In that analysis, we identified seven target topics that would be the focus of our research: engaging automation as a full partner, reducing the volume of uncorrelated events, continuous knowledge discovery, more effective visualizations, collaboration and sharing, minimizing tedious work, and architecting scalability and resilience. In addressing the first target topic, we show how coactive emergence inspires an agent-supported threat understanding process that is consistent with Klein's Data/Frame theory of sensemaking. In subsequent sections, we describe our efforts to address the remaining six target topics as part of design and development of a cyber operations framework called Sol. Specifically, we describe the use of agents, policies, and visualization to enable coactive emergence for taskwork and teamwork. We also show how policy-governed agents working collaboratively with people can help in additional ways. We introduce the primary implementation frameworks that provide the core capabilities of our Sol cyber framework: the Luna Software Agent Framework, and the KAoS Policy Services Framework. We describe areas for future development of Sol, including the incorporation of the VIA Cross-Layer Communications Substrate. Finally, we describe recent results and current plans for empirical studies addressing some of the issues raised in this article.

Research paper thumbnail of Factors influencing analysis of complex cognitive tasks: A framework and example from industrial process control

Human Factors: The …, Jan 1, 2000

Research paper thumbnail of Learning, teaching, and testing for complex conceptual understanding

… for a new generation of tests, Jan 1, 1993

Research paper thumbnail of Kaa: Policy-based explorations of a richer model for adjustable autonomy

Though adjustable autonomy is hardly a new topic in agent systems, there has been a general lack ... more Though adjustable autonomy is hardly a new topic in agent systems, there has been a general lack of consensus on terminology and basic concepts. In this paper, we describe the multi-dimensional nature of adjustable autonomy and give examples of how various dimensions might be adjusted in order to enhance performance of human-agent teams. We then introduce Kaa (KAoS adjustable autonomy), which extends our previous work on KAoS policy and domain services to provide a policy-based capability for adjustable autonomy based on this richer notion of adjustable autonomy. The current implementation of Kaa uses a combination of ontologies represented in OWL and influence-diagram-based decision-theoretic algorithms to determine what if any changes should be made in agent autonomy in a given context. We have demonstrated Kaa as part of ONRsponsored research to improve naval de-mining operations through more effective human-robot interaction. A brief comparison among alternate approaches to adjustable autonomy is provided.

Research paper thumbnail of Teamwork-centered autonomy for extended human-agent interaction in space applications

AAAI 2004 Spring Symposium, Mar 1, 2004

This paper summarizes our efforts to bring together and extend the best in current theory and tec... more This paper summarizes our efforts to bring together and extend the best in current theory and technologies for teamwork-centered autonomy for space applications. Traditional planning technologies at the foundation of intelligent robotic systems typically take an autonomycentered approach, with representations, mechanisms, and algorithms that have been designed to ingest a set of goals and output a complete plan in the most efficient and sound fashion possible. A teamwork-centered autonomy approach, on the other hand, takes as a beginning premise ...

Research paper thumbnail of A semantically-rich policy-based approach to robot control

Proceedings of the …, 2006

In this paper we describe our approach to enhancing control of robotic systems by providing domai... more In this paper we describe our approach to enhancing control of robotic systems by providing domain and policy services via KAoS. Recently developed languages such as OWL provide a powerful descriptive logic foundation that can be used to express semantically rich relationships between entities and actions, and thus create complex context sensitive policies. KAoS provides a tool to create policies using OWL and an infrastructure to enforce these policies on robots. We contend that a policy-based approach can provide significant advantages in controlling robotic systems and is a much more natural way for operators to interact with and manage multiple robots.

Research paper thumbnail of Common Ground and Coordination in Joint Activity

Generalizing the concepts of joint activity developed by , we describe key aspects of team coordi... more Generalizing the concepts of joint activity developed by , we describe key aspects of team coordination. Joint activity depends on interpredictability of the participants' attitudes and actions. Such interpredictability is based on common ground-pertinent knowledge, beliefs and assumptions that are shared among the involved parties. Joint activity assumes a basic compact, which is an agreement (often tacit) to facilitate coordination and prevent its breakdown. One aspect of the Basic Compact is the commitment to some degree of aligning multiple goals. A second aspect is that all parties are expected to bear their portion of the responsibility to establish and sustain common ground and to repair it as needed.

Research paper thumbnail of Self-explaining Agents: A Study in the BW4T Testbed for Team Coordination

Public reporting burden for this collection of information is estimated to average 1 hour per res... more Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS.

Research paper thumbnail of Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity

IEEE Expert / IEEE Intelligent Systems, 2004

Research paper thumbnail of Making Agents Acceptable to People

Because ever more powerful intelligent agents will interact with people in increasingly sophistic... more Because ever more powerful intelligent agents will interact with people in increasingly sophisticated and important ways, greater attention must be given to the technical and social aspects of how to make agents acceptable to people [16.72]. From a technical perspective, we want to help ensure the protection of agent states, the viability of agent communities, and the reliability of the resources on which they depend. To accomplish this, we must guarantee, insofar as is possible, that the autonomy of agents can always be bounded by an explicit enforceable policy that can be continually adjusted to maximize the agents' effectiveness and safety for both human beings and computational environments. From a social perspective, we want agents to be designed to fit well with how people actually work together. Explicit policies governing human-agent interaction, based on careful observation of work practice and an understanding of current research in the social sciences and cognitive engineering, can help assure that effective and natural coordination, appropriate levels and modalities of feedback, and adequate predictability and responsiveness to human control are maintained. These factors are key to providing the reassurance and trust that are the prerequisites to the widespread acceptance of agent technology for non-trivial applications.

Research paper thumbnail of Adjustable Autonomy and Human-Agent Teamwork in Practice: An Interim Report on Space Applications

Research paper thumbnail of Living with agents and liking it: Addressing the technical and social acceptability of agent technology

Science Fiction, Oct 1, 1953

This paper summarizes our efforts to address some of the technical and social aspects of agent de... more This paper summarizes our efforts to address some of the technical and social aspects of agent design for increased human acceptability. From a technical perspective, we want to be able to ensure the protection of agent state, the viability of agent communities, and the reliability of the resources on which they depend. To accomplish this, we must guarantee insofar as possible that the autonomy of agents can always be bounded by explicit enforceable policy that can be continually adjusted to maximize their effectiveness ...

Research paper thumbnail of Order and KAoS: Using policy to represent agent cultures

… of the AAMAS 03 Workshop on …, 2003

Research paper thumbnail of An Agent-Based Framework for Cyber Situation Awareness

Abstract In this article, we describe how we augment human perception and cognition through Sol, ... more Abstract In this article, we describe how we augment human perception and cognition through Sol, an agentbased framework for distributed sensemaking. We describe how our visualization approach, based on IHMC's OZ flight display, has been leveraged and ...

Research paper thumbnail of Sol: An Agent-Based Framework for Cyber Situation Awareness

KI - Künstliche Intelligenz, 2012

In this article, we describe how we augment human perception and cognition through Sol, an agent-... more In this article, we describe how we augment human perception and cognition through Sol, an agent-based framework for distributed sensemaking. We describe how our visualization approach, based on IHMC's OZ flight display, has been leveraged and extended in our development of the Flow Capacitor, an analyst display for maintaining cyber situation awareness, and in the Parallel Coordinates 3D Observatory (PC3O or Observatory), a generalization of the Flow Capacitor that provides capabilities for developing and exploring lines of inquiry. We then introduce the primary implementation frameworks that provide the core capabilities of Sol: the Luna Software Agent Framework, the VIA Cross-Layer Communications Substrate, and the KAoS Policy Services Framework. We show how policy-governed agents can perform much of the tedious high-tempo tasks of analysts and facilitate collaboration. Much of the power of Sol lies in the concept of coactive emergence, whereby a comprehension of complex situations is achieved through the collaboration of analysts and agents working together in tandem. Not only can the approach embodied in Sol lead to a qualitative improvement in cyber situation awareness, but its approach is equally relevant to applications of distributed sensemaking for other kinds of complex high-tempo tasks.

Research paper thumbnail of From Tools to Teammates: Joint Activity in Human-Agent-Robot Teams

Coordination is an essential ingredient of joint activity in human-agent-robot teams. In this pap... more Coordination is an essential ingredient of joint activity in human-agent-robot teams. In this paper, we discuss some of the challenges and requirements for successful coordination, and briefly how we have used KAoS HART services framework to support coordination in a multi-team human-robot field exercise.

Research paper thumbnail of Policy-Based Governance within Luna: Why We Developed Yet Another Agent Framework

2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, 2012

In this article, we explain our rationale for the development of Luna, a software agent framework... more In this article, we explain our rationale for the development of Luna, a software agent framework. In particular, we focus on how we use capabilities for comprehensive policy-based governance to ensure that key requirements for security, declarative specification of taskwork, and built-in support for joint activity within mixed teams of humans and agents are satisfied. KAoS, IHMC's ontology-based policy services framework, enables the semantically-rich and extensible semantics and the operational power and flexibility needed to realize these capabilities within Luna. We show how Luna is specifically designed to allow developers and users to leverage different forms of policybased governance in an endless variety of ways.

Research paper thumbnail of Coordination in Human-Agent-Robot Teamwork

Coordination is an essential ingredient of a teamworkcentered approach to autonomy. In this paper... more Coordination is an essential ingredient of a teamworkcentered approach to autonomy. In this paper, we discuss some of the challenges and requirements for successful coordination, and briefly how we have used KAoS HART services to support coordination in a multi-team humanrobot field exercise.

Research paper thumbnail of Command and Control Requirements for Moving-Target Defense

IEEE Expert / IEEE Intelligent Systems, 2012

The macrocognitive workplace is constantly changing, and a work system can never match its enviro... more The macrocognitive workplace is constantly changing, and a work system can never match its environment completely; there are always gaps in fitness because the work is itself a moving target. This article looks at a domain where the workplace is a moving target in three ways: cyberdefense. New technology and work methods are continually being introduced, domain constraints are not constant; the work itself is changing in terms of its new goals and requirements, and anything can be surprising. The article presents a possible sensemaking strategy and implications for the design of intelligent systems founded on human-machine interdependence, semantically rich policy governance, and having the goal of achieving resilience in the cognitive work.

Research paper thumbnail of Human-Agent Teamwork in Cyber Operations: Supporting Co-evolution of Tasks and Artifacts with Luna

Lecture Notes in Computer Science, 2012

In this article, we outline the general concept of coactive emergence, an iterative process where... more In this article, we outline the general concept of coactive emergence, an iterative process whereby joint sensemaking and decision-making activities are undertaken by analysts and software agents. Then we explain our rationale for the development of the Luna software agent framework. In particular, we focus on how we use capabilities for comprehensive policy-based governance to ensure that key requirements for security, declarative specification of taskwork, and built-in support for joint activity within mixed teams of humans and agents are satisfied.

Research paper thumbnail of Coactive emergence as a sensemaking strategy for cyber operations

In this article we describe how we apply the concept of coactive emergence as a phenomenon of com... more In this article we describe how we apply the concept of coactive emergence as a phenomenon of complexity that has implications for the design of sensemaking support tools involving a combination of human analysts and software agents. We apply this concept in the design of work methods for distributed sensemaking in cyber operations. Sensemaking is a motivated, continuous effort to understand, anticipate, and act upon complex situations. We discuss selected results of a macrocognitive work analysis that informed our focus for design and development of support tools. In that analysis, we identified seven target topics that would be the focus of our research: engaging automation as a full partner, reducing the volume of uncorrelated events, continuous knowledge discovery, more effective visualizations, collaboration and sharing, minimizing tedious work, and architecting scalability and resilience. In addressing the first target topic, we show how coactive emergence inspires an agent-supported threat understanding process that is consistent with Klein's Data/Frame theory of sensemaking. In subsequent sections, we describe our efforts to address the remaining six target topics as part of design and development of a cyber operations framework called Sol. Specifically, we describe the use of agents, policies, and visualization to enable coactive emergence for taskwork and teamwork. We also show how policy-governed agents working collaboratively with people can help in additional ways. We introduce the primary implementation frameworks that provide the core capabilities of our Sol cyber framework: the Luna Software Agent Framework, and the KAoS Policy Services Framework. We describe areas for future development of Sol, including the incorporation of the VIA Cross-Layer Communications Substrate. Finally, we describe recent results and current plans for empirical studies addressing some of the issues raised in this article.

Research paper thumbnail of Factors influencing analysis of complex cognitive tasks: A framework and example from industrial process control

Human Factors: The …, Jan 1, 2000

Research paper thumbnail of Learning, teaching, and testing for complex conceptual understanding

… for a new generation of tests, Jan 1, 1993

Research paper thumbnail of Kaa: Policy-based explorations of a richer model for adjustable autonomy

Though adjustable autonomy is hardly a new topic in agent systems, there has been a general lack ... more Though adjustable autonomy is hardly a new topic in agent systems, there has been a general lack of consensus on terminology and basic concepts. In this paper, we describe the multi-dimensional nature of adjustable autonomy and give examples of how various dimensions might be adjusted in order to enhance performance of human-agent teams. We then introduce Kaa (KAoS adjustable autonomy), which extends our previous work on KAoS policy and domain services to provide a policy-based capability for adjustable autonomy based on this richer notion of adjustable autonomy. The current implementation of Kaa uses a combination of ontologies represented in OWL and influence-diagram-based decision-theoretic algorithms to determine what if any changes should be made in agent autonomy in a given context. We have demonstrated Kaa as part of ONRsponsored research to improve naval de-mining operations through more effective human-robot interaction. A brief comparison among alternate approaches to adjustable autonomy is provided.

Research paper thumbnail of Teamwork-centered autonomy for extended human-agent interaction in space applications

AAAI 2004 Spring Symposium, Mar 1, 2004

This paper summarizes our efforts to bring together and extend the best in current theory and tec... more This paper summarizes our efforts to bring together and extend the best in current theory and technologies for teamwork-centered autonomy for space applications. Traditional planning technologies at the foundation of intelligent robotic systems typically take an autonomycentered approach, with representations, mechanisms, and algorithms that have been designed to ingest a set of goals and output a complete plan in the most efficient and sound fashion possible. A teamwork-centered autonomy approach, on the other hand, takes as a beginning premise ...

Research paper thumbnail of A semantically-rich policy-based approach to robot control

Proceedings of the …, 2006

In this paper we describe our approach to enhancing control of robotic systems by providing domai... more In this paper we describe our approach to enhancing control of robotic systems by providing domain and policy services via KAoS. Recently developed languages such as OWL provide a powerful descriptive logic foundation that can be used to express semantically rich relationships between entities and actions, and thus create complex context sensitive policies. KAoS provides a tool to create policies using OWL and an infrastructure to enforce these policies on robots. We contend that a policy-based approach can provide significant advantages in controlling robotic systems and is a much more natural way for operators to interact with and manage multiple robots.

Research paper thumbnail of Common Ground and Coordination in Joint Activity

Generalizing the concepts of joint activity developed by , we describe key aspects of team coordi... more Generalizing the concepts of joint activity developed by , we describe key aspects of team coordination. Joint activity depends on interpredictability of the participants' attitudes and actions. Such interpredictability is based on common ground-pertinent knowledge, beliefs and assumptions that are shared among the involved parties. Joint activity assumes a basic compact, which is an agreement (often tacit) to facilitate coordination and prevent its breakdown. One aspect of the Basic Compact is the commitment to some degree of aligning multiple goals. A second aspect is that all parties are expected to bear their portion of the responsibility to establish and sustain common ground and to repair it as needed.

Research paper thumbnail of Self-explaining Agents: A Study in the BW4T Testbed for Team Coordination

Public reporting burden for this collection of information is estimated to average 1 hour per res... more Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS.

Research paper thumbnail of Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity

IEEE Expert / IEEE Intelligent Systems, 2004

Research paper thumbnail of Making Agents Acceptable to People

Because ever more powerful intelligent agents will interact with people in increasingly sophistic... more Because ever more powerful intelligent agents will interact with people in increasingly sophisticated and important ways, greater attention must be given to the technical and social aspects of how to make agents acceptable to people [16.72]. From a technical perspective, we want to help ensure the protection of agent states, the viability of agent communities, and the reliability of the resources on which they depend. To accomplish this, we must guarantee, insofar as is possible, that the autonomy of agents can always be bounded by an explicit enforceable policy that can be continually adjusted to maximize the agents' effectiveness and safety for both human beings and computational environments. From a social perspective, we want agents to be designed to fit well with how people actually work together. Explicit policies governing human-agent interaction, based on careful observation of work practice and an understanding of current research in the social sciences and cognitive engineering, can help assure that effective and natural coordination, appropriate levels and modalities of feedback, and adequate predictability and responsiveness to human control are maintained. These factors are key to providing the reassurance and trust that are the prerequisites to the widespread acceptance of agent technology for non-trivial applications.

Research paper thumbnail of Adjustable Autonomy and Human-Agent Teamwork in Practice: An Interim Report on Space Applications

Research paper thumbnail of Living with agents and liking it: Addressing the technical and social acceptability of agent technology

Science Fiction, Oct 1, 1953

This paper summarizes our efforts to address some of the technical and social aspects of agent de... more This paper summarizes our efforts to address some of the technical and social aspects of agent design for increased human acceptability. From a technical perspective, we want to be able to ensure the protection of agent state, the viability of agent communities, and the reliability of the resources on which they depend. To accomplish this, we must guarantee insofar as possible that the autonomy of agents can always be bounded by explicit enforceable policy that can be continually adjusted to maximize their effectiveness ...

Research paper thumbnail of Order and KAoS: Using policy to represent agent cultures

… of the AAMAS 03 Workshop on …, 2003