Emergent verbal behaviour in human-robot interaction (original) (raw)

Adding Speech to a Robotics Simulator

Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop, 2011

We present a demo showing different levels of emergent verbal behaviour that arise when speech is added to a robotics simulator.

Human-robot interaction through spoken language dialogue

2000

Abstract The development of robots that are able to accept instructions, via a friendly interface, in terms of concepts that are familiar to a human user remains a challenge. It is argued that designing and building such intelligent robots can be seen as the problem of integrating four main dimensions: human-robot communication, sensory motor skills and perception, decision-making capabilities, and learning.

A dialog system for comparative user studies on robot verbal behavior

Robot and Human Interactive …, 2006

In domestic social robot systems the dialog system is often the main user interface. The verbal behavior of such a robot, therefore, plays crucial role in human-robot interaction. Comparative user studies on various verbal behaviors of a robot can effectively contribute to human-robot interaction research. In this paper we present a dialog system that can be easily configured to demonstrate different verbal, initiativetaking behaviors for a robot and, thus, can be used as a platform for such comparative user studies. The pilot study we conducted does not only provide strong evidence for this suitability, but also reveals benefits of comparative studies on a real robot in general.

More than just words: Building a chatty robot

IWSDS, 2012

Speech meditates human interactions in all areas of life. Some conversations have a clear purpose such as communicating important information (warning) or creating change (giving an order), while, in others, the goal of the exchange is not so much to transfer linguistic information as to cement social bonds.

Human-robot interaction based on spoken natural language dialogue

Proceedings of the European Workshop on Service and Humanoid Robots, 2001

We report on recent work on human-robot spoken dialogue interaction in the context of Hygeiorobot, a project that aims to build a mobile robotic assistant for hospitals. Spoken dialogue systems are particularly suitable to this context, as the robot does not carry a keyboard or other common interaction devices, and is intended to be used by people with little or no computing experience. In this paper, we concentrate on dialogue management issues. After providing a brief survey of dialogue management techniques, we focus on ...

Towards Robot Learning from Spoken Language

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

The paper proposes a robot learning framework that empowers a robot to automatically generate a sequence of actions from unstructured spoken language. The robot learning framework was able to distinguish between instructions and unrelated conversations. Data were collected from 25 participants, who were asked to instruct the robot to perform a collaborative cooking task while being interrupted and distracted. The system was able to identify the sequence of instructed actions for a cooking task with the accuracy of 92.85 ± 3.87%. CCS CONCEPTS • Computer systems organization → External interfaces for robotics; Robotic autonomy; • Human-centered computing → Accessibility technologies.

Natural Programming of a Social Robot by Dialogs

2010

This paper aims at bringing social robots closer to naive users. A Natural Programming System that allows the end-user to give instructions to a Social Robot has been developed. The instructions derive in a sequence of actions and conditions, that can be executed while the own sequence verbal edition continues. A Dialogue Manager System (DMS) has been developed in a Social Robot. The dialog is described in a voiceXML structure, where a set of information slots is defined. These slots are related to the necessary attributes for the construction of the sequence in execution time. The robot can make specific requests on encountering unfilled slots. Temporal aspects of dialog such as barge-in property, mixed-initiative, or speech intonation control are also considered. Dialog flow is based on Dialog Acts. The dialog specification has also been extended for multimodality management. The presented DMS has been used as a part of a Natural Programming System but can also be used for other multimodal humanrobot interactive skills.

A spoken dialogue system to control robots

Projektarbeten 2002, 2002

Speech recognition is available on ordinary personal computers and is starting to appear in standard software applications. A known problem with speech interfaces is their integration into current graphical user interfaces.

A Configurable Dialogue Platform for ASORO Robots

2011

This paper is concerned with the architectural design and development of a spoken dialogue platform for robots. The platform adopts modular software architecture and event driven communication paradigm which makes speech enabled hardware devices and software components configurable and reusable. The platform is able to integrate heterogeneous dialogue components (such as speech recognizer, natural language understanding, speech synthesizer, etc.) through message-oriented middleware and a number of adaptors in a plug-and-play fashion. The dialogue system is empowered by a multi-purpose XML-based dialogue engine which is capable for pipeline information flow construction, programmable event mediation, multi-topic dialogue modeling and different types of knowledge representation. The proposed platform provides a generic framework for the easy and quick construction of robust, efficient and flexible spoken dialogue applications ranging from simple state-based dialogue prototype to compl...