John Bateman | Universität Bremen (original) (raw)

Papers by John Bateman

Research paper thumbnail of The Shape of Creativity

Research paper thumbnail of Give MEANinGS to Robots with Kitchen Clash: A VR Human Computation Serious Game for World Knowledge Accumulation

Lecture Notes in Computer Science, 2019

Research paper thumbnail of Editorial: Multimodal coherence across media and genres

Frontiers in Communication, Dec 14, 2022

Research paper thumbnail of Introducing the Diagrammatic Semiotic Mode

Lecture Notes in Computer Science, 2022

Research paper thumbnail of Introducing the diagrammatic semiotic mode

arXiv (Cornell University), Jan 30, 2020

Research paper thumbnail of Multimodality: Disciplinary Throughts and the Challenge of Diversity

Research paper thumbnail of Preface and Acknowledgements

De Gruyter eBooks, Nov 18, 2019

Research paper thumbnail of Multimodality: Disciplinary Thoughts and the Challenge of Diversity – Introduction

De Gruyter eBooks, Nov 18, 2019

Research paper thumbnail of FakeNarratives – First Forays in Understanding Narratives of Disinformation in Public and Alternative News Videos

Zenodo (CERN European Organization for Nuclear Research), Mar 10, 2023

Research paper thumbnail of On the track of visual style: a diachronic study of page composition in comics and its functional motivation

Visual Communication, May 15, 2019

Research paper thumbnail of Respondenz von John A. Bateman & Chiao-I Tseng

De Gruyter eBooks, May 8, 2023

Research paper thumbnail of Linguistik und Multimodalität

De Gruyter eBooks, May 8, 2023

Research paper thumbnail of The impact of multimodal cohesion on attention and interpretation in film

Discourse, Context and Media, Dec 1, 2021

Research paper thumbnail of A not very civil war: effecting attitude changes via visual narrative

2013-2014 > Academic research: refereed > Refereed conference pape

Research paper thumbnail of The DArt system: constructive text, diagram and layout generation for information presentation

Research paper thumbnail of E Pluribus Unum

Atlantis thinking machines, Dec 5, 2014

Conceptual blending has been employed very successfully to understand the process of concept inve... more Conceptual blending has been employed very successfully to understand the process of concept invention, studied particularly within cognitive psychology and linguistics. However, despite this influential research, within computational creativity little effort has been devoted to fully formalise these ideas and to make them amenable to computational techniques. Unlike other combination techniques, blending aims at creatively generating (new) concepts on the basis of input theories whose domains are thematically distinct but whose specifications share structural similarity based on a relation of analogy, identified in a generic space, the baseontology. We introduce here the basic formalisation of conceptual blending, as sketched by the late Joseph Goguen, and discuss some of its variations. We illustrate the vast array of conceptual blends that may be covered by this approach and discuss the theoretical and conceptual challenges that ensue. Moreover, we show how the Distributed Ontology Language \(\mathsf {DOL}\) can be used to declaratively specify blending diagrams of various shapes, and discuss in detail how the workflow and creative act of generating and evaluating a new, blended concept can be managed and computationally supported within Ontohub, a \(\mathsf {DOL}\)-enabled theory repository with support for a large number of logical languages and formal linking constructs.

Research paper thumbnail of Editorial: Movement, embodiment, Kinesemiotics: interdisciplinary approaches to movement-based communication

Frontiers in Communication

Research paper thumbnail of Towards semiotically driven empirical studies of ballet as a communicative form

Humanities and Social Sciences Communications

This paper treats dance as a movement-based semiotic system, focusing on classical ballet as an e... more This paper treats dance as a movement-based semiotic system, focusing on classical ballet as an example in order to show how dance can be made accessible to both detailed description and empirical investigation as a form of communication. The study contributes to a growing tradition of multidisciplinary research that looks at a variety of dance forms from the perspectives of linguistics, communication studies and social semiotics, drawing additionally on recent developments in the formal semantics of non-verbal semiotic systems and on empirical methods emerging within functional accounts of multimodality. The paper consequently develops a particular treatment of ballet that offers a principled means of linking the physical stream of movement, recorded using motion caption technology, and discourse interpretations, such as those that are typically narratively relevant in classical ballet but which may be found in other forms of dance as well. The paper sets out how this may then supp...

Research paper thumbnail of Kinetik und Methodik - Film als dynamische und multimodale Herausforderung für die DH

Zenodo (CERN European Organization for Nuclear Research), Mar 7, 2022

Research paper thumbnail of Revisiting Cinematic Authorship: A Multimodal Approach

Critical Multimodal Studies of Popular Discourse, 2013

Research paper thumbnail of The Shape of Creativity

Research paper thumbnail of Give MEANinGS to Robots with Kitchen Clash: A VR Human Computation Serious Game for World Knowledge Accumulation

Lecture Notes in Computer Science, 2019

Research paper thumbnail of Editorial: Multimodal coherence across media and genres

Frontiers in Communication, Dec 14, 2022

Research paper thumbnail of Introducing the Diagrammatic Semiotic Mode

Lecture Notes in Computer Science, 2022

Research paper thumbnail of Introducing the diagrammatic semiotic mode

arXiv (Cornell University), Jan 30, 2020

Research paper thumbnail of Multimodality: Disciplinary Throughts and the Challenge of Diversity

Research paper thumbnail of Preface and Acknowledgements

De Gruyter eBooks, Nov 18, 2019

Research paper thumbnail of Multimodality: Disciplinary Thoughts and the Challenge of Diversity – Introduction

De Gruyter eBooks, Nov 18, 2019

Research paper thumbnail of FakeNarratives – First Forays in Understanding Narratives of Disinformation in Public and Alternative News Videos

Zenodo (CERN European Organization for Nuclear Research), Mar 10, 2023

Research paper thumbnail of On the track of visual style: a diachronic study of page composition in comics and its functional motivation

Visual Communication, May 15, 2019

Research paper thumbnail of Respondenz von John A. Bateman & Chiao-I Tseng

De Gruyter eBooks, May 8, 2023

Research paper thumbnail of Linguistik und Multimodalität

De Gruyter eBooks, May 8, 2023

Research paper thumbnail of The impact of multimodal cohesion on attention and interpretation in film

Discourse, Context and Media, Dec 1, 2021

Research paper thumbnail of A not very civil war: effecting attitude changes via visual narrative

2013-2014 > Academic research: refereed > Refereed conference pape

Research paper thumbnail of The DArt system: constructive text, diagram and layout generation for information presentation

Research paper thumbnail of E Pluribus Unum

Atlantis thinking machines, Dec 5, 2014

Conceptual blending has been employed very successfully to understand the process of concept inve... more Conceptual blending has been employed very successfully to understand the process of concept invention, studied particularly within cognitive psychology and linguistics. However, despite this influential research, within computational creativity little effort has been devoted to fully formalise these ideas and to make them amenable to computational techniques. Unlike other combination techniques, blending aims at creatively generating (new) concepts on the basis of input theories whose domains are thematically distinct but whose specifications share structural similarity based on a relation of analogy, identified in a generic space, the baseontology. We introduce here the basic formalisation of conceptual blending, as sketched by the late Joseph Goguen, and discuss some of its variations. We illustrate the vast array of conceptual blends that may be covered by this approach and discuss the theoretical and conceptual challenges that ensue. Moreover, we show how the Distributed Ontology Language \(\mathsf {DOL}\) can be used to declaratively specify blending diagrams of various shapes, and discuss in detail how the workflow and creative act of generating and evaluating a new, blended concept can be managed and computationally supported within Ontohub, a \(\mathsf {DOL}\)-enabled theory repository with support for a large number of logical languages and formal linking constructs.

Research paper thumbnail of Editorial: Movement, embodiment, Kinesemiotics: interdisciplinary approaches to movement-based communication

Frontiers in Communication

Research paper thumbnail of Towards semiotically driven empirical studies of ballet as a communicative form

Humanities and Social Sciences Communications

This paper treats dance as a movement-based semiotic system, focusing on classical ballet as an e... more This paper treats dance as a movement-based semiotic system, focusing on classical ballet as an example in order to show how dance can be made accessible to both detailed description and empirical investigation as a form of communication. The study contributes to a growing tradition of multidisciplinary research that looks at a variety of dance forms from the perspectives of linguistics, communication studies and social semiotics, drawing additionally on recent developments in the formal semantics of non-verbal semiotic systems and on empirical methods emerging within functional accounts of multimodality. The paper consequently develops a particular treatment of ballet that offers a principled means of linking the physical stream of movement, recorded using motion caption technology, and discourse interpretations, such as those that are typically narratively relevant in classical ballet but which may be found in other forms of dance as well. The paper sets out how this may then supp...

Research paper thumbnail of Kinetik und Methodik - Film als dynamische und multimodale Herausforderung für die DH

Zenodo (CERN European Organization for Nuclear Research), Mar 7, 2022

Research paper thumbnail of Revisiting Cinematic Authorship: A Multimodal Approach

Critical Multimodal Studies of Popular Discourse, 2013

Research paper thumbnail of Dutch Grammatical Resources Description

ESPRIT Basic Research Project

Research paper thumbnail of Multilingual textuality: Some experiences from multilingual text generation

Trends in Natural Language Generation …, Jan 1, 1996

The present article describes an approach to multilingual text generation focusing on how textual... more The present article describes an approach to multilingual text generation focusing on how textuality is achieved across languages (here: English, German, and Dutch). We specify an appropriately abstract level of textual semantics that can accomodate both commonalities and differences between languages. We describe the interaction between global-level discourse semantics and grammar via the newly introduced level of local-level discourse semantics that mediates information between global text structure and the lower linguistic ...

Research paper thumbnail of From Empirical Studies to Visual Narrative Organization: Exploring Page Composition

Empirical Approaches to Comics Research (Routledge), 2019

Performing empirical studies on artifacts that are considered to be creative art is wrought with ... more Performing empirical studies on artifacts that are considered to be creative
art is wrought with ideological controversy and practical challenges. Conceptions of artistic freedom seem to diametrically oppose the kind of regulation and systematization required for controlled empirical study. In this contribution we explore how the apparently infinite freedom of page design, or mise-en-page, can be brought under analytic control by developing fine-grained and multiple-level systems of qualitative categorization open to empirical probing. We introduce this approach and suggest how it may be employed in some exploratory eye-tracking studies, raising questions for further research.