Bradley Smith - Academia.edu (original) (raw)
Uploads
Papers by Bradley Smith
The language of the heart and breath: bridging strata, bridging discourses of INFORMATION systems., 2007
Study of textual systems of intonation, considering what it means to choose in the textual metafu... more Study of textual systems of intonation, considering what it means to choose in the textual metafunction
Critical Discourse Studies, 2011
... “The multimodal transcription of ... In Multimodality and multimediality in the distance lear... more ... “The multimodal transcription of ... In Multimodality and multimediality in the distance learning age: Papers in English linguistics , Edited by: Baldry, A. 311–385 ... being made available for furtheranalysis via annotation, or aligned vertically alongside other analyses of the film text (eg ...
Information Design Journal, 2010
The paper discusses the challenges faced by researchers in developing effective digital interface... more The paper discusses the challenges faced by researchers in developing effective digital interfaces for analyzing the meaning-making processes of multimodal phenomena. The authors propose a social semiotic approach as the underlying theoretical foundation, because interactive digital technology is the embodiment of multimodal social semiotic communication. The paper outlines the complex issues with which researchers are confronted in designing digital interface frameworks for modeling, analyzing, and retrieving meaning from multimodal data, giving due consideration to the multiplicity of theoretical frameworks and theories which have been developed for the study of multimodal text within social semiotics, and their impact on the development of a computer-based tool for the exploration, annotation, and analysis of multimodal data.
Social Semiotics, 2011
The present paper discusses issues arising from the use of an interactive digital software tool t... more The present paper discusses issues arising from the use of an interactive digital software tool to analyze multimodal communication. The focus is on the ways in which such technical resources and associated techniques enable the analyst of social semiosis to apply different types of analysis, and provide the site for critical reflection upon the results of such analyses. The aim is to present an argument for the use of an interactive digital software application as a meta-semiotic tool. Three major challenges for scholars engaged in multimodal social semiotics are addressed in pursuing this aim, specifically with reference to the development of digital interactive analytical resources. Firstly, scholars are faced with the task of not only accounting for an increasing range of semiotic resources, but also for the way different semiotic phenomena interact to produce meaning. Secondly, the multimodal semiotician has a broad range of analytical approaches potentially relevant to any task to draw upon. Thirdly, the nature of contemporary media forms offer challenges themselves in terms of access, analysis and presentation of analysis.
Information Design Journal, 2010
The following paper discusses the challenges faced in designing a flexible, easy-to-use, cross-pl... more The following paper discusses the challenges faced in designing a flexible, easy-to-use, cross-platform software tool for modeling, analyzing and retrieving meaning from multimedia data. In a project currently being undertaken at the Multimodal Analysis Lab, Interactive and Digital Media Institute (IDMI), at the National University of Singapore (see http://multimodal-analysis-lab.org/), social scientists and computer scientists collaborate to produce an interactive digital software tool for studying multimodal communication (that is, communication using and integrating multiple semiotic resources such as language, visual imagery, gesture, music, dress and so on), in media such as written text, pictures, sound and video. This software is projected to have application across a variety of academic disciplines, theoretical traditions and professional vocations.
Social Semiotics, 2011
The present paper discusses issues arising from the use of an interactive digital software tool t... more The present paper discusses issues arising from the use of an interactive digital software tool to analyze multimodal communication. The focus is on the ways in which such technical resources and associated techniques enable the analyst of social semiosis to apply different types of analysis, and provide the site for critical reflection upon the results of such analyses. The aim is to present an argument for the use of an interactive digital software application as a meta-semiotic tool. Three major challenges for scholars engaged in multimodal social semiotics are addressed in pursuing this aim, specifically with reference to the development of digital interactive analytical resources. Firstly, scholars are faced with the task of not only accounting for an increasing range of semiotic resources, but also for the way different semiotic phenomena interact to produce meaning. Secondly, the multimodal semiotician has a broad range of analytical approaches potentially relevant to any task to draw upon. Thirdly, the nature of contemporary media forms offer challenges themselves in terms of access, analysis and presentation of analysis.
Critical Discourse Studies, 2011
... “The multimodal transcription of ... In Multimodality and multimediality in the distance lear... more ... “The multimodal transcription of ... In Multimodality and multimediality in the distance learning age: Papers in English linguistics , Edited by: Baldry, A. 311–385 ... being made available for furtheranalysis via annotation, or aligned vertically alongside other analyses of the film text (eg ...
Proceedings of the …, 2009
In this paper we present a collaborative work between computer and social scientists resulting in... more In this paper we present a collaborative work between computer and social scientists resulting in the development of annotation software for conducting research and analysis in social semiotics in both multimodal and linguistic aspects. The paper describes the proposed software and discusses how this tool can contribute for development of social semiotic theory and practice.
Conference Presentations by Bradley Smith
The talking book is a type of assistive technology where original print text is audio recorded an... more The talking book is a type of assistive technology where original print text is audio recorded and marked-up in order to make it accessible for people with print-disabilities, such as visual impairments or dyslexia. In this pilot study, we explore the implications of remediating a written text, the script of Shakespeare’s King Lear, into spoken text. We compare two readings of the play: a talking book version; and a commercial audiobook recording. We examine intonation choices in an excerpt from the play in the two readings. The analysis shows significant variation in choices of intonation, and thus the meanings that are produced in the two versions, resulting in not one but two King Lear plays. One implication of such variation might be that different styles of narration demand different ways of reading. The results point to the need to explore how intonation makes meaning for actual talking book readers in situ, where meaning-potentials are realised through the interaction and encounter between the text, the reader(s), the social settings in which they are reading, and the material properties of talking books.
The language of the heart and breath: bridging strata, bridging discourses of INFORMATION systems., 2007
Study of textual systems of intonation, considering what it means to choose in the textual metafu... more Study of textual systems of intonation, considering what it means to choose in the textual metafunction
Critical Discourse Studies, 2011
... “The multimodal transcription of ... In Multimodality and multimediality in the distance lear... more ... “The multimodal transcription of ... In Multimodality and multimediality in the distance learning age: Papers in English linguistics , Edited by: Baldry, A. 311–385 ... being made available for furtheranalysis via annotation, or aligned vertically alongside other analyses of the film text (eg ...
Information Design Journal, 2010
The paper discusses the challenges faced by researchers in developing effective digital interface... more The paper discusses the challenges faced by researchers in developing effective digital interfaces for analyzing the meaning-making processes of multimodal phenomena. The authors propose a social semiotic approach as the underlying theoretical foundation, because interactive digital technology is the embodiment of multimodal social semiotic communication. The paper outlines the complex issues with which researchers are confronted in designing digital interface frameworks for modeling, analyzing, and retrieving meaning from multimodal data, giving due consideration to the multiplicity of theoretical frameworks and theories which have been developed for the study of multimodal text within social semiotics, and their impact on the development of a computer-based tool for the exploration, annotation, and analysis of multimodal data.
Social Semiotics, 2011
The present paper discusses issues arising from the use of an interactive digital software tool t... more The present paper discusses issues arising from the use of an interactive digital software tool to analyze multimodal communication. The focus is on the ways in which such technical resources and associated techniques enable the analyst of social semiosis to apply different types of analysis, and provide the site for critical reflection upon the results of such analyses. The aim is to present an argument for the use of an interactive digital software application as a meta-semiotic tool. Three major challenges for scholars engaged in multimodal social semiotics are addressed in pursuing this aim, specifically with reference to the development of digital interactive analytical resources. Firstly, scholars are faced with the task of not only accounting for an increasing range of semiotic resources, but also for the way different semiotic phenomena interact to produce meaning. Secondly, the multimodal semiotician has a broad range of analytical approaches potentially relevant to any task to draw upon. Thirdly, the nature of contemporary media forms offer challenges themselves in terms of access, analysis and presentation of analysis.
Information Design Journal, 2010
The following paper discusses the challenges faced in designing a flexible, easy-to-use, cross-pl... more The following paper discusses the challenges faced in designing a flexible, easy-to-use, cross-platform software tool for modeling, analyzing and retrieving meaning from multimedia data. In a project currently being undertaken at the Multimodal Analysis Lab, Interactive and Digital Media Institute (IDMI), at the National University of Singapore (see http://multimodal-analysis-lab.org/), social scientists and computer scientists collaborate to produce an interactive digital software tool for studying multimodal communication (that is, communication using and integrating multiple semiotic resources such as language, visual imagery, gesture, music, dress and so on), in media such as written text, pictures, sound and video. This software is projected to have application across a variety of academic disciplines, theoretical traditions and professional vocations.
Social Semiotics, 2011
The present paper discusses issues arising from the use of an interactive digital software tool t... more The present paper discusses issues arising from the use of an interactive digital software tool to analyze multimodal communication. The focus is on the ways in which such technical resources and associated techniques enable the analyst of social semiosis to apply different types of analysis, and provide the site for critical reflection upon the results of such analyses. The aim is to present an argument for the use of an interactive digital software application as a meta-semiotic tool. Three major challenges for scholars engaged in multimodal social semiotics are addressed in pursuing this aim, specifically with reference to the development of digital interactive analytical resources. Firstly, scholars are faced with the task of not only accounting for an increasing range of semiotic resources, but also for the way different semiotic phenomena interact to produce meaning. Secondly, the multimodal semiotician has a broad range of analytical approaches potentially relevant to any task to draw upon. Thirdly, the nature of contemporary media forms offer challenges themselves in terms of access, analysis and presentation of analysis.
Critical Discourse Studies, 2011
... “The multimodal transcription of ... In Multimodality and multimediality in the distance lear... more ... “The multimodal transcription of ... In Multimodality and multimediality in the distance learning age: Papers in English linguistics , Edited by: Baldry, A. 311–385 ... being made available for furtheranalysis via annotation, or aligned vertically alongside other analyses of the film text (eg ...
Proceedings of the …, 2009
In this paper we present a collaborative work between computer and social scientists resulting in... more In this paper we present a collaborative work between computer and social scientists resulting in the development of annotation software for conducting research and analysis in social semiotics in both multimodal and linguistic aspects. The paper describes the proposed software and discusses how this tool can contribute for development of social semiotic theory and practice.
The talking book is a type of assistive technology where original print text is audio recorded an... more The talking book is a type of assistive technology where original print text is audio recorded and marked-up in order to make it accessible for people with print-disabilities, such as visual impairments or dyslexia. In this pilot study, we explore the implications of remediating a written text, the script of Shakespeare’s King Lear, into spoken text. We compare two readings of the play: a talking book version; and a commercial audiobook recording. We examine intonation choices in an excerpt from the play in the two readings. The analysis shows significant variation in choices of intonation, and thus the meanings that are produced in the two versions, resulting in not one but two King Lear plays. One implication of such variation might be that different styles of narration demand different ways of reading. The results point to the need to explore how intonation makes meaning for actual talking book readers in situ, where meaning-potentials are realised through the interaction and encounter between the text, the reader(s), the social settings in which they are reading, and the material properties of talking books.