Stadler, Jane. “Cinesonic Imagination: The Somatic, the Sonorous, and the Synaesthetic.” Cinephile Special Issue: Philosophy and New Media. 12.1 (2018): 8–15. (original) (raw)

Imagination and the Cinematic Experience

This paper concerns the role of the imagination in the experience of fictional movies. In the philosophy of cinema we can find two main and opposing theses: the Imagined Seeing Thesis (IST), which claims that the moviegoer imagines perceiving the fictional world in a first-personal way, and the Impersonal Imagining Thesis (IIT), which claims that the moviegoer uses the pictures and sounds of the film as prompts for the imaginative construction of a fictional world. We argue that these theses are both flawed, and we propose a different account, namely: the Imagined Causation Thesis (ICT), which can solve the problems of both IST and IIT.

Stadler, J. “‘Mind the Gap’: Between Movies and Mind, Affective Neuroscience and the Philosophy of Film.” Projections: Journal of Movies and Mind 12.2 (2018): 86–94.

PAGE PROOFS (please see Projections for finished article): Murray Smith's book "Film, Art, and the Third Culture" makes a significant contribution to cognitive film theory and philosophical aesthetics, expanding the conceptual tools of film analysis to include perspectives from neuroscience and evolutionary psychology. Smith probes assumptions about how cinema affects spectators by examining aspects of experience and neurophysiological responses that are unavailable to conscious, systematic reflection on experience and aesthetic techniques. This article interrogates Smith's account of emotion, empathy, and imagination in cinematic representation and film spectatorship, placing his work in dialogue with other recent interventions in the fields of cinema studies and embodied cognition. Smith's contribution to understanding the role of emotion in screen studies is vital, and when read in conjunction with recent publications by Carl Plantinga and Mark Johnson on ethical engagement and the moral imagination, this new work constitutes a notable advance in film theory.

The Role of Sound in Filmic Experience: A Cognitive Semiotics Approach

Proceedings of the 12th World Congress of the International Association for Semiotic Studies (IASS/AIS), 2017

In the Semiology of Cinema tradition sound was assumed as a particular type of “expression substance” among others, an ingredient of “syncretic” semiotics. From this perspective, films are closed texts made of codes deci­pherable by the spectator (Metz, 1971, 1974), one of which would be the sound code. After the cognitive turn in film theories (Bordwell, 1987; Branigan, 1992; Currie, 1995; Bordwell & Carroll, 1996; Grodal, 1999, 2009, among others), film (and audiovisual) semiotics is interested in accounting for the viewer’s experience. This experience is now understood under the same parameters of real life experience, to the extent that humans use the same skills to understand movies that to deal with reality. Some researchers have devoted part of their theo­ries to the description of sound and hearing experience in cinema from different approaches: ecological (Anderson, 1998; Anderson, Fischer, Bordwell et al, 2007), socio-historical (Altman et al, 1980, 1992, 2001, 2007) “eclectic” (Chion, 1985, 1991, 1998, 2003) or even cognitive – in a broad sense (Jullier, 1995, 2002, 2012). Nevertheless, the bridge between cognitive theories and film semiotics is still weak, particularly when dealing with the multimodal dimensions of spectatorship experience. To address the role of sound in filmic experience with more powerful tools, in this presentation I propose to follow the current trend of cognitive semiotics and its link with phenomenology and cognitive sciences (Sones­son, 2009). First, I will show the insights of philosophy and phenomenology of sound (Ihde, 2007; O’Callaghan, 2007; Nudds, O’Callaghan et al., 2009): the phenomenological description of the auditory field and sound hori­zons, and the idea of conceiving sounds as events in hearing experience. Second, I will present some discoveries of cognitive research from an enactive perspective, about the intersubjective exploration of sound spaces (Krue­ger, 2006, 2000, 200). Third, I will link these ideas with a general description of event perception and concep­tion (Zacks, 2008, 2010: Zacks & et al., 2011), particularly in film comprehension (Zacks, Speer, and Reynolds, 2009; Zacks & Magliano, 2009). Finally, I will integrate all these insights in the context of a new semiotic the­ory: agentive semiotics (Niño, 2013a, 2013b; Niño, 2014, forthcoming). This theory provides precise criteria to distinguish (but also integrate) the experience of "semiotic scenes" (intentional constructions assumed here as a particular type of events) and the experience of the world. Thus I hope to provide a new approach to understand the role of sound in the (multimodal) experience of film spectatorship.

Between the mind and the senses: Jean Mitry’s approach to cinematic consciousness.

Altered States, 2022

Representing altered states of consciousness, even through the most phantasmal of technical images, is an inherent contradiction; once we attribute a physical body, i.e. objectivity, to mental images, we deny what Husserl considers their very essence. Jean Mitry draws from this assumption when discussing filmic access to mental states from a phenomenological perspective. The following essay reconsiders Mitry’s contribution with specific reference to the role of projection, technically and metaphorically speaking, in the cinematic technique and imagination; this, with the intention of suggesting some crucial questions for the comparison between the filmic forms of the visible and those inaugurated by the technology of the virtual.

Ward, M.S. 2015, 'Art in noise: an embodied simulation account of cinematic sound design', in M. Coëgnarts & P. Kravanja (eds), Embodied cognition and cinema, Leuven University Press, Leuven, Belgium, pp. 155-186.

This chapter examines the meaning-making functions of cinematic sound from the perspective of embodied cognition. Using embodied simulation theory (Gallese, 2005) as a unifying framework, and placing particular emphasis upon the affective aspects of ‘Feeling of Body’ (Wojciehowski & Gallese, 2011), an account of cinematic media emerges which puts into play Mark Johnson’s concept of ‘embodied meaning’ (Johnson, 2007). Central to Johnson’s concept is the assertion that all human meaning, abstract conceptual thinking, and imagination have basis in our sensorimotor interactions with the world. In the context of cinematic media, it suggests the stylistic crafting and patterning of perceptual content not only elicits an affective response but also shapes cognition. Drawing upon examples of cinematic sound design an embodied aesthetics is illustrated.

4 / JOURNAL OF COMPARATIVE LITERATURE AND AESTHETICS Films, the Visual, and their Effects on our Minds and Emotions METKA ZUPANCIC

JCLA, 2020

4 / JOURNAL OF COMPARATIVE LITERATURE AND AESTHETICS Films, the Visual, and their Effects on our Minds and Emotions METKA ZUPANCIC The visual, and in particular the audiovisual, appears to be overbearingly present intoday’s world, not only in the so-called “technologically advanced” society, but alsoin places where we could hardly imagine the existence of the devices that allow us toconstantly check information that is often accompanied by images. Abundant mediaresearch is already warning about various levels of influences this exposure to the devices may have on today’s humans, especially the younger generations (see, f. ex., Kabali et ali 2015). What does such a massive exposure to images mean for the research in the field of myth criticism, the approach we apply in the present volume of JCLA? The main hypothesis is that images, together with all other domains of human creativity,from literature to fine arts and even music, carry within them a layer, a substratumthat I would call a “mythical charge.” In this sense, the main purpose of our collectiveendeavors in this context is to verify the modalities in which the underlying mythical schemes, connected to ancient myths from various cultures, continue to manifest themselves in the vast realm of the (audio)visual. Furthermore, we are interested in finding out how these mythical models are being transformed because of the various media in which they may appear, from photography, paintings, comics and video gamesto cinema.

Cinematic Empathies. Spectator Involvement in the Film Experience

Kinesthetic Empathy in Creative and Cultural Practices, edited by Matthew Reason and Dee Reynolds, 2012

"In his chapter, ‘Cinematic Empathy: Spectator Involvement in the Film Experience’, Adriano D’Aloia discusses the role of empathy in spectators’ involvement in narrative fiction film. He highlights the importance of the ‘quasi’ or ‘as if ’ aspect of empathy: when we experience the fictive world of the film ‘as if ’ it was real, while also knowing that it is not and we relate to the other ‘as if ’ they were us, while knowing that they are separate. This ‘as if ’ experience is an imaginary act that activates the spectator’s kinesthetic sensations in a motor imitation of movement perceived in the film, which can be that of a character or of the #lm itself, as in the movement of the camera. D’Aloia exemplifies graphically the ‘as if’ experience in #lm spectatorship by contrasting the reaction of spectators within a film who witness an acrobat falling with the reaction of spectators in the cinema; whereas the former jump up in horror, the latter remain seated – perhaps also horrified, but viewing the event ‘as if ’ real, while not actually happening in front of them. D’Aloia also explores connections between motor and emotional experience in spectators’ responses to films. However, he regards imitation in the form of synchronisation (e.g. foot tapping) as a relatively basic and undeveloped form of activation, which ‘must not be confused with empathy as such’. D’Aloia emphasises the potential of "lm to intensify the spectator’s experience, and rather than temporal alignment as in the musical context, he is interested in how, for the cinema spectator, motor imitation carries an affective charge that intensifies emotional response. !e camera can include its own movement – that of the‘film’s body’, which is specific to the "lm medium – thereby intensifying the spectator’s own kinesthetic sensations as they internally ‘imitate’ the movement of the camera as well as the character. Spectators’ involvement can be enhanced by skilful acting, by narrative, or by the dramatic quality of the movement itself, such as an acrobat swaying on a tightrope, in danger of falling."

"Once More, with Feeling: Cinema and Cinesthesia"

In marked contrast to more recent discussions of cinematic affect, this article seeks to affirm the ineluctably passive experience of moving-images. In particular, the essay returns to the tradition of psychology and art history that developed, in the later nineteenth and early twentieth century, around the concept of Einfühlung. On this basis, I argue that cinema constitutes a kind of prosthetic perception whereby the brain is inhabited and vehicularized by images that are not its own.

"Film Music as Embodiment" In Maarten Coëgnarts and Peter Kravanja (eds.) Embodied Cognition and Cinema. Leuven: Leuven University Press, 2015: 81-112.

Music is a multi-parametric construct that operates at an almost subliminal level to support, highlight, complement, or even negate any other aspect of the cinematic experience. Current trends of film scoring reflect a fading interest in the associative dimensions of music; rather, composers now strive to contribute with a phenomenological score. It is primarily through embodiment, a hardwired process grounded in our physiology and cognition, that music functions phenomenologically within lm. Embodiment mediates signification, enabling the music to guide the audience’s attention toward particular visual events, to shape the perception of segmentation at micro- and macro-levels, to trigger a myriad of bodily states, and ultimately to present a unique perspective on the discourse of characters and cinematic narrative. Although most film-scoring techniques have gradually emerged through the intuitive use of music, interdisciplinary strands of scholarship from embodied cognition can be instrumental to examine these techniques from empirical and theoretical perspectives, and thus shed light on the logic that motivates the interaction between music and other facets of the cinematic experience.