Digital systems for live multimodal performance in Death and the Powers (original) (raw)
Related papers
Disembodied Performance: Abstraction of Representation in Live Theater
Early in Tod Machover's opera Death and the Powers, the main character, Simon Powers, is subsumed into a technological environment of his own creation. The theatrical set comes alive in the form of robotic, visual, and sonic elements that allow the actor to extend his range and influence across the stage in unique and dynamic ways. The environment must compellingly assume the behavior and expression of the absent Simon.
Music and Technology in Death and the Powers
In composer Tod Machover's new opera Death and the Powers, the main character uploads his consciousness into an elaborate computer system to preserve his essence and agency after his corporeal death. Consequently, for much of the opera, the stage and the environment itself come alive as the main character. This creative need brings with it a host of technical challenges and opportunities. In order to satisfy the needs of this storyline, Machover's Opera of the Future group at the MIT Media Lab has developed a suite of new performance technologies, including robot characters, interactive performance capture systems, mapping systems for authoring interactive multimedia performances, new musical instruments, unique spatialized sound controls, and a uni ed control system for all these technological components. While developed for a particular theatrical production, many of the concepts and design procedures remain relevant to broader contexts including performance, robotics, and interaction design.
'Multimedia as a Prosthesis': Mingling Live Theatrical Arts and Virtuality
The simultaneous presence of virtual and physical reality on a theatre scene is of problematic nature. In terms of empathy it is difficult for an attendance to identify with these 2 different dimensions of reality at the same time. This observation led us to conceive an expressive technological environment and a theatrical concept in which we could achieve a 'natural' symbiosis of the physical and the virtual: 'multimedia as prosthesis' This application of VR technology offers intuitive tools (for drawing and navigation, speaking,..) at a paralyzed, technology-dependant actor. In order to have the mimetic faculty of this man communicated to the audience we built a computer-cave on the theatre scene, so that he can share his virtual space with the spectators. This is an environment of which the parameters are generated and steered by the actor in real time.
Interactive Technologies and Audiovisual Programming for the Performing Arts
Digital Tools for Computer Music Production and Distribution
While many scientific fields loosely rely on coarse depiction of findings and clues, other disciplines demand exact appreciation, consideration and acknowledgement for an accurate diagnosis of scientific data. But what happens if the examined data have a depth of focus and a degree of perplexity that is beyond our analyzed scope? Such is the case of performing arts, where humans demonstrate a surplus in creative potential, intermingled with computer supported technologies that provide the substrate for advanced programming for audiovisual effects. However, human metrics diverge from computer measurements, and therefore a space of convergence needs to be established analogous to the expressive capacity of musical inventiveness in terms of rhythm, spatial movement and dancing, advanced expression of emotion through harmony and beauty of the accompanying audiovisual form. In this chapter, the new era of audiovisual effects programming will be demonstrated that leverage massive particip...
Integrating Human Interaction in Audiovisual Performance
This thesis investigates the area of audiovisual composition and audiovisual performance. A brief history of the audiovisual genre is presented with reference to influential composers and artists who have carried out pioneering work in this field. The technological advancements that have contributed to audiovisual composition and performance are also identified. A selection of pieces that represent audiovisual works in a performance context are then discussed which relate to the original composition ‘A Fading Vision’. The development of a real time audiovisual performance system incorporating a hexaphonic guitar, Max/MSP and Processing is then described. A detailed analysis of the audiovisual composition, ‘A Fading Vision’, is then carried out followed by a critical evaluation of the piece and the technical system.
Design and implementation of a multimedia opera
PROCEEDINGS OF THE INTERNATIONAL …, 1996
While the traditional notion of "opera" describes a production that incorporates musical elements with other art forms and media, the conceptual and technical considerations required to mount an electronic multimedia opera add significant layers of complexity. Design issues including projecting visual media, the implementing of an immersive audio environment and maintaining synchronization (between live singers and digital music, 3D computer animation, stage lighting and projected imagery) add to the standard list of compositional and production challenges. An overview of the design and implementation of such a production, StarChild: The Opera, offers a primer in the musical and extra-musical considerations that are required to realize a large-scale composition in an electronic mixed media environment.
Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion, 2018
Despite of its long history, opera as an art form is constantly evolving. Composers have never lost their fascination about it and keep exploring with innovative aesthetics, techniques, and modes of expression. New technologies, such as Virtual Reality (VR), Robotics and Artificial Intelligence (AI) are steadily having an impact upon the world of opera. The evolving use of performance-based software such as Ableton Live and Max/MSP has created new and exciting compositional techniques that intertwine theatrical and musical performance. This paper presents some initial work on the development of an opera using such technologies that is being composed by Kallionpää and Chamberlain. Furthermore, it presents two composition case studies by Kallionpää: "She" (2017) and puppet opera "Croak" (2018), as well as their documentation within the world's first 360° 3D VR recordings with full spatial audio in third-order Ambisonics and the application of an unmixing paradi...
Live Movies: A Field Guide to New Media for the Performing Arts
2006
The business of workers in the theatre is, as I see it, to express a timeless theme by means of the tools of one's own time. And we are not using the tools of our own time in the theatre.-Robert Edmond Jones (1941/1952) …A fi lm is a matter of a few miles of celluloid in a tin box.-Bertolt Brecht (c. 1930) While other writers in this book document and discuss many contemporary new media artists in the performing arts, this essay is concerned primarily with historical precedents for the current wildfire of new technologies making their way onto the stage, and how these new technologies change methods of, and approaches to, performance and production. New technologies come, and new technologies replicate, mutate, malfunction, evolve, devolve, obsolesce, and go. When they fi rst arrive, we tend to fetishize them, a feverishly melancholy act. This fervor for the machines can blot out what really matters…meaning, content, narrative, story… The panoply of computer graphics and animation, video, data, fi lm and slide projection, digital sound design, amplifi cation and sound processing, and computercontrol of scenic elements represents just some of the new devices and processes which are at the disposal of designers, technicians and other theater artists in the early 21 st century. With the profoundly new kind of theater, opera, concerts and exhibitions st century. With the profoundly new kind of theater, opera, concerts and exhibitions st which can be crafted with these innovative tools comes a whole range of challenges in how to use them, and especially in how to integrate them with live performers. The singer-actor in new media theater today learns to deal with a wireless microphone, to treat sound design as another character, to talk and interact with projected characters, become a projected character and transform back again, to lip-synch and digitally ventriloquize. They are not acting like they're Triple-A Plowed Under, Federal Theatre Project's Living Newspaper, 1936. 12 LIVE MOVIES LIVE MOVIES: A PERSONAL (FUTURE) HISTORY OF MULTIMEDIA PERFORMANCE in a play. They're not acting like they're on fi lm. They're acting as one does in a live movie, interwoven, interspersed with phantoms of the same insubstantiality in live movie, interwoven, interspersed with phantoms of the same insubstantiality in live movie which we dwell in the technospheric mediascape. Not only actors have a different task before them in new media theater. So, too, do writers, directors, designers, composers, producers, stage managers and operators. Writers compose "sampling scripts" in "synthetic fragments." New media (or multimedia, or projection) design shows up in the scenographic process and no one's really sure what to do, or what to do with it. Multimedia designers are essentially fi lmmakers. The good ones are skilled not only in creating on multiple two-dimensional picture planes, but also in three dimensions, and in four, through time. Some set and lighting designers are skeptical, even territorial, toward this (once again) new force in the theater; some resist, some try to do it themselves. But it's a different medium and discipline than most are trained or adept in, so over the past ten years a growing number of artists now train (often themselves) to focus solely on multimedia design. It is important to de-mystify so-called "new media," with the realization that they simply are tools, and will soon be assimilated by theater's production apparatus as were nautical rigging, electrical lighting, servo-mechanisms, fi lm and slide projection, and sound sampling and amplifi cation. Projections are simply another kind of light, and the set and the costumes form the screens. This interdependence necessarily leads to a unifi ed, dialectical approach to scenography, and to the fabled Gesamtkunstwerk, the total artwork, total theater. Gesamtkunstwerk, the total artwork, total theater. Gesamtkunstwerk Multimedia design, in American regional theater, experimental groups and grassroots companies, university-based theater, and even on Broadway, fi nds itself in much the same position that sound design was ten or fi fteen years ago, struggling to unfold as a new, dynamic facet of the production apparatus. Today most directors and production managers don't ask whether a show needs sound design, but whether a show needs sound design, but whether what will the sound design be? Ten or twenty years from now, multimedia design (with all the "new media" we can't imagine yet) will inhabit an integral place in the design spectrum. In the meantime, it's amusing and instructive to witness, and participate in, the growing pains, and the turf wars, and the experimentation and adaptation, and yet another new dawn of technologically-enhanced social and artistic change.
Challenges of the Internet of Things, 2018
In the first part of this paper, we will introduce the scenographic design on which our presentation is based, and the modifications we have made in relation to our previous work. Next, in the second section, we will discuss in detail the impact of augmenting the player’s game using an avatar, compared to the scenic limitations of the theatrical stage. In part three of the paper, we will discuss the software-related aspects of the project, focusing on exchanges between the different components of our design and describing the algorithms enabling us to utilize the real-time movement of a player via various capture devices. To conclude, we will examine in detail how our experimental system linking physical actors and avatars profoundly alters the nature of collaboration between directors, actors, and digital artists in terms of actor/avatar direction.
The intersection of live and digital: new technical classifications for digital scenography in opera
Theatre and Performance Design, 2017
Over the past decade, there has been a substantive increase in the number of theatrical productions that utilise digital scenography. Whether in dance, theatre or opera, these works encounter a number of artistic and technical challenges, as well as scrutiny from those who consider digital effects as interfering with live performers in the context of legacy art forms. While the use of digital technology in theatre has been the subject of study by scholars such as Auslander, Baugh and Salter, the use of digital enhancement in opera production has received far less attention, particularly in terms of the scenographic conventions that have emerged as a result of advancing technologies. Because opera is largely defined and constrained by highly traditional production conventions, including a seated orchestra and unamplified singers, the genre provides a unique framework for considering the use of new technologies in the performative space. This article will propose a method for classifying and quantifying digitally enhanced theatrical productions and explore the resulting dramaturgical implications through a close study of three productions of Mozart's The Magic Flute.