Zachary Seldess | University of California, San Diego (original) (raw)

Papers by Zachary Seldess

This paper discusses MIAP (Manifold-Interface Amplitude Panning), a new freely available implemen... more This paper discusses MIAP (Manifold-Interface Amplitude Panning), a new freely available implementation of Meyer Sound’s SpaceMap abstract spatialization software via a collection of C externals for Max/MSP and Pure Data. SpaceMap’s technical and conceptual innovations are discussed and placed within the larger context of widely available codified spatialization algorithms and approaches such as Vector-base amplitude panning. An examination of the new implementation is made along with discussion of added features resulting from the translation.

Chapter in Springer Edition: "Israel’s Exodus in Trans-Disciplinary Perspective: Text, Archeology... more Chapter in Springer Edition: "Israel’s Exodus in Trans-Disciplinary Perspective: Text, Archeology, Culture, and Geoscience"

In this paper, a new approach to enriching the experience of cyber-archaeology and other advanced museum and visualization efforts is discussed. Using advanced, adaptive, listener-centered audio systems in development at UCSD, the authors experimented with computer-audio digital signal processing and acoustical design strategies to provide a well-controlled listening environment that complemented the advanced display technologies of EX3, with the goal of improving the overall audience experience of the show. Several supporting technologies and systems were integrated to control and deliver audio in close synchronization with visual content. Primary hardware and software components included custom control and signal processing software, unique content creation rendered by highly directional small format speaker arrays for optimal auditory intelligibility, and human image tracking driving auditory content rendering. Acoustical engineering was also employed in service of an extremely media-rich environment comfortably serving visiting audiences of up to 100 people, concentrated in a relatively small physical space. Specific techniques and design/engineering challenges are discussed; prospects for future work are noted.

Proc. SPIE 9012, The Engineering Reality of Virtual Reality 2014, Feb 28, 2014

This paper describes an interactive performance system for oor and Aerial Dance that controls vis... more This paper describes an interactive performance system for oor and Aerial Dance that controls visual and sonic aspects of the presentation via a depth sensing camera (MS Kinect). In order to detect, measure and track free movement in space, 3 degree of freedom (3-DOF) tracking in space (on the ground and in the air) is performed using IR markers. Gesture tracking and recognition is performed using a simpli ed HMM model that allows robust mapping of the actor's actions to graphics and sound. Additional visual e ects are achieved by segmentation of the actor body based on depth information, allowing projection of separate imagery on the performer and the backdrop. Artistic use of augmented reality performance relative to more traditional concepts of stage design and dramaturgy are discussed. © (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.

Proceedings of the 17th International Conference on Auditory Display (ICAD-2011), Jun 20, 2011

The Music Cre8tor: an interactive system for musical exploration and education Jane Rigler Co-des... more The Music Cre8tor: an interactive system for musical exploration and education Jane Rigler Co-designer, Coordinator 25 Monroe St. Brooklyn, NY 11238 (917) 826-9608 Zachary Seldess Programmer/Co-Designer 16 Ocean Parkway #a18 Brooklyn, NY 11218 (718) 928-8387 ...

Proceedings of the International Conference on New Interfaces in Musical Expression, Jun 1, 2011

This paper discusses MIAP (Manifold-Interface Amplitude Panning), a new freely available implemen... more This paper discusses MIAP (Manifold-Interface Amplitude Panning), a new freely available implementation of Meyer Sound’s SpaceMap abstract spatialization software via a collection of C externals for Max/MSP and Pure Data. SpaceMap’s technical and conceptual innovations are discussed and placed within the larger context of widely available codified spatialization algorithms and approaches such as Vector-base amplitude panning. An examination of the new implementation is made along with discussion of added features resulting from the translation.

Chapter in Springer Edition: "Israel’s Exodus in Trans-Disciplinary Perspective: Text, Archeology... more Chapter in Springer Edition: "Israel’s Exodus in Trans-Disciplinary Perspective: Text, Archeology, Culture, and Geoscience"

In this paper, a new approach to enriching the experience of cyber-archaeology and other advanced museum and visualization efforts is discussed. Using advanced, adaptive, listener-centered audio systems in development at UCSD, the authors experimented with computer-audio digital signal processing and acoustical design strategies to provide a well-controlled listening environment that complemented the advanced display technologies of EX3, with the goal of improving the overall audience experience of the show. Several supporting technologies and systems were integrated to control and deliver audio in close synchronization with visual content. Primary hardware and software components included custom control and signal processing software, unique content creation rendered by highly directional small format speaker arrays for optimal auditory intelligibility, and human image tracking driving auditory content rendering. Acoustical engineering was also employed in service of an extremely media-rich environment comfortably serving visiting audiences of up to 100 people, concentrated in a relatively small physical space. Specific techniques and design/engineering challenges are discussed; prospects for future work are noted.

Proc. SPIE 9012, The Engineering Reality of Virtual Reality 2014, Feb 28, 2014

This paper describes an interactive performance system for oor and Aerial Dance that controls vis... more This paper describes an interactive performance system for oor and Aerial Dance that controls visual and sonic aspects of the presentation via a depth sensing camera (MS Kinect). In order to detect, measure and track free movement in space, 3 degree of freedom (3-DOF) tracking in space (on the ground and in the air) is performed using IR markers. Gesture tracking and recognition is performed using a simpli ed HMM model that allows robust mapping of the actor's actions to graphics and sound. Additional visual e ects are achieved by segmentation of the actor body based on depth information, allowing projection of separate imagery on the performer and the backdrop. Artistic use of augmented reality performance relative to more traditional concepts of stage design and dramaturgy are discussed. © (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.

Proceedings of the 17th International Conference on Auditory Display (ICAD-2011), Jun 20, 2011

The Music Cre8tor: an interactive system for musical exploration and education Jane Rigler Co-des... more The Music Cre8tor: an interactive system for musical exploration and education Jane Rigler Co-designer, Coordinator 25 Monroe St. Brooklyn, NY 11238 (917) 826-9608 Zachary Seldess Programmer/Co-Designer 16 Ocean Parkway #a18 Brooklyn, NY 11218 (718) 928-8387 ...

Proceedings of the International Conference on New Interfaces in Musical Expression, Jun 1, 2011