K Inuk - Academia.edu (original) (raw)

Papers by K Inuk

Research paper thumbnail of ‘Unheard’ Sounds

Electronic Workshops in Computing, 2015

Research paper thumbnail of Interactive Multimedia for Technology-Enhanced Learning with Multimodal Feedback

Springer Tracts in Advanced Robotics, 2011

Musical performances are generally physically demanding with high degree of control (mental and m... more Musical performances are generally physically demanding with high degree of control (mental and motor) and accuracy. This chapter presents the i-Maestro (www.i-maestro.org) project which explored interactive multimedia environments for technology-enhanced music education. It discusses one of the key requirements for an interactive musical robot which is to analyze and provide feedback/interaction to a “performance”. This Chapter also serves as an

Research paper thumbnail of Eye.Breathe.Music: A Multimeadia Controller That Uses Eye Movement And Breathing

The Lumiselo is an instrument that is operated through moving the eyes and breathing through a tu... more The Lumiselo is an instrument that is operated through moving the eyes and breathing through a tube. A camera tracks the coordinates of the user’s pupil; a pressure sensor outputs a respective voltage according to how hard the user breathes into a closed pipe and a display communicates this back to the user. This paper performs background research, discussing the creation of the instrument and critically evaluates it on completion.

Research paper thumbnail of Electronic Visualisation and the Arts (EVA 2010) - Index

Electronic Workshops in Computing, 2010

Electronic Visualisation and the Arts London 2010 (EVA 2010) is co-sponsored by the Computer Arts... more Electronic Visualisation and the Arts London 2010 (EVA 2010) is co-sponsored by the Computer Arts Society and BCS, The Chartered Institute for IT, of which the Computer Arts Society is a specialist group. Since 1992, the EVA conference series has established itself as a natural home from which to explore the richly interdisciplinary and constantly evolving world of digital visualisation. Nothing illustrates this more than the great scope, depth and diversity of the papers contained within this year's Proceedings. The latest research in digital arts and new media are explored, with contributors ranging from established scholars to the new generation of research students who will lead the field tomorrow. Conference papers cover reconstructive archaeology, virtual museology, digital arts concepts and practice, immersive environments, and digital performance and music. Editors Alan Seal has recently worked as Head of Records and Collections Services in the Victoria and Albert Museum where he was responsible for the photographic services and archive in the museum and the automation and digitisation of the collections. He was previously head of collections management in the National Art Library in the V&A. A librarian by training, he is particularly interested in user interfaces and online public access systems, both textual and multi-media. He has undertaken research into bibliographic standards in information systems and online library catalogues during a period at the Centre for Catalogue Research at the University of Bath.

Research paper thumbnail of Electronic Visualisation and the Arts (EVA 2013) - Index

Electronic Workshops in Computing, 2013

Over almost two decades, the EVA London conference on Electronic Visualisation and the Arts has e... more Over almost two decades, the EVA London conference on Electronic Visualisation and the Arts has established itself as one of the United Kingdom's most innovative and interdisciplinary conferences. It brings together a wide range of research domains to celebrate a diverse range of interests with a specialised focus on visualisation. EVA London 2013 presents a wide spectrum of papers, presentations, demonstrations, an exhibition, and a research workshop. It is a forum where the sciences, arts, humanities and performance are equally at home. EVA London 2013 presents 66 papers and abstracts from 15 countries, by researchers inside and outside academia, from graduate artists, PhD students, seasoned industry professionals, established scholars and senior researchers, who value EVA London for its interdisciplinary community. This year, the conference features three keynote speakers: Prof. Steve DiPaola from Simon Fraser University (Canada); Prof. Linda Candy from the University of Technology (Australia); and Don McIntyre from the Glasgow School of Arts (United Kingdom). The proceedings has resulted from a highly selective peer review process, fitting as many excellent submissions as possible into the limited timetable of the conference. The papers cover digital culture and creativity, museum studies, digital enhanced reality, computer arts, 3D modelling, emotion, haptic, mobile, cross-media, multimodal interactivities and performances, as well as many other interdisciplinary areas. EVA London is part of a larger network of EVA international conferences. In the past twenty years, EVA events have been held in Athens,

Research paper thumbnail of Electronic Visualisation and the Arts (EVA 2015) - Index

Electronic Workshops in Computing, 2015

and it is a condition of accessing publications that users recognise and abide by the legal requi... more and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

Research paper thumbnail of Visualising Sound: Localisation, Feature Analysis and Visualisation

Electronic Workshops in Computing, 2012

Sound is an integral medium of communication in society. Despite its influence in everyday intera... more Sound is an integral medium of communication in society. Despite its influence in everyday interaction, the fundamental features of sound and its impact are not commonly understood and often not considered. Advanced dissection and analysis of sound is often used to aid technology's understanding of its environment (e.g. in robotics and telecommunications). The aim of this project is to utilise sound information technology to enhance our understanding of sound and how we process it. Visualisation can provide a more accessible representation of complex sound analysis, and so it is investigated here in the context of musical performance and interactive installation. This cross-modal experience is informed by the phenomenon of synaesthesia and creative mapping to express its subjectivity by providing a user-unique experience. In addition to results and user evaluations, the paper concludes with plans for future development, focusing on the impact of the interactive installation on the user and ways in which the technology developed can be used in creative interaction with sound.

Research paper thumbnail of Configuring a Haptic Interface for Music Performance

Electronic Workshops in Computing, 2015

Our daily interactions and perceptions involve multiple sensory multimodalities; most exchanges a... more Our daily interactions and perceptions involve multiple sensory multimodalities; most exchanges are inherently multimodal, playing an important part in our decoding and understanding of environments. Events can often engage multiple senses. Furthermore, musical experiences can be highly multisensory, with obvious auditory stimulation, the visual elements of a live performance, and physical stimulation of the body. In this paper, we will propose a means of incorporating an additional somatic channel of communication into live performances and compositional practice to further augment the physical nature of live performance. This work explores the integration of augmented vibratory, or haptic stimulation for audiences in live performance. The vibration interface is presented as an expressive and creative live performance-based tool for composers. Vibrations, or haptics, are implemented as an additional instrumental line, alongside auditory musical gestures, to expand the composer's palette of expressions through augmented somatic engagement. This paper will describe the background, and design and development of a haptic interface for the purpose of audio-haptic listening-feeling. The focus of this paper is to describe a study into motor latency for informing multimedia simultaneity.

Research paper thumbnail of LIVeMotion: A Multi-Sensory System to Encourage the Awareness of Mindfulness

Electronic Workshops in Computing, 2015

For stress management and well-being, there are many approaches that require heightened awareness... more For stress management and well-being, there are many approaches that require heightened awareness of different bodily motions. Based on psychological studies of physiological response to music, LIVeMotion integrates a range of multimedia technologies, exploring several different sensor measurements to monitor external and internal "motions". Sensor data analysis and feature detections are mapped to visualisation and sonification feedback to enhance awareness of one's consciousness of bodily movement. With a brief background on the relationship between stress, music, physiology, and related literature, this paper discusses design considerations and development. Using several specific Use Cases, the paper demonstrates different application scenarios with the proposed system.

Research paper thumbnail of AXMEDIS 2007 Conference Proceedings

Proceedings e report, 2007

The AXMEDIS International Conference series has been established since 2005 and is focused on the... more The AXMEDIS International Conference series has been established since 2005 and is focused on the research, developments and applications in the cross-media domain, exploring innovative technologies to meet the challenges of the sector. AXMEDIS2007 deals with all subjects and topics related to cross-media and digital-media content production, processing, management, standards, representation, sharing, interoperability, protection and rights management. It addresses the latest developments and future trends of the technologies and their applications, their impact and exploitation within academic, business and industrial communities.

Research paper thumbnail of Low- and high-level approaches to optical music score recognition

IEE Colloquium on Document Image Processing and Multimedia Environments, 1995

The computer has become an increasingly important device in music. It can not only generate sound... more The computer has become an increasingly important device in music. It can not only generate sound (audio synthesis) but is also able to perform time consuming and repetitive tasks, such as transposition and part extraction, witb speed and accuracy. However, a score must be ...

Research paper thumbnail of Proceedings of the 2002 Conference on New Instruments for Musical Expression (NIME-02),Dublin, Ireland, May 24-26, 2002 Situated Trio: An Interactive Live Performance for a

We describe a 15 to 20 minute interactive live perform- ance work entitled Situated Trio for augm... more We describe a 15 to 20 minute interactive live perform- ance work entitled Situated Trio for augmented guitar and two computer musicians with expressive controllers. This work brings into focus a number of issues concern- ing musically expressive control and interaction among performers.

Research paper thumbnail of Watermark: From Paper Texture to Digital Media

First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'05)

... from new paper without any foreground interference, and not concerned with detailed extractio... more ... from new paper without any foreground interference, and not concerned with detailed extraction and ... watermark shape from a collection of watermarked documents that hold the same watermarkdesign. 10. ... [1] NF Johnson, and S. Jajodia, “Exploring Steganography: Seeing the ...

Research paper thumbnail of Using 3D Visualisations of Motion Data for Collaborative Multimedia Music Learning and Playing

Research paper thumbnail of i-Maestro framework and interactive multimedia tools for technology-enhanced learning and teaching for music

The i-Maestro project (www.i-maestro.org) has been supported by the EC IST 6 th Framework Program... more The i-Maestro project (www.i-maestro.org) has been supported by the EC IST 6 th Framework Programme to develop interactive multimedia environments for technology enhanced music education. Building on recent innovations resulting from the development of computer and information technologies, the project explores novel solutions for music training in both theory and performance, and exploits new pedagogical paradigms with cooperative and interactive self-learning environments, gesture interfaces, and augmented instruments. This paper presents a brief overview of the project, together with some highlights of selected tools.

Research paper thumbnail of Bringing Music Industry into the Interactive Multimedia Age

First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'05)

Abstract The MUSICNETWORK has been funded by the European Commission to help bringing music into ... more Abstract The MUSICNETWORK has been funded by the European Commission to help bringing music into the interactive multimedia era. It represents a Centre/Network of Excellence where music content providers, cultural institutions, industry, and research institutions work ...

Research paper thumbnail of A Novel Data Representation Method for 3D Model-Based Gesture Tracking

2006 2nd International Conference on Information & Communication Technologies

This paper introduces a new spline-based approach for the representation of object together with ... more This paper introduces a new spline-based approach for the representation of object together with an associated search method using best-curve matching technique. The targeted object is acquired from the video stream using a stereo camera. Many image processing ...

Research paper thumbnail of Metadata Editing and Mapping within the AXMEDIS Framework

Third International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'07), 2007

Metadata is increasingly used in the digital industry for content description. In line with this ... more Metadata is increasingly used in the digital industry for content description. In line with this emerging trend, the AXMEDIS framework has employed several kinds of metadata for describing digital items embedded in AXMEDIS Objects. This paper introduces the metadata utilised inside AXMEDIS Objects and presents the AXMEDIS Metadata Editor and Mapper which provide graphical user interface and tools for metadata

Research paper thumbnail of Automatic detection of tonality using note distribution

Journal of New Music Research, 1996

Western musical compositions written in the period of common-practice tonality tend to use key si... more Western musical compositions written in the period of common-practice tonality tend to use key signatures which are effectively a measure of their local harmonic 'weight'. The authors report a rule-based system for the automated detection of tonality which makes use of the total ...

Research paper thumbnail of Polyphonic note tracking using multimodal retrieval of musical events

Proceedings of the International …, 2008

This paper addresses the problem of retrieval of mu-sical events from a performance. Current stat... more This paper addresses the problem of retrieval of mu-sical events from a performance. Current state of the art transcription and score following systems extract features from the audio signal which are used to estimate what has been played in order to transcribe or find a position ...

Research paper thumbnail of ‘Unheard’ Sounds

Electronic Workshops in Computing, 2015

Research paper thumbnail of Interactive Multimedia for Technology-Enhanced Learning with Multimodal Feedback

Springer Tracts in Advanced Robotics, 2011

Musical performances are generally physically demanding with high degree of control (mental and m... more Musical performances are generally physically demanding with high degree of control (mental and motor) and accuracy. This chapter presents the i-Maestro (www.i-maestro.org) project which explored interactive multimedia environments for technology-enhanced music education. It discusses one of the key requirements for an interactive musical robot which is to analyze and provide feedback/interaction to a “performance”. This Chapter also serves as an

Research paper thumbnail of Eye.Breathe.Music: A Multimeadia Controller That Uses Eye Movement And Breathing

The Lumiselo is an instrument that is operated through moving the eyes and breathing through a tu... more The Lumiselo is an instrument that is operated through moving the eyes and breathing through a tube. A camera tracks the coordinates of the user’s pupil; a pressure sensor outputs a respective voltage according to how hard the user breathes into a closed pipe and a display communicates this back to the user. This paper performs background research, discussing the creation of the instrument and critically evaluates it on completion.

Research paper thumbnail of Electronic Visualisation and the Arts (EVA 2010) - Index

Electronic Workshops in Computing, 2010

Electronic Visualisation and the Arts London 2010 (EVA 2010) is co-sponsored by the Computer Arts... more Electronic Visualisation and the Arts London 2010 (EVA 2010) is co-sponsored by the Computer Arts Society and BCS, The Chartered Institute for IT, of which the Computer Arts Society is a specialist group. Since 1992, the EVA conference series has established itself as a natural home from which to explore the richly interdisciplinary and constantly evolving world of digital visualisation. Nothing illustrates this more than the great scope, depth and diversity of the papers contained within this year's Proceedings. The latest research in digital arts and new media are explored, with contributors ranging from established scholars to the new generation of research students who will lead the field tomorrow. Conference papers cover reconstructive archaeology, virtual museology, digital arts concepts and practice, immersive environments, and digital performance and music. Editors Alan Seal has recently worked as Head of Records and Collections Services in the Victoria and Albert Museum where he was responsible for the photographic services and archive in the museum and the automation and digitisation of the collections. He was previously head of collections management in the National Art Library in the V&A. A librarian by training, he is particularly interested in user interfaces and online public access systems, both textual and multi-media. He has undertaken research into bibliographic standards in information systems and online library catalogues during a period at the Centre for Catalogue Research at the University of Bath.

Research paper thumbnail of Electronic Visualisation and the Arts (EVA 2013) - Index

Electronic Workshops in Computing, 2013

Over almost two decades, the EVA London conference on Electronic Visualisation and the Arts has e... more Over almost two decades, the EVA London conference on Electronic Visualisation and the Arts has established itself as one of the United Kingdom's most innovative and interdisciplinary conferences. It brings together a wide range of research domains to celebrate a diverse range of interests with a specialised focus on visualisation. EVA London 2013 presents a wide spectrum of papers, presentations, demonstrations, an exhibition, and a research workshop. It is a forum where the sciences, arts, humanities and performance are equally at home. EVA London 2013 presents 66 papers and abstracts from 15 countries, by researchers inside and outside academia, from graduate artists, PhD students, seasoned industry professionals, established scholars and senior researchers, who value EVA London for its interdisciplinary community. This year, the conference features three keynote speakers: Prof. Steve DiPaola from Simon Fraser University (Canada); Prof. Linda Candy from the University of Technology (Australia); and Don McIntyre from the Glasgow School of Arts (United Kingdom). The proceedings has resulted from a highly selective peer review process, fitting as many excellent submissions as possible into the limited timetable of the conference. The papers cover digital culture and creativity, museum studies, digital enhanced reality, computer arts, 3D modelling, emotion, haptic, mobile, cross-media, multimodal interactivities and performances, as well as many other interdisciplinary areas. EVA London is part of a larger network of EVA international conferences. In the past twenty years, EVA events have been held in Athens,

Research paper thumbnail of Electronic Visualisation and the Arts (EVA 2015) - Index

Electronic Workshops in Computing, 2015

and it is a condition of accessing publications that users recognise and abide by the legal requi... more and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

Research paper thumbnail of Visualising Sound: Localisation, Feature Analysis and Visualisation

Electronic Workshops in Computing, 2012

Sound is an integral medium of communication in society. Despite its influence in everyday intera... more Sound is an integral medium of communication in society. Despite its influence in everyday interaction, the fundamental features of sound and its impact are not commonly understood and often not considered. Advanced dissection and analysis of sound is often used to aid technology's understanding of its environment (e.g. in robotics and telecommunications). The aim of this project is to utilise sound information technology to enhance our understanding of sound and how we process it. Visualisation can provide a more accessible representation of complex sound analysis, and so it is investigated here in the context of musical performance and interactive installation. This cross-modal experience is informed by the phenomenon of synaesthesia and creative mapping to express its subjectivity by providing a user-unique experience. In addition to results and user evaluations, the paper concludes with plans for future development, focusing on the impact of the interactive installation on the user and ways in which the technology developed can be used in creative interaction with sound.

Research paper thumbnail of Configuring a Haptic Interface for Music Performance

Electronic Workshops in Computing, 2015

Our daily interactions and perceptions involve multiple sensory multimodalities; most exchanges a... more Our daily interactions and perceptions involve multiple sensory multimodalities; most exchanges are inherently multimodal, playing an important part in our decoding and understanding of environments. Events can often engage multiple senses. Furthermore, musical experiences can be highly multisensory, with obvious auditory stimulation, the visual elements of a live performance, and physical stimulation of the body. In this paper, we will propose a means of incorporating an additional somatic channel of communication into live performances and compositional practice to further augment the physical nature of live performance. This work explores the integration of augmented vibratory, or haptic stimulation for audiences in live performance. The vibration interface is presented as an expressive and creative live performance-based tool for composers. Vibrations, or haptics, are implemented as an additional instrumental line, alongside auditory musical gestures, to expand the composer's palette of expressions through augmented somatic engagement. This paper will describe the background, and design and development of a haptic interface for the purpose of audio-haptic listening-feeling. The focus of this paper is to describe a study into motor latency for informing multimedia simultaneity.

Research paper thumbnail of LIVeMotion: A Multi-Sensory System to Encourage the Awareness of Mindfulness

Electronic Workshops in Computing, 2015

For stress management and well-being, there are many approaches that require heightened awareness... more For stress management and well-being, there are many approaches that require heightened awareness of different bodily motions. Based on psychological studies of physiological response to music, LIVeMotion integrates a range of multimedia technologies, exploring several different sensor measurements to monitor external and internal "motions". Sensor data analysis and feature detections are mapped to visualisation and sonification feedback to enhance awareness of one's consciousness of bodily movement. With a brief background on the relationship between stress, music, physiology, and related literature, this paper discusses design considerations and development. Using several specific Use Cases, the paper demonstrates different application scenarios with the proposed system.

Research paper thumbnail of AXMEDIS 2007 Conference Proceedings

Proceedings e report, 2007

The AXMEDIS International Conference series has been established since 2005 and is focused on the... more The AXMEDIS International Conference series has been established since 2005 and is focused on the research, developments and applications in the cross-media domain, exploring innovative technologies to meet the challenges of the sector. AXMEDIS2007 deals with all subjects and topics related to cross-media and digital-media content production, processing, management, standards, representation, sharing, interoperability, protection and rights management. It addresses the latest developments and future trends of the technologies and their applications, their impact and exploitation within academic, business and industrial communities.

Research paper thumbnail of Low- and high-level approaches to optical music score recognition

IEE Colloquium on Document Image Processing and Multimedia Environments, 1995

The computer has become an increasingly important device in music. It can not only generate sound... more The computer has become an increasingly important device in music. It can not only generate sound (audio synthesis) but is also able to perform time consuming and repetitive tasks, such as transposition and part extraction, witb speed and accuracy. However, a score must be ...

Research paper thumbnail of Proceedings of the 2002 Conference on New Instruments for Musical Expression (NIME-02),Dublin, Ireland, May 24-26, 2002 Situated Trio: An Interactive Live Performance for a

We describe a 15 to 20 minute interactive live perform- ance work entitled Situated Trio for augm... more We describe a 15 to 20 minute interactive live perform- ance work entitled Situated Trio for augmented guitar and two computer musicians with expressive controllers. This work brings into focus a number of issues concern- ing musically expressive control and interaction among performers.

Research paper thumbnail of Watermark: From Paper Texture to Digital Media

First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'05)

... from new paper without any foreground interference, and not concerned with detailed extractio... more ... from new paper without any foreground interference, and not concerned with detailed extraction and ... watermark shape from a collection of watermarked documents that hold the same watermarkdesign. 10. ... [1] NF Johnson, and S. Jajodia, “Exploring Steganography: Seeing the ...

Research paper thumbnail of Using 3D Visualisations of Motion Data for Collaborative Multimedia Music Learning and Playing

Research paper thumbnail of i-Maestro framework and interactive multimedia tools for technology-enhanced learning and teaching for music

The i-Maestro project (www.i-maestro.org) has been supported by the EC IST 6 th Framework Program... more The i-Maestro project (www.i-maestro.org) has been supported by the EC IST 6 th Framework Programme to develop interactive multimedia environments for technology enhanced music education. Building on recent innovations resulting from the development of computer and information technologies, the project explores novel solutions for music training in both theory and performance, and exploits new pedagogical paradigms with cooperative and interactive self-learning environments, gesture interfaces, and augmented instruments. This paper presents a brief overview of the project, together with some highlights of selected tools.

Research paper thumbnail of Bringing Music Industry into the Interactive Multimedia Age

First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'05)

Abstract The MUSICNETWORK has been funded by the European Commission to help bringing music into ... more Abstract The MUSICNETWORK has been funded by the European Commission to help bringing music into the interactive multimedia era. It represents a Centre/Network of Excellence where music content providers, cultural institutions, industry, and research institutions work ...

Research paper thumbnail of A Novel Data Representation Method for 3D Model-Based Gesture Tracking

2006 2nd International Conference on Information & Communication Technologies

This paper introduces a new spline-based approach for the representation of object together with ... more This paper introduces a new spline-based approach for the representation of object together with an associated search method using best-curve matching technique. The targeted object is acquired from the video stream using a stereo camera. Many image processing ...

Research paper thumbnail of Metadata Editing and Mapping within the AXMEDIS Framework

Third International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'07), 2007

Metadata is increasingly used in the digital industry for content description. In line with this ... more Metadata is increasingly used in the digital industry for content description. In line with this emerging trend, the AXMEDIS framework has employed several kinds of metadata for describing digital items embedded in AXMEDIS Objects. This paper introduces the metadata utilised inside AXMEDIS Objects and presents the AXMEDIS Metadata Editor and Mapper which provide graphical user interface and tools for metadata

Research paper thumbnail of Automatic detection of tonality using note distribution

Journal of New Music Research, 1996

Western musical compositions written in the period of common-practice tonality tend to use key si... more Western musical compositions written in the period of common-practice tonality tend to use key signatures which are effectively a measure of their local harmonic 'weight'. The authors report a rule-based system for the automated detection of tonality which makes use of the total ...

Research paper thumbnail of Polyphonic note tracking using multimodal retrieval of musical events

Proceedings of the International …, 2008

This paper addresses the problem of retrieval of mu-sical events from a performance. Current stat... more This paper addresses the problem of retrieval of mu-sical events from a performance. Current state of the art transcription and score following systems extract features from the audio signal which are used to estimate what has been played in order to transcribe or find a position ...