Willy Yvart - Academia.edu (original) (raw)
Papers by Willy Yvart
HAL (Le Centre pour la Communication Scientifique Directe), 2021
Cornell University - arXiv, Jan 19, 2018
Skeletal data acquisition generates a huge amount of highdimensionality data. In many fields wher... more Skeletal data acquisition generates a huge amount of highdimensionality data. In many fields where motion capture techniques are now used, practitioners would greatly benefit from high-level representations of these motion sequences. However meaningful motion data dimensionality reduction is not a trivial task and the selection of the best set of features will largely depend on the considered use case, hence enhancing the need for a fast customization and prototyping tool. In this work, we present a prototyping tool for motion representation and interaction design based on the MotionMachine framework, as well as use cases of new audiovisual instruments that use full-body motion to drive sound and visuals. These instruments have been developed using the proposed prototyping environment. The development of these instruments is a proof of concept and demonstrates the potential of an elaborate choice of higher-level feature extraction techniques in improving the human/computer interaction and leading to more expressive experiences.
Le Centre pour la Communication Scientifique Directe - HAL - Diderot, Oct 29, 2018
Le Centre pour la Communication Scientifique Directe - HAL - Diderot, Oct 29, 2018
Le serveur TEL (thèses-en-ligne), Dec 5, 2019
La musique au mètre, 2013
Le Centre pour la Communication Scientifique Directe - HAL - memSIC, 2015
The 11th Summer Workshop on Multimodal Interfaces eNTERFACE'15 was hosted by the Numediart Instit... more The 11th Summer Workshop on Multimodal Interfaces eNTERFACE'15 was hosted by the Numediart Institute of Creative Technologies of the University of Mons from August 10th to September 2015. During the four weeks, students and researchers from all over the world came together in the Numediart Institute of the University of Mons to work on eight selected projects structured around "multimodal interfaces". The eNTERFACE workshops aim at establishing a tradition of collaborative, localized research and development work by gathering, in a single place, a team of leading professionals in multimodal human-machine interfaces together with students (both graduate and undergraduate), to work on a prespecified list of challenges, for four complete weeks. In this respect, it is an innovative and intensive collaboration scheme, designed to allow researchers to integrate their software tools, deploy demonstrators, collect novel databases, and work side by side with a great number of experts. It brings together dozens of researchers for a whole month, subsequently it is the largest workshop on multimodal interfaces.
Proceedings of EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016, 2016
Even though the emotional state is increasingly taken into account in scientific studies aimed at... more Even though the emotional state is increasingly taken into account in scientific studies aimed at determining user experience of user acceptance, there are still only a few normalized tools. In this article, we decided to focus on mood determination as we consider this affective state to be more pervasive and more understandable by the person who is experiencing it. Thus, we propose a prototypical tool called SYM (Spot Your Mood) as a new tool in user mood determination to be used in many different situations.
Sound designers organize their sound libraries either with dedicated applications (often featurin... more Sound designers organize their sound libraries either with dedicated applications (often featuring spreadsheet views), or with default file browsers. Content-based research ap-plications have been favoring cloud-like similarity layouts. We propose a solution combining the advantages of these: after feature extraction and dimension reduction (Student-t Stochastic Neighbor Embedding), we apply a proximity grid, optimized to preserve nearest neighborhoods between the adjacent cells. By counting direct vertical / horizontal / diagonal neighbors, we compare this solution over a stan-dard layout: a grid ordered by filename. Our evaluation is performed on subsets of the One Laptop Per Child sound library, either selected by thematic folders, or filtered by tag. We also compare 3 layouts (grid by filename without visual icons, with visual icons, and proximity grid) by a user evaluation through known-item search tasks. This op-timization method can serve as a human-readable metric for the co...
Sound designers source sounds in massive collections, heav-ily tagged by themselves and sound lib... more Sound designers source sounds in massive collections, heav-ily tagged by themselves and sound librarians. For each query, once successive keywords attained a limit to filter down the results, hundreds of sounds are left to be reviewed. AudioMetro combines a new content-based information visu-alization technique with instant audio feedback to facilitate this part of their workflow. We show through user evalua-tions by known-item search in collections of textural sounds that a default grid layout ordered by filename unexpectedly outperforms content-based similarity layouts resulting from a recent dimension reduction technique (Student-t Stochas-tic Neighbor Embedding), even when complemented with content-based glyphs that emphasize local neighborhoods and cue perceptual features. We propose a solution bor-rowed from image browsing: a proximity grid, whose density we optimize for nearest neighborhood preservation among the closest cells. Not only does it remove overlap but we show thro...
Abstract. The recent decade has seen a rapid evolution in the field of digital media. Mobile devi... more Abstract. The recent decade has seen a rapid evolution in the field of digital media. Mobile devices are now being integrated into every aspect of urban life. GPS, sensor technologies and augmented reality have transformed the new generation of mobile devices from a communication and information platform into a navigational tool, fostering new ways of perceiving reality and image building. Touch sensor technology has changed the screen into a joint input and display device. In this paper we present the FlanoGraph, an application for smartphones and tablets designed to take benefit of the changes induced by mobile devices. We first briefly outline the conceptual background, evoking the work of some researchers in the fields of ‘Non Representational Theory’, mobile media, and computational data processing. We then present and describe the FlanoGraph through a set of use cases. Finally, we conclude discussing some techniques necessary for the development of the application.
Even though the emotional state is increasingly taken into account in scientific studies aimed at... more Even though the emotional state is increasingly taken into account in scientific studies aimed at determining user experience of user acceptance, there are still only a few normalized tools. In this article, we decided to focus on mood determination as we consider this affective state to be more pervasive and more understandable by the person who is experiencing it. Thus, we propose a prototypical tool called SYM (Spot Your Mood) as a new tool in user mood determination to be used in many different situations.
Qualification (a)verbale de l’humeur musicale : nouvelles perspectives pour la synchronisation da... more Qualification (a)verbale de l’humeur musicale : nouvelles perspectives pour la synchronisation dans l’audiovisuel La musique est presente dans tous les metrages produits par les industries audiovisuelles et cinematographiques. Elle peut preexister au film, avoir pour destination l’industrie traditionnelle de la musique ou etre specialement prevue pour etre synchronisee a des images. Dans ce cas, la musique recherchee est generalement perdue dans des bases de media musicaux disposant de leurs propres Systemes de Recherche d’Information (SRI). Alors que dans le monde anglo-saxon la profession de Music Supervisor (MS) permet d’allouer a cette tâche un vrai specialiste de l’utilisation de ces systemes, il n’en est pas de meme dans les productions d’Europe continentale. Des MS per accidens s’y trouvent devoir traduire l’humeur musicale desiree en requetes pour ces SRI qu’ils interrogent parfois pour la premiere fois. Dans l’optique de rendre cette tâche moins ardue pour des non-specialis...
HAL (Le Centre pour la Communication Scientifique Directe), 2021
Cornell University - arXiv, Jan 19, 2018
Skeletal data acquisition generates a huge amount of highdimensionality data. In many fields wher... more Skeletal data acquisition generates a huge amount of highdimensionality data. In many fields where motion capture techniques are now used, practitioners would greatly benefit from high-level representations of these motion sequences. However meaningful motion data dimensionality reduction is not a trivial task and the selection of the best set of features will largely depend on the considered use case, hence enhancing the need for a fast customization and prototyping tool. In this work, we present a prototyping tool for motion representation and interaction design based on the MotionMachine framework, as well as use cases of new audiovisual instruments that use full-body motion to drive sound and visuals. These instruments have been developed using the proposed prototyping environment. The development of these instruments is a proof of concept and demonstrates the potential of an elaborate choice of higher-level feature extraction techniques in improving the human/computer interaction and leading to more expressive experiences.
Le Centre pour la Communication Scientifique Directe - HAL - Diderot, Oct 29, 2018
Le Centre pour la Communication Scientifique Directe - HAL - Diderot, Oct 29, 2018
Le serveur TEL (thèses-en-ligne), Dec 5, 2019
La musique au mètre, 2013
Le Centre pour la Communication Scientifique Directe - HAL - memSIC, 2015
The 11th Summer Workshop on Multimodal Interfaces eNTERFACE'15 was hosted by the Numediart Instit... more The 11th Summer Workshop on Multimodal Interfaces eNTERFACE'15 was hosted by the Numediart Institute of Creative Technologies of the University of Mons from August 10th to September 2015. During the four weeks, students and researchers from all over the world came together in the Numediart Institute of the University of Mons to work on eight selected projects structured around "multimodal interfaces". The eNTERFACE workshops aim at establishing a tradition of collaborative, localized research and development work by gathering, in a single place, a team of leading professionals in multimodal human-machine interfaces together with students (both graduate and undergraduate), to work on a prespecified list of challenges, for four complete weeks. In this respect, it is an innovative and intensive collaboration scheme, designed to allow researchers to integrate their software tools, deploy demonstrators, collect novel databases, and work side by side with a great number of experts. It brings together dozens of researchers for a whole month, subsequently it is the largest workshop on multimodal interfaces.
Proceedings of EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016, 2016
Even though the emotional state is increasingly taken into account in scientific studies aimed at... more Even though the emotional state is increasingly taken into account in scientific studies aimed at determining user experience of user acceptance, there are still only a few normalized tools. In this article, we decided to focus on mood determination as we consider this affective state to be more pervasive and more understandable by the person who is experiencing it. Thus, we propose a prototypical tool called SYM (Spot Your Mood) as a new tool in user mood determination to be used in many different situations.
Sound designers organize their sound libraries either with dedicated applications (often featurin... more Sound designers organize their sound libraries either with dedicated applications (often featuring spreadsheet views), or with default file browsers. Content-based research ap-plications have been favoring cloud-like similarity layouts. We propose a solution combining the advantages of these: after feature extraction and dimension reduction (Student-t Stochastic Neighbor Embedding), we apply a proximity grid, optimized to preserve nearest neighborhoods between the adjacent cells. By counting direct vertical / horizontal / diagonal neighbors, we compare this solution over a stan-dard layout: a grid ordered by filename. Our evaluation is performed on subsets of the One Laptop Per Child sound library, either selected by thematic folders, or filtered by tag. We also compare 3 layouts (grid by filename without visual icons, with visual icons, and proximity grid) by a user evaluation through known-item search tasks. This op-timization method can serve as a human-readable metric for the co...
Sound designers source sounds in massive collections, heav-ily tagged by themselves and sound lib... more Sound designers source sounds in massive collections, heav-ily tagged by themselves and sound librarians. For each query, once successive keywords attained a limit to filter down the results, hundreds of sounds are left to be reviewed. AudioMetro combines a new content-based information visu-alization technique with instant audio feedback to facilitate this part of their workflow. We show through user evalua-tions by known-item search in collections of textural sounds that a default grid layout ordered by filename unexpectedly outperforms content-based similarity layouts resulting from a recent dimension reduction technique (Student-t Stochas-tic Neighbor Embedding), even when complemented with content-based glyphs that emphasize local neighborhoods and cue perceptual features. We propose a solution bor-rowed from image browsing: a proximity grid, whose density we optimize for nearest neighborhood preservation among the closest cells. Not only does it remove overlap but we show thro...
Abstract. The recent decade has seen a rapid evolution in the field of digital media. Mobile devi... more Abstract. The recent decade has seen a rapid evolution in the field of digital media. Mobile devices are now being integrated into every aspect of urban life. GPS, sensor technologies and augmented reality have transformed the new generation of mobile devices from a communication and information platform into a navigational tool, fostering new ways of perceiving reality and image building. Touch sensor technology has changed the screen into a joint input and display device. In this paper we present the FlanoGraph, an application for smartphones and tablets designed to take benefit of the changes induced by mobile devices. We first briefly outline the conceptual background, evoking the work of some researchers in the fields of ‘Non Representational Theory’, mobile media, and computational data processing. We then present and describe the FlanoGraph through a set of use cases. Finally, we conclude discussing some techniques necessary for the development of the application.
Even though the emotional state is increasingly taken into account in scientific studies aimed at... more Even though the emotional state is increasingly taken into account in scientific studies aimed at determining user experience of user acceptance, there are still only a few normalized tools. In this article, we decided to focus on mood determination as we consider this affective state to be more pervasive and more understandable by the person who is experiencing it. Thus, we propose a prototypical tool called SYM (Spot Your Mood) as a new tool in user mood determination to be used in many different situations.
Qualification (a)verbale de l’humeur musicale : nouvelles perspectives pour la synchronisation da... more Qualification (a)verbale de l’humeur musicale : nouvelles perspectives pour la synchronisation dans l’audiovisuel La musique est presente dans tous les metrages produits par les industries audiovisuelles et cinematographiques. Elle peut preexister au film, avoir pour destination l’industrie traditionnelle de la musique ou etre specialement prevue pour etre synchronisee a des images. Dans ce cas, la musique recherchee est generalement perdue dans des bases de media musicaux disposant de leurs propres Systemes de Recherche d’Information (SRI). Alors que dans le monde anglo-saxon la profession de Music Supervisor (MS) permet d’allouer a cette tâche un vrai specialiste de l’utilisation de ces systemes, il n’en est pas de meme dans les productions d’Europe continentale. Des MS per accidens s’y trouvent devoir traduire l’humeur musicale desiree en requetes pour ces SRI qu’ils interrogent parfois pour la premiere fois. Dans l’optique de rendre cette tâche moins ardue pour des non-specialis...