Rui Jesus - Academia.edu (original) (raw)
Papers by Rui Jesus
Proceedings of the 4th ACM workshop on Geographical information retrieval - GIR '07, 2007
Abstract This paper describes an application that is based on geographic queries to retrieve pers... more Abstract This paper describes an application that is based on geographic queries to retrieve personal pictures when visiting points of interest using mobile devices such as PDAs. The retrieved information can be visualized in different ways, including the spatial visualization of the pictures of the places visited. The paper describes the user interface features and the experiments that were made to illustrate the proposed methods.
ABSTRACT The identification of authorship of an important Portuguese artist, Amadeo de Souza-Card... more ABSTRACT The identification of authorship of an important Portuguese artist, Amadeo de Souza-Cardoso (1887-1918), by image processing techniques based both on spectral UV-VIS data and elemental analysis will be presented. Despite his youth, Amadeo was internationally acclaimed, and very successful at the most important International exhibitions, side by side with Brancusi, Cézanne, Delaunay, Gauguin, Matisse, Picasso, van Gogh, and others. Since he was rediscovered, at the end of the fifties, the value of his works increased and forgeries appeared in the art market. Here we develop hyperspectral image processing algorithms for pigment characterization and mapping, which combines molecular information (reflectance UV-VIS spectral data) with the identification of the chemical elements present. The data was obtained by hyperspectral imaging and X-ray Fluorescence spectrometry (EDXRF). Finally, we combine molecular information with computer based image processing to explore its potentiality as a routine tool in authentication studies of Amadeo's work.
ABSTRACT The shape, orientation and distribution of brushstrokes are distinctive markers left by ... more ABSTRACT The shape, orientation and distribution of brushstrokes are distinctive markers left by the artist on the surface of a painting. Consequently, they are useful as additional evidence to decide on issues of attribution and authenticity. This paper proposes an image classification algorithm for the paintings of Amadeo de Souza-Cardoso, a modern Portuguese artist who is at the top of the Portuguese police's list of forged artists. The proposed system is based on a binary classification using bag-of-features (SIFT descriptors and a Gabor filter) for image representation. Experimental results using the algorithm show that the classification of the paintings by extracting brushstroke information is very promising.
Proceedings of IADIS International Conference e- …, 2008
In the current literature there is emphasis that learners' ICT skills are critical to e-lear... more In the current literature there is emphasis that learners' ICT skills are critical to e-learning success (named e-skills in the context of this paper). Can this imply that more tech savvy students are best suited to get the top grades in e-learning? Or e-learning can help ...
5th EURASIP Conference focused …, 2005
... Rui M. Jesus 1 , Arnaldo J. Abrantes 1 and Jorge S. Marques 2 ... Automática, Instituto Super... more ... Rui M. Jesus 1 , Arnaldo J. Abrantes 1 and Jorge S. Marques 2 ... Automática, Instituto Superiorde Engenharia de Lisboa Rua Conselheiro Emıdio Navarro, n o 1, 1940-014 Lisboa, Portugal {rjesus,aja}@deetc.isel.ipl.pt 2 Instituto de Sistemas e ... John Wiley and Sons, 1977. 6
We describe our experiments for the shot boundary detection, high-level feature extraction and se... more We describe our experiments for the shot boundary detection, high-level feature extraction and search. In the shot boundary detection task, we employ our proven method based on the calculation of distances between colour histograms of frames over a range of timescales. For the search task, we tested a different system. This year, content based search is complemented with a new relevance feedback method. Results of one interactive run are presented to evaluate the performance of the new system. In the high-level feature detection task we tested two new methods: naïve model and non-parametric density estimation. We evaluated these models with all keywords.
Multimedia Information Retrieval, Jul 1, 2007
Social networks popularity has been increasing on the Web over the last years. These web sites pr... more Social networks popularity has been increasing on the Web over the last years. These web sites provide an easy way to share digital data between people with common interests. With this way of exchanging memories of personal experiences, large repositories of data are being created. Indeed personal media, like photos and videos, are excellent vehicles to exchange experiences, however to manage large multimedia databases suitable tools are needed. This paper describes a multimedia retrieval system to access the ...
Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems - CHI '08, 2008
Abstract This paper proposes and discusses the ASAA (Application for Semi-Automatic Annotation) i... more Abstract This paper proposes and discusses the ASAA (Application for Semi-Automatic Annotation) interface, a new computer game for image tagging. The application is composed by a 3D game interface, a game engine that uses a system for automatic image ...
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011
Relevant past events can be remembered when visualizing related pictures. The main difficulty is ... more Relevant past events can be remembered when visualizing related pictures. The main difficulty is how to find these photos in a large personal collection. Query definition and image annotation are key issues to overcome this problem. The former is relevant due to the diversity of the clues provided by our memory when recovering a past moment and the later because images need to be annotated with information regarding those clues to be retrieved. Consequently, tools to recover past memories should deal carefully with these two tasks. This paper describes a user interface designed to explore pictures from personal memories. Users can query the media collection in several ways and for this reason an iconic visual language to define queries is proposed. Automatic and semi-automatic annotation is also performed using the image content and the audio information obtained when users show their images to others. The paper also presents the user interface evaluation based on tests with 58 participants.
Proceedings of the 2008 International Conference in Advances on Computer Entertainment Technology - ACE '08, 2008
Abstract Manual annotation is difficult to perform in large image databases and the automatic met... more Abstract Manual annotation is difficult to perform in large image databases and the automatic methods deliver results that are far from what is desired by the users. New and fun ways to provide image annotation are required. This paper describes Tag Around, a ...
Lecture Notes in Computer Science, 2006
Abstract. This paper presents techniques for retrieving photos from personal memories collections... more Abstract. This paper presents techniques for retrieving photos from personal memories collections using generic concepts that the users specify. It is part of a larger project for capturing, storing, and retrieving personal memories in different contexts of use. Semantic concepts ...
Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '07, 2007
This project develops tools to manage personal memories that include a multimedia retrieval syste... more This project develops tools to manage personal memories that include a multimedia retrieval system and user interfaces for different devices. This paper and demonstration presents the mobile interface which allows browsing, retrieving, and taking pictures that are automatically annotated with GPS data and audio information. The multimedia retrieval system uses multimodal information: visual content, GPS metadata and audio information. The
Procedia Technology, 2014
ABSTRACT
2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008
Image annotation is hard to do in an automatic way. In this paper, we propose a framework for ima... more Image annotation is hard to do in an automatic way. In this paper, we propose a framework for image annotation that combines the benefits of three paradigms: automatic annotation, human intervention and entertainment activities. We also describe our proposal inside this ...
Multimedia Tools and Applications, 2011
Personal memories composed of digital pictures are very popular at the moment. To retrieve these ... more Personal memories composed of digital pictures are very popular at the moment. To retrieve these media items annotation is required. During the last years, several approaches have been proposed in order to overcome the image annotation problem. This paper presents our proposals to address this problem. Automatic and semi-automatic learning methods for semantic concepts are presented. The automatic method is based on semantic concepts estimated using visual content, context metadata and audio information. The semi-automatic method is based on results provided by a computer game. The paper describes our proposals and presents their evaluations.
Proceedings of the 4th ACM workshop on Geographical information retrieval - GIR '07, 2007
Abstract This paper describes an application that is based on geographic queries to retrieve pers... more Abstract This paper describes an application that is based on geographic queries to retrieve personal pictures when visiting points of interest using mobile devices such as PDAs. The retrieved information can be visualized in different ways, including the spatial visualization of the pictures of the places visited. The paper describes the user interface features and the experiments that were made to illustrate the proposed methods.
ABSTRACT The identification of authorship of an important Portuguese artist, Amadeo de Souza-Card... more ABSTRACT The identification of authorship of an important Portuguese artist, Amadeo de Souza-Cardoso (1887-1918), by image processing techniques based both on spectral UV-VIS data and elemental analysis will be presented. Despite his youth, Amadeo was internationally acclaimed, and very successful at the most important International exhibitions, side by side with Brancusi, Cézanne, Delaunay, Gauguin, Matisse, Picasso, van Gogh, and others. Since he was rediscovered, at the end of the fifties, the value of his works increased and forgeries appeared in the art market. Here we develop hyperspectral image processing algorithms for pigment characterization and mapping, which combines molecular information (reflectance UV-VIS spectral data) with the identification of the chemical elements present. The data was obtained by hyperspectral imaging and X-ray Fluorescence spectrometry (EDXRF). Finally, we combine molecular information with computer based image processing to explore its potentiality as a routine tool in authentication studies of Amadeo's work.
ABSTRACT The shape, orientation and distribution of brushstrokes are distinctive markers left by ... more ABSTRACT The shape, orientation and distribution of brushstrokes are distinctive markers left by the artist on the surface of a painting. Consequently, they are useful as additional evidence to decide on issues of attribution and authenticity. This paper proposes an image classification algorithm for the paintings of Amadeo de Souza-Cardoso, a modern Portuguese artist who is at the top of the Portuguese police's list of forged artists. The proposed system is based on a binary classification using bag-of-features (SIFT descriptors and a Gabor filter) for image representation. Experimental results using the algorithm show that the classification of the paintings by extracting brushstroke information is very promising.
Proceedings of IADIS International Conference e- …, 2008
In the current literature there is emphasis that learners' ICT skills are critical to e-lear... more In the current literature there is emphasis that learners' ICT skills are critical to e-learning success (named e-skills in the context of this paper). Can this imply that more tech savvy students are best suited to get the top grades in e-learning? Or e-learning can help ...
5th EURASIP Conference focused …, 2005
... Rui M. Jesus 1 , Arnaldo J. Abrantes 1 and Jorge S. Marques 2 ... Automática, Instituto Super... more ... Rui M. Jesus 1 , Arnaldo J. Abrantes 1 and Jorge S. Marques 2 ... Automática, Instituto Superiorde Engenharia de Lisboa Rua Conselheiro Emıdio Navarro, n o 1, 1940-014 Lisboa, Portugal {rjesus,aja}@deetc.isel.ipl.pt 2 Instituto de Sistemas e ... John Wiley and Sons, 1977. 6
We describe our experiments for the shot boundary detection, high-level feature extraction and se... more We describe our experiments for the shot boundary detection, high-level feature extraction and search. In the shot boundary detection task, we employ our proven method based on the calculation of distances between colour histograms of frames over a range of timescales. For the search task, we tested a different system. This year, content based search is complemented with a new relevance feedback method. Results of one interactive run are presented to evaluate the performance of the new system. In the high-level feature detection task we tested two new methods: naïve model and non-parametric density estimation. We evaluated these models with all keywords.
Multimedia Information Retrieval, Jul 1, 2007
Social networks popularity has been increasing on the Web over the last years. These web sites pr... more Social networks popularity has been increasing on the Web over the last years. These web sites provide an easy way to share digital data between people with common interests. With this way of exchanging memories of personal experiences, large repositories of data are being created. Indeed personal media, like photos and videos, are excellent vehicles to exchange experiences, however to manage large multimedia databases suitable tools are needed. This paper describes a multimedia retrieval system to access the ...
Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems - CHI '08, 2008
Abstract This paper proposes and discusses the ASAA (Application for Semi-Automatic Annotation) i... more Abstract This paper proposes and discusses the ASAA (Application for Semi-Automatic Annotation) interface, a new computer game for image tagging. The application is composed by a 3D game interface, a game engine that uses a system for automatic image ...
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011
Relevant past events can be remembered when visualizing related pictures. The main difficulty is ... more Relevant past events can be remembered when visualizing related pictures. The main difficulty is how to find these photos in a large personal collection. Query definition and image annotation are key issues to overcome this problem. The former is relevant due to the diversity of the clues provided by our memory when recovering a past moment and the later because images need to be annotated with information regarding those clues to be retrieved. Consequently, tools to recover past memories should deal carefully with these two tasks. This paper describes a user interface designed to explore pictures from personal memories. Users can query the media collection in several ways and for this reason an iconic visual language to define queries is proposed. Automatic and semi-automatic annotation is also performed using the image content and the audio information obtained when users show their images to others. The paper also presents the user interface evaluation based on tests with 58 participants.
Proceedings of the 2008 International Conference in Advances on Computer Entertainment Technology - ACE '08, 2008
Abstract Manual annotation is difficult to perform in large image databases and the automatic met... more Abstract Manual annotation is difficult to perform in large image databases and the automatic methods deliver results that are far from what is desired by the users. New and fun ways to provide image annotation are required. This paper describes Tag Around, a ...
Lecture Notes in Computer Science, 2006
Abstract. This paper presents techniques for retrieving photos from personal memories collections... more Abstract. This paper presents techniques for retrieving photos from personal memories collections using generic concepts that the users specify. It is part of a larger project for capturing, storing, and retrieving personal memories in different contexts of use. Semantic concepts ...
Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '07, 2007
This project develops tools to manage personal memories that include a multimedia retrieval syste... more This project develops tools to manage personal memories that include a multimedia retrieval system and user interfaces for different devices. This paper and demonstration presents the mobile interface which allows browsing, retrieving, and taking pictures that are automatically annotated with GPS data and audio information. The multimedia retrieval system uses multimodal information: visual content, GPS metadata and audio information. The
Procedia Technology, 2014
ABSTRACT
2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008
Image annotation is hard to do in an automatic way. In this paper, we propose a framework for ima... more Image annotation is hard to do in an automatic way. In this paper, we propose a framework for image annotation that combines the benefits of three paradigms: automatic annotation, human intervention and entertainment activities. We also describe our proposal inside this ...
Multimedia Tools and Applications, 2011
Personal memories composed of digital pictures are very popular at the moment. To retrieve these ... more Personal memories composed of digital pictures are very popular at the moment. To retrieve these media items annotation is required. During the last years, several approaches have been proposed in order to overcome the image annotation problem. This paper presents our proposals to address this problem. Automatic and semi-automatic learning methods for semantic concepts are presented. The automatic method is based on semantic concepts estimated using visual content, context metadata and audio information. The semi-automatic method is based on results provided by a computer game. The paper describes our proposals and presents their evaluations.