Mehdi Elahi | Politecnico di Milano (original) (raw)
Papers by Mehdi Elahi
Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence... more Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence and success of online streaming services, which nowadays make available almost all music in the world at the user's fingertip. While today's MRSs considerably help users to find interesting music in these huge catalogs, MRS research is still facing substantial challenges. In particular when it comes to build, incorporate, and evaluate recommendation strategies that integrate information beyond simple user-item interactions or content-based descriptors, but dig deep into the very essence of listener needs, preferences, and intentions, MRS research becomes a big endeavor and related publications quite sparse. The purpose of this trends and survey article is twofold. We first identify and shed light on what we believe are the most pressing challenges MRS research is facing, from both academic and industry perspectives. We review the state of the art toward solving these challenges and discuss its limitations. Second, we detail possible future directions and visions we contemplate for the further evolution of the field. The article should therefore serve two purposes: giving the interested reader an overview of current challenges in MRS research and providing guidance for young researchers by identifying interesting, yet under-researched, directions in the field.
Users of a recommender system may be requested to express their preferences about items either wi... more Users of a recommender system may be requested to express their
preferences about items either with evaluations of items (e.g. a
rating) or with comparisons of item pairs. In this work we focus
on the acquisition of pairwise preferences in the music domain.
Asking the user to explicitly compare music, i.e., which, among
two listened tracks, is preferred, requires some user effort.We have
therefore developed a novel approach for automatically extracting
these preferences from the analysis of the facial expressions of the
users while listening to the compared tracks. We have trained a
predictor that infers user’s pairwise preferences by using features
extracted from these data. We show that the predictor performs
better than a commonly used baseline, which leverages the user’s
listening duration of the tracks to infer pairwise preferences. Furthermore,
we show that there are differences in the accuracy of the
proposed method between users with different personalities and
we have therefore adapted the trained model accordingly. Our work
shows that by introducing a low user effort preference elicitation
approach, which, however, requires to access information that may
raise potential privacy issues (face expression), one can obtain good
prediction accuracy of pairwise music preferences.
The Internet of Things (IoT) enables new ways for exploiting the synergy between the physical and... more The Internet of Things (IoT) enables new ways for exploiting the synergy between the physical and the digital world and therefore promises a more direct and active interaction between tourists and local products and places. In this article we show how, by distributing sensors/actuators in the environment or attaching them to objects, one can sense, trace and respond to users' actions onsite. Our research method analysis specific scenarios (case studies) of tangible interaction. We first discuss important issues, which were identified in these scenarios, and are related to log analysis, system usability, and extended models for learning user preferences. Then, the lessons learned in these specific cases have informed the constructive design of a wider scope infrastructure, which is here described and motivated. We envisage the tight integration of localized IoT solutions into a comprehensive mobile information system for tourism.
In the last years, there has been much aaention given to the semantic gap problem in multimedia r... more In the last years, there has been much aaention given to the semantic gap problem in multimedia retrieval systems. Much eeort has been devoted to bridge this gap by building tools for the extraction of high-level, semantics-based features from multimedia content, as low-level features are not considered useful because they deal primarily with representing the perceived content rather than the semantics of it. In this paper, we explore a diierent point of view by leveraging the gap between low-level and high-level features. We experiment with a recent approach for movie recommendation that extract low-level Mise-en-Scène features from multimedia content and combine it with high-level features provided by the wisdom of the crowd. To this end, we rst performed an ooine performance assessment by implementing a pure content-based recommender system with three diierent versions of the same algorithm, respectively based on (i) conventional movie aaributes, (ii) mise-en-scène features , and (iii) a hybrid method that interleaves recommendations based on movie aaributes and mise-en-scène features. In a second study, we designed an empirical study involving 100 subjects and collected data regarding the quality perceived by the users. Results from both studies show that the introduction of mise-en-scène features in conjunction with traditional movie aaributes improves both ooine and online quality of recommendations.
Children, nowadays, are great consumers of media for them [6], and there is growing interest towa... more Children, nowadays, are great consumers of media for them [6], and there is growing interest towards novel mechanisms that can consider their specific needs and improve both the recommendation process and output of videos for them. Children, in fact, have unique characteristics , which change with age. In particular, in the 8–12 age range, they like challenging interactions with systems, they enjoy exploring and " to feel the experts ". The majority of current recommendation solutions are unable to leverage on such specific features of children, and others, when interacting with them and recommending adequate videos. In this paper, we introduce ITTuB, an exploratory project, set at the intersection of recommender system and interaction design for children. Starting from previous research in the two areas, it plans to introduce tangibles for enhancing the interaction of children with videos, and to leverage stylistic features of videos in order to deliver recommendations that are optimized for children. This workshop paper presents the main ideas of ITTuB.
Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence... more Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence and success of online streaming services, which nowadays make available almost all music in the world at the user's fingertip. While today's MRSs considerably help users to find interesting music in these huge catalogs, MRS research is still facing substantial challenges. In particular when it comes to build, incorporate, and evaluate recommendation strategies that integrate information beyond simple user–item interactions or content-based descriptors, but dig deep into the very essence of listener needs, preferences, and intentions, MRS research becomes a big endeavor and related publications quite sparse. The purpose of this trends and survey article is twofold. We first identify and shed light on what we believe are the most pressing challenges MRS research is facing, from both academic and industry perspectives. We review the state of the art toward solving these challenges and discuss its limitations. Second, we detail possible future directions and visions we contemplate for the further evolution of the field. The article should therefore serve two purposes: giving the interested reader an overview of current challenges in MRS research and providing guidance for young researchers by identifying interesting, yet under-researched, directions in the field.
Item features play an important role in movie recommender systems, where recommendations can be g... more Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on traditional features (attributes) such as tag, genre, and cast. Typically, movie features are human-generated, either editorially (e.g., genre and cast) or by leveraging the wisdom of the crowd (e.g., tag), and as such, they are prone to noise and are expensive to collect. Moreover, these features are often rare or absent for new items, making it difficult or even impossible to provide good quality recommendations. In this paper, we show that users' preferences on movies can be well or even better described in terms of the mise-en-scène features, i.e., the visual aspects of a movie that characterize design, aesthetics and style (e.g., colors, textures). We use both MPEG-7 visual descriptors and Deep Learning hidden layers as examples of mise-en-scène features that can visually describe movies. These features can be computed automatically from any video file, offering the flexibility in handling new items, avoiding the need for costly and error-prone human-based tagging, and providing good scalability. We have conducted a set of experiments on a large catalog of 4K movies. Results show that recommendations based on mise-en-scène features consistently outperform traditional metadata attributes (e.g., genre and tag).
User Modeling and User-Adapted Interaction, 2016
The new user problem in recommender systems is still challenging , and there is not yet a unique ... more The new user problem in recommender systems is still challenging , and there is not yet a unique solution that can be applied in any domain or situation. In this paper we analyze viable solutions to the new user problem in collaborative filtering that are based on the exploitation of user personality information: (a) personality-based collaborative filtering, which directly improves the recommendation prediction model by incorporating user personality information; (b) personality-based active learning, which utilizes personality information for identifying additional useful preference data in the target recommendation domain to be elicited from the user; and (c) personality-based cross-domain recommendation, which exploits personality information to better use user preference data from auxiliary domains which can be used to compensate the lack of user preference data in the target domain. We benchmark the effectiveness of these methods on large datasets that span several domains, namely movies, music and books. Our results show that personality-aware methods achieve performance improvements that range from 6% to 94% for users completely new to the system, while increasing the novelty of the recommended items by 3% to 40% with respect to the non-personalized popularity baseline. We also discuss the limitations of our approach and the situations in which the proposed methods can be better applied, hence providing guidelines for researchers and practitioners in the field.
Lecture Notes in Computer Science, 2013
Recommender systems (RSs) suffer from the cold-start or new user/item problem, i.e., the impossib... more Recommender systems (RSs) suffer from the cold-start or new user/item problem, i.e., the impossibility to provide a new user with accurate recommendations or to recommend new items. Active learning (AL) addresses this problem by actively selecting items to be presented to the user in order to acquire her ratings and hence improve the output of the RS. In this paper, we propose a novel AL approach that exploits the user's personality -using the Five Factor Model (FFM) -in order to identify the items that the user is requested to rate. We have evaluated our approach in a user study by integrating it into a mobile, contextaware RS that provides users with recommendations for places of interest (POIs). We show that the proposed AL approach significantly increases the number of ratings acquired from the user and the recommendation accuracy.
Item features play an important role in movie recommender systems, where recommendations can be g... more Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on traditional features (attributes) such as tag, genre, and cast. Typically, movie features are human-generated, either editorially (e.g., genre and cast) or by leveraging the wisdom of the crowd (e.g., tag), and as such, they are prone to noise and are expensive to collect. Moreover, these features are often rare or absent for new items, making it difficult or even impossible to provide good quality recommendations. In this paper, we show that user's preferences on movies can be better described in terms of the Mise-en-Scène features , i.e., the visual aspects of a movie that characterize design, aesthetics and style (e.g., colors, textures). We use both MPEG-7 visual descriptors and Deep Learning hidden layers as example of mise-en-scène features that can visually describe movies. Interestingly, mise-en-scène features can be computed automatically from video files or even from trailers , offering more flexibility in handling new items, avoiding the need for costly and error-prone human-based tagging, and providing good scalability. We have conducted a set of experiments on a large catalogue of 4K movies. Results show that recommendations based on mise-en-scène features consistently provide the best performance with respect to richer sets of more traditional features, such as genre and tag.
This paper proposes a novel adaptive algorithm for the automated short-term trading of financial ... more This paper proposes a novel adaptive algorithm for the automated short-term trading of financial instrument. The algorithm adopts a semantic sentiment analysis technique to inspect the Twitter posts and to use them to predict the behaviour of the stock market. Indeed, the algorithm is specifically developed to take advantage of both the sentiment and the past values of a certain financial instrument in order to choose the best investment decision. This allows the algorithm to ensure the maximization of the obtainable profits by trading on the stock market. We have conducted an investment simulation and compared the performance of our proposed with a well-known benchmark (DJTATO index) and the optimal results, in which an investor knows in advance the future price of a product. The result shows that our approach outperforms the benchmark and achieves the performance score close to the optimal result.
Previous works have shown the effectiveness of using stylistic visual features, indicative of the... more Previous works have shown the effectiveness of using stylistic visual features, indicative of the movie style, in content-based movie recommendation. However, they have mainly focused on a particular recommendation scenario, i.e. , when a new movie is added to the catalogue and no information is available for that movie (New Item scenario). However , the stylistic visual features can be also used when other sources of information is available (Existing Item scenario). In this work, we address the second scenario and propose a hybrid technique that exploits not only the typical content available for the movies (e.g., tags), but also the stylistic visual content extracted form the movie files and fuse them by applying a fusion method called Canonical Correlation Analysis (CCA). Our experiments on a large catalogue of 13K movies have shown very promising results which indicates a considerable improvement of the recommendation quality by using a proper fusion of the stylistic visual features with other type of features.
Design Patterns (DPs) are acknowledged as powerful conceptual tools to improve design quality and... more Design Patterns (DPs) are acknowledged as powerful conceptual tools to improve design quality and to reduce time and cost of the development process by effect of the reuse of " good " design solutions. In many fields (e.g., software engineering, web engineering, interface design) patterns are widely used by practitioners and are also investigated from a research perspective. Still, they have been seldom explored in the arena of Recommender Systems (RSs). RSs provide suggestions (" recommendations ") for items that are likely to be appropriate for the user profile, and are increasingly adopted in content-intensive multimedia applications. to complement traditional forms of search in large information spaces. This paper explores RSs through the lens of User Interface (UI) Design Patterns. We have performed a systematic analysis of 54 recommendation-empowered content-intensive multimedia applications, in order to: (i) discover the occurrences of existing domain independent UI patterns; (ii) identify frequently adopted UI solutions that are not modelled by existing patterns, and define a set of new UI patterns, some of which are specific of the interfaces for recommendation features while others can be useful also in a broader context. The results of our inspection have been discussed with and evaluated by a team of experts, leading to a consolidated set of 14 new patterns that are reported in the paper. Reusing pattern-based design solutions instead of building new solutions from scratch enables novice and expert designers to build good UIs for Recommendation-empowered content intensive multimedia applications more effectively, and ultimately can improve the UX experience in this class of systems. From a broader perspective, our work can stimulate future research bridging Recommender Systems, Web Engineering and Interface Design by means of Design Patterns, and highlights new research directions also discussed in the paper.
Item features play an important role in movie recommender systems, where recommendations can be g... more Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on attributes such as genres. Traditionally, movie features are human-generated, either editorially or by leveraging the wisdom of the crowd. In this short paper, we present a recommender system for movies based of Factorization Machines that makes use of the low-level visual features extracted automatically from movies as side information. Low-level visual features – such as lighting, colors and motion – represent the design aspects of a movie and characterize its aesthetic and style. Our experiments on a dataset of more than 13K movies show that recommendations based on low-level visual features provides almost 10 times better accuracy in comparison to genre based recommendations, in terms of various evaluation metrics.
In this paper, we present an ongoing work that will ultimately result in a movie recommender syst... more In this paper, we present an ongoing work that will ultimately result in a movie recommender system based on the Mise-en-Scène characteristics of the movies. We believe that the preferences of users on movies can be well described in terms of the mise-en-scène, i.e., the design aspects of movie making influencing aesthetic and style. Examples of mise-en-scène characteristics are Lighting, colors, background, and movements. Our recommender system opens new opportunities in the design of new user interfaces able to offer a personalized way to search for interesting movies through the analysis of film styles rather than using the traditional classifications of movies based on explicit attributes such as genre and cast.
In collaborative filtering recommender systems user's preferences are expressed as ratings for it... more In collaborative filtering recommender systems user's preferences are expressed as ratings for items, and each additional rating extends the knowledge of the system and affects the system's recommendation accuracy. In general, the more ratings are elicited from the users, the more effective the recommendations are. However, the usefulness of each rating may vary significantly, i.e., different ratings may bring a different amount and type of information about the user's tastes. Hence, specific techniques, which are defined as " active learning strategies " , can be used to selectively choose the items to be presented to the user for rating. In fact, an active learning strategy identifies and adopts criteria for obtaining data that better reflects users' preferences and enables to generate better recommendations. So far, a variety of active learning strategies have been proposed in the literature. In this article, we survey recent strategies by grouping them with respect to two distinct dimensions: personalization, i.e., whether the system selected items are different for different users or not, and, hybridization, i.e., whether active learning is guided by a single criterion (heuristic) or by multiple criteria. In addition, we present a comprehensive overview of the evaluation methods and metrics that have been employed by the research community in order to test active learning strategies for collaborative filtering. Finally, we compare the surveyed strategies and provide guidelines for their usage in recommender systems.
This paper investigates the use of automatically extracted visual features of videos in the conte... more This paper investigates the use of automatically extracted visual features of videos in the context of recommender systems and brings some novel contributions in the domain of video recommendations. We propose a new content-based recommender system that encompasses a technique to automatically analyze video contents and to extract a set of representative stylistic features (lighting, color, and motion) grounded on existing approaches of Applied Media Theory. The evaluation of the proposed recommendations, assessed w.r.t. relevance metrics (e.g., recall) and compared with existing content-based recommender systems that exploit explicit features such as movie genre, shows that our technique leads to more accurate recommendations. Our proposed technique achieves better results not only when visual features are extracted from full-length videos, but also when the feature extraction technique operates on movie trailers, pinpointing that our approach is effective also when full-length videos are not available or when there are performance requirements. Our recommender can be used in combination with more traditional content-based recommendation techniques that exploit explicit content features associated to video files, to improve the accuracy of recommendations. Our recommender can also be used alone, to address the problem originated from video files that have no meta-data, a typical situation of popular movie-sharing websites (e.g., YouTube) where every day hundred millions of hours of videos are uploaded by users and may contain no associated information. As they lack explicit content, these items cannot be considered for recommendation purposes by conventional content-based techniques even when they could be relevant for the user.
The new user problem in recommender systems is still challenging , and there is not yet a unique ... more The new user problem in recommender systems is still challenging , and there is not yet a unique solution that can be applied in any domain or situation. In this paper we analyze viable solutions to the new user problem in collaborative filtering that are based on the exploitation of user personality information: (a) personality-based collaborative filtering, which directly improves the recommendation prediction model by incorporating user personality information; (b) personality-based active learning, which utilizes personality information for identifying additional useful preference data in the target recommendation domain to be elicited from the user; and (c) personality-based cross-domain recommendation, which exploits personality information to better use user preference data from auxiliary domains which can be used to compensate the lack of user preference data in the target domain. We benchmark the effectiveness of these methods on large datasets that span several domains, namely movies, music and books. Our results show that personality-aware methods achieve performance improvements that range from 6% to 94% for users completely new to the system, while increasing the novelty of the recommended items by 3% to 40% with respect to the non-personalized popularity baseline. We also discuss the limitations of our approach and the situations in which the proposed methods can be better applied, hence providing guidelines for researchers and practitioners in the field.
One of the challenges in video recommendation systems is the New Item problem, which happens when... more One of the challenges in video recommendation systems is the New Item problem, which happens when the system is unable to recommend video items, that no information is available about them. For example, in the popular movie-sharing websites, such as Youtube, everyday , hundred millions of hours of videos are uploaded and big portion of these videos may not contain any meta-data, to be used by the system to generate recommendations. In this paper, we address this problem by proposing a method, that is based on automatic analysis of the video content in order to extract a number representative low-level visual features. Such features are then used to generate personalized content-based recommendations. Our evaluation shows that our proposed method can outperform the baselines, by producing more relevant recommendations. Hence, a set low-level features extracted automatically can be more descriptive and informative of the video content than a set of high-level expert annotated features.
Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence... more Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence and success of online streaming services, which nowadays make available almost all music in the world at the user's fingertip. While today's MRSs considerably help users to find interesting music in these huge catalogs, MRS research is still facing substantial challenges. In particular when it comes to build, incorporate, and evaluate recommendation strategies that integrate information beyond simple user-item interactions or content-based descriptors, but dig deep into the very essence of listener needs, preferences, and intentions, MRS research becomes a big endeavor and related publications quite sparse. The purpose of this trends and survey article is twofold. We first identify and shed light on what we believe are the most pressing challenges MRS research is facing, from both academic and industry perspectives. We review the state of the art toward solving these challenges and discuss its limitations. Second, we detail possible future directions and visions we contemplate for the further evolution of the field. The article should therefore serve two purposes: giving the interested reader an overview of current challenges in MRS research and providing guidance for young researchers by identifying interesting, yet under-researched, directions in the field.
Users of a recommender system may be requested to express their preferences about items either wi... more Users of a recommender system may be requested to express their
preferences about items either with evaluations of items (e.g. a
rating) or with comparisons of item pairs. In this work we focus
on the acquisition of pairwise preferences in the music domain.
Asking the user to explicitly compare music, i.e., which, among
two listened tracks, is preferred, requires some user effort.We have
therefore developed a novel approach for automatically extracting
these preferences from the analysis of the facial expressions of the
users while listening to the compared tracks. We have trained a
predictor that infers user’s pairwise preferences by using features
extracted from these data. We show that the predictor performs
better than a commonly used baseline, which leverages the user’s
listening duration of the tracks to infer pairwise preferences. Furthermore,
we show that there are differences in the accuracy of the
proposed method between users with different personalities and
we have therefore adapted the trained model accordingly. Our work
shows that by introducing a low user effort preference elicitation
approach, which, however, requires to access information that may
raise potential privacy issues (face expression), one can obtain good
prediction accuracy of pairwise music preferences.
The Internet of Things (IoT) enables new ways for exploiting the synergy between the physical and... more The Internet of Things (IoT) enables new ways for exploiting the synergy between the physical and the digital world and therefore promises a more direct and active interaction between tourists and local products and places. In this article we show how, by distributing sensors/actuators in the environment or attaching them to objects, one can sense, trace and respond to users' actions onsite. Our research method analysis specific scenarios (case studies) of tangible interaction. We first discuss important issues, which were identified in these scenarios, and are related to log analysis, system usability, and extended models for learning user preferences. Then, the lessons learned in these specific cases have informed the constructive design of a wider scope infrastructure, which is here described and motivated. We envisage the tight integration of localized IoT solutions into a comprehensive mobile information system for tourism.
In the last years, there has been much aaention given to the semantic gap problem in multimedia r... more In the last years, there has been much aaention given to the semantic gap problem in multimedia retrieval systems. Much eeort has been devoted to bridge this gap by building tools for the extraction of high-level, semantics-based features from multimedia content, as low-level features are not considered useful because they deal primarily with representing the perceived content rather than the semantics of it. In this paper, we explore a diierent point of view by leveraging the gap between low-level and high-level features. We experiment with a recent approach for movie recommendation that extract low-level Mise-en-Scène features from multimedia content and combine it with high-level features provided by the wisdom of the crowd. To this end, we rst performed an ooine performance assessment by implementing a pure content-based recommender system with three diierent versions of the same algorithm, respectively based on (i) conventional movie aaributes, (ii) mise-en-scène features , and (iii) a hybrid method that interleaves recommendations based on movie aaributes and mise-en-scène features. In a second study, we designed an empirical study involving 100 subjects and collected data regarding the quality perceived by the users. Results from both studies show that the introduction of mise-en-scène features in conjunction with traditional movie aaributes improves both ooine and online quality of recommendations.
Children, nowadays, are great consumers of media for them [6], and there is growing interest towa... more Children, nowadays, are great consumers of media for them [6], and there is growing interest towards novel mechanisms that can consider their specific needs and improve both the recommendation process and output of videos for them. Children, in fact, have unique characteristics , which change with age. In particular, in the 8–12 age range, they like challenging interactions with systems, they enjoy exploring and " to feel the experts ". The majority of current recommendation solutions are unable to leverage on such specific features of children, and others, when interacting with them and recommending adequate videos. In this paper, we introduce ITTuB, an exploratory project, set at the intersection of recommender system and interaction design for children. Starting from previous research in the two areas, it plans to introduce tangibles for enhancing the interaction of children with videos, and to leverage stylistic features of videos in order to deliver recommendations that are optimized for children. This workshop paper presents the main ideas of ITTuB.
Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence... more Music recommender systems (MRSs) have experienced a boom in recent years, thanks to the emergence and success of online streaming services, which nowadays make available almost all music in the world at the user's fingertip. While today's MRSs considerably help users to find interesting music in these huge catalogs, MRS research is still facing substantial challenges. In particular when it comes to build, incorporate, and evaluate recommendation strategies that integrate information beyond simple user–item interactions or content-based descriptors, but dig deep into the very essence of listener needs, preferences, and intentions, MRS research becomes a big endeavor and related publications quite sparse. The purpose of this trends and survey article is twofold. We first identify and shed light on what we believe are the most pressing challenges MRS research is facing, from both academic and industry perspectives. We review the state of the art toward solving these challenges and discuss its limitations. Second, we detail possible future directions and visions we contemplate for the further evolution of the field. The article should therefore serve two purposes: giving the interested reader an overview of current challenges in MRS research and providing guidance for young researchers by identifying interesting, yet under-researched, directions in the field.
Item features play an important role in movie recommender systems, where recommendations can be g... more Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on traditional features (attributes) such as tag, genre, and cast. Typically, movie features are human-generated, either editorially (e.g., genre and cast) or by leveraging the wisdom of the crowd (e.g., tag), and as such, they are prone to noise and are expensive to collect. Moreover, these features are often rare or absent for new items, making it difficult or even impossible to provide good quality recommendations. In this paper, we show that users' preferences on movies can be well or even better described in terms of the mise-en-scène features, i.e., the visual aspects of a movie that characterize design, aesthetics and style (e.g., colors, textures). We use both MPEG-7 visual descriptors and Deep Learning hidden layers as examples of mise-en-scène features that can visually describe movies. These features can be computed automatically from any video file, offering the flexibility in handling new items, avoiding the need for costly and error-prone human-based tagging, and providing good scalability. We have conducted a set of experiments on a large catalog of 4K movies. Results show that recommendations based on mise-en-scène features consistently outperform traditional metadata attributes (e.g., genre and tag).
User Modeling and User-Adapted Interaction, 2016
The new user problem in recommender systems is still challenging , and there is not yet a unique ... more The new user problem in recommender systems is still challenging , and there is not yet a unique solution that can be applied in any domain or situation. In this paper we analyze viable solutions to the new user problem in collaborative filtering that are based on the exploitation of user personality information: (a) personality-based collaborative filtering, which directly improves the recommendation prediction model by incorporating user personality information; (b) personality-based active learning, which utilizes personality information for identifying additional useful preference data in the target recommendation domain to be elicited from the user; and (c) personality-based cross-domain recommendation, which exploits personality information to better use user preference data from auxiliary domains which can be used to compensate the lack of user preference data in the target domain. We benchmark the effectiveness of these methods on large datasets that span several domains, namely movies, music and books. Our results show that personality-aware methods achieve performance improvements that range from 6% to 94% for users completely new to the system, while increasing the novelty of the recommended items by 3% to 40% with respect to the non-personalized popularity baseline. We also discuss the limitations of our approach and the situations in which the proposed methods can be better applied, hence providing guidelines for researchers and practitioners in the field.
Lecture Notes in Computer Science, 2013
Recommender systems (RSs) suffer from the cold-start or new user/item problem, i.e., the impossib... more Recommender systems (RSs) suffer from the cold-start or new user/item problem, i.e., the impossibility to provide a new user with accurate recommendations or to recommend new items. Active learning (AL) addresses this problem by actively selecting items to be presented to the user in order to acquire her ratings and hence improve the output of the RS. In this paper, we propose a novel AL approach that exploits the user's personality -using the Five Factor Model (FFM) -in order to identify the items that the user is requested to rate. We have evaluated our approach in a user study by integrating it into a mobile, contextaware RS that provides users with recommendations for places of interest (POIs). We show that the proposed AL approach significantly increases the number of ratings acquired from the user and the recommendation accuracy.
Item features play an important role in movie recommender systems, where recommendations can be g... more Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on traditional features (attributes) such as tag, genre, and cast. Typically, movie features are human-generated, either editorially (e.g., genre and cast) or by leveraging the wisdom of the crowd (e.g., tag), and as such, they are prone to noise and are expensive to collect. Moreover, these features are often rare or absent for new items, making it difficult or even impossible to provide good quality recommendations. In this paper, we show that user's preferences on movies can be better described in terms of the Mise-en-Scène features , i.e., the visual aspects of a movie that characterize design, aesthetics and style (e.g., colors, textures). We use both MPEG-7 visual descriptors and Deep Learning hidden layers as example of mise-en-scène features that can visually describe movies. Interestingly, mise-en-scène features can be computed automatically from video files or even from trailers , offering more flexibility in handling new items, avoiding the need for costly and error-prone human-based tagging, and providing good scalability. We have conducted a set of experiments on a large catalogue of 4K movies. Results show that recommendations based on mise-en-scène features consistently provide the best performance with respect to richer sets of more traditional features, such as genre and tag.
This paper proposes a novel adaptive algorithm for the automated short-term trading of financial ... more This paper proposes a novel adaptive algorithm for the automated short-term trading of financial instrument. The algorithm adopts a semantic sentiment analysis technique to inspect the Twitter posts and to use them to predict the behaviour of the stock market. Indeed, the algorithm is specifically developed to take advantage of both the sentiment and the past values of a certain financial instrument in order to choose the best investment decision. This allows the algorithm to ensure the maximization of the obtainable profits by trading on the stock market. We have conducted an investment simulation and compared the performance of our proposed with a well-known benchmark (DJTATO index) and the optimal results, in which an investor knows in advance the future price of a product. The result shows that our approach outperforms the benchmark and achieves the performance score close to the optimal result.
Previous works have shown the effectiveness of using stylistic visual features, indicative of the... more Previous works have shown the effectiveness of using stylistic visual features, indicative of the movie style, in content-based movie recommendation. However, they have mainly focused on a particular recommendation scenario, i.e. , when a new movie is added to the catalogue and no information is available for that movie (New Item scenario). However , the stylistic visual features can be also used when other sources of information is available (Existing Item scenario). In this work, we address the second scenario and propose a hybrid technique that exploits not only the typical content available for the movies (e.g., tags), but also the stylistic visual content extracted form the movie files and fuse them by applying a fusion method called Canonical Correlation Analysis (CCA). Our experiments on a large catalogue of 13K movies have shown very promising results which indicates a considerable improvement of the recommendation quality by using a proper fusion of the stylistic visual features with other type of features.
Design Patterns (DPs) are acknowledged as powerful conceptual tools to improve design quality and... more Design Patterns (DPs) are acknowledged as powerful conceptual tools to improve design quality and to reduce time and cost of the development process by effect of the reuse of " good " design solutions. In many fields (e.g., software engineering, web engineering, interface design) patterns are widely used by practitioners and are also investigated from a research perspective. Still, they have been seldom explored in the arena of Recommender Systems (RSs). RSs provide suggestions (" recommendations ") for items that are likely to be appropriate for the user profile, and are increasingly adopted in content-intensive multimedia applications. to complement traditional forms of search in large information spaces. This paper explores RSs through the lens of User Interface (UI) Design Patterns. We have performed a systematic analysis of 54 recommendation-empowered content-intensive multimedia applications, in order to: (i) discover the occurrences of existing domain independent UI patterns; (ii) identify frequently adopted UI solutions that are not modelled by existing patterns, and define a set of new UI patterns, some of which are specific of the interfaces for recommendation features while others can be useful also in a broader context. The results of our inspection have been discussed with and evaluated by a team of experts, leading to a consolidated set of 14 new patterns that are reported in the paper. Reusing pattern-based design solutions instead of building new solutions from scratch enables novice and expert designers to build good UIs for Recommendation-empowered content intensive multimedia applications more effectively, and ultimately can improve the UX experience in this class of systems. From a broader perspective, our work can stimulate future research bridging Recommender Systems, Web Engineering and Interface Design by means of Design Patterns, and highlights new research directions also discussed in the paper.
Item features play an important role in movie recommender systems, where recommendations can be g... more Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on attributes such as genres. Traditionally, movie features are human-generated, either editorially or by leveraging the wisdom of the crowd. In this short paper, we present a recommender system for movies based of Factorization Machines that makes use of the low-level visual features extracted automatically from movies as side information. Low-level visual features – such as lighting, colors and motion – represent the design aspects of a movie and characterize its aesthetic and style. Our experiments on a dataset of more than 13K movies show that recommendations based on low-level visual features provides almost 10 times better accuracy in comparison to genre based recommendations, in terms of various evaluation metrics.
In this paper, we present an ongoing work that will ultimately result in a movie recommender syst... more In this paper, we present an ongoing work that will ultimately result in a movie recommender system based on the Mise-en-Scène characteristics of the movies. We believe that the preferences of users on movies can be well described in terms of the mise-en-scène, i.e., the design aspects of movie making influencing aesthetic and style. Examples of mise-en-scène characteristics are Lighting, colors, background, and movements. Our recommender system opens new opportunities in the design of new user interfaces able to offer a personalized way to search for interesting movies through the analysis of film styles rather than using the traditional classifications of movies based on explicit attributes such as genre and cast.
In collaborative filtering recommender systems user's preferences are expressed as ratings for it... more In collaborative filtering recommender systems user's preferences are expressed as ratings for items, and each additional rating extends the knowledge of the system and affects the system's recommendation accuracy. In general, the more ratings are elicited from the users, the more effective the recommendations are. However, the usefulness of each rating may vary significantly, i.e., different ratings may bring a different amount and type of information about the user's tastes. Hence, specific techniques, which are defined as " active learning strategies " , can be used to selectively choose the items to be presented to the user for rating. In fact, an active learning strategy identifies and adopts criteria for obtaining data that better reflects users' preferences and enables to generate better recommendations. So far, a variety of active learning strategies have been proposed in the literature. In this article, we survey recent strategies by grouping them with respect to two distinct dimensions: personalization, i.e., whether the system selected items are different for different users or not, and, hybridization, i.e., whether active learning is guided by a single criterion (heuristic) or by multiple criteria. In addition, we present a comprehensive overview of the evaluation methods and metrics that have been employed by the research community in order to test active learning strategies for collaborative filtering. Finally, we compare the surveyed strategies and provide guidelines for their usage in recommender systems.
This paper investigates the use of automatically extracted visual features of videos in the conte... more This paper investigates the use of automatically extracted visual features of videos in the context of recommender systems and brings some novel contributions in the domain of video recommendations. We propose a new content-based recommender system that encompasses a technique to automatically analyze video contents and to extract a set of representative stylistic features (lighting, color, and motion) grounded on existing approaches of Applied Media Theory. The evaluation of the proposed recommendations, assessed w.r.t. relevance metrics (e.g., recall) and compared with existing content-based recommender systems that exploit explicit features such as movie genre, shows that our technique leads to more accurate recommendations. Our proposed technique achieves better results not only when visual features are extracted from full-length videos, but also when the feature extraction technique operates on movie trailers, pinpointing that our approach is effective also when full-length videos are not available or when there are performance requirements. Our recommender can be used in combination with more traditional content-based recommendation techniques that exploit explicit content features associated to video files, to improve the accuracy of recommendations. Our recommender can also be used alone, to address the problem originated from video files that have no meta-data, a typical situation of popular movie-sharing websites (e.g., YouTube) where every day hundred millions of hours of videos are uploaded by users and may contain no associated information. As they lack explicit content, these items cannot be considered for recommendation purposes by conventional content-based techniques even when they could be relevant for the user.
The new user problem in recommender systems is still challenging , and there is not yet a unique ... more The new user problem in recommender systems is still challenging , and there is not yet a unique solution that can be applied in any domain or situation. In this paper we analyze viable solutions to the new user problem in collaborative filtering that are based on the exploitation of user personality information: (a) personality-based collaborative filtering, which directly improves the recommendation prediction model by incorporating user personality information; (b) personality-based active learning, which utilizes personality information for identifying additional useful preference data in the target recommendation domain to be elicited from the user; and (c) personality-based cross-domain recommendation, which exploits personality information to better use user preference data from auxiliary domains which can be used to compensate the lack of user preference data in the target domain. We benchmark the effectiveness of these methods on large datasets that span several domains, namely movies, music and books. Our results show that personality-aware methods achieve performance improvements that range from 6% to 94% for users completely new to the system, while increasing the novelty of the recommended items by 3% to 40% with respect to the non-personalized popularity baseline. We also discuss the limitations of our approach and the situations in which the proposed methods can be better applied, hence providing guidelines for researchers and practitioners in the field.
One of the challenges in video recommendation systems is the New Item problem, which happens when... more One of the challenges in video recommendation systems is the New Item problem, which happens when the system is unable to recommend video items, that no information is available about them. For example, in the popular movie-sharing websites, such as Youtube, everyday , hundred millions of hours of videos are uploaded and big portion of these videos may not contain any meta-data, to be used by the system to generate recommendations. In this paper, we address this problem by proposing a method, that is based on automatic analysis of the video content in order to extract a number representative low-level visual features. Such features are then used to generate personalized content-based recommendations. Our evaluation shows that our proposed method can outperform the baselines, by producing more relevant recommendations. Hence, a set low-level features extracted automatically can be more descriptive and informative of the video content than a set of high-level expert annotated features.
World Scientific, 2019
A prerequisite for implementing collaborative filtering recommender systems is the availability o... more A prerequisite for implementing collaborative filtering recommender systems is the availability of users' preferences data. This data, typically in the form of ratings, is exploited to learn the tastes of the users and to serve them with personalized recommendations. However, there may be a lack of preference data, especially at the initial stage of the operations of a recommender system, i.e., in the Cold Start phase. In particular, when a new user has not yet rated any item, the system would be incapable of generating relevant recommendations for this user. Or, when a new item is added to the system catalogue and no user has rated it, the system cannot recommend this item to any user. This chapter discusses the cold start problem and provides a comprehensive description of techniques that have been proposed to address this problem. It surveys algorithmic solutions and provides a summary of their performance comparison. Moreover, it lists publicly available resources (e.g., libraries and datasets) and offers a set of practical guidelines that can be adopted by researchers and practitioners.
In Recommender Systems (RS), a users preferences are expressed in terms of rated items, where inc... more In Recommender Systems (RS), a users preferences are expressed in terms of rated items, where incorporating each rating may improve the RS's pre-dictive accuracy. In addition to a user rating items at-will (a passive process), RSs may also actively elicit the user to rate items, a process known as Active Learning (AL). However, the number of interactions between the RS and the user is still limited. One aim of AL is therefore the selection of items whose ratings are likely to provide the most information about the user's preferences. In this chapter, we provide an overview of AL within RSs, discuss general objectives and considerations, and then summarize a variety of methods commonly employed. AL methods are categorized based on our interpretation of their primary motivation/goal, and then sub-classified into two commonly classified types, instance-based and model-based, for easier comprehension. We conclude the chapter by outlining ways in which AL methods could be evaluated, and provide a brief summary of methods performance.
The accuracy of collaborative-filtering recommender systems largely depends on three factors: the... more The accuracy of collaborative-filtering recommender systems largely depends on three factors: the quality of the rating prediction algorithm, and the quantity and quality of available ratings. While research in the field of recommender systems often concentrates on improving prediction algorithms, even the best algorithms will fail if they are fed poor quality data during training. Active learning aims to remedy this problem by focusing on obtaining better quality data that more aptly reflects a user’s preferences. In attempt to do that, an active learning strategy selects the best items to be presented to the user in order to acquire her ratings and hence improve the output of the RS.
In this thesis, we propose a set of novel active learning strategies with different characteristics and evaluate comprehensively their performances with respect to several evaluation measures (i.e., MAE, NDCG, Precision, Coverage, Recommendation Quality, and, Quantity of the acquired ratings and contextual conditions). Furthermore, we argue that traditional evaluation of active learning strategies has two major flaws:
(i) Performance has been evaluated for each user independently (ignoring system-wide improvements)
(ii) Active learning strategies have been evaluated in isolation from unsolicited user ratings (natural acquisition).
Addressing these flaws, we show that an elicited rating has effects across the system, so a typical user-centric evaluation which ignores any changes of rating prediction of other users also ignores these cumulative effects, which may be more influential on the performance of the system as a whole (system-centric). Hence, we propose a novel offline evaluation methodology and use it to evaluate some novel and state of the art rating elicitation strategies. We found that the system-wide effectiveness of a rating elicitation strategy depends on the stage of the rating elicitation process, and on the
evaluation measures.
While the first set of experiments was done offline, the true value of active learning must be evaluated in an online setting. Hence, in the second part of the thesis, we propose a novel active learning approach that exploits some additional information of the user (i.e. the user’s personality) to deal with the cold start problem in an up-and-running mobile context-aware RS called STS, that provides users with recommendations for places of interest (POIs). In live user studies, we have evaluated our approach by integrating it into STS system, and have shown that the proposed AL approach significantly increases the quantity of the ratings and contextual conditions acquired from the user as well as the recommendation accuracy
MA14KD (“ Movie Atract 14K Dataset”) provides a set of 10 VISUAL features extracted from 14074 mo... more MA14KD (“ Movie Atract 14K Dataset”) provides a set of 10 VISUAL features extracted from 14074 movie and tv series trailers. The movie IDs are in agreement with the movie IDs provided by "MovieLens (ML) dataset" (ML-20M or ML Latest Version). All the movie titles, ratings and
associated movie genres and tags can be collected from the MovieLens website.
We measured the “Attractiveness” of every frame of the movie trailers according to a paper by Jose San Pedro, and Stefan Siersdorfer and extracted the described features from movie trailers.
MA14KD (“ Movie A tract 14K Dataset”) provides a set of 10 VISUAL features extracted from 14074 m... more MA14KD (“ Movie A tract 14K Dataset”) provides a set of 10 VISUAL features extracted from 14074 movie and tv series trailers. The movie IDs are in agreement with the movie IDs provided by "MovieLens (ML) dataset" (ML-20M or ML Latest Version). All the movie titles, ratings and associated movie genres and tags can be collected from the MovieLens website. We measured the “Attractiveness” of every frame of the movie trailers according to a paper by Jose San Pedro, and Stefan Siersdorfer and extracted the described features from movie trailers.
2019
In Movie Recommender Systems, when a new user registers to the system and she has not yet provide... more In Movie Recommender Systems, when a new user registers to the system and she has not yet provided any information about her, the system may not be able to generate personalized recommendations for that user. In such a Cold Start situation, many real-world recommender systems suggest popular movies to the new user. Such movies are very likely to be interesting to the new users. A very common approach for measuring the movie popularity is based on counting the number of ratings (as user votes) provided by a community of the existing users. However, in certain cases, we cannot properly measure the popularity of the movies with this common approach. This paper proposes a novel method for predicting the popularity of movies. The method is based on hybrid visually-driven features, representative of the movie content, which can be used to effectively predict not only the movie popularity but also the average rating of the movie. Our extensive experiments on a large dataset of more than 13'000 movies trailers show that the proposed hybrid approach achieves promising results by exploiting visual Attractiveness features of movies in comparison to the other baseline features.
Recommendation systems are essential tools to overcome the choice overload problem by suggesting ... more Recommendation systems are essential tools to overcome the choice overload problem by suggesting items of interest to users. However, they suffer from a major challenge which is the so-called cold-start problem. The cold-start problem typically happens when the system does not have any form of data on new users and on new items. In this chapter, we describe the cold start problem in recommendation systems. We mainly focus on Collaborative Filtering (CF) systems which are the most popular approaches to build recommender systems and have been successfully employed in many real-world applications. Moreover, we discuss multiple scenarios that cold-start may happen in these systems and explain different solutions for them.