A recursive framework for expression recognition: from web images to deep models to game dataset (original) (raw)
Related papers
Database Development and Recognition of Facial Expression using Deep Learning
Facial expressions reflect human emotions and an individual's intentions. To detect facial expressions by human beings is a very easy task whereas it’s a very difficult task using computers. They perform a vigorous part in everyday life. It is a non-verbal mode that may include feelings, opinions, and thoughts without speaking. Deep neural networks, Convolutional Neural Networks, Neural networks, Artificial Intelligence, Fuzzy Logic, and Machine Learning are the different technologies used to detect facial expressions. To detect facial expressions, static images, video, webcam data, or real-time images can be used. This research paper focused on developing the SMM Facial Expression dataset and proposes a convolutional neural network model to identify facial expressions. The proposed method was tested on two different benchmarked datasets namely FER2013 and CK+ for facial expression detection. We have explored the proposed model on CK+ and achieved 93.94% accuracy and 67.18 % for...
Deep Learning-based Facial Expression Recognition and Analysis for Filipino Gamers
International Journal of Recent Technology and Engineering (IJRTE), 2019
This paper presents a computer vision based emotion recognition system for the identification of six basic emotions among Filipino Gamers using deep learning techniques. In particular, the proposed system utilized deep learning through the Inception Network and Long-Short Term Memory (LSTM). The researchers gathered a database for Filipino Facial Expressions consisting of 74 gamers for the training data and 4 gamer subjects for the testing data. The system was able to produce a maximum categorical validation accuracy of .9983 and a test accuracy of .9940 for the six basic emotions using the Filipino database. The cross-database analysis results using the well-known Cohn -Kanade+ database showed that the proposed Inception-LSTM system has accuracy on a par with the current existing systems. The results demonstrated the feasibility of the proposed system and showed sample computations of empathy and engagement based on the six basic emotions as a proof of concept.
Towards an "In-the-Wild" Emotion Dataset Using a Game-based Framework
arXiv (Cornell University), 2016
In order to create an "in-the-wild" dataset of facial emotions with large number of balanced samples, this paper proposes a game-based data collection framework. The framework mainly include three components: a game engine, a game interface, and a data collection and evaluation module. We use a deep learning approach to build an emotion classifier as the game engine. Then a emotion web game to allow gamers to enjoy the games, while the data collection module obtains automatically-labelled emotion images. Using our game, we have collected more than 15,000 images within a month of the test run and built an emotion dataset "GaMo". To evaluate the dataset, we compared the performance of two deep learning models trained on both GaMo and CIFE. The results of our experiments show that because of being large and balanced, GaMo can be used to build a more robust emotion detector than the emotion detector trained on CIFE, which was used in the game engine to collect the face images.
CNN based Facial Expression Recognition System
Social Science Research Network, 2021
Training machines to think and behave like humans have fascinated many researchers around the world. Deep learning a subgroup of Machine Learning enables us to develop a system that can extract features, recognize distinct patterns, and classifies them just like a human brain. Facial Expression Recognition (FER) is one of the trending technology in the Human-Machine Interaction field. This paper contributes to a novel system that makes use of Convolutional Neural networks with fewer data samples and high accuracy. The main objective is to develop a system that can classify the different expressions from the human face and identifies them accurately. In our system, we had developed a 15 layer CNN architecture which plays an important role in classifying images and training the system. This existing system can classify 6 basics facial expressions such as happy, angry, fear, sad, disgust, and surprise with an accuracy of 98.1%.
Facial Expression Recognition with Convolutional Neural Networks
2020 10th Annual Computing and Communication Workshop and Conference (CCWC), 2020
Facial expression recognition has been an active research area in the past ten years, with growing application areas including avatar animation, neuromarketing and sociable robots. The recognition of facial expressions is not an easy problem for machine learning methods, since people can vary significantly in the way they show their expressions. Even images of the same person in the same facial expression can vary in brightness, background and pose, and these variations are emphasized if considering different subjects (because of variations in shape, ethnicity among others). Although facial expression recognition is very studied in the literature, few works perform fair evaluation avoiding mixing subjects while training and testing the proposed algorithms. Hence, facial expression recognition is still a challenging problem in computer vision. In this work, we propose a simple solution for facial expression recognition that uses a combination of Convolutional Neural Network and specific image pre-processing steps. Convolutional Neural Networks achieve better accuracy with big data. However, there are no pub
A CNN based facial expression recognizer
Materials Today: Proceedings, 2021
Facial expression recognition [FER] has gained attraction among many researchers in the field of artificial intelligence. The existing models available for facial expression recognition are developed with the help of native machine learning models. But the accuracies and efficiency achieved by these models are still undergoing extensive research. The proposed research work uses Convolutional Neural Networks (CNN) deep learning models with sufficient Computational power to run the algorithms. This model is able to achieve good accuracy even on the new datasets. Our experimental results achieved an accuracy of 57% in a five-classification task.
A Compact Deep Learning Model for Robust Facial Expression Recognition
International Journal of Engineering and Advanced Technology, 2019
In this paper we are proposing a compact CNN model for facial expression recognition. Expression recognition on the low quality images are much more challenging and interesting due to the presence of low-intensity expressions. These low intensity expressions are difficult to distinguish with insufficient image resolution. Data collection for FER is expensive and time-consuming. Researches indicates the fact that downloaded images from the Internet is very useful to model and train expression recognition problem. We use extra datasets to improve the training of facial expression recognition, each representing specific data source. Moreover, to prevent subjective annotation, each dataset is labeled with different approaches to ensure annotation qualities. Recognizing the precise and exact expression from a variety of expressions of different people is a huge problem. To solve this problem, we proposed an Emotion Detection Model to extract emotions from the given input image. This work mainly focuses on the psychological approach of color circle-emotion relation[1] to find the accurate emotion from the input image. Initially the whole image is preprocessed and pixel by pixel data is studied. And the combinations of the circles based on combined data will result in a new color. This resulted color will be directly correlated to a particular emotion. Based on the psychological aspects the output will be of reasonable accuracy. The major application of our work is to predict a person's emotion based on his face images or video frames This can even be applied for evaluating the public opinion relating to a particular movie, form the video reaction posts on social Medias. One of the diverse applications of our system is to understand the students learning from their emotions. Human beings shows their emotional states and intentions through facial expressions.. Facial expressions are powerful and natural methods that emphasize the emotional status of humans .The approach used in this work successfully exploits temporal information and it improves the accuracies on the public benchmarking databases. The basic facial expressions are happiness, fear, anger, disgust sadness, and surprise[2]. Contempt was subsequently added as one of the basic emotions. Having sufficient well labeled training data with variations of the populations and environments is important for the design of a deep expression recognition system .Behaviors, poses, facial expressions, actions and speech are considered as channels, which convey human emotions. Lot of research works are going on in this field to explore the correlation between the above mentioned channels and emotions. This paper highlights on the development of a system which automatically recognizes the
Optimizing Deep Convolutional Neural Network for Facial Expression Recognitions
Advances in intelligent systems and computing, 2018
Facial expression recognition (FER) systems have attracted much research interest in the area of Machine Learning. We designed a large, deep convolutional neural network to classify 40,000 images in the data-set into one of seven categories (disgust, fear, happy, angry, sad, neutral, surprise). In this project, we have designed deep learning Convolution Neural Network (CNN) for facial expression recognition and developed model in Theano and Caffe for training process. The proposed architecture achieves 61% accuracy. This work presents results of accelerated implementation of the CNN GPUs. Optimizing Deep CNN is to reduce training time for system.
Optimizing Deep Convolutional Neural Network for Facial Expression Recognition
European Journal of Engineering Research and Science
Facial expression recognition (FER) systems have attracted much research interest in the area of Machine Learning. We designed a large, deep convolutional neural network to classify 40,000 images in the data-set into one of seven categories (disgust, fear, happy, angry, sad, neutral, surprise). In this project, we have designed deep learning Convolution Neural Network (CNN) for facial expression recognition and developed model in Theano and Caffe for training process. The proposed architecture achieves 61% accuracy. This work presents results of accelerated implementation of the CNN with graphic processing units (GPUs). Optimizing Deep CNN is to reduce training time for system.
Applied Sciences
This work proposes a facial expression recognition system for a diversified field of applications. The purpose of the proposed system is to predict the type of expressions in a human face region. The implementation of the proposed method is fragmented into three components. In the first component, from the given input image, a tree-structured part model has been applied that predicts some landmark points on the input image to detect facial regions. The detected face region was normalized to its fixed size and then down-sampled to its varying sizes such that the advantages, due to the effect of multi-resolution images, can be introduced. Then, some convolutional neural network (CNN) architectures were proposed in the second component to analyze the texture patterns in the facial regions. To enhance the proposed CNN model’s performance, some advanced techniques, such data augmentation, progressive image resizing, transfer-learning, and fine-tuning of the parameters, were employed in t...