The impact of pre-processing algorithms in facial expression recognition

Abstract

This paper proposes several pre-processing algorithms to improve facial expression recognition based on Convolutional Neural Networks (CNNs) models. The proposed CNN model was trained on the Extended Cohn-Kanade dataset (CK+) after applying the pre-processing stages and achieved competitive results (93.90% recognition accuracy) despite its simple and light architecture. Using this CNN model, a study on the impact of each pre-processing algorithm when extracting facial features is presented. In the end, it is understood that pre-processing algorithms help CNNs to extract the most relevant features for each facial expression more effectively, reducing the overfitting and increasing the recognition accuracy. Attention maps before and after the pre-processing step are shown in order to visualize its impact when the proposed CNN model makes a prediction.