Machine Learning Integration for Precise Facial Micro-Expression Recognition
Viola Bakiasi Shtino1, Markela Muça2 & Senada Bushati1 Show affiliations
- Department Computer Science, Faculty of Information Technology, University of Durres, Albania
- Department of Applied Mathematics, Faculty of Natural Science, University of Tirana, Albania
Journal of Computer Science, Volume 20, Issue 11, pp. 1545–1558 · doi.org/10.3844/jcssp.2024.1545.1558
Abstract
This study advances facial micro-expression recognition through innovative machine-learning techniques, addressing critical needs in psychology, security, and human-computer interaction. The purpose of this study is to improve micro-expression recognition through the optimization of feature transformation and machine learning algorithms. We introduce a novel approach combining Kernel Principal Component Analysis (KPCA) and Uniform Manifold Approximation and Projection (UMAP) for dimensionality reduction, paired with advanced classifiers (SVM, Random Forest, k-NN, Decision Trees) to enhance recognition accuracy of these subtle, rapid facial movements. This combination outperforms previous KPCA and t-SNE approaches in preserving both local and global structures of high-dimensional facial data. Our rigorous experimental design involved 28,175 samples from the AffectNet dataset (22,540 for training and 5,635 for validation), utilizing a combination of Kernel Principal Component Analysis (KPCA) with Uniform Manifold Approximation and Projection (UMAP) for dimensionality reduction, followed by random forest classification to capture micro-expressions. Ethical standards, including informed consent and data protection, were strictly maintained throughout. The results show a marked improvement over traditional methods, with our top-performing model achieving 94% accuracy. Key contributions include The optimization of KPCA and UMAP for dimensionality reduction, achieving a state-of-the-art 94% accuracy with Random Forest classification on the AffectNet dataset; Significant computational efficiency gains, reducing training time while improving accuracy; Comprehensive quantitative comparisons of classification performance (accuracy, precision, recall, F1-score) across various model combinations; and Rigorous analysis of the impact of dimensionality reduction techniques on preserving essential micro-expression features. These advancements significantly push the boundaries of emotion recognition technology. This research has far-reaching implications, potentially revolutionizing lie detection, autism research, and human-robot interaction. Our findings pave the way for a more nuanced understanding of human emotions in various applications. The software used for the experiments was Python.
Licence and reuse
Open access. This article is licensed under a Creative Commons Attribution 4.0 International Licence (CC BY 4.0), as printed on the article, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original authors and the source. No permission is needed.
How to reuse this articleResponses (0)
About this article
Shtino, V. B., Muça, M. & Bushati, S. (2024). Machine Learning Integration for Precise Facial Micro-Expression Recognition. Journal of Computer Science, 20(11), 1545–1558. https://doi.org/10.3844/jcssp.2024.1545.1558
- Licence
- CC BY 4.0
- Issue
- Volume 20, Issue 11
- Policies
- Editorial independenceUse of generative AIData availabilityAppeals and complaints
- Version
- Version of record
