Sign inSubmit
computersciencejournal.org is not ours. This journal is published only at thescipub.com/jcs. Report a suspicious emailcomputersciencejournal.org is not ours · Report
ArticleMetrics
Review Article · Open access · Published 22 October 2024

Machine Learning Integration for Precise Facial Micro-Expression Recognition

Viola Bakiasi Shtino1, Markela Muça2 & Senada Bushati1

Journal of Computer Science, Volume 20, Issue 11, pp. 1545–1558 · doi.org/10.3844/jcssp.2024.1545.1558

5,592 accesses2,397 downloads0 citations (Crossref)Metrics
Cite Check for updates

Abstract

This study advances facial micro-expression recognition through innovative machine-learning techniques, addressing critical needs in psychology, security, and human-computer interaction. The purpose of this study is to improve micro-expression recognition through the optimization of feature transformation and machine learning algorithms. We introduce a novel approach combining Kernel Principal Component Analysis (KPCA) and Uniform Manifold Approximation and Projection (UMAP) for dimensionality reduction, paired with advanced classifiers (SVM, Random Forest, k-NN, Decision Trees) to enhance recognition accuracy of these subtle, rapid facial movements. This combination outperforms previous KPCA and t-SNE approaches in preserving both local and global structures of high-dimensional facial data. Our rigorous experimental design involved 28,175 samples from the AffectNet dataset (22,540 for training and 5,635 for validation), utilizing a combination of Kernel Principal Component Analysis (KPCA) with Uniform Manifold Approximation and Projection (UMAP) for dimensionality reduction, followed by random forest classification to capture micro-expressions. Ethical standards, including informed consent and data protection, were strictly maintained throughout. The results show a marked improvement over traditional methods, with our top-performing model achieving 94% accuracy. Key contributions include The optimization of KPCA and UMAP for dimensionality reduction, achieving a state-of-the-art 94% accuracy with Random Forest classification on the AffectNet dataset; Significant computational efficiency gains, reducing training time while improving accuracy; Comprehensive quantitative comparisons of classification performance (accuracy, precision, recall, F1-score) across various model combinations; and Rigorous analysis of the impact of dimensionality reduction techniques on preserving essential micro-expression features. These advancements significantly push the boundaries of emotion recognition technology. This research has far-reaching implications, potentially revolutionizing lie detection, autism research, and human-robot interaction. Our findings pave the way for a more nuanced understanding of human emotions in various applications. The software used for the experiments was Python.

Licence and reuse

Open access. This article is licensed under a Creative Commons Attribution 4.0 International Licence (CC BY 4.0), as printed on the article, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original authors and the source. No permission is needed.

How to reuse this article

Responses (0)

Have a comment on this research? Sign in to respond. Responses are moderated and published with your name and affiliation; the authors are invited to reply. How we use your dataWrite a response

About this article

Cite this article

Shtino, V. B., Muça, M. & Bushati, S. (2024). Machine Learning Integration for Precise Facial Micro-Expression Recognition. Journal of Computer Science, 20(11), 1545–1558. https://doi.org/10.3844/jcssp.2024.1545.1558

Licence
CC BY 4.0
Issue
Volume 20, Issue 11
Policies
Editorial independenceUse of generative AIData availabilityAppeals and complaints
Version
Version of record
Machine Learning Integration for Precise Facial Micro-Expression RecognitionJournal of Computer Science · Volume 20, Issue 11 · pp. 1545–1558 · CC BY 4.0Download