J Shanghai Jiaotong Univ Sci

Journal of Shanghai Jiaotong University(Science) >

2020 , Vol. 25 >Issue 5: 589 - 599

DOI: https://doi.org/10.1007/s12204-020-2219-7

Micro-Expression Recognition Algorithm Based on Information Entropy Feature

Expand
  • (School of Electronic Engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, China)

Online published: 2020-09-11

Fold

Abstract

The intensity of the micro-expression is weak, although the directional low frequency components in
the image are preserved by many algorithms, the extracted micro-expression feature information is not sufficient
to accurately represent its sequences. In order to improve the accuracy of micro-expression recognition, first, each
frame image is extracted from its sequences, and the image frame is pre-processed by using gray normalization,
size normalization, and two-dimensional principal component analysis (2DPCA); then, the optical flow method
is used to extract the motion characteristics of the reduced-dimensional image, the information entropy value
of the optical flow characteristic image is calculated by the information entropy principle, and the information
entropy value is analyzed to obtain the eigenvalue. Therefore, more micro-expression feature information is
extracted, including more important information, which can further improve the accuracy of micro-expression
classification and recognition; finally, the feature images are classified by using the support vector machine (SVM).
The experimental results show that the micro-expression feature image obtained by the information entropy
statistics can effectively improve the accuracy of micro-expression recognition.

Key words：  micro-expression recognition; two-dimensional principal component analysis (2DPCA); optical flow;
information entropy statistics; support vector machine (SVM)

Cite this article

WU Jin, MIN Yu, YANG Xiaodie, MA Simin . Micro-Expression Recognition Algorithm Based on Information Entropy Feature[J]. Journal of Shanghai Jiaotong University(Science), 2020 , 25(5) : 589 -599 . DOI: 10.1007/s12204-020-2219-7

References

[1] WARREN G, SCHERTLER E, BULL P. Detecting deception from emotional and unemotional cues [J].Journal of Nonverbal Behavior, 2009, 33(1): 59-69.
[2] SHEN X B, WU Q, FU X L. Effects of the duration of expressions on the recognition of microexpressions[J]. Journal of Zhejiang University SCIENCE B, 2012,13(3): 221-230.
[3] KHOR H Q, SEE J, PHAN R C W, et al. Enriched long-term recurrent convolutional network for facial micro-expression recognition [C]//13th IEEE International Conference on Automatic Face & Gesture Recognition.Xi’an, China, 2018: 667-674.
[4] BEN X, ZHANG P, YAN R, et al. Gait recognition and micro-expression recognition based on maximum margin projection with tensor representation [J]. Neural Computing and Applications, 2016, 27(8): 2629-2646.
[5] JIA X, BEN X, YUAN H, et al. Macro-to-micro transformation model for micro-expression recognition [J].Journal of Computational Science, 2018, 25: 289-297.
[6] BEN X, JIA X, YAN R, et al. Learning effective binary descriptors for micro-expression recognition transferred by macro-information [J]. Pattern Recognition Letters, 2018, 107: 50-58.
[7] ZHU X, BEN X, LIU S, et al. Coupled source domain targetized with updating tag vectors for microexpression recognition [J]. Multimedia Tools and Applications,2018, 77(3): 3105-3124.
[8] ZHU C L, CHEN X Y, ZHANG J X, et al. Comparison of ecological micro-expression recognition in patients with depression and healthy individuals [J]. Frontiers in Behavioral Neuroscience, 2017, 11: 199.
[9] GAN Y S, LIONG S. Bi-directional vectors from apex in CNN for micro-expression recognition [C]//IEEE 3rd International Conference on Image, Vision and Computing. Chongqing, China: IEEE, 2018: 168-172.
[10] COLLINS R. Visual micro-sociology and the sociology of flesh and blood: Comment on wacquant [J]. Qualitative Sociology, 2015, 38(1): 13-17.
[11] POLIKOVSKY S, KAMEDA Y, OHTA Y. Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor [C]//3rd International Conference on Imaging for Crime Detection and Prevention.London, UK: IET, 2009: 1-6.
[12] WU Q, SHEN X, FU X. The machine knows what you are hiding: An automatic micro-expression recognition system [M]. Affective Computing and Intelligent Interaction.Berlin, Germany: Springer, 2011: 152-162.
[13] LU Z Y, LUO Z Q, ZHENG H, et al. A Delaunay-based temporal coding model for micro-expression recognition [M]//Computer Vision—ACCV 2014 Workshops.Cham, Switzerland: Springer International Publishing,2014: 698-711.
[14] KHAN M A, XYDEAS C, AHMED H. On the application of AAM-based systems in face recognition[C]//2014 22nd European Signal Processing Conference.Lisbon, Portugal: IEEE, 2014: 2445-2449.
[15] JUN H, WANG M. The implement of an improved delaunay triangulation algorithm [C]//2010 Third International Conference on Information and Computing.Wuhan, China: IEEE, 2010: 211-214.
[16] HUANG X H, ZHAO G Y, HONG X P, et al. Texture description with completed local quantized patterns[M]//Image Analysis. Berlin, Germany: Springer,2013: 1-10.
[17] KIM D H, BADDAR W J, RO Y M. Micro-expression recognition with expression-state constrained spatiotemporal feature representations [C]//ACM on Multimedia Conference. Amsterdam, the Netherlands:ACM, 2016: 382-386.
[18] SENGAR S S, MUKHOPADHYAY S. Motion detection using block based bi-directional optical flow method [J]. Journal of Visual Communication and Image Representation, 2017, 49: 89-103.
[19] XIONG X, CHEN L, LIANG J. A new framework of vehicle collision prediction by combining SVM and HMM [J]. IEEE Transactions on Intelligent Transportation Systems, 2018, 19(3): 699-710.

Options
Outlines

/

〈 〉