Artificial intelligence

Scientific journal

ISSN 2710-1673

ONLINE: ISSN 2710-1681

Select your language


Analysis of facial expressions on a human face

Krak U.1, Kuznetsov V.2, Ternov A.3
1 Taras Shevchenko National University of Kyiv
2 V.M. Hlushkov Institute of Cybernetics of NAS of Ukraine
3 V.M. Glushkov Institute of Cybernetics

Full text (PDF)

UDC: 004.8
Publication Language: Russian
Stuc. intelekt. 2015; 20(3-4):37-50

Abstract: Facial expressions were recorded on video, stored in facial expressions videolibrary and processed by means of computer vision. Numeric values were analyzed by two algorithms – one layer perceptron and perceptron combined with Karhunen-Loeve transform, singular value decomposition, discrete cosine transform and Fourier transform as a source of teach data. Each algorithm was tested on test data sets. Some solutions were proposed in order to improve quality of analyzed data and effectiveness of facial expression classification algorithms.

Keywords: facial expressions, classification algorithms, perceptron, Karhunen-Loeve transform.

References:

  1. Zaytseva G.L. Zhestovaya rech. Daktilologiya: Ucheb. dlya stud. vyissh. ucheb. zavedeniy / ZaytsevaG.L. – M: Gumanit. izd. tsentr VLADOS, 2000. – 192s.
  2. Tkacheva T. Zhestovyiy yazyik gluhih kak osobaya znakovaya kommunikativnaya sistema (namateriale russkogo i frantsuzskogo zhestovyih yazyikov) / Tkacheva T., Ahmedyisheva N. //Materialyi Mezhdunarodnoy nauchno-prakticheskoy konferentsii «Prioritetyi i interesyisovremennogo obschestva». – Astrahan: AGU, 2010. – S.361-365.
  3. Kulbida S.V. UkraYinska zhestova mova yak prirodna znakova sistema / S. V. KulbIda // zbIrniknaukovih prats «Zhestova mova y suchasnIst»: K: PedagogIchna dumka, 2009 . – S. 218-239.
  4. Krak Yu.V., Ternov A.S., KuznEtsov V.A. Razrabotka audiovizualnoy bazyi dannyih nemanualnyihkomponent zhestovoy rechi // Upravlyayuschie sistemyi i mashinyi (USiM). – 2013. – #4. – S.58-62.
  5. Krak Yu.V., Kuznetsov V.A., Ternov A.S. Modelirovanie emotsionalnyih proyavleniy s pomoschyuparametricheskih modeley golovyi cheloveka // Shtuchniy Intelekt. – 2013. – #3(61). – S.154-170.
  6. Dailey Matthew N. EMPATH: A Neural Network that Categorizes Facial Expressions / Matthew N.Dailey, Garrison W. Cottrell, Curtis Padgett, Ralph Adolphs// Massachusetts Institute of TechnologyJournal of Cognitive Neuroscience, – 2002. – Vol. 14, No 8. – R.1158-1173.
  7. Krishna K.V., Varma K., Varma G. Hybrid Emotional Neural Network for Facial ExpressionClassification // International Journal of Computer Applications – Foundation of Computer Science,New York. – 2011. –Vol. 35, No 12. – R. 8-22.
  8. Novakovic J. et al. Classification Accuracy of Neural Networks with PCA in Emotion Recognition /Jasmina Novakovica, Milomir Minica, Alempije Veljovicb // Theory and Applications ofMathematics & Computer Science – University of Arad, Arad, Romania. – 2011. – #1. – R.11-16.
  9. M. Karthigayan et al. Genetic Algorithm and Neural Network for Face Emotion Recognition // M.Karthigayan, M. Rizon, R. Nagarajan and Sazali Yaacob / Affective Computing - I-Tech Educationand Publishing. – 2008. – R. 57-67.
  10. Leontev V.O. Klassifikatsiya emotsiy / Leontev V.O. – Odessa: Innovatsionno-ipotechnyii tsentr,2002. 84 s.
  11. Izard K.E. Emotsii cheloveka / Izard K.E. – M.: MGU, 1980. – 439s.
  12. Ekman P. Unmasking the face. A guide to recognizing emotions from facial clues / Cambridge, M.A.,Malor books, 2003. – 214 r.
  13. Darvin Ch. Vyirazhenie emotsiiy u cheloveka i u zhivotnyih. / Darvin Ch. // Sochineniya; [per.S.L.Sobolya pod red. akad. E.N. Pavlovskogo: v 8 t.] – M.: Izd. AN SSSR – 1953. – T.5. – C.431-480.
  14. Medlej J. Drawing People / Medlej J. - London.: Cedarseed, 2012. – 99 p.
  15. Iurii Krak , Anton Ternov, Vladislav Kuznetzov. Facial expressions analysis based on a computervision algorithms //International Journal Information Models and Analysis. –2014. – Vol.1.– P.62-77.
  16. Alberto Menache. Understanding Motion Capture for Computer Animation and Video Games//Alberto M.// - Morgan Kaufmann Publishers Inc. San Francisco, CA, 1999. – 231 p.
  17. Miller F. P. Facial Action Coding System. / Miller F. P., Vandome A. F., McBrewster J. – BeauBassin, International Book Marketing Service Ltd, 2011. – 80 p.
  18. Matthias Grundmann et al. Auto-Directed Video Stabilization with Robust L1 Optimal Camera Paths// Matthias Grundmann, Vivek Kwatra, Irfan Essa // IEEE Conference on Computer Vision andPattern Recognition (CVPR 2011) – 2011. - Colorado Springs, USA. – P. 225-232.
  19. Grewal M.S., Andrews A.P. Kalman Filtering – Theory and Practice Using MATLAB. – EditionsWiley, 2001. – 640 p.
  20. Elektronnyiy resurs biblioteki kompyuternogo zreniya OpenCV. Rezhim dostupa: http://opencv.org/
  21. Elektronnyiy resurs biblioteki perekodirovschika video avconv/ffmpeg. Rezhim dostupa:http://libav.org/news.html
  22. Elektronnyiy resurs prilozheniya Blender. Rezhim dostupa: http://www.blender.org
  23. Nussbaumer G. Byistroe preobrazovanie Fure i algoritmyi vyichisleniya svertok: Per. s angl. - M.:Radio i svyaz, 1985. – 248 s.
  24. Flannery Rian P. et al. Numerical Recipes Example Book // Rian P. Flannery, Saul A. Teukolsky,William H. Press, William T. Vetterling. – Cambridge University Press, 1992. – 336 p.
  25. Chumakov A.G., Kurashov V.N. Karhunen-Loeve Basis Synthesis for Grate Capacity SignalPerformance in Optical Processors // SPIE Proc. – 1993. – Vol.21-08. – P.338- 342.
  26. Loeffler C., Ligtenberg A., Moschytz G.. Practical Fast 1-D DCT Algorithms with 11 Multiplications// Proc. Int. Conf. on Acoustics, Speech, and Signal Processing 1989 (ICASSP '89). – 1989. – P. 988-991.
  27. Elektronnyiy resurs programmyi Octave. Rezhim dostupa: https://www.gnu.org/software/octave/

View full text (PDF)