Artificial intelligence

Scientific journal

ISSN 2710-1673

ONLINE: ISSN 2710-1681

Search by:

Year of publication
Author name
Paper title

Structural-Viseme analysis of Ukrainian Speech Articulation

Krak U.1, Ternov A.2, Lisniak M.2
1 Taras Shevchenko National University of Kyiv
2 V.M. Glushkov Institute of Cybernetics

Full text (PDF)

UDC: 004.932.751
Publication Language: Ukrainian
Stuc. intelekt. 2011; 16(3):156-166

Abstract: An approach to the structural analysis of visemes of visual component of speech process in the video stream is proposed in this paper. The approach allows to compute numeric information about presence of a viseme in an animation frame chosen from the given base set by calculating the optimal parameters of state for threedimensional model of a human head. Experimental studies have shown the efficiency of using the proposed model to identify the basic states of lip articulation by test video samples with 185 words of the Ukrainian language.

Keywords:

References:

  1. Ouni S. EURASIP Journal on Audio, Speech and Music Processing. 2007. P. 1-12.
  2. McGurk H. Nature. 1976. Vol. 264. P. 746-768.
  3. Krak Ju.V. Komp’juterna matematyka. № 1. 2009. S. 86-95.
  4. Krivonos Ju.G. Shtuchnij іntelekt. № 3. 2009. S. 186-197.
  5. Beskow J. The Teleface project - disability, feasibility and intelligibility.http://www.speech.kth.se/~beskow/papers/fon97teleface.pdf.
  6. Werda S. International Journal of Computer & Information Science. 2007. S. 62-75.
  7. Sadat V. IJCSNS International Journal of Computer Science and Network Security. 2006. P. 154-158.
  8. Davidov M.V Іnformacіjnі systemy ta merezhі. L'vіv.: Vydavnyctvo Nacіonal'nogo unіversytetu “L'vіvs'kapolіtehnіka”. № 673. 2010. S. 267-273.
  9. Murygin K.V. Shtuchnij іntelekt. № 2. 2009. S 116-123
  10. EmguCV http://www.emgu.com/wiki/index.php/Main_Page.
  11. Bouguet J. Pyramidal Implementation of the Lucas Kanade feature tracker. Description of the algorithm.http://robots.stanford.edu/cs223b04/algo_tracking.pdf
  12. Krivonos Ju.G. Sintez vіzual'noi skladovoї zovnіshn'oi artikuljacіi na oblichchі ljudeni z vikoristannjammorfіv vіzem dlja modeljuvannja zhestovoi movi D: IPII “Nauka і osvіta”. 2010. S. 291-294
  13. Kessenih J. The OpenGL Shading Language. http://www.opengl.org/registry/doc/GLSLangSpec.Full.1.20.8.pdf
  14. Boreskov A.V. Razrabotka i otladka shejderov. Sankt-Peterburg: BHV. 2006. 496 s.
  15. Dobeshi I. Desjat' lekcij po vejvletam. Izhevsk: NIC “Reguljarnaja i haoticheskaja dinamika”. 2001. 464 s.
  16. Encog project, Heaton Research. http://www.heatonresearch.com/encog.
  17. Bіlodіd І.K. Suchasna ukrains'ka lіteraturna mova. Vstup. Foneteka. K. : Naukova dumka. 1969. 435 s.
  18. Toc'ka N.І. Suchasna ukrains'ka lіteraturna mova. Foneteka, orfoepіja, grafіka, orfografіja. K : Vishhashkola. 1981. 182 s.

View full text (PDF)