|
This article is cited in 4 scientific papers (total in 4 papers)
Methods of Information Processing and Management
An Analysis of Perspectives for Using High-Speed Cameras in Processing Dynamic Video Information
D. V. Ivankoa, A. A. Karpovb a ITMO University (Saint Petersburg National Research University of Information Technologies, Mechanics and Optics)
b St. Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences (SPIIRAS)
Abstract:
In this paper, we review the actual and perspective areas of use of high-speed video cameras. We discuss the possibility of applying high-speed cameras in the field of human-computer interaction to detect dynamic video information (including visual speech). We also describe main tasks, which can be solved with high-speed cameras, such as: automatic lip-reading, eye blink detection, facial micro-expression recognition, etc. We identify potential challenges associated with the introduction of high-speed video cameras and analyze the conditions of research area. Besides, we analyze state-of-the-art in the field at the moment and prove that there is an urgent need for further scientific and technical developments in this area. We propose some advanced applications and tasks in the human-computer interaction domain, where high-speed video capturing can be useful, such as audio-visual continuous speech recognition and automatic reading speech by lips. In further research, we will implement such a multimodal system for audio-visual Russian speech recognition using a microphone and a high-speed video camera JAI Pulnix.
Keywords:
high-speed video camera; computer vision; audio-visual speech recognition; audio-visual data corpus; lip-reading; dynamic video information.
Citation:
D. V. Ivanko, A. A. Karpov, “An Analysis of Perspectives for Using High-Speed Cameras in Processing Dynamic Video Information”, Tr. SPIIRAN, 44 (2016), 98–113
Linking options:
https://www.mathnet.ru/eng/trspy857 https://www.mathnet.ru/eng/trspy/v44/p98
|
Statistics & downloads: |
Abstract page: | 161 | Full-text PDF : | 57 |
|