A real-time algorithm for human’s hand gesture recognition on video-sequence for human-computer interaction interfaces

The author presents the new real-time algorithm for hand gestures recognizing on a video sequence, based on the color clustering principles, interframe differences for video sequences and contour analysis principal. The first chapter of this paper contains the research of related work, which is based on Viola-Jones algorithm, the search for the skin color, wavelet transformation, localization of the centroid of the image, etc. The second chapter describes the new gesture recognition approach, and third includes experiment results. A proposed gesture recognition algorithm resolVes two tasks: gesture localization and gesture recognition. The gesture localization task is resolved by compilation results of the image segmentation by human skin color clustering principle and motion search on the video sequences. The feature extraction task is resolved by invariant gesture contour moments analysis. A presented approach does not use any tutorial images. Gesture domain is not close and can be set up during initialization process. Key performance indicators (KPI) of the proposed approach are number of processed video sequence items per time unit and gesture recognition stability mark. The analysis of the performance of the proposed algorithm shows that the performance is at a high level. An average frame rate, which can function designed system is about 50 fps, which even exceeds the ability of the human visual perception. Recognition stability depends on environment condition changes, but the number of recognition errors can be reduced to a minimum by video device calibrating. The quality of recognition is 96%, which is a good indicator for such purpose algorithms. The KPI analysis, based on experimental data, is shown the applicability of the proposed approach in real-time gesture recognition systems, based on different hardware platforms. This fact allows to use the algorithm primarily in the aerospace industry to build effective management systems based on gestural interfaces.