Accès ouvert · CC BY

Frame Comparison Network for Video Event Recognition

Article scientifique 2022 Informatique et sciences numériques › Intelligence artificielle › Vision par ordinateur (OCDE 1.2) Anglais

Résumé

Abstract Automatic recognition of actions in videos taken in uncontrolled environments is one of the most challenging tasks in computer vision. The most successful recent methods are based on Convolutional Neural Networks (CNNs) and use a variant of optical flow alongside the video frames to extract the information hidden in the variation of images. We propose a method that provides a neural network with the means to learn to extract features from local frame-to-frame variations, in addition to the global variation from a set of frames. The proposed method does not need to use any variant of pre-computed hand-crafted optical flow. We propose also a mechanism to raise the two limitations of CNNs when dealing with videos instead of single images: their inability to capture the difference between the video frames, and being optimized to find patterns regardless of their positions in space, i. e. insensitive to the occurrence order of features. The architecture we propose provides the possibility of reusing pre-trained image classification CNNs as feature extractors, allowing to take advantage of them with minimal tuning. The computational cost is mostly dependent on the choice of feature extractors. By taking the most efficient state-of-the art image classification CNNs, the proposed approach reaches impressive computational efficiency and at the same time outperforms all the state-of-art real-time methods in term of accuracy.

Citer ce document

henni, N., Bouzenada, M., & Talbi, H. (2022). Frame Comparison Network for Video Event Recognition. Research Square. https://doi.org/10.21203/rs.3.rs-1605125/v1

Exporter : BibTeX · RIS (Zotero, Mendeley, EndNote)

Accès au document

Texte intégral archivé sur SPHAERO, en accès ouvert : lisible gratuitement en ligne après connexion. Le document reste aussi disponible à sa source. Se connecter

Voir l'article sur le site de la revue

Licence et provenance

Licence : CC BY

Notice moissonnée depuis OpenAlex le 09/09/2026. Le document reste hébergé par sa source.
Voir le document à la source →

Statistiques

Consultations (hors robots) : 19

Téléchargements (hors robots) : 0

Méthode de comptage