Please use this identifier to cite or link to this item:
https://hdl.handle.net/10316/110979
Title: | Video action recognition collaborative learning with dynamics via PSO-ConvNet Transformer | Authors: | Nguyen, Huu Phong Ribeiro, Bernardete M. |
Issue Date: | 5-Sep-2023 | Publisher: | Springer Nature | Project: | UIDB/00326/2020 UIDP/00326/2020 |
Serial title, monograph or event: | Scientific Reports | Volume: | 13 | Issue: | 1 | Abstract: | Recognizing human actions in video sequences, known as Human Action Recognition (HAR), is a challenging task in pattern recognition. While Convolutional Neural Networks (ConvNets) have shown remarkable success in image recognition, they are not always directly applicable to HAR, as temporal features are critical for accurate classification. In this paper, we propose a novel dynamic PSO-ConvNet model for learning actions in videos, building on our recent work in image recognition. Our approach leverages a framework where the weight vector of each neural network represents the position of a particle in phase space, and particles share their current weight vectors and gradient estimates of the Loss function. To extend our approach to video, we integrate ConvNets with state-of-the-art temporal methods such as Transformer and Recurrent Neural Networks. Our experimental results on the UCF-101 dataset demonstrate substantial improvements of up to 9% in accuracy, which confirms the effectiveness of our proposed method. In addition, we conducted experiments on larger and more variety of datasets including Kinetics-400 and HMDB-51 and obtained preference for Collaborative Learning in comparison with Non-Collaborative Learning (Individual Learning). Overall, our dynamic PSO-ConvNet model provides a promising direction for improving HAR by better capturing the spatio-temporal dynamics of human actions in videos. The code is available at https://github.com/leonlha/Video-Action-Recognition-Collaborative-Learning-with-Dynamics-via-PSO-ConvNet-Transformer . | URI: | https://hdl.handle.net/10316/110979 | ISSN: | 2045-2322 | DOI: | 10.1038/s41598-023-39744-9 | Rights: | openAccess |
Appears in Collections: | I&D CISUC - Artigos em Revistas Internacionais |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Video-action-recognition-collaborative-learning-with-dynamics-via-PSOConvNet-TransformerScientific-Reports.pdf | 2.61 MB | Adobe PDF | View/Open |
Page view(s)
94
checked on Oct 9, 2024
Download(s)
47
checked on Oct 9, 2024
Google ScholarTM
Check
Altmetric
Altmetric
This item is licensed under a Creative Commons License