Ciência_Iscte
Publicações
Descrição Detalhada da Publicação
Attention-Enhanced Multi-Branch Spiking Neural Network for Event Stream Super-Resolution
Proceedings 2025 International Symposium on Multimedia - ISM 2025
Ano (publicação definitiva)
2025
Língua
Inglês
País
Itália
Mais Informação
Web of Science®
Scopus
Google Scholar
Esta publicação não está indexada no Overton
Abstract/Resumo
Traditional visual sensors capture images by sampling light at fixed intervals, producing a sequence of frames. In contrast, event vision sensors detect changes in light intensity asynchronously at the pixel level and generate discrete events with precise timing information, allowing to capture challenging scenes with high-speed object motion and extreme lighting conditions accurately. This paper introduces an attention-enhanced, polarity-aware multi-branch Spiking Neural Network (SNN) that directly super-resolves low-resolution event streams while preserving their temporal accuracy. The proposed architecture uses two parallel branches with novel spike-based spatial and temporal attention modules that give more importance to salient spatio-temporal structures, yet remaining fully asynchronous and hardware-friendly. Experimental results demonstrate that the proposed spike-based attention with multi-branch SNN significantly outperforms existing state-of-the-art methods across all evaluation metrics, while effectively maintaining the underlying spatio-temporal characteristics of the event stream.
Agradecimentos/Acknowledgements
--
Palavras-chave
Event Cameras,Super-resolution,Spiking Neural Network,Attention Mechanism
Classificação Fields of Science and Technology
- Ciências da Computação e da Informação - Ciências Naturais
- Engenharia Eletrotécnica, Eletrónica e Informática - Engenharia e Tecnologia
English