Scientific journal paper Q2
Dual representation-based Light Field View Synthesis using deformable convolutional and Deep Residual Channel Attention networks
Muhammad Zubair (Zubair, M.); Paulo Nunes (Nunes, P.); Caroline Conti (Conti, C.); Luís Ducla Soares (Soares, L. D.);
Journal Title
IEEE Open Journal of Signal Processing
Year (definitive publication)
2026
Language
English
Country
United States of America
More Information
Web of Science®

Times Cited: 0

(Last checked: 2026-10-06 20:45)

View record in Web of Science®

Scopus

Times Cited: 0

(Last checked: 2026-09-29 10:11)

View record in Scopus

Google Scholar

Times Cited: 0

(Last checked: 2026-10-05 18:34)

View record in Google Scholar

This publication is not indexed in Overton

Abstract
Light Field (LF) cameras simultaneously capture both intensity values and directional information of light rays in a single exposure, providing a unique perspective for computational photography and 3D geometry perception. However, existing LF cameras are constrained by sensor resolution, limiting their ability to capture high spatial and angular resolutions simultaneously. To mitigate these issues, various learning-based methods have been proposed to increase the angular resolution of captured LFs, known as LF View Synthesis (LFVS). Many of these methods either neglect essential geometric cues or rely on neural networks with large receptive fields, which restrict their ability to accurately exploit LF structural characteristics. In response to these challenges, this paper introduces a dual representation-based LFVS method that employs deformable convolutional and Deep Residual Channel Attention (DRCA) networks. The proposed method includes two main modules: (i) Coarse Light Field View Synthesis (CLFVS) for initial LFVS, and (ii) Coarse-To-Fine Refinement (CFR) for final quality enhancement. The CLFVS module relies on deformable convolutions to adaptively extract LF features using two parallel networks: (i) Spatial Feature Extraction (SPFE) network using a depth-dependent LFVS approach, and (ii) Angular Feature Extraction (AFE) network using a non-depth-dependent LFVS approach. The CFR module refines the CLFVS output using a DRCA network, which employs dense residual connections between residual groups instead of conventional convolutional layers. The DRCA network employs Residual Channel Attention Blocks (RCABs) to model inter-channel dependencies, selectively enhancing meaningful features while suppressing irrelevant ones. The proposed method achieves state-of-the-art performance on synthetic and real-world LF benchmarks.
Acknowledgements
This work was supported in part by the National Funds Through FCT – Fundação Para a Ciência e a Tecnologia, I.P. and in part by EU Funds through Project/support UID/50008/2025 – Instituto de Telecomunicações.
Keywords
Light field,View synthesis,Residual channel attention,Spatial-angular correlation,Deformable convolution
  • Computer and Information Sciences - Natural Sciences
  • Electrical Engineering, Electronic Engineering, Information Engineering - Engineering and Technology
Funding Records
Funding Reference Funding Entity
UID/50008/2025 Fundação para a Ciência e a Tecnologia

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência_Iscte. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.