Talk
View-consistent 4D Light Field Style Transfer using Neural Networks and Over-segmentation
Maryam Hamad (Hamad, M.); Caroline Conti (Conti, C.); Paulo Nunes (Nunes, P.); Luís Ducla Soares (Soares, L. D.);
Event Title
2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP)
Year (definitive publication)
2022
Language
English
Country
Greece
More Information
Web of Science®

This publication is not indexed in Web of Science®

Scopus

This publication is not indexed in Scopus

Google Scholar

This publication is not indexed in Google Scholar

This publication is not indexed in Overton

Abstract
Deep learning has shown promising results in several computer vision applications, such as style transfer applications. Style transfer aims at generating a new image by combining the content of one image with the style and color palette of another image. When applying style transfer to a 4D Light Field (LF) that represents the same scene from different angular perspectives, new challenges and requirements are involved. While the visually appealing quality of the stylized image is an important criterion in 2D images, cross-view consistency is essential in 4D LFs. Moreover, the need for large datasets to train new robust models arises as another challenge due to the limited LF datasets that are currently available. In this paper, a neural style transfer approach is used, along with a robust propagation based on over-segmentation, to stylize 4D LFs. Experimental results show that the proposed solution outperforms the state-of-the-art without any need for training or fine-tuning existing ones while maintaining consistency across LF views.
Acknowledgements
--
Keywords
light field,angular consistency,deep learning,neural style transfer,superpixels
Funding Records
Funding Reference Funding Entity
UIDB/50008/2020 FCT/MCTES
PTDC/EEI-COM/7096/2020 FCT/MCTES