Comunicação em evento científico
View-consistent 4D Light Field Style Transfer using Neural Networks and Over-segmentation
Maryam Hamad (Hamad, M.); Caroline Conti (Conti, C.); Paulo Nunes (Nunes, P.); Luís Ducla Soares (Soares, L. D.);
Título Evento
2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP)
Ano (publicação definitiva)
2022
Língua
Inglês
País
Grécia
Mais Informação
Web of Science®

Esta publicação não está indexada na Web of Science®

Scopus

Esta publicação não está indexada na Scopus

Google Scholar

Esta publicação não está indexada no Google Scholar

Esta publicação não está indexada no Overton

Abstract/Resumo
Deep learning has shown promising results in several computer vision applications, such as style transfer applications. Style transfer aims at generating a new image by combining the content of one image with the style and color palette of another image. When applying style transfer to a 4D Light Field (LF) that represents the same scene from different angular perspectives, new challenges and requirements are involved. While the visually appealing quality of the stylized image is an important criterion in 2D images, cross-view consistency is essential in 4D LFs. Moreover, the need for large datasets to train new robust models arises as another challenge due to the limited LF datasets that are currently available. In this paper, a neural style transfer approach is used, along with a robust propagation based on over-segmentation, to stylize 4D LFs. Experimental results show that the proposed solution outperforms the state-of-the-art without any need for training or fine-tuning existing ones while maintaining consistency across LF views.
Agradecimentos/Acknowledgements
--
Palavras-chave
light field,angular consistency,deep learning,neural style transfer,superpixels
Registos de financiamentos
Referência de financiamento Entidade Financiadora
UIDB/50008/2020 FCT/MCTES
PTDC/EEI-COM/7096/2020 FCT/MCTES