Ciência_Iscte
Comunicações
Descrição Detalhada da Comunicação
View-consistent 4D Light Field Style Transfer using Neural Networks and Over-segmentation
Título Evento
2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP)
Ano (publicação definitiva)
2022
Língua
Inglês
País
Grécia
Mais Informação
Web of Science®
Esta publicação não está indexada na Web of Science®
Scopus
Esta publicação não está indexada na Scopus
Google Scholar
Esta publicação não está indexada no Google Scholar
Esta publicação não está indexada no Overton
Abstract/Resumo
Deep learning has shown promising results in several computer vision applications, such as style transfer applications. Style transfer aims at generating a new image by combining the content of one image with the style and color palette of another image. When applying style transfer to a 4D Light Field (LF) that represents the same scene from different angular perspectives, new challenges and requirements are involved. While the visually appealing quality of the stylized image is an important criterion in 2D images, cross-view consistency is essential in 4D LFs. Moreover, the need for large datasets to train new robust models arises as another challenge due to the limited LF datasets that are currently available. In this paper, a neural style transfer approach is used, along with a robust propagation based on over-segmentation, to stylize 4D LFs. Experimental results show that the proposed solution outperforms the state-of-the-art without any need for training or fine-tuning existing ones while maintaining consistency across LF views.
Agradecimentos/Acknowledgements
--
Palavras-chave
light field,angular consistency,deep learning,neural style transfer,superpixels
Registos de financiamentos
| Referência de financiamento | Entidade Financiadora |
|---|---|
| UIDB/50008/2020 | FCT/MCTES |
| PTDC/EEI-COM/7096/2020 | FCT/MCTES |
English