Free3D: Consistent Novel View Synthesis Without 3D Representation [PDF]
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-S, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS.
Chuanxia Zheng, Andrea Vedaldi
semanticscholar +4 more sources
Novel View Synthesis with Diffusion Models [PDF]
International Conference on Learning Representations, 2022 We present 3DiM, a diffusion model for 3D novel view synthesis, which is able to translate a single input view into consistent and sharp completions across many views. The core component of 3DiM is a pose-conditional image-to-image diffusion model, which
Daniel Watson +5 more
semanticscholar +3 more sources
Large-Scale Indoor Visual–Geometric Multimodal Dataset and Benchmark for Novel View Synthesis [PDF]
SensorsThe accurate reconstruction of indoor environments is crucial for applications in augmented reality, virtual reality, and robotics. However, existing indoor datasets are often limited in scale, lack ground truth point clouds, and provide insufficient ...
Junming Cao +2 more
doaj +2 more sources
FluoNeRF: Fluorescent Novel-View Synthesis Under Novel Light Source Colors and Spectra [PDF]
Journal of ImagingSynthesizing photo-realistic images of a scene from arbitrary viewpoints and under arbitrary lighting environments is one of the important research topics in computer vision and graphics.
Lin Shi +4 more
doaj +2 more sources
Gaussian Splatting: 3D Reconstruction and Novel View Synthesis: A Review [PDF]
IEEE AccessImage-based 3D reconstruction is a challenging task that involves inferring the 3D shape of an object or scene from a set of input images. Learning-based methods have gained attention for their ability to directly estimate 3D shapes.
Anurag Dalal +3 more
doaj +2 more sources
Light Field Diffusion for Single-View Novel View Synthesis
IEEE AccessSingle-view novel view synthesis, the task of generating images from new viewpoints based on a single reference image, is important but challenging in computer vision.
Yifeng Xiong +5 more
doaj +3 more sources
Neural LiDAR Fields for Novel View Synthesis
2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023 We present Neural Fields for LiDAR (NFL), a method to optimise a neural field scene representation from LiDAR measurements, with the goal of synthesizing realistic LiDAR scans from novel viewpoints.
S. Huang +7 more
semanticscholar +3 more sources
Lumina-4DGS: Illumination-Robust Four-Dimensional Gaussian Splatting for Dynamic Scene Reconstruction [PDF]
SensorsHigh-fidelity 4D reconstruction of dynamic scenes is pivotal for immersive simulation yet remains challenging due to the photometric inconsistencies inherent in multi-view sensor arrays.
Xiaoqiang Wang +3 more
doaj +2 more sources
Single view generalizable 3D reconstruction based on 3D Gaussian splatting [PDF]
Scientific Reports3D Gaussian Splatting (3DGS) has become a significant research focus in recent years, particularly for 3D reconstruction and novel view synthesis under non-ideal conditions.
Kun Fang +4 more
doaj +2 more sources
View-Invariant Policy Learning via Zero-Shot Novel View Synthesis
Conference on Robot LearningLarge-scale visuomotor policy learning is a promising approach toward developing generalizable manipulation systems. Yet, policies that can be deployed on diverse embodiments, environments, and observational modalities remain elusive.
Stephen Tian +6 more
semanticscholar +3 more sources