New-View-Synthesis

Collecting papers about new view synthesis

:bowtie::star::fire::muscle: I will update each day and add more details about every paper :sunny::sunny::sunny:

Stereo Magnification: Learning View Synthesis using Multiplane Images [arxiv] | [code] | 2018
Local Light Field Fusion [arxiv] | [code] | 2019
DeepView: View synthesis with learned gradient descent [pdf] | [code] | 2019
3D Ken Burns Effect from a Single Image [arxiv] | [code] | 2020
3D Photography using Context-aware Layered Depth Inpainting [arxiv] | [code] | 2020
NeRF: Neural Radiance Fields [arxiv] | [code] | 2020
NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections [arxiv] | [code] | 2020
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering [arxiv] | [code]
DeRF: Decomposed Radiance Fields [arxiv] | 2020
NeRF++: Analyzing and Improving Neural Radiance Fields [arxiv] | [code] | 2020
Extreme View Synthesis [arxiv] | [code] | 2019
Generative View Synthesis: From Single-view Semantics to Novel-view Images [arxiv] | [code] | 2020
Semantic view synthesis [arxiv] | [code] |2020
Single-view view synthesis with multiplane images [arxiv] | [code] | 2020
Neural Sparse Voxel Fields [arixv] | [code] | 2020
SynSin: End-to-end View Synthesis from a Single Image [arxiv] | [code] | 2020
Neural Point-Based Graphics [arxiv] | [code] | 2020
Free View Synthesis [arxiv] | [code] | 2020
Stable View Synthesis [arxiv] | [code]2020
Deformable Neural Radiance Fields [pdf] | [code] | 2020
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images [arxiv] | [code] | 2020
Immersive light field video with a layered mesh representation [pdf] | [project] | 2020
NRMVS: Non-Rigid Multi-View Stereo [code] | 2019
Neural Volumes: Learning Dynamic Renderable Volumes from Images [arxiv] | [code] | 2020
Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization [arxiv] | [code]
Neural3D: Light-weight Neural Portrait Scanning via Context-aware Correspondence Learning [pdf] | 2020
Monocular Real-Time Volumetric Performance Capture [pdf] | [code] | 2020
pixelNeRF : Neural Radiance Fields from One or Few Images [pdf] | [code] | 2020
Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Camera [arxiv] | 2020
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes [arxiv] | [code] | 2020
Space-time Neural Irradiance Fields for Free-Viewpoint Video [arxiv] | [code] | 2020
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis [project] | 2020
Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction [project] | 2020
- use 3DMM to get the facical expression
- encode the input image sqquences to get latent code
- like nerf's MLP, also use facial expressing and latent code as input for the Radiance Fields Network
NeRD: Neural Reflectance Decomposition from Image Collections [code] | 2020
Portrait Neural Radiance Fields from a Single Image [pdf] | [project] | 2020
Object-Centric Neural Scene Rendering [project] | 2020
Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Image [project] | 2020
Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image [arxiv] | [video] | 2020
Neural Radiance Flow for 4D View Synthesis and Video Processing [project] | 2020
Learning Compositional Radiance Fields of Dynamic Human Heads [pdf] | [project] | 2020
Relightable 3D Head Portraits from a Smartphone Video [pdf] | 2020
Learning to Recover 3D Scene Shape from a Single Image [project] | 2020
Vid2Actor: Free-viewpoint Animatable Person Synthesis from Video in the Wild [project] | 2020
Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video [pdf] | 2020
ANR: Articulated Neural Rendering for Virtual Avatars [project] | 2020
Neural Point-Based Graphics [pdf] | [project]
Equivariant Neural Rendering [pdf] | [code]
Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans [pdf] | [project]
Pixel-aligned Volumetric Avatars [pdf] | [project]
D-NeRF: Neural Radiance Fields for Dynamic Scenes [pdf]
Shape-conditioned Radiance Fields from a Single View [pdf] | [project]
NeRF--: Neural Radiance Fields Without Known Camera Parameters [pdf] | [project]
IBRNet: Learning Multi-View Image-Based Rendering [pdf] | [project]
DONeRF: Towards Real-Time Rendering of Neural Radiance Fields using Depth Oracle Networks [pdf] | [project]
Neural 3D Video Synthesis [pdf] | [project]
NeX: Real-time View Synthesis with Neural Basis Expansion [pdf] | [project]
A-NeRF: Surface-free Human 3D Pose Refinement via Neural Rendering [pdf] | [project]
FastNeRF: High-Fidelity Neural Rendering at 200FPS [pdf]
AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis [pdf]
Neural Lumigraph Rendering [pdf] | [project]
AutoInt: Automatic Integration for Fast Neural Volume Rendering [pdf]
PlenOctrees for Real-time Rendering of Neural Radiance Fields [pdf] | [project]
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs [pdf]
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields [pdf]
Baking Neural Radiance Fields for Real-Time View Synthesis [pdf] | [project]
DDR-Net: Learning Multi-Stage Multi-View Stereo With Dynamic Depth Range [pdf] | [code]
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo [pdf] | [project]
GNeRF: GAN-based Neural Radiance Field without Posed Camera [pdf]
NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video [project]
Putting NeRF on a Diet: Semantically Consistent Few-Shot View [pdf] | [project]
MirrorNeRF: One-shot Neural Portrait Radiance Field from Multi-mirror Catadioptric Imaging [pdf]
Neural Articulated Radiance Field [pdf] | [code]
Pixel Codec Avatars [pdf]
Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes [pdf] | [code]
Geometry-Free View Synthesis: Transformers and no 3D Priors [pdf] | [code]
PeeledHuman: Robust Shape Representation for Textured 3D Human Body Reconstruction [pdf] | [project]
High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation [pdf]
UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction [pdf] | [code]
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modelling [pdf] | [project]
BARF : Bundle-Adjusting Neural Radiance Fields [pdf] | [project]
Neural RGB-D Surface Reconstruction [pdf] | [project]
NeMI: Unifying Neural Radiance Fields with Multiplane Images for Novel View Synthesis [pdf] | project
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis [pdf] | [code]
Animatable Neural Radiance Fields for Human Body Modeling [project]
Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors [pdf]
Editable Free-Viewpoint Video using a Layered Neural Representation [pdf]
LASR: Learning Articulated Shape Reconstruction from a Monocular Video [project]
Learning to Generate Novel Scene Compositions from Single Images and Videos [pdf]
POSEFusion: Pose-guided Selective Fusion for Single-view Human Volumetric Capture [project]
Deep Relightable Appearance Models for Animatable Faces [projcet]
Total Relighting:Learning to Relight Portraits for Background Replacement [project]
Dynamic View Synthesis from Dynamic Monocular Video [pdf]
Editing Conditional Radiance Fields [pdf] | [code]
Neural Trajectory Fields for Dynamic Novel View Synthesis [pdf]
NeLF: Practical Novel View Synthesis with Neural Light Field [pdf]
Recursive-NeRF: An Efficient and Dynamically Growing NeRF [pdf]
Convolutional Neural Opacity Radiance Fields [pdf]
Light Field Networks:Neural Scene Representations with Single-Evaluation Rendering [project]
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination[project]
Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control[pdf] | [project]
DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering [pdf] | [project]
Neural Implicit 3D Shapes from Single Images with Spatial Patterns [code]
NeRF in detail: Learning to sample for view synthesis [pdf]
View Generalization for Single Image Textured 3D Models [projet]
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields [project]
FaDIV-Syn: Fast Depth-Independent View Synthesis [pdf]
Animatable Neural Radiance Fields from Monocular RGB Video [pdf]
Free-viewpoint Indoor Neural Relighting from Multi-view Stereo [pdf]
StylePeople A Generative Model of Fullbody Human Avatars [project]
Explicit Clothing Modeling for an Animatable Full-Body Avatar [pdf]
Depth-supervised NeRF: Fewer Views and Faster Training for Free [code]
iNeRF : Inverting Neural Radiance Fields for Pose Estimation [project]
Sharf: Shape-conditioned Radiance Fields from a Single View [project]
STaR : Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Rendering [project]
NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting [project]
H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction [project]
Neural Rays for Occlusion-aware Image-based Rendering [project]
Fast and Explicit Neural View Synthesis [pdf]
Baking Neural Radiance Fields for Real-Time View Synthesis [project]
Relightable Neural Video Portrait [pdf]
MINE Towards Continuous Depth MPI with NeRF for Novel View Synthesis [project]
NeuralMVS: Bridging Multi-View Stereo and Novel View Synthesis [pdf]
FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animation [pdf]
iButter: Neural Interactive Bullet Time Generator for Human Free-viewpoint Rendering [pdf]
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction [code]
improved-nerfmm [code]
Self-Calibrating Neural Radiance Fields [code]
Deep 3D Mask Volume for View Synthesis of Dynamic Scenes [pdf] | [project]
NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo [project]
SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting [project]
Dynamic Scene Novel View Synthesis via Deferred Spatio-temporal Consistency [pdf]
Stochastic Neural Radiance Fields:Quantifying Uncertainty in Implicit 3D Representations [pdf]
CodeNeRF: Disentangled Neural Radiance Fields for Object Categories [code]
Multi-view 3D reconstruction using neural rendering [code]
Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering [code]
FreeStyleGAN: Free-view Editable Portrait Rendering with the Camera Manifold [project]
LENS: Localization enhanced by NeRF synthesis [pdf]
Neural Radiance Fields Approach to Deep Multi-View Photometric Stereo [pdf]
ADOP: Approximate Differentiable One-Pixel Point Rendering [pdf] | [code]
NeRS: Neural Reflectance Surfaces for Sparse-View 3D Reconstruction in the Wild [project]
Appearance Editing with Free-viewpoint Neural Rendering [pdf]
NeuralBlox: Real-Time Neural Representation Fusion for Robust Volumetric Mapping [code]
StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis [project]
3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers [code]
NeRV: Neural Representations for Videos [code]
H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion [pdf]
Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objects [[https://arxiv.org/pdf/2110.14217.pdf]]
Novel View Synthesis from a Single Image via Unsupervised Learning [pdf]
Neural View Synthesis and Matching for Semi-Supervised Few-Shot Learning of 3D Pose [code]
Volume Rendering of Neural Implicit Surfaces [pdf]
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis [project]
Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance [project]
Common Objects in 3D:Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction [pdf] | [code]
TermiNeRF: Ray Termination Prediction for Efficient Neural Rendering [project]
LOLNeRF: Learn from One Look [pdf]
DIVeR: Deterministic Integration for Volume Rendering [pdf] | [code]
irect Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction [pdf] [code]
Neural Fields in Visual Computing and Beyond [pdf]
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields [pdf]
VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field [code]
NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images [project]
GeoNeRF: Generalizing NeRF with Geometry Priors [project]
Neural Fields as Learnable Kernels for 3D Reconstruction [project]
NeSF: Neural Scene Fields [project]
Human Pose Manipulation and Novel View Synthesis using Differentiable Rendering [pdf]
HDR-NeRF: High Dynamic Range Neural Radiance Fields [project]
Deblur-NeRF: Neural Radiance Fields from Blurry Images [pdf]
NeuSample: Neural Sample Field for Efficient View Synthesis [project]
FENeRF: Face Editing in Neural Radiance Fields [pdf]
Hallucinated Neural Radiance Fields in the Wild [pdf] | [project]
NeRFReN: Neural Radiance Fields with Reflections [project]
Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs [project]
Learning Neural Light Fields with Ray-Space Embedding Networks [project]
Neural Point Light Fields [pdf]
CoNeRF: Controllable Neural Radiance Fields [project]
NeRF-SR: High-Quality Neural Radiance Fields using Super-Sampling [project]
Neural Head Avatars from Monocular RGB Videos [project]
Fast Neural Representations for Direct Volume Rendering [project]
Efficient Neural Radiance Fields with Learned Depth-Guided Sampling [project]
HumanNeRF: Generalizable Neural Human Radiance Field from Sparse Inputs [pdf]
Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields [project]
CG-NeRF: Conditional Generative Neural Radiance Fields [pdf]
Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering [pdf]
Neural Radiance Fields for Outdoor Scene Relighting [project]
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields [project]
Plenoxels: Radiance Fields without Neural Networks [project]
HeadNeRF: A Real-time NeRF-based Parametric Head Model [project]
PERF: Performant, Explicit Radiance Fields [pdf]
CityNeRF: Building NeRF at City Scale [project]
Dynamic View Synthesis from Dynamic Monocular Video [project]
Light Field Neural Rendering [project]
Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs [project]
DD-NeRF: Double-Diffusion Neural Radiance Field as a Generalizable Implicit Body Representation[pdf]
Human View Synthesis using a Single Sparse RGB-D Input [project]
DFA-NeRF: Personalized Talking Head Generation via Disentangled Face attributes Neural Rendering [pdf]
InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering [project]
NeROIC: Neural Object Capture and Rendering from Online Image Collections [project]
HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video [project]
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding [code]
Point-NeRF: Point-based Neural Radiance Fields project
Animatable Neural Radiance Fields from Monocular RGB Videos [code]
Block-NeRF: Scalable Large Scene Neural View Synthesis [project]
PVSeRF: Joint Pixel-, Voxel- and Surface-Aligned Radiance Field for Single-Image Novel View Synthesis [pdf]
NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing [pdf]
NeuralFusion: Neural Volumetric Rendering under Human-object Interactions [pdf]
NeRF-Supervision：Learning Dense Object Descriptors from Neural Radiance Fields [project]
NeReF: Neural Refractive Field for Fluid Surface Reconstruction and Implicit Representation [pdf]
RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering [project]
NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimation [pdf]
DialogueNeRF: Towards Realistic Avatar Face-to-face Conversation Video Generation [pdf]
Tensorial Radiance Fields [project]
Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Cameras [pdf]
Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering [pdf]
Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantification [pdf]
ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers[pdf]
Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields[project]
NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction [project]
Spline-NeRF: C0-Continuous Dynamic NeRF [project]
NPBG++: Accelerating Neural Point-Based Graphics [project]
DRaCoN – Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars [project]
AutoRF: Learning 3D Object Radiance Fields from Single View Observations [project]
NAN: Noise-Aware NeRFs for Burst-Denoising [project]
GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation [project]
StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions [project]
Modeling Indirect Illumination for Inverse Rendering [project]
Block-NeRF Scalable Large Scene Neural View Synthesis [project]
FENeRF: Face Editing in Neural Radiance Fields [project]
RegNeRF:Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs [project]
Urban Radiance Fields [project]
Dense Depth Priors for Neural Radiance Fields from Sparse Input Views [project]
Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulation [pdf]
Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis [project]
Real-Time Neural Character Rendering with Pose-Guided Multiplane Images [project]
NeuMips: Neural Mixture of Planar Experts for View Synthesis [project]
KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypoints [project]
NeRF-Editing: Geometry Editing of Neural Radiance Fields [pdf]
View Synthesis with Sculpted Neural Points [project]
Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation [pdf]
3D Moments from Near-Duplicate Photos [project]
Mip-NeRF RGB-D: Depth Assisted Fast Neural Radiance Fields [pdf]
EfficientNeRF – Efficient Neural Radiance Fields [pdf] | [[code]](ttps://github.com/dvlab- research/EfficientNeRF)
StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning [pdf]
Neural 3D Reconstruction in the Wild [project]
TiNeuVox:Fast Dynamic Radiance Fields with Time-Aware Neural Voxels [project]
V4D: Voxel for 4D Novel View Synthesis [pdf]
D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video [code]
DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes [pdf] | [code]
Novel View Synthesis for High-fidelity Headshot Scenes [pdf]
Decomposing NeRF for Editing via Feature Field Distillation [project]
Neural Volumetric Object Selection [project]
Points2NeRF: Generating Neural Radiance Fields from 3D point cloud [code]
ARF: Artistic Radiance Fields [project]
RigNeRF: Fully Controllable Neural 3D Portraits [project]
Compressible-composable NeRF via Rank-residual Decomposition [code]
UNeRF: Time and Memory Conscious U-Shaped Network for Training Neural Radiance Fields [pdf]
EventNeRF: Neural Radiance Fields from a Single Colour Event Camera [code]
Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations [code]
SNeRF: Stylized Neural Implicit Representations for 3D Scenes [pdf]
VMRF: View Matching Neural Radiance Fields [pdf]
Progressively-connected Light Field Network for Efficient View Synthesis [project]
Vision Transformer for NeRF-Based View Synthesis from a Single Input Image [project]
Relighting4D: Neural Relightable Human from Videos [code]
Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation [project]
AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields [project]
Generalizable Patch-Based Neural Rendering [project]
NeRF for Outdoor Scene Relighting [code]
Neural Pixel Composition: 3D-4D View Synthesis from Multi-Views [project]
Deforming Radiance Fields with Cages [project]
PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo [project]
Neural-Sim: Learning to Generate Training Data with NeRF [code]
Is Attention All NeRF Needs? [code]
Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Images [code]
DoF-NeRF: Depth-of-Field Meets Neural Radiance Fields [code]
NeuMan: Neural Human Radiance Field from a Single Video [code]
UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene [project]
Scalable Neural Indoor Scene Rendering [project]
NeuralPassthrough: Learned Real-Time View Synthesis for VR [code]
NeROIC: Neural Object Capture and Rendering from Online Image Collections [project]