Awesome Radiance Field-based 3D Editing

Curated by Weize Li ; Huan-ang Gao @AIR-DISCOVER Lab and Tianshu Kuai @University of Toronto

We express our gratitude to the contributors.

Welcome to awesome-nerf-editing🧙🏻‍♂️, your ultimate resource for exploring the exciting world of Radiance Fields Editing! Neural Fields is revolutionizing computer vision and 3D graphics, and this curated collection of resources is your gateway to understanding and mastering editing techniques.

Seminal Papers

• ECCV 2020 Oral NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis | [Project Page]
• SIGGRAPH 2023 3D Gaussian Splatting for Real-Time Radiance Field Rendering | [Project Page]

Related Surveys

• arXiv Recent Advances in 3D Gaussian Splatting
• arXiv Advances in 3D Generation: A Survey
• arXiv A Survey on 3D Gaussian Splatting
• arXiv 3D Gaussian as a New Vision Era: A Survey
• arXiv Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review
• Eurographics 2022 Advances in Neural Rendering
• arXiv Advances in 3D Neural Stylization: A Survey
• Eurographics 2021 Neural Fields in Visual Computing and Beyond
• arXiv A Revisit of Shape Editing Techniques: from the Geometric to the Neural Viewpoint
• arXiv Text-guided Image-and-Shape Editing and Generation: A Short Survey
• arXiv Diffusion Model-Based Image Editing: A Survey
• TPAMI 2023 Multimodal Image Synthesis and Editing: The Generative AI Era

Recent Research [Latest Update: 2024/06/22☕]

🚨 Note: Please be aware that the acceptance status of some works might not be up-to-date.
💬 Feel Welcome to Open an Issue or Pull Request!

• 2024
  • CVPR 2024 Highlight TutteNet: Injective 3D Deformations by Composition of 2D Mesh Deformations | [Project Page]
  • CVPR 2024 Highlight PAPR in Motion: Seamless Point-level 3D Scene Interpolation | [Project Page]
  • CVPR 2024 Highlight Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents | [Project Page]
  • CVPR 2024 GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting | [Project Page]
  • CVPR 2024 GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions | [Project Page]
  • CVPR 2024 PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF | [Project Page]
  • CVPR 2024 PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics | [Project Page]
  • CVPR 2024 SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering | [Project Page]
  • CVPR 2024 Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes | [Project Page]
  • CVPR 2024 Posterior Distillation Sampling | [Project Page]
  • CVPR 2024 SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes | [Project Page]
  • CVPR 2024 NeRFiller: Completing Scenes via Generative 3D Inpainting | [Project Page]
  • CVPR 2024 DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes | [Project Page]
  • CVPR 2024 LAENeRF: Local Appearance Editing for Neural Radiance Fields | [Project Page]
  • CVPR 2024 NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs | [Project Page]
  • CVPR 2024 Control4D: Efficient 4D Portrait Editing with Text | [Project Page]
  • CVPR 2024 Dynamic LiDAR Re-simulation using Compositional Neural Fields | [Project Page]
  • CVPR 2024 SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds | [Project Page]
  • CVPR 2024 Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training | [Project Page]
  • CVPR 2024 SIGNeRF: Scene Integrated Generation for Neural Radiance Fields | [Project Page]
  • CVPR 2024 Geometry Transfer for Stylizing Radiance Fields | [Project Page]
  • CVPR 2024 DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing | [Project Page]
  • CVPR 2024 BerfScene: Bev-conditioned Equivariant Radiance Fields for Infinite 3D Scene Generation | [Project Page]
  • CVPR 2024 CoGS: Controllable Gaussian Splatting | [Project Page]
  • CVPR 2024 InNeRF360: Text-Guided 3D-Consistent Object Inpainting on Unbounded Neural Radiance Fields | [Project Page]
  • CVPR 2024 Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields | [Project Page]
  • CVPR 2024 GenN2N: Generative NeRF2NeRF Translation | [Project Page]
  • CVPR 2024 Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video | [Project Page]
  • CVPR 2024 SANeRF-HQ: Segment Anything for NeRF in High Quality | [Project Page]
  • CVPR 2024 IReNe: Instant Recoloring in Neural Radiance Fields | [Project Page]
  • CVPR 2024 NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows | [Project Page]
  • CVPR 2024 Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusion | [Project Page]
  • CVPR 2024 S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic Scenes | [Project Page]
  • CVPR 2024 Text-Guided 3D Face Synthesis - From Generation to Editing | [Project Page]
  • CVPR 2024 Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates | [Code]
  • CVPR 2024 MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior
  • CVPR 2024 StrokeFaceNeRF: Stroke-based Facial Appearance Editing in Neural Radiance Field
  • CVPRW 2024 ICE-G: Image Conditional Editing of 3D Gaussian Splats | [Project Page]
  • SIGGRAPH 2024 TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts | [Project Page]
  • SIGGRAPH 2024 LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer | [Project Page]
  • SIGGRAPH 2024 Bilateral Guided Radiance Field Processing | [Project Page]
  • SIGGRAPH 2024 SketchDream: Sketch-based Text-to-3D Generation and Editing
  • ICLR 2024 EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision | [Project Page]
  • ICLR 2024 InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image | [Project Page]
  • ICLR 2024 SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D | [Project Page]
  • ICLR 2024 ED-NeRF: Efficient Text-Guided Editing of 3D Scene using Latent Space NeRF | [Project Page]
  • ICLR 2024 MagicDrive: Street View Generation with Diverse 3D Geometry Control | [Project Page]
  • ICLR 2024 Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts | [Project Page]
  • WACV 2024 NeRFEditor: Differentiable Style Decomposition for 3D Scene Editing | [Project Page]
  • WACV 2024 Volumetric Disentanglement for 3D Scene Manipulation 丨 [Project Page]
  • WACV 2024 Fast Sun-aligned Outdoor Scene Relighting based on TensoRF
  • WACV 2024 Open-NeRF: Towards Open Vocabulary NeRF Decomposition
  • WACV 2024 3D Face Style Transfer with a Hybrid Solution of NeRF and Mesh Rasterization
  • 3DV 2024 Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture 丨 [Project Page]
  • 3DV 2024 Text-Guided Generation and Editing of Compositional 3D Avatars 丨 [Project Page]
  • 3DV 2024 Learning Controllable 3D Diffusion Models from Single-view Images 丨 [Project Page]
  • 3DV 2024 Compositional 3D Scene Generation using Locally Conditioned Diffusion | [Project Page]
  • 3DV 2024 Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models | [Project Page]
  • 3DV 2024 CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields
  • CG & A 2024 NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors | [Project Page]
  • AAAI 2024 A General Implicit Framework for Fast NeRF Composition and Rendering
  • AAAI 2024 FPRF: Feed-Forward Photorealistic Style Transfer of Large-Scale 3D Neural Radiance Fields | [Project Page]
  • I3D 2024 ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context | [Project Page]
  • ICRA 2024 Closing the Visual Sim-to-Real Gap with Object-Composable NeRFs
  • IEEE VR 2024 Dreaming Your Room Space with Text-Driven | [Project Page]
  • arXiv GO-NeRF: Generating Virtual Objects in Neural Radiance Fields | [Project Page]
  • arXiv InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenes | [Project Page]
  • arXiv Street Gaussians for Modeling Dynamic Urban Scenes | [Project Page]
  • arXiv Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting | [Project Page]
  • arXiv VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality | [Project Page]
  • arXiv ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields | [Project Page]
  • arXiv GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting | [Code]
  • arXiv GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing | [Project Page]
  • arXiv StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting | [Project Page]
  • arXiv StyleDyRF: Zero-shot 4D Style Transfer for Dynamic Neural Radiance Fields | [Code]
  • arXiv CoSSegGaussians: Compact and Swift Scene Segmenting 3D Gaussians | [Project Page]
  • arXiv Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering | [Project Page]
  • arXiv Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing | [Project Page]
  • arXiv Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition | [Project Page]
  • arXiv Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior | [Project Page]
  • arXiv DATENeRF: Depth-Aware Text-based Editing of NeRFs | [Project Page]
  • arXiv Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing | [Project Page]
  • arXiv Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting | [Project Page]
  • arXiv EgoLifter: Open-world 3D Segmentation for Egocentric Perception | [Project Page]
  • arXiv Taming Latent Diffusion Model for Neural Radiance Field Inpainting | [Project Page]
  • arXiv RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting | [Project Page]
  • arXiv StyleCity: Large-Scale 3D Urban Scenes Stylization with Vision-and-Text Reference via Progressive Optimization | [Project Page]
  • arXiv InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior | [Project Page]
  • arXiv PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation | [Project Page]
  • arXiv GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal | [Project Page]
  • arXiv ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis | [Code]
  • arXiv DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing | [Project Page]
  • arXiv Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting | [Project Page]
  • arXiv Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians | [Project Page]
  • arXiv Gaga: Group Any Gaussians via 3D-aware Memory Bank | [Project Page]
  • arXiv GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting | [Project Page]
  • arXiv GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting | [Project Page]
  • arXiv Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injection | [Project Page]
  • arXiv Mani-GS: Gaussian Splatting Manipulation with Triangular Mesh | [Project Page]
  • arXiv 3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting | [Project Page]
  • arXiv Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion | [Project Page]
  • arXiv Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images | [Project Page]
  • arXiv Scaling Face Interaction Graph Networks to Real World Scenes
  • arXiv Segment Anything in 3D Gaussians
  • arXiv Mesh-based Gaussian Splatting for Real-time Large-scale Deformation
  • arXiv SealD-NeRF: Interactive Pixel-Level Editing for Dynamic Scenes by Neural Radiance Fields
  • arXiv Real-time 3D-aware Portrait Editing from a Single Image
  • arXiv Gaussian Splatting in Style
  • arXiv GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting
  • arXiv A New Split Algorithm for 3D Gaussian Splatting
  • arXiv 3D Gaussian Model for Animation and Texturing
  • arXiv SWAG: Splatting in the Wild images with Appearance-conditioned Gaussians
  • arXiv View-Consistent 3D Editing with Gaussian Splatting
  • arXiv Fast Sparse View Guided NeRF Update for Object Reconfigurations
  • arXiv Omni-Recon: Towards General-Purpose Neural Radiance Fields for Versatile 3D Applications
  • arXiv StylizedGS: Controllable Stylization for 3D Gaussian Splatting
  • arXiv DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading
  • arXiv NeRF-Insert: 3D Local Editing with Multimodal Control Signals
  • arXiv Depth Priors in Removal Neural Radiance Fields
  • arXiv Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splatting
  • arXiv M2DNeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields
  • arXiv Point Resampling and Ray Transformation Aid to Editable NeRF Models
  • arXiv Direct Learning of Mesh and Appearance via 3D Gaussian Splatting
  • arXiv TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing
  • arXiv Preserving Identity with Variational Score for General-purpose 3D Editing

• 2023
  • NeurIPS 2023 UE4-NeRF:Neural Radiance Field for Real-Time Rendering of Large-Scale Scene | [Project Page]
  • NeurIPS 2023 FDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Models 丨 [Code]
  • NeurIPS 2023 OBJect 3DIT: Language-guided 3D-aware Image Editing 丨 [Project Page]
  • NeurIPS 2023 ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields 丨 [Project Page]
  • NeurIPS 2023 LightSim: Neural Lighting Simulation for Urban Scenes 丨 [Project Page]
  • CICAI 2023 Best Paper Runner-up MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Driving 丨 [Project Page]
  • ICCV 2023 Oral ENVIDR: Implicit Differentiable Renderer with Neural Environment Lighting 丨 [Project Page]
  • ICCV 2023 Oral Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions 丨 [Project Page]
  • ICCV 2023 UrbanGIRAFFE: Representing Urban Scenes as Compositional Generative Neural Feature Fields 丨 [Project Page]
  • ICCV 2023 Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting 丨 [Project Page]
  • ICCV 2023 ICE-NeRF: Interactive Color Editing of NeRFs via Decomposition-Aware Weight Optimization
  • ICCV 2023 ReNeRF: Relightable Neural Radiance Fields with Nearfield Lighting
  • ICCV 2023 3D-aware Blending with Generative NeRFs 丨 [Project Page]
  • ICCV 2023 Vox-E: Text-guided Voxel Editing of 3D Objects 丨 [Project Page]
  • ICCV 2023 3D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capability 丨 [Code]
  • ICCV 2023 Urban Radiance Field Representation with Deformable Neural Mesh Primitives 丨 [Project Page]
  • ICCV 2023 DeformToon3D: Deformable 3D Toonification from Neural Radiance Fields 丨 [Project Page]
  • ICCV 2023 Learning Neural Implicit Surfaces with Object-Aware Radiance Fields
  • ICCV 2023 X-Mesh:Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance 丨 [Project Page]
  • ICCV 2023 Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images
  • ICCV 2023 Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction 丨 [Project Page]
  • ICCV 2023 Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement 丨 [Project Page]
  • ICCV 2023 Locally Stylized Neural Radiance Fields
  • ICCV 2023 CC3D: Layout-Conditioned Generation of Compositional 3D Scenes 丨 [Project Page]
  • ICCV 2023 IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis 丨 [Project Page]
  • ICCV 2023 Dynamic Mesh-Aware Radiance Fields 丨 [Project Page]
  • ICCV 2023 Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields 丨 [Project Page]
  • ICCV 2023 Text2Tex: Text-driven Texture Synthesis via Diffusion Models | [Project Page]
  • ICCV 2023 Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models | [Project Page]
  • ICCV 2023 Learning Unified Decompositional and Compositional NeRF for Editable Novel View Synthesis 丨 [Project Page]
  • ICCV 2023 Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fields 丨 [Project Page]
  • ICCV 2023 FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields 丨 [Project Page]
  • ICCV 2023 Reference-guided Controllable Inpainting of Neural Radiance Fields 丨 [Project Page]
  • ICCV 2023 Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior 丨 [Project Page]
  • ICCV 2023 SKED: Sketch-guided Text-based 3D Editing 丨 [Project Page]
  • ICCV 2023 MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videos | [code]
  • ICCV 2023 ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field 丨 [Project Page]
  • ICCV 2023 Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Views 丨 [Project Page]
  • ICCVW 2023 LatentSwap3D: Semantic Edits on 3D Image GANs 丨 [Project Page]
  • ICCVW 2023 S2RF: Semantically Stylized Radiance Fields
  • ICCVW 2023 CoRF : Colorizing Radiance Fields using Knowledge Distillation
  • ICCVW 2023 BluNF: Blueprint Neural Field 丨 [Project Page]
  • ICCVW 2023 Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields 丨 [Project Page]
  • TPAMI 2023 Interactive NeRF Geometry Editing With Shape Priors
  • TVCG 2023 IntrinsicNGP: Intrinsic Coordinate based Hash Encoding for Human NeRF 丨 [Project Page]
  • TVCG 2023 VQ-NeRF: Neural Reflectance Decomposition and Editing with Vector Quantization | [Project Page]
  • TVCG 2023 Nerf-Art: Text-Driven Neural Radiance Fields Stylization | [Project Page]
  • CVPR 2023 Highlight UniSim: A Neural Closed-Loop Sensor Simulator 丨 [Project Page]
  • CVPR 2023 Highlight Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization
  • CVPR 2023 Highlight DiffRF: Rendering-Guided 3D Radiance Field Diffusion 丨 [Project Page]
  • CVPR 2023 Highlight Frequency-Modulated Point Cloud Rendering with Easy Editing 丨 [Code]
  • CVPR 2023 Interactive Segmentation of Radiance Fields 丨 Project Page
  • CVPR 2023 NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Clouds 丨 [Project Page]
  • CVPR 2023 PaletteNeRF: Palette-based Color Editing for NeRFs | [Project Page]
  • CVPR 2023 SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields 丨 [Project Page]
  • CVPR 2023 Removing Objects From Neural Radiance Fields | [Project Page]
  • CVPR 2023 EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points | [Project Page]
  • CVPR 2023 Local 3D Editing via 3D Distillation of CLIP Knowledge 丨 [Project Page]
  • CVPR 2023 SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field 丨 [Project Page]
  • CVPR 2023 PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervision 丨 [Project Page]
  • CVPR 2023 Magic3D: High-Resolution Text-to-3D Content Creation 丨 [Project Page]
  • CVPR 2023 StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields 丨 [Project Page]
  • CVPR 2023 Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization 丨 [Project Page]
  • CVPR 2023 Multi-Object Manipulation via Object-Centric Neural Scattering Functions 丨 [Project Page]
  • CVPR 2023 UV Volumes for Real-time Rendering of Editable Free-view Human Performance 丨 [Project Page]
  • CVPR 2023 Neural Fields meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes 丨 [Project Page]
  • CVPR 2023 TexIR:Multi-view Inverse Rendering for Large-scale Real-world Indoor Scenes 丨 [Project Page]
  • CVPR 2023 TensoIR: Tensorial Inverse Rendering 丨 [Project Page]
  • CVPR 2023 RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation 丨 [Code]
  • CVPR 2023 I_{2}-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFs 丨 [Project Page]
  • CVPR 2023 Nerflets: Local Radiance Fields for Efficient Structure-Aware 3D Scene Representation from 2D Supervision 丨 [Project Page]
  • CVPR 2023 HumanGen: Generating Human Radiance Fields with Explicit Priors
  • CVPR 2023 NeRFInvertor: High Fidelity NeRF-GAN Inversion for Single-shot Real Image Animation
  • CVPRW 2023 FusedRF: Fusing Multiple Radiance Fields
  • CVPRW 2023 SPIDR: SDF-based Neural Point Fields for Illumination and Deformation 丨 [Project Page]
  • CVPRW 2023 DeSRF: Deformable Stylized Radiance Field
  • ICLR 2023 General Neural Gauge Fields 丨 [Project Page]
  • SIGGRAPH 2023 Adaptive Shells for Efficient Neural Radiance Field Rendering | [Project Page]
  • SIGGRAPH 2023 DE-NeRF: DEcoupled Neural Radiance Fields for View-Consistent Appearance Editing and High-Frequency Environmental Relighting | [Project Page]
  • SIGGRAPH 2023 ClipFace: Text-guided Editing of Textured 3D Morphable Models | [Project Page]
  • SIGGRAPH Asia 2023 HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Image | [Project Page]
  • SIGGRAPH Asia 2023 SeamlessNeRF: Stitching Part NeRFs with Gradient Propagation | [Project Page]
  • SIGGRAPH Asia 2023 DreamEditor: Text-Driven 3D Scene Editing with Neural Fields
  • SIGGRAPH Asia 2023 BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesis
  • SIGGRAPH Asia 2023 AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars 丨 [Project Page]
  • SIGGRAPH Asia 2023 SOL-NeRF: Sunlight Modeling for Outdoor Scene Decomposition and Relighting | [Project Page]
  • ICRA 2023 Reconstructing Objects in-the-wild for Realistic Sensor Simulation 丨 [Project Page]
  • AAAI 2023 Oral Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field 丨 [Code]
  • AAAI 2023 Oral One is All: Bridging the Gap Between Neural Radiance Fields Architectures with Progressive Volume Distillation | [Project Page]
  • ACM MM 2023 Relit-NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field | [Project Page]
  • ACM MM 2023 RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenes | [Project Page]
  • ACM MM 2023 Context-Aware Talking-Head Video Editing
  • IJCAI 2023 RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models
  • IJCAI 2023 TeSTNeRF: Text-Driven 3D Style Transfer via Cross-Modal Learning
  • BMVC 2023 Breathing New Life into 3D Assets with Generative Repainting | [Project Page]
  • WACV 2023 3D GAN Inversion with Pose Optimization | [Project Page]
  • WACV 2023 Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulation | [Project Page]
  • ICMR 2023 RIP-NeRF: Learning Rotation-Invariant Point-based Neural Radiance Field for Fine-grained Editing and Compositing
  • PG & CGF 2023 Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulation
  • I3D 2023 NeRFshop: Interactive Editing of Neural Radiance Fields | [Project Page]
  • arXiv Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models | [Project Page]
  • arXiv LatentEditor: Text Driven Local Editing of 3D Scenes | [Project Page]
  • arXiv Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models | [Project Page]
  • arXiv Learning Naturally Aggregated Appearance for Efficient 3D Editing | [Project Page]
  • arXiv Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion | [Project Page]
  • arXiv Towards 4D Human Video Stylization | [Code]
  • arXiv Segment Any 3D Gaussians | [Project Page]
  • arXiv Mesh-Guided Neural Implicit Field Editing | [Project Page]
  • arXiv Gaussian Grouping: Segment and Edit Anything in 3D Scenes | [Project Page]
  • arXiv Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing | [Project Page]
  • arXiv Obj-NeRF: Extracting Object NeRFs from Multi-view Images | [Project Page]
  • arXiv 4D-Editor: Interactive Object-level Editing in Dynamic Neural Radiance Fields via 4D Semantic Segmentation | [Project Page]
  • arXiv NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields | [Code]
  • arXiv Controllable Dynamic Appearance for Neural 3D Portraits | [Project Page]
  • arXiv Text-driven Editing of 3D Scenes without Retraining 丨 [Project Page]
  • arXiv Watch Your Steps: Local Image and Scene Editing by Text Instructions 丨 [Project Page]
  • arXiv Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields 丨 [Project Page]
  • arXiv Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images 丨 [Project Page]
  • arXiv DORSal: Diffusion for Object-centric Representations of Scenes et al. 丨 [Project Page]
  • arXiv UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video 丨 [Project Page]
  • arXiv OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fields 丨 [Project Page]
  • arXiv Unsupervised Object-Centric Voxelization for Dynamic Scene Understanding 丨 [Project Page]
  • arXiv PVD-AL: Progressive Volume Distillation with Active Learning for Efficient Conversion Between Different NeRF Architectures 丨 [Project Page]
  • arXiv VMesh: Hybrid Volume-Mesh Representation for Efficient View Synthesis 丨 [Project Page]
  • arXiv TEGLO: High Fidelity Canonical Texture Mapping from Single-View Images 丨 [Project Page]
  • arXiv Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenes 丨 [Project Page]
  • arXiv MovingParts: Motion-based 3D Part Discovery in Dynamic Radiance Field 丨 [Project Page]
  • arXiv In-N-Out: Face Video Inversion and Editing with Volumetric Decomposition 丨 [Project Page]
  • arXiv Free-Editor: Zero-shot Text-driven 3D Scene Editing | [Project Page]
  • arXiv UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene | [Project Page]
  • arXiv Instant Neural Radiance Fields Stylization | [Code]
  • arXiv LANe: Lighting-Aware Neural Fields for Compositional Scene Synthesis | [Project Page]
  • arXiv SERF: Fine-Grained Interactive 3D Segmentation and Editing with Radiance Fields
  • arXiv Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fields
  • arXiv DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance Fields
  • arXiv Neural Implicit Field Editing Considering Object-environment Interaction
  • arXiv A Real-time Method for Inserting Virtual Objects into Neural Radiance Fields
  • arXiv Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraints
  • arXiv ITEM3D: Illumination-Aware Directional Texture Editing for 3D Models
  • arXiv MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field
  • arXiv Focused Specific Objects NeRF
  • arXiv Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model
  • arXiv Instruct-NeuralTalker: Editing Audio-Driven Talking Radiance Fields with Instructions
  • arXiv PlaNeRF: SVD Unsupervised 3D Plane Regularization for NeRF Large-Scale Scene Reconstruction
  • arXiv NaviNeRF: NeRF-based 3D Representation Disentanglement by Latent Semantic Navigation
  • arXiv UVA: Towards Unified Volumetric Avatar for View Synthesis, Pose rendering, Geometry and Texture Editing
  • arXiv CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout
  • arXiv Interactive Geometry Editing of Neural Radiance Fields
  • arXiv LC-NeRF: Local Controllable Face Generation in Neural Randiance Field
  • arXiv ASSIST: Interactive Scene Nodes for Scalable and Realistic Indoor Simulation

• 2022
  • EGSR 2022 Recolorable Posterization of Volumetric Radiance Fields Using Visibility-Weighted Palette Extraction | [Project Page]
  • NeurIPS 2022 Spotlight Neural Shape Deformation Priors | [Project Page]
  • NeurIPS 2022 Spotlight TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition 丨 [Project Page]
  • NeurIPS 2022 NeuPhysics: Editable Neural Geometry and Physics from Monocular Videos 丨 [Project Page]
  • NeurIPS 2022 Compressible-composable NeRF via Rank-residual Decomposition 丨 [Project Page]
  • NeurIPS 2022 CageNeRF: Cage-based Neural Radiance Fields for Genrenlized 3D Deformation and Animation 丨 [Project Page]
  • NeurIPS 2022 Decomposing NeRF for Editing via Feature Field Distillation 丨 [Project Page]
  • NeurIPS 2022 SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections 丨 [Project Page]
  • NeurIPS 2022 Unsupervised Multi-View Object Segmentation Using Radiance Field Propagation 丨 [Project Page]
  • NeurIPS 2022 D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video
  • ECCV 2022 Oral Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing | [Project Page]
  • ECCV 2022 MoFaNeRF: Morphable Facial Neural Radiance Field | [Project Page]
  • ECCV 2022 LaTeRF: Label and Text Driven Object Radiance Fields
  • ECCV 2022 NeRF for Outdoor Scene Relighting | [Project Page]
  • ECCV 2022 Deforming Radiance Fields with Cages | [Project Page]
  • ECCV 2022 Object-Compositional Neural Implicit Surfaces | [Project Page]
  • ECCV 2022 ARF: Artistic Radiance Fields | [Project Page]
  • ECCV 2022 Unified Implicit Neural Stylization | [Project Page]
  • ECCV 2022 Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis 丨 [Project Page]
  • ECCV 2022 PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo | [Project Page]
  • ECCV 2022 Multiview Regenerative Morphing with Dual Flows | [Project Page]
  • CVPR 2022 Oral Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields | [Project Page]
  • CVPR 2022 NeRF-Editing: Geometry Editing of Neural Radiance Fields | [Code]
  • CVPR 2022 CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields | [Project Page]
  • CVPR 2022 CoNeRF: Controllable Neural Radiance Fields | [Project Page]
  • CVPR 2022 Zero-Shot Text-Guided Object Generation with Dream Fields | [Project Page]
  • CVPR 2022 StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning | [Project Page]
  • CVPR 2022 AutoRF: Learning 3D Object Radiance Fields from Single View Observations | [Project Page]
  • CVPR 2022 Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation | [Project Page]
  • CVPR 2022 Self-supervised Neural Articulated Shape and Appearance Models | [Project Page]
  • CVPR 2022 RigNeRF: Fully Controllable Neural 3D Portraits | [Project Page]
  • CVPR 2022 NeRFReN: Neural Radiance Fields with Reflections | [Project Page]
  • CVPR 2022 FENeRF: Face Editing in Neural Radiance Fields | [Project Page]
  • ICLR 2022 Unsupervised Discovery of Object Radiance Fields | [Project Page]
  • ICLR 2022 StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis | [Project Page]
  • SIGGRAPH 2022 AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars | [Project Page]
  • SIGGRAPH 2022 SNeRF: Stylized Neural Implicit Representations for 3D Scenes | [Project Page]
  • SIGGRAPH 2022 Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects | [Project Page]
  • SIGGRAPH Asia 2022 Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracing | [Project Page]
  • SIGGRAPH Asia 2022 FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression Editing
  • SIGGRAPH Asia 2022 Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video | [Project Page]
  • 3DV 2022 Oral Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations | Project Page
  • 3DV 2022 Controllable Radiance Fields for Dynamic Face Synthesis | [Project Page]
  • PG & CGF 2022 Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects
  • arXiv Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion | [Project Page]
  • arXiv SSDNeRF: Semantic Soft Decomposition of Neural Radiance Fields | [Project Page]
  • arXiv ONeRF: Unsupervised 3D Object Segmentation from Multiple Views
  • arXiv FLNeRF: 3D Facial Landmarks Estimation in Neural Radiance Fields
  • arXiv NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields
  • arXiv Estimating Neural Reflectance Field from Radiance Field using Tree Structures
  • arXiv ObPose: Leveraging Pose for Object-Centric Scene Inference and Generation in 3D
  • arXiv ERF: Explicit Radiance Field Reconstruction From Scratch
  • arXiv NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing
  • arXiv VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representations

  ---

• 2021
  • CVPR 2021 Oral Neural Scene Graphs for Dynamic Scenes | [Project Page]
  • CVPR 2021 NeuTex: Neural Texture Mapping for Volumetric Neural Rendering | [Code]
  • CVPR 2021 STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Rendering | [Project Page]
  • ICCV 2021 CodeNeRF: Disentangled Neural Radiance Fields for Object Categories | [Project Page]
  • ICCV 2021 Editing Conditional Radiance Fields | [Project Page]
  • ICCV 2021 Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering | [Project Page]
  • ICCV 2021 Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video | [Project Page]
  • ICCV 2021 AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis | [Project Page]
  • SIGGRAPH Asia 2021 NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination | [Project Page]
  • SIGGRAPH 2021 Editable Free-viewpoint Video Using a Layered Neural Representation | [Project Page]
  • arXiv DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering | [Code]
  • arXiv Appearance Editing with Free-viewpoint Neural Rendering

  ---

• 2020
  • NeurIPS 2020 Spotlight Neural Sparse Voxel Fields | [Project Page]
  • arXiv Object-Centric Neural Scene Rendering

License

This project is licensed under the MIT License.