My Cart

Subtotal: $0,00
No products in the cart.

3D Modeling News from the Web

3D Modeling and 3D Design News from the good 'ol internet

Free NeRF toolset Nerfstudio now supports 360° video

Share on Social Media

Open-source Neural Radiance Field framework Nerfstudio now supports 360-degree video.

Nerfstudio 0.1.19 supports equirectangular video, making it possible to generate 3D scenes matching footage recorded on 360-degree cameras and export them to DCC apps for use in games, VFX or visualisation.

An open-source library of modular components for NeRF-based scene reconstruction pipelines
First released last year, Nerftudio is a library of modular components for implementing Neural Radiance Fields (NeRF) into computer graphics pipelines.

Developed by researchers at UC Berkeley, Neural Radiance Fields (NeRF) are a new method for training a neural network to generate and optimise a volumetric representation of a scene from a set of source images.

Although its creators focused on NeRF as a means of synthesising new views of a scene, the volumetric representation can be converted into a 3D mesh, making it an alterative to photogrammetry for 3D scanning.

Generate 3D scenes matching source images and export them as point clouds or textured meshes
Using Nerfstudio, artists can train a neural network on a set of custom images and export the 3D data it generates to DCC software, either as point clouds in PLY format or textured meshes in OBJ format.

The framework comes with a dedicated add-on for Blender, and the project website includes instructions for exporting Nerftudio models to Unreal Engine in NVOL format.

The source images themselves can be ingested into Nerfstudio via open-source photogrammetry pipeline COLMAP, or directly from photogrammetry apps including Kiri Engine, Polycam and Metashape.

As of Nerfstudio 0.1.19, users can also process videos in equirectangular format, like those captured by 360-degree cameras, making it easier to reconstruct large outdoor environments.

You can get an idea of the results from the tweet embedded at the top of this story, which shows an aerial flythrough of a NeRF environment generated from video captured on a handheld 360-degree camera.

Licensing and system requirements
Nerfstudio can be compiled from source for Windows and Linux. The source code is available under an Apache 2.0 licence.

You can find a full list of dependencies and compilation instructions on the project website. In particular, note that Nerfstudio uses CUDA, so you will need a compatible Nvidia GPU to run it.

Read more about Nerfstudio on the project website

Download the source code for Nerfstudio from GitHub

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

This post was automatically crawled from the internet. (What’s this?)

Leave a Reply

Your email address will not be published. Required fields are marked *

I am . Designer

Sign up for a Free CGBucket Vendor Account

More Posts and 3D News

Instant Terra 2.3

Instant Terra 2.3

Instant Terra 2.3 has been released with new thermal erosion, multi-scale erosion, and mountain ageing erosion nodes. Find out more on the Wysilab website.

Read More »


Thanks for signing up!
You have been added to our awesome newsletter.

Request Received

Thank you for taking interest in CGBucket Business 3D Services.

We have received your quotation  request and will respond within 3 Business Days.