Using the viewer

The nerfstudio web-based viewer makes it easy to view training in real-time, and to create content videos from your trained models 🌟!

In the tutorial below, we walk you through how you can turn a simple capture into a 3D video 📸 🎬

For specific sections, click the links below to navigate to the associated portion of the video.

Getting started

• Hello from nerfstudio

• Preprocess your video

• Launching training and viewer

Viewer basics

• Viewer scene introduction

• Moving around in viewer

• Overview of Controls Panel - train speed/output options

• Overview of Scene Panel - toggle visibility

Creating camera trajectories

• Creating a custom camera path

• Camera spline options - cycle, speed, smoothness

• Camera options - move, add, view

Rendering a video

• Preview camera trajectory

• How to render final video

See also

For a more in-depth developer overview on how to hack with the viewer, see our developer guide

Local vs. remote compute

Training on a local machine

You should be able to click the link obtained while running a script to open the viewer in your browser.

Training on a remote machine

If you are training on a remote machine, the viewer will still let you view your trainings. You will need to forward traffic from your viewing host to the listening port on the host running ns-train (7007 by default). You can achieve this by securely tunneling traffic on the specified port through an ssh session. In a terminal window on the viewing host, issue the following command:

ssh -L 7007:<training-host-ip>:7007 <username>@<training-host-ip>

Note

You can now simply open the link (same one shown in image above) in your browser on your local machine and it should connect!. So long as you don’t close this terminal window with this specific active ssh connection, the port will remain open for all your other ssh sessions.

For example, if you do this in a new terminal window, any existing ssh sessions (terminal windows, VSCode remote connection, etc) will still be able to access the port, but if you close this terminal window, the port will be closed.

Warning

If the port is being used, you will need to switch the port using the –viewer.websocket-port flag tied to the model subcommand.