Using existing data#
Nerfstudio comes with built-in support for a number of datasets, which can be downloaded with the ns-download-data
command. Each of the built-in datasets comes ready to use with various Nerfstudio methods (e.g. the recommended default Nerfacto), allowing you to get started in the blink of an eye.
Example#
Here are a few examples of downloading different scenes. Please see the Training Your First NeRF documentation for more details on how to train a model with them.
# Download all scenes from the Blender dataset, including the "classic" Lego model
ns-download-data blender
# Download the subset of data used in the SIGGRAPH 2023 Nerfstudio paper
ns-download-data nerfstudio --capture-name nerfstudio-dataset
# Download a few room-scale scenes from the EyefulTower dataset at different resolutions
pip install awscli # Install `awscli` for EyefulTower downloads.
ns-download-data eyefultower --capture-name riverview seating_area apartment --resolution-name jpeg_1k jpeg_2k
# Download the full D-NeRF dataset of dynamic synthetic scenes
ns-download-data dnerf
Dataset Summary#
Many of these datasets are used as baselines to evaluate new research in novel view synthesis, such as in the original Nerfstudio paper. Scenes from these datasets lie at dramatically different points in the space of images, across axes such as photorealism (synthetic vs real), dynamic range (LDR vs HDR), scale (number of images), and resolution. The tables below describe some of this variation, and hopefully make it easier to pick an appropriate dataset for your research or application.
Dataset |
Synthetic |
Real |
LDR |
HDR |
Scenes |
Image Count1 |
Image Resolution2 |
---|---|---|---|---|---|---|---|
✔️ |
✔️ |
8 |
➖➕️➖➖ |
➕️➖➖➖➖ |
|||
✔️ |
✔️ |
8 |
➕️➖➖➖ |
➕️➖➖➖➖ |
|||
✔️ |
✔️ |
✔️ |
11 |
➖➕️➕️➕️ |
➖➕️➕️➕️➕️ |
||
✔️ |
✔️ |
2 |
➖➖➕️➖ |
➖➖➖➕️➖ |
|||
✔️ |
✔️ |
9 |
➕➕️➕️➖ |
➖➕️➖➕️➖ |
|||
✔️ |
✔️ |
18 |
➕➕️➕️➖ |
➕️➕️➕️➖➖ |
|||
✔️ |
✔️ |
10 |
➖➕️➕️➖ |
➖➕️➖➖➖ |
|||
✔️ |
✔️ |
1 |
➖➖➕️➖ |
➕️➖➖➖➖ |
|||
✔️ |
✔️ |
✔️ |
45 |
➕️➕️➕️➖ |
➕️➖➕️➖➖ |
||
✔️ |
✔️ |
10 |
➕️➖➖➖ |
➕️➕️➖➖➖ |
In the tables below, each dataset was placed into a bucket based on the table’s chosen property. If a box contains a ✔️, the corresponding dataset will have at least one scene falling into the corresponding bucket for that property, though there may be multiple scenes at different points within the range.
1: Condensed version of the "Scene Size: Number of RGB Images" table below.2: Condensed version of the "Scene RGB Resolutions: `max(width, height)`" table below.
Scene Size: Number of RGB Images#
Dataset |
< 250 |
250 - 999 |
1000 - 3999 |
≥ 4000 |
---|---|---|---|---|
✔️ |
||||
✔️ |
||||
✔️ |
✔️ |
✔️ |
||
✔️ |
||||
✔️ |
✔️ |
✔️ |
||
✔️ |
✔️ |
✔️ |
||
✔️ |
✔️ |
|||
✔️ |
||||
✔️ |
✔️ |
✔️ |
||
✔️ |
Scene RGB Resolutions: max(width, height)
#
Dataset |
< 1000 |
1000 - 1999 |
2000 - 3999 |
4000 - 7999 |
≥ 8000 |
---|---|---|---|---|---|
✔️ |
|||||
✔️ |
|||||
✔️ |
✔️ |
✔️ |
✔️ |
||
✔️ |
|||||
✔️ |
✔️ |
||||
✔️ |
✔️ |
✔️ |
|||
✔️ |
|||||
✔️ |
|||||
✔️ |
✔️ |
||||
✔️ |
✔️ |
Eyeful Tower#
Downloading Eyeful Tower scenes requires installing the AWS CLI, an optional dependency. To do so, run:
conda activate nerfstudio
pip install awscli