vlar-group / nvfi Goto Github PK
View Code? Open in Web Editor NEWNVFi in PyTorch (NeurIPS 2023)
NVFi in PyTorch (NeurIPS 2023)
The InDoorSeg training code is not incorrect, but the quality of generation in the extrapolation of the training viewpoint of the test data is relatively good, but the images of the unknown viewpoint (interpolation) tended to be black.
If you know of a solution, please let me know.
I wonder how to make an NVFi dataset.
As I know, it is similar to the D-NeRF dataset structure. When I use ColMap to save videos as images, the time information is not
included in the JSON file. I wonder about how this was included in the JSON file.
I would appreciate it if you tell me how this process.
The render_test_evaluation()
function in train_nvfi()
writes generated images to disk with files names r_some_number.png
where the some_number
indicates the position of the corresponding target in all_targets
. However, the read_images_in_dir()
function sorts these images by their filenames as strings and not numbers, and hence there is a mismatch between the ordering of generated examples and targets.
This shouldn't be impactful if there are fewer than 1000 images since the images have up to three zeros prepended to their index in the corresponding filename.
The fix is simple: in the read_images_in_dir()
function in utils/metrics.py
, one must replace
fnames.sort()
with
remove_non_numeric = lambda x: ''.join(filter(str.isdigit, x))
fnames = sorted(fnames, key=lambda x: int(remove_non_numeric(x)))
Hi,
I'm trying to run the code as instructed, but stumbled upon a few issues.
tensorf_model_utils.py
there are the following imports which are not in the requirements:import plyfile
import skimage.measure
A pip install of plyfile and scikit-image seems to fix it, so I guess it should be added to the requirements.txt
.
train_nvfi.py
the argument config_args.keyframe
is missing, causing an attribute error.Hi! Thanks for your great job and finally it opened!
However, as I was reading the code of velocity part, I found that new random points and time were considered when calculating the velocity constrain. Is any reason to do so? Since usually I think the pts to render color should be the same with the pts calculating all the losses, and your code seems to be an exception.
Looking forward to your reply soon!
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.