Comments (8)
My best guess is that it's failing during the preprocessing step of computing the ray importance sampling weights. Here's what a recommend (a bit more specific version of the suggestion on the readme):
- Edit the config file to use 4x downsampling instead of 2x, and change the number of training steps to 1. Run with this config, and it will compute and save the importance sampling weights at the lower resolution, which should fit in memory.
- Reset the config file back to default, and run it again. It will load and interpolate the downsampled importance sampling weights, rather than recomputing them, so it should fit in memory. In my experience 100G of CPU memory should be sufficient, following this two-step procedure.
from k-planes.
Thanks for your help. I tried as you said, but the process stopped at 'Loading test data' with no response or reported error.
from k-planes.
Yeah that can happen sometimes, it's a concurrency bug in multi-threaded loading.. It's annoying but if you ctrl+c and try again it should work. Let me know if it's still not loading
from k-planes.
I tried to run main.py again for about 8 times, it all failed with the same problem. Besides, reading training video was sucessful but quite slow. Got no idea what to do. Appreciate it a lot for your generous help.
from k-planes.
I'm not sure if this will fix the issue or not, but if it's related to multithreading you could try reducing the number of threads here https://github.com/sarafridov/K-Planes/blob/main/plenoxels/datasets/data_loading.py#L144
from k-planes.
I tried so, but it's still not working. Is there other way to solve the problem?
from k-planes.
Do you have this issue with other datasets (e.g. D-NeRF, or regular NeRF) or do those load properly? Also, are you getting this issue in the initial preprocessing run at downsample=4, or after that when you try to actually train at downsample=2?
from k-planes.
That's really weird, after about 25 times running, it finally works. The issue occurred only in reading test data. While the iterator was successfully created by Pool.imap and tqdm info was outputed, it makes no sense that the process stopped at 'out=next(iterator)'.
I'm sure it's not the problem of slow speed of reading data, since the longest time I waited was a whole night.
from k-planes.
Related Issues (20)
- Please provide a set of parameters to reproduce the results on the lego dataset HOT 2
- Training on Custom Data HOT 4
- Visualization/Evaluation ERROR HOT 4
- Mismatch in total variation loss between description in paper and the implementation HOT 2
- OOM issue HOT 3
- Question about result of DyNeRF dataset : a difference between the results in the paper and my results HOT 6
- Bad performance on other dataset. HOT 4
- Questions about planes HOT 1
- Performance on TanksandTemple dataset HOT 2
- Model size HOT 5
- Replicating Fig 8 from the paper HOT 2
- IndexError at "video_datasets.py" HOT 1
- why is ndc_far=2.6 and not 1?
- About average_poses function?
- Query Regarding 'bds.npy' File in K-Planes Dataset HOT 1
- Temporal difference (IST) strategy HOT 4
- About Bilinear interpolation?
- Inconsistent Results Despite Setting Random Seed HOT 2
- used coordinate system in Phototourism
- Image Height and Width Flipped for D-NeRF scenes
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from k-planes.