Comments (5)
Hi, how many frames do you have in your sequence and how many steps do you train for? Rule of thumb for ActorsHQ is training for 1000*N iterations (for 4x downscaled data) where N is the number of frames you have in your video sequences. Although, this might differ for your dataset, you can try to follow the same guideline.
Moreover, for your dataset, you may need to adapt the expansion factor threshold. Setting 1.25 worked well for all the sequences for ActorsHQ.
from humanrf.
Hi, how many frames do you have in your sequence and how many steps do you train for? Rule of thumb for ActorsHQ is training for 1000*N iterations (for 4x downscaled data) where N is the number of frames you have in your video sequences. Although, this might differ for your dataset, you can try to follow the same guideline.
Moreover, for your dataset, you may need to adapt the expansion factor threshold. Setting 1.25 worked well for all the sequences for ActorsHQ.
Thanks for your reply.
In previous experiments, I have 100 frames in my sequence, and train for 60000 steps. However, even if I increase the number of iterations like 100000 as your replied, the quality basically does not increase. I try to adjust the expansion factor threshold, setting 1.00 for my slow motion sequence, the quality is the same as before.
Moreover, I increase the hash-map-size, the quality gets a bit better. I compare the single frame result generated by intstant-ngp, it is relatively poor in areas with high-frequency details such as the face and ears.
from humanrf.
So, when you run instant-ngp on a single frame, the quality is as expected? Because if the camera calibration is the issue, instant-ngp couldn't produce sharp results either.
Do you already have occupancy grids and per-frame masks for your dataset? Also, the current step size is set to 4e-4
, this might need to be adjusted as well if you use a different scaling for your actors/subjects.
If the motion complexity of your dataset is similar to that of ActorsHQ, there shouldn't be any issues. Additionally, you can see how HumanRF performed on DFA (dynamic furry animal) dataset if you check the supplemental material of our paper. So, I believe there must a tiny detail missing for the optimal quality.
from humanrf.
Hi, I am a collaborator of the poster.
The camera calibration parameters are accurate, as the quality is as expected when runing instant-ngp on a single frame.
After decreasing camera_converge, I regenerated the occupancy grids of my data, and used dynamic partition in training. At this time, the rendering quality of still motion part and slow motion part in one sequence were both improved.
But the person in slow motion part is a little bit blurred than that in still motion part. Is this problem normal?
from humanrf.
Hi, if it is slightly blurrier, it should be fine. But if they are quite noticeable I would further check if everything works as expected.
For reference, you can watch the videos on humanrf website. We have results for both moderate motion and strong motion, and we produce decent results for both. However, if you check our supplemental for numerical comparison, you can see that HumanRF performs better when the motion is smaller due to its compression capability., and this is the expected outcome.
from humanrf.
Related Issues (20)
- Unable to install ActorsHQ module HOT 5
- dataset HOT 2
- Validation Error HOT 1
- How to extract meshes after training HOT 1
- CUDA Error during validation HOT 8
- Data Missing HOT 1
- Why use NeRF to represent the scene when you have a lot of cameras (160)?
- Python Version HOT 1
- FileNotFoundError: [Errno 2] No such file or directory: 'vmaf' HOT 3
- Leaderboard HOT 1
- How to Parsing SMPL-X Parameters in ActorsHQ Dataset? HOT 3
- How to render novel view images in training data's time steps? HOT 1
- "shape mismatch" when validation HOT 1
- Cmake fail for tool box HOT 1
- Novel pose synthesis HOT 1
- Processing for mesh HOT 1
- aabbs.csv not found when downloading
- Please zip the dataset
- Issue with HumanRF Training on ActorHQ Dataset (Sequence 2 - Actor05)
- Training and evaluation on full resolution images
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from humanrf.