Comments (5)
Hi,
It looks like the same cause to another issue here #20.
Could you plz try using a newer CUDA version such as 11.8 and keeping your torch version at least 2.1.2?
I haven't encountered such problem locally so that I'm not sure where is the root cause either. Hopefully upgrading to newer versions would help.
Plz feel free to comment if it persists.
from openlrm.
This is a problem caused by too little training data in the custom trained model, but the threshold value is large. In the openlrm/runners/infer/lrm.py file infer_mesh function, the shape of vtx and faces was 0,3 due to the threshold! Adjusting the threshold to match the value of grid_out['sigma'] solved the problem! It's been resolved, so we'll close the issue. Thank you.
from openlrm.
Hi,
Could you plz share with us how you are running inference and some context on your key not found
errors?
from openlrm.
Thank you for your quick response. Below are the errors that are currently occurring
gpuadmin@gpusystem:~/ihjune/OpenLRM$ python -m openlrm.launch infer.lrm --infer $INFER_CONFIG model_name=$MODEL_NAME image_input=$IMAGE_INPUT export_video=$EXPORT_VIDEO export_mesh=$EXPORT_MESH
[2024-03-27 14:55:35,448] openlrm.models.modeling_lrm: [INFO] Using DINOv2 as the encoder
/home/gpuadmin/ihjune/OpenLRM/openlrm/models/encoders/dinov2/layers/swiglu_ffn.py:43: UserWarning: xFormers is available (SwiGLU)
warnings.warn("xFormers is available (SwiGLU)")
/home/gpuadmin/ihjune/OpenLRM/openlrm/models/encoders/dinov2/layers/attention.py:27: UserWarning: xFormers is available (Attention)
warnings.warn("xFormers is available (Attention)")
/home/gpuadmin/ihjune/OpenLRM/openlrm/models/encoders/dinov2/layers/block.py:39: UserWarning: xFormers is available (Block)
warnings.warn("xFormers is available (Block)")
Loading weights from local directory
0%| | 0/1 [00:00<?, ?it/s]/home/gpuadmin/ihjune/OpenLRM/openlrm/datasets/cam_utils.py:153: UserWarning: Using torch.cross without specifying the dim arg is deprecated.
Please either pass the dim explicitly or simply use torch.linalg.cross.
The default value of dim will change to agree with that of linalg.cross in a future release. (Triggered internally at ../aten/src/ATen/native/Cross.cpp:63.)
x_axis = torch.cross(up_world, z_axis)
0%| | 0/1 [00:27<?, ?it/s]
Traceback (most recent call last):
File "/home/gpuadmin/miniconda3/envs/lrm/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/gpuadmin/miniconda3/envs/lrm/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/launch.py", line 38, in
main()
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/launch.py", line 33, in main
runner.run()
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/runners/infer/base_inferrer.py", line 62, in run
self.infer()
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/runners/infer/lrm.py", line 284, in infer
self.infer_single(
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/runners/infer/lrm.py", line 244, in infer_single
mesh = self.infer_mesh(planes, mesh_size=mesh_size, mesh_thres=mesh_thres, dump_mesh_path=dump_mesh_path)
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/runners/infer/lrm.py", line 207, in infer_mesh
vtx_colors = self.model.synthesizer.forward_points(planes, vtx_tensor)['rgb'].squeeze(0).cpu().numpy() # (0, 1)
File "/home/gpuadmin/ihjune/OpenLRM/openlrm/models/rendering/synthesizer.py", line 206, in forward_points
for k in outs[0].keys()
IndexError: list index out of range
from openlrm.
Hi @eolgaeng-i , recently I've generated checkpoint model, and tried inference on my trained model.
But the result quality of the inference ply is not very good.
Could you please check my #41 when you have time?
It would be a huge help if you could check it when it possible.
Thank you in advance!
from openlrm.
Related Issues (20)
- Issue serving a model trained with the provided training code HOT 14
- Why encoder is not freeze in training config? HOT 1
- Can you share large training config?
- MVImgNet code HOT 1
- Not able to run blender_script.py and also how do I train on objaverse? HOT 24
- How to fix "Cannot find valid data directory for uid" error? HOT 3
- Inference Issue HOT 2
- 训练需要什么样的显卡配置 HOT 4
- Training with .obj files HOT 2
- How to evaluate metrics HOT 1
- Matrix multiplication: not supported between 'Matrix' and 'Vector' types HOT 2
- ValueError: math domain error HOT 5
- Inference result quality on trained model is not good HOT 10
- CUDA out of memory for inferring HOT 1
- What resources to train from scratch HOT 1
- Matrix multiplication: not supported between 'Matrix' and 'Vector' types HOT 1
- Pretrained models config files HOT 10
- Whether the camera system is OpenGL?
- Which parts are covered by Nvidia license? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openlrm.