sdf mode PSNR problem

[trebladev]

sdf mode PSNR problem

[trebladev]

And when I train the ship, it will error below when epoch 40-45
loss=nan (nan) lr=0.007100: : 86% 86/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007100: : 87% 87/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007099: : 88% 88/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007099: : 89% 89/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007098: : 90% 90/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007098: : 91% 91/100 [00:00<00:00, 98.30it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007097: : 93% 93/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007097: : 93% 93/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007096: : 94% 94/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007096: : 95% 95/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007095: : 96% 96/100 [00:00<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007094: : 97% 97/100 [00:01<00:00, 98.93it/s]NaN or Inf found in input tensor. loss=nan (nan) lr=0.007094: : 98% 98/100 [00:01<00:00, 98.93it/s]NaN or Inf found in input tensor.

[Seiano]

貌似sdf模式不仅降低了psnr的值，而且训练速度也很慢。

[fatbao55]

I also encountered the same problem NaN or Inf found in input tensor for certain examples. @trebladev Have you found the fix?

[juuso-oskari]

Same error here, at least with the synthetic scenes

[zzj403]

I also encountered the same problem NaN or Inf found in input tensor for certain examples. @trebladev Have you found the fix?

same problem. Wondering reason. also be seen in #96

here is some result in lego