hello , in the process of Training and Validation,I come across an problem,as the epoch goes,the L1 and EPE become larger and larger,that's Mathematical Divergent which confuse me .
I don't know where the problem is ,when i run the Inference process ,it works well,so ,can you help me?
1:
my training code is 😀
python main.py --batch_size 8 --model FlowNet2 --loss=L1Loss --optimizer=Adam --optimizer_lr=1e-4
--training_dataset MpiSintelFinal --training_dataset_root MPI-Sintel-complete/training/
--validation_dataset MpiSintelClean --validation_dataset_root MPI-Sintel-complete/training/
2:
is whether the bash wrong?the path is not right?
3:
the training and validation epoch:(some)
Training Epoch 16 L1: 20.014, EPE: 32.409, lr: 1.0e-04, load: 1.1e-04: 1%| | 1/131.0 [00:02Training Epoch 16 L1: 20.014, EPE: 32.409, lr: 1.0e-04, load: 1.1e-04: 2%|1 | 2/131.0 [00:02Training Epoch 16 L1: 13.450, EPE: 20.976, lr: 1.0e-04, load: 2.0e-04: 2%|1 | 2/131.0 [00:03Training Epoch 16 L1: 13.450, EPE: 20.976, lr: 1.0e-04, load: 2.0e-04: 2%|2 | 3/131.0 [00:03Training Epoch 16 L1: 13.146, EPE: 20.628, lr: 1.0e-04, load: 1.1e-04: 2%|2 | 3/131.0 [00:03Training Epoch 16 L1: 13.146, EPE: 20.628, lr: 1.0e-04, load: 1.1e-04: 3%|3 | 4/131.0 [00:03Training Epoch 16 L1: 12.203, EPE: 18.957, lr: 1.0e-04, load: 2.8e-04: 3%|3 | 4/131.0 [00:03Training Epoch 16 L1: 12.203, EPE: 18.957, lr: 1.0e-04, load: 2.8e-04: 4%|3 | 5/131.0 [00:03Training Epoch 16 L1: 19.179, EPE: 31.449, lr: 1.0e-04, load: 9.4e-05: 4%|3 | 5/131.0 [00:04Training Epoch 16 L1: 19.179, EPE: 31.449, lr: 1.0e-04, load: 9.4e-05: 5%|4 | 6/131.0 [00:04Training Epoch 16 L1: 13.530, EPE: 20.727, lr: 1.0e-04, load: 1.1e-04: 5%|4 | 6/131.0 [00:04Training Epoch 16 L1: 13.530, EPE: 20.727, lr: 1.0e-04, load: 1.1e-04: 5%|5 | 7/131.0 [00:04Training Epoch 16 L1: 15.606, EPE: 24.507, lr: 1.0e-04, load: 1.0e-04: 5%|5 | 7/131.0 [00:05Training Epoch 16 L1: 15.606, EPE: 24.507, lr: 1.0e-04, load: 1.0e-04: 6%|6 | 8/131.0 [00:05Training Epoch 16 L1: 11.642, EPE: 18.232, lr: 1.0e-04, load: 1.4e-04: 6%|6 | 8/131.0 [00:05Training Epoch 16 L1: 11.642, EPE: 18.232, lr: 1.0e-04, load: 1.4e-04: 7%|6 | 9/131.0 [00:05Training Epoch 16 L1: 12.322, EPE: 19.302, lr: 1.0e-04, load: 9.4e-05: 7%|6 | 9/131.0 [00:06Training Epoch 16 L1: 12.322, EPE: 19.302, lr: 1.0e-04, load: 9.4e-05: 8%|6 | 10/131.0 [00:06Training Epoch 16 L1: 30.777, EPE: 46.454, lr: 1.0e-04, load: 1.9e-04: 8%|6 | 10/131.0 [00:06Training Epoch 16 L1: 30.777, EPE: 46.454, lr: 1.0e-04, load: 1.9e-04: 8%|7 | 11/131.0 [00:06Training Epoch 16 L1: 23.191, EPE: 35.177, lr: 1.0e-04, load: 9.2e-05: 8%|7 | 11/131.0 [00:07Training Epoch 16 L1: 23.191, EPE: 35.177, lr: 1.0e-04, load: 9.2e-05: 9%|8 | 12/131.0 [00:07Training Epoch 16 L1: 20.174, EPE: 31.803, lr: 1.0e-04, load: 8.3e-05: 9%|8 | 12/131.0 [00:07Training Epoch 16 L1: 20.174, EPE: 31.803, lr: 1.0e-04, load: 8.3e-05: 10%|8 | 13/131.0 [00:07Training Epoch 16 L1: 11.984, EPE: 18.587, lr: 1.0e-04, load: 1.6e-04: 10%|8 | 13/131.0 [00:08Training Epoch 16 L1: 11.984, EPE: 18.587, lr: 1.0e-04, load: 1.6e-04: 11%|9 | 14/131.0 [00:08Training Epoch 16 L1: 21.247, EPE: 31.631, lr: 1.0e-04, load: 8.2e-05: 11%|9 | 14/131.0 [00:08Training Epoch 16 L1: 21.247, EPE: 31.631, lr: 1.0e-04, load: 8.2e-05: 11%|# | 15/131.0 [00:08Training Epoch 16 L1: 22.299, EPE: 35.021, lr: 1.0e-04, load: 1.7e-04: 11%|# | 15/131.0 [00:09Training Epoch 16 L1: 22.299, EPE: 35.021, lr: 1.0e-04, load: 1.7e-04: 12%|# | 16/131.0 [00:09Training Epoch 16 L1: 15.094, EPE: 23.169, lr: 1.0e-04, load: 8.5e-05: 12%|# | 16/131.0 [00:09Training Epoch 16 L1: 15.094, EPE: 23.169, lr: 1.0e-04, load: 8.5e-05: 13%|#1 | 17/131.0 [00:09Training Epoch 16 L1: 12.046, EPE: 18.704, lr: 1.0e-04, load: 1.2e-04: 13%|#1 | 17/131.0 [00:10Training Epoch 16 L1: 12.046, EPE: 18.704, lr: 1.0e-04, load: 1.2e-04: 14%|#2 | 18/131.0 [00:10
Training Epoch 23 L1: 1120820.625, EPE: 1789642.750, lr: 1.0e-04, load: 1.1e-04: 79%|7| 104/131.0 [00Training Epoch 23 L1: 1124944.250, EPE: 1796120.625, lr: 1.0e-04, load: 1.1e-04: 79%|7| 104/131.0 [00Training Epoch 23 L1: 1124944.250, EPE: 1796120.625, lr: 1.0e-04, load: 1.1e-04: 80%|8| 105/131.0 [00Training Epoch 23 L1: 1131694.000, EPE: 1806845.500, lr: 1.0e-04, load: 8.0e-05: 80%|8| 105/131.0 [00Training Epoch 23 L1: 1131694.000, EPE: 1806845.500, lr: 1.0e-04, load: 8.0e-05: 81%|8| 106/131.0 [00Training Epoch 23 L1: 1148796.625, EPE: 1834048.500, lr: 1.0e-04, load: 9.7e-05: 81%|8| 106/131.0 [00Training Epoch 23 L1: 1148796.625, EPE: 1834048.500, lr: 1.0e-04, load: 9.7e-05: 82%|8| 107/131.0 [00Training Epoch 23 L1: 1152218.125, EPE: 1839424.000, lr: 1.0e-04, load: 1.1e-04: 82%|8| 107/131.0 [00Training Epoch 23 L1: 1152218.125, EPE: 1839424.000, lr: 1.0e-04, load: 1.1e-04: 82%|8| 108/131.0 [00Training Epoch 23 L1: 1156170.000, EPE: 1845637.000, lr: 1.0e-04, load: 1.1e-04: 82%|8| 108/131.0 [00Training Epoch 23 L1: 1156170.000, EPE: 1845637.000, lr: 1.0e-04, load: 1.1e-04: 83%|8| 109/131.0 [00Training Epoch 23 L1: 1161018.750, EPE: 1853342.250, lr: 1.0e-04, load: 1.0e-04: 83%|8| 109/131.0 [00Training Epoch 23 L1: 1161018.750, EPE: 1853342.250, lr: 1.0e-04, load: 1.0e-04: 84%|8| 110/131.0 [00Training Epoch 23 L1: 1163659.375, EPE: 1857491.000, lr: 1.0e-04, load: 2.0e-04: 84%|8| 110/131.0 [00Training Epoch 23 L1: 1163659.375, EPE: 1857491.000, lr: 1.0e-04, load: 2.0e-04: 85%|8| 111/131.0 [00Training Epoch 23 L1: 1167923.625, EPE: 1864260.875, lr: 1.0e-04, load: 1.0e-04: 85%|8| 111/131.0 [00Training Epoch 23 L1: 1167923.625, EPE: 1864260.875, lr: 1.0e-04, load: 1.0e-04: 85%|8| 112/131.0 [00Training Epoch 23 L1: 1176208.875, EPE: 1877437.750, lr: 1.0e-04, load: 1.1e-04: 85%|8| 112/131.0 [00Training Epoch 23 L1: 1176208.875, EPE: 1877437.750, lr: 1.0e-04, load: 1.1e-04: 86%|8| 113/131.0 [00Training Epoch 23 L1: 1172562.375, EPE: 1871562.125, lr: 1.0e-04, load: 1.1e-04: 86%|8| 113/131.0 [00Training Epoch 23 L1: 1172562.375, EPE: 1871562.125, lr: 1.0e-04, load: 1.1e-04: 87%|8| 114/131.0 [00Training Epoch 23 L1: 1174640.250, EPE: 1874833.625, lr: 1.0e-04, load: 2.1e-04: 87%|8| 114/131.0 [00Overall Progress: 0%| | 23/10000 [30:52<223:09:55, 80.52s/it]00Training Epoch 23 L1: 1174350.000, EPE: 1874322.875, lr: 1.0e-04, load: 1.1e-04: 88%|8| 115/131.0 [00Training Epoch 23 L1: 1174350.000, EPE: 1874322.875, lr: 1.0e-04, load: 1.1e-04: 89%|8| 116/131.0 [00Training Epoch 23 L1: 1174977.250, EPE: 1875286.625, lr: 1.0e-04, load: 1.1e-04: 89%|8| 116/131.0 [00Training Epoch 23 L1: 1174977.250, EPE: 1875286.625, lr: 1.0e-04, load: 1.1e-04: 89%|8| 117/131.0 [00Training Epoch 23 L1: 1182209.000, EPE: 1886798.125, lr: 1.0e-04, load: 1.1e-04: 89%|8| 117/131.0 [00Training Epoch 23 L1: 1182209.000, EPE: 1886798.125, lr: 1.0e-04, load: 1.1e-04: 90%|9| 118/131.0 [00Training Epoch 23 L1: 1178459.125, EPE: 1880784.750, lr: 1.0e-04, load: 9.2e-05: 90%|9| 118/131.0 [00Training Epoch 23 L1: 1178459.125, EPE: 1880784.750, lr: 1.0e-04, load: 9.2e-05: 91%|9| 119/131.0 [00Training Epoch 23 L1: 1182520.750, EPE: 1887210.875, lr: 1.0e-04, load: 8.5e-05: 91%|9| 119/131.0 [01Training Epoch 23 L1: 1182520.750, EPE: 1887210.875, lr: 1.0e-04, load: 8.5e-05: 92%|9| 120/131.0 [01Training Epoch 23 L1: 1172557.500, EPE: 1871309.875, lr: 1.0e-04, load: 1.1e-04: 92%|9| 120/131.0 [01Training Epoch 23 L1: 1172557.500, EPE: 1871309.875, lr: 1.0e-04, load: 1.1e-04: 92%|9| 121/131.0 [01Training Epoch 23 L1: 1174187.750, EPE: 1873864.625, lr: 1.0e-04, load: 1.3e-04: 92%|9| 121/131.0 [01Training Epoch 23 L1: 1174187.750, EPE: 1873864.625, lr: 1.0e-04, load: 1.3e-04: 93%|9| 122/131.0 [01Training Epoch 23 L1: 1172614.375, EPE: 1871375.375, lr: 1.0e-04, load: 1.1e-04: 93%|9| 122/131.0 [01Training Epoch 23 L1: 1172614.375, EPE: 1871375.375, lr: 1.0e-04, load: 1.1e-04: 94%|9| 123/131.0
Training Epoch 30 L1: 7526267.000, EPE: 11999885.000, lr: 1.0e-04, load: 9.7e-05: 79%|7| 104/131.0 [0Training Epoch 30 L1: 7526267.000, EPE: 11999885.000, lr: 1.0e-04, load: 9.7e-05: 80%|8| 105/131.0 [0Training Epoch 30 L1: 7697239.500, EPE: 12272357.000, lr: 1.0e-04, load: 1.0e-04: 80%|8| 105/131.0 [0Training Epoch 30 L1: 7697239.500, EPE: 12272357.000, lr: 1.0e-04, load: 1.0e-04: 81%|8| 106/131.0 [0Training Epoch 30 L1: 7870356.500, EPE: 12548359.000, lr: 1.0e-04, load: 2.0e-04: 81%|8| 106/131.0 [0Training Epoch 30 L1: 7870356.500, EPE: 12548359.000, lr: 1.0e-04, load: 2.0e-04: 82%|8| 107/131.0 [0Training Epoch 30 L1: 8068172.500, EPE: 12863640.000, lr: 1.0e-04, load: 1.2e-04: 82%|8| 107/131.0 [0Training Epoch 30 L1: 8068172.500, EPE: 12863640.000, lr: 1.0e-04, load: 1.2e-04: 82%|8| 108/131.0 [0Training Epoch 30 L1: 8262953.000, EPE: 13174119.000, lr: 1.0e-04, load: 1.1e-04: 82%|8| 108/131.0 [0Training Epoch 30 L1: 8262953.000, EPE: 13174119.000, lr: 1.0e-04, load: 1.1e-04: 83%|8| 109/131.0 [0Training Epoch 30 L1: 8458786.000, EPE: 13486154.000, lr: 1.0e-04, load: 1.1e-04: 83%|8| 109/131.0 [0Training Epoch 30 L1: 8458786.000, EPE: 13486154.000, lr: 1.0e-04, load: 1.1e-04: 84%|8| 110/131.0 [0Overall Progress: 0%|1 | 30/10000 [39:36<219:20:56, 79.20s/it][0Training Epoch 30 L1: 8676531.000, EPE: 13833231.000, lr: 1.0e-04, load: 1.1e-04: 85%|8| 111/131.0 [0Training Epoch 30 L1: 8906124.000, EPE: 14199155.000, lr: 1.0e-04, load: 7.9e-05: 85%|8| 111/131.0 [0Training Epoch 30 L1: 8906124.000, EPE: 14199155.000, lr: 1.0e-04, load: 7.9e-05: 85%|8| 112/131.0 [0Training Epoch 30 L1: 9146764.000, EPE: 14582753.000, lr: 1.0e-04, load: 8.2e-05: 85%|8| 112/131.0 [0Training Epoch 30 L1: 9146764.000, EPE: 14582753.000, lr: 1.0e-04, load: 8.2e-05: 86%|8| 113/131.0 [0Training Epoch 30 L1: 9381907.000, EPE: 14957424.000, lr: 1.0e-04, load: 1.9e-04: 86%|8| 113/131.0 [0Training Epoch 30 L1: 9381907.000, EPE: 14957424.000, lr: 1.0e-04, load: 1.9e-04: 87%|8| 114/131.0 [0Training Epoch 30 L1: 9641827.000, EPE: 15371584.000, lr: 1.0e-04, load: 9.3e-05: 87%|8| 114/131.0 [0Training Epoch 30 L1: 9641827.000, EPE: 15371584.000, lr: 1.0e-04, load: 9.3e-05: 88%|8| 115/131.0 [0Training Epoch 30 L1: 9932562.000, EPE: 15835133.000, lr: 1.0e-04, load: 1.0e-04: 88%|8| 115/131.0 [0Training Epoch 30 L1: 9932562.000, EPE: 15835133.000, lr: 1.0e-04, load: 1.0e-04: 89%|8| 116/131.0 [0Training Epoch 30 L1: 10214386.000, EPE: 16284384.000, lr: 1.0e-04, load: 1.4e-04: 89%|8| 116/131.0 [Training Epoch 30 L1: 10214386.000, EPE: 16284384.000, lr: 1.0e-04, load: 1.4e-04: 89%|8| 117/131.0 [Training Epoch 30 L1: 10510787.000, EPE: 16756787.000, lr: 1.0e-04, load: 1.1e-04: 89%|8| 117/131.0 [Training Epoch 30 L1: 10510787.000, EPE: 16756787.000, lr: 1.0e-04, load: 1.1e-04: 90%|9| 118/131.0 [Training Epoch 30 L1: 10803096.000, EPE: 17222668.000, lr: 1.0e-04, load: 2.3e-04: 90%|9| 118/131.0 [Training Epoch 30 L1: 10803096.000, EPE: 17222668.000, lr: 1.0e-04, load: 2.3e-04: 91%|9| 119/131.0 [Training Epoch 30 L1: 11161372.000, EPE: 17793628.000, lr: 1.0e-04, load: 2.1e-04: 91%|9| 119/131.0 [Training Epoch 30 L1: 11161372.000, EPE: 17793628.000, lr: 1.0e-04, load: 2.1e-04: 92%|9| 120/131.0 [Training Epoch 30 L1: 11545046.000, EPE: 18404904.000, lr: 1.0e-04, load: 1.1e-04: 92%|9| 120/131.0 [Training Epoch 30 L1: 11545046.000, EPE: 18404904.000, lr: 1.0e-04, load: 1.1e-04: 92%|9| 121/131.0 [Training Epoch 30 L1: 11917996.000, EPE: 18999540.000, lr: 1.0e-04, load: 1.1e-04: 92%|9| 121/131.0 [Training Epoch 30 L1: 11917996.000, EPE: 18999540.000, lr: 1.0e-04, load: 1.1e-04: 93%|9| 122/131.0 [Training Epoch 30 L1: 12331476.000, EPE: 19658392.000, lr: 1.0e-04, load: 1.3e-04: 93%|9| 122/131.0 [Training Epoch 30 L1: 12331476.000, EPE: 19658392.000, lr: 1.0e-04, load: 1.3e-04: 94%|9| 123/131.0 [Training Epoch 30 L1: 12736597.000, EPE: 20304082.000, lr: 1.0e-04, load: 2.0e-05: 94%|9| 123/131.0 [Training Epoch 30 L1: 12736597.000, EPE: 20304082.000, lr: 1.0e-04, load: 2.0e-05: 95%|9| 124/131.0 [Training Epoch 30 L1: 13234406.000, EPE: 21097104.000, lr: 1.0e-04, load: 2.8e-05: 95%|9| 124/131.0 [Training Epoch 30 L1: 13234406.000, EPE: 21097104.000, lr: 1.0e-04, load: 2.8e-05: 95%|9| 125/131.0 [Training Epoch 30 L1: 13745968.000, EPE: 21912486.000, lr: 1.0e-04, load: 1.5e-05: 95%|9| 125/131.0 [Training Epoch 30 L1: 13745968.000, EPE: 21912486.000, lr: 1.0e-04, load: 1.5e-05: 96%|9| 126/131.0 [Training Epoch 30 L1: 14259961.000, EPE: 22731514.000, lr: 1.0e-04, load: 4.8e-05: 96%|9| 126/131.0 [Training Epoch 30 L1: 14259961.000, EPE: 22731514.000, lr: 1.0e-04, load: 4.8e-05: 97%|9| 127/131.0 [Training Epoch 30 L1: 14828019.000, EPE: 23636724.000, lr: 1.0e-04, load: 4.5e-05: 97%|9| 127/131.0 [Training Epoch 30 L1: 14828019.000, EPE: 23636724.000, lr: 1.0e-04, load: 4.5e-05: 98%|9| 128/131.0 [Training Epoch 30 L1: 15450925.000, EPE: 24629376.000, lr: 1.0e-04, load: 1.7e-05: 98%|9| 128/131.0 [Training Epoch 30 L1: 15450925.000, EPE: 24629376.000, lr: 1.0e-04, load: 1.7e-05: 98%|9| 129/131.0 [Training Epoch 30 L1: 16118957.000, EPE: 25693774.000, lr: 1.0e-04, load: 2.6e-05: 98%|9| 129/131.0 [Training Epoch 30 L1: 16118957.000, EPE: 25693774.000, lr: 1.0e-04, load: 2.6e-05: 99%|9| 130/131.0 [Training Epoch 30 L1: 16797780.000, EPE: 26775512.000, lr: 1.0e-04, load: 7.2e-06: 99%|9| 130/131.0 [Training Epoch 30 L1: 16797780.000, EPE: 26775512.000, lr: 1.0e-04, load: 7.2e-06: 100%|#| 131/131.0 [01:04<00:00, 2.03it/s]
Validating Epoch 30 L1: 17581342.000, EPE: 28024272.000, load: 1.545: 1%| | 1/131.0 [00:01<03:36, 1Validating Epoch 30 L1: 17564684.000, EPE: 27997840.000, load: 1.1e-04: 1%| | 1/131.0 [00:01<03:51, Validating Epoch 30 L1: 17564684.000, EPE: 27997840.000, load: 1.1e-04: 2%| | 2/131.0 [00:01<01:54, Validating Epoch 30 L1: 17613800.000, EPE: 28076012.000, load: 1.2e-04: 2%| | 2/131.0 [00:01<02:02, Validating Epoch 30 L1: 17613800.000, EPE: 28076012.000, load: 1.2e-04: 2%| | 3/131.0 [00:01<01:20, Validating Epoch 30 L1: 17574314.000, EPE: 28012996.000, load: 7.4e-05: 2%| | 3/131.0 [00:02<01:25, Validating Epoch 30 L1: 17574314.000, EPE: 28012996.000, load: 7.4e-05: 3%| | 4/131.0 [00:02<01:03, Validating Epoch 30 L1: 17609200.000, EPE: 28068660.000, load: 0.903: 3%| | 4/131.0 [00:03<01:36, 1Validating Epoch 30 L1: 17609200.000, EPE: 28068660.000, load: 0.903: 4%| | 5/131.0 [00:03<01:16, 1Validating Epoch 30 L1: 17573464.000, EPE: 28011888.000, load: 0.035: 4%| | 5/131.0 [00:03<01:20, 1Validating Epoch 30 L1: 17573464.000, EPE: 28011888.000, load: 0.035: 5%| | 6/131.0 [00:03<01:06, 1Validating Epoch 30 L1: 17493966.000, EPE: 27885052.000, load: 0.009: 5%| | 6/131.0 [00:03<01:08, 1Validating Epoch 30 L1: 17493966.000, EPE: 27885052.000, load: 0.009: 5%| | 7/131.0 [00:03<00:58, 2Validating Epoch 30 L1: 17509758.000, EPE: 27910458.000, load: 0.006: 5%| | 7/131.0 [00:03<01:00, 2Validating Epoch 30 L1: 17509758.000, EPE: 27910458.000, load: 0.006: 6%| | 8/131.0 [00:03<00:52, 2Validating Epoch 30 L1: 17450372.000, EPE: 27815528.000, load: 1.008: 6%| | 8/131.0 [00:04<01:09, 1Validating Epoch 30 L1: 17450372.000, EPE: 27815528.000, load: 1.008: 7%| | 9/131.0 [00:04<01:01, 1Validating Epoch 30 L1: 17444074.000, EPE: 27805670.000, load: 0.176: 7%| | 9/131.0 [00:04<01:05, 1Validating Epoch 30 L1: 17444074.000, EPE: 27805670.000, load: 0.176: 8%| | 10/131.0 [00:04<00:58, Validating Epoch 30 L1: 17574704.000, EPE: 28013616.000, load: 0.006: 8%| | 10/131.0 [00:04<01:00, Validating Epoch 30 L1: 17574704.000, EPE: 28013616.000, load: 0.006: 8%| | 11/131.0 [00:04<00:54, Validating Epoch 30 L1: 17583654.000, EPE: 28027948.000, load: 7.6e-05: 8%| | 11/131.0 [00:05<00:55,Validating Epoch 30 L1: 17583654.000, EPE: 28027948.000, load: 7.6e-05: 9%| | 12/131.0 [00:05<00:50,Validating Epoch 30 L1: 17634218.000, EPE: 28108360.000, load: 0.838: 9%| | 12/131.0 [00:06<00:59, Validating Epoch 30 L1: 17634218.000, EPE: 28108360.000, load: 0.838: 10%| | 13/131.0 [00:06<00:54, Validating Epoch 30 L1: 17527270.000, EPE: 27938416.000, load: 0.006: 10%| | 13/131.0 [00:06<00:55, Validating Epoch 30 L1: 17527270.000, EPE: 27938416.000, load: 0.006: 11%|1| 14/131.0 [00:06<00:51, Validating Epoch 30 L1: 17424492.000, EPE: 27774274.000, load: 0.067: 11%|1| 14/131.0 [00:06<00:53, Validating Epoch 30 L1: 17424492.000, EPE: 27774274.000, load: 0.067: 11%|1| 15/131.0 [00:06<00:49, Validating Epoch 30 L1: 17455616.000, EPE: 27823988.000, load: 0.082: 11%|1| 15/131.0 [00:06<00:50, Validating Epoch 30 L1: 17455616.000, EPE: 27823988.000, load: 0.082: 12%|1| 16/131.0 [00:06<00:47, Validating Epoch 30 L1: 17453390.000, EPE: 27820352.000, load: 0.952: 12%|1| 16/131.0 [00:07<00:54, Validating Epoch 30 L1: 17453390.000, EPE: 27820352.000, load: 0.952: 13%|1| 17/131.0 [00:07<00:51, Validating Epoch 30 L1: 17424604.000, EPE: 27774368.000, load: 1.0e-04: 13%|1| 17/131.0 [00:07<00:51,Validating Epoch 30 L1: 17424604.000, EPE: 27774368.000, load: 1.0e-04: 14%|1| 18/131.0 [00:07<00:48,Validating Epoch 30 L1: 17429204.000, EPE: 27781808.000, load: 0.066: 14%|1| 18/131.0 [00:07<00:49, Validating Epoch 30 L1: 17429204.000, EPE: 27781808.000, load: 0.066: 15%|1| 19/131.0 [00:07<00:46, Validating Epoch 30 L1: 17461886.000, EPE: 27834034.000, load: 0.006: 15%|1| 19/131.0 [00:08<00:47, Validating Epoch 30 L1: 17461886.000, EPE: 27834034.000, load: 0.006: 15%|1| 20/131.0 [00:08<00:44,