start training : long_term_forecast_weather_96_96_none_TimeMixer_custom_sl96_pl96_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0>>>>>>>>>>>>>>>>>>>>>>>>>>
train 36696
val 5175
test 10444
iters: 100, epoch: 1 | loss: 0.4307363
speed: 0.0692s/iter; left time: 389.1167s
iters: 200, epoch: 1 | loss: 0.4297568
speed: 0.0611s/iter; left time: 337.2267s
Epoch: 1 cost time: 17.889004945755005
Epoch: 1, Steps: 286 | Train Loss: 0.5415171 Vali Loss: 0.4307196 Test Loss: 0.1833659
Validation loss decreased (inf --> 0.430720). Saving model ...
Updating learning rate to 0.0018082204734143938
iters: 100, epoch: 2 | loss: 0.3520306
speed: 0.1521s/iter; left time: 811.5801s
iters: 200, epoch: 2 | loss: 0.3565684
speed: 0.0618s/iter; left time: 323.7447s
Epoch: 2 cost time: 17.85987901687622
Epoch: 2, Steps: 286 | Train Loss: 0.4447075 Vali Loss: 0.4094866 Test Loss: 0.1705955
Validation loss decreased (0.430720 --> 0.409487). Saving model ...
Updating learning rate to 0.005206596517931138
iters: 100, epoch: 3 | loss: 0.3173375
speed: 0.1528s/iter; left time: 771.3829s
iters: 200, epoch: 3 | loss: 0.3592640
speed: 0.0621s/iter; left time: 307.5004s
Epoch: 3 cost time: 17.934012413024902
Epoch: 3, Steps: 286 | Train Loss: 0.4251685 Vali Loss: 0.3993056 Test Loss: 0.1661765
Validation loss decreased (0.409487 --> 0.399306). Saving model ...
Updating learning rate to 0.008601101999279598
iters: 100, epoch: 4 | loss: 0.3249778
speed: 0.1530s/iter; left time: 728.5612s
iters: 200, epoch: 4 | loss: 0.4692132
speed: 0.0622s/iter; left time: 289.8614s
Epoch: 4 cost time: 17.94803547859192
Epoch: 4, Steps: 286 | Train Loss: 0.4286626 Vali Loss: 0.4020122 Test Loss: 0.1657454
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.009999998821672624
iters: 100, epoch: 5 | loss: 0.3110182
speed: 0.1529s/iter; left time: 684.4151s
iters: 200, epoch: 5 | loss: 5966753.5000000
speed: 0.0621s/iter; left time: 271.7755s
Epoch: 5 cost time: 17.991345167160034
Epoch: 5, Steps: 286 | Train Loss: 73039167.1294913 Vali Loss: 124857.1351563 Test Loss: 41927.7059582
EarlyStopping counter: 2 out of 10
Updating learning rate to 0.00990325594987406
iters: 100, epoch: 6 | loss: 27256.5839844
speed: 0.1534s/iter; left time: 642.9746s
iters: 200, epoch: 6 | loss: 40716.7031250
speed: 0.0625s/iter; left time: 255.5338s
Epoch: 6 cost time: 18.048863887786865
Epoch: 6, Steps: 286 | Train Loss: 61819.4581956 Vali Loss: 19785.5467773 Test Loss: 8566.0788152
EarlyStopping counter: 3 out of 10
Updating learning rate to 0.009618084470288236
iters: 100, epoch: 7 | loss: 42804.7265625
speed: 0.1541s/iter; left time: 601.9182s
iters: 200, epoch: 7 | loss: 14851.3417969
speed: 0.0624s/iter; left time: 237.5837s
Epoch: 7 cost time: 18.051480293273926
Epoch: 7, Steps: 286 | Train Loss: 30657.5081574 Vali Loss: 13869.5492432 Test Loss: 4513.3062156
EarlyStopping counter: 4 out of 10
Updating learning rate to 0.009155443362949628
iters: 100, epoch: 8 | loss: 9879.9335938
speed: 0.1534s/iter; left time: 555.0071s
iters: 200, epoch: 8 | loss: 26258.4062500
speed: 0.0624s/iter; left time: 219.5428s
Epoch: 8 cost time: 18.00772786140442
Epoch: 8, Steps: 286 | Train Loss: 23289.7381600 Vali Loss: 7120.0204468 Test Loss: 2942.5684035
EarlyStopping counter: 5 out of 10
Updating learning rate to 0.008533111666161134
iters: 100, epoch: 9 | loss: 6651.8051758
speed: 0.1532s/iter; left time: 510.6945s
iters: 200, epoch: 9 | loss: 7979.3217773
speed: 0.0624s/iter; left time: 201.8479s
Epoch: 9 cost time: 18.038314819335938
Epoch: 9, Steps: 286 | Train Loss: 13656.0039387 Vali Loss: 9894.2515869 Test Loss: 4533.5889727
EarlyStopping counter: 6 out of 10
Updating learning rate to 0.007775005238022703
iters: 100, epoch: 10 | loss: 7160.9116211
speed: 0.1537s/iter; left time: 468.3441s
iters: 200, epoch: 10 | loss: 11085.7910156
speed: 0.0624s/iter; left time: 183.7755s
Epoch: 10 cost time: 18.018856048583984
Epoch: 10, Steps: 286 | Train Loss: 11040.1564498 Vali Loss: 7765.1726685 Test Loss: 3500.1894863
EarlyStopping counter: 7 out of 10
Updating learning rate to 0.006910257683416708
iters: 100, epoch: 11 | loss: 21434.4316406
speed: 0.1536s/iter; left time: 424.1434s
iters: 200, epoch: 11 | loss: 4110.5146484
speed: 0.0624s/iter; left time: 166.1284s
Epoch: 11 cost time: 18.04583215713501
Epoch: 11, Steps: 286 | Train Loss: 8240.5528419 Vali Loss: 5190.9347229 Test Loss: 1577.0768572
EarlyStopping counter: 8 out of 10
Updating learning rate to 0.005972100765910645
iters: 100, epoch: 12 | loss: 3391.3840332
speed: 0.1540s/iter; left time: 381.0550s
iters: 200, epoch: 12 | loss: 22552.2753906
speed: 0.0625s/iter; left time: 148.4305s
Epoch: 12 cost time: 18.07685947418213
Epoch: 12, Steps: 286 | Train Loss: 7187.2250772 Vali Loss: 3726.9754517 Test Loss: 1578.9364279
EarlyStopping counter: 9 out of 10
Updating learning rate to 0.004996587329719809
iters: 100, epoch: 13 | loss: 3442.0224609
speed: 0.1533s/iter; left time: 335.4760s
iters: 200, epoch: 13 | loss: 2756.2189941
speed: 0.0624s/iter; left time: 130.3737s
Epoch: 13 cost time: 18.014405965805054
Epoch: 13, Steps: 286 | Train Loss: 7158.0969733 Vali Loss: 5071.9943359 Test Loss: 2097.3409002
EarlyStopping counter: 10 out of 10
Early stopping
testing : long_term_forecast_weather_96_96_none_TimeMixer_custom_sl96_pl96_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
test 10444
test shape: (81, 128, 96, 21) (81, 128, 96, 21)
test shape: (10368, 96, 21) (10368, 96, 21)
mse:0.1661764234304428, mae:0.21156392991542816
rmse:0.40764743089675903, mape:0.5020378828048706, mspe:25357502.0
Args in experiment:
Namespace(task_name='long_term_forecast', is_training=1, model_id='weather_96_192', model='TimeMixer', data='custom', root_path='./dataset/weather/', data_path='weather.csv', features='M', target='OT', freq='h', checkpoints='./checkpoints/', seq_len=96, label_len=0, pred_len=192, seasonal_patterns='Monthly', inverse=False, top_k=5, num_kernels=6, enc_in=21, dec_in=21, c_out=21, d_model=16, n_heads=4, e_layers=3, d_layers=1, d_ff=32, moving_avg=25, factor=3, distil=True, dropout=0.1, embed='timeF', activation='gelu', output_attention=False, channel_independence=1, decomp_method='moving_avg', use_norm=1, down_sampling_layers=3, down_sampling_window=2, down_sampling_method='avg', num_workers=10, itr=1, train_epochs=20, batch_size=128, patience=10, learning_rate=0.01, des='Exp', loss='MSE', lradj='TST', pct_start=0.2, use_amp=False, comment='none', use_gpu=True, gpu=0, use_multi_gpu=False, devices='0,1', p_hidden_dims=[128, 128], p_hidden_layers=2)
Use GPU: cuda:0
start training : long_term_forecast_weather_96_192_none_TimeMixer_custom_sl96_pl192_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0>>>>>>>>>>>>>>>>>>>>>>>>>>
train 36600
val 5079
test 10348
iters: 100, epoch: 1 | loss: 0.5949332
speed: 0.0736s/iter; left time: 412.3825s
iters: 200, epoch: 1 | loss: 0.6008663
speed: 0.0653s/iter; left time: 359.0430s
Epoch: 1 cost time: 19.023356199264526
Epoch: 1, Steps: 285 | Train Loss: 0.6265348 Vali Loss: 0.5050493 Test Loss: 0.2290545
Validation loss decreased (inf --> 0.505049). Saving model ...
Updating learning rate to 0.0018082286694699988
iters: 100, epoch: 2 | loss: 0.4368003
speed: 0.1606s/iter; left time: 853.6822s
iters: 200, epoch: 2 | loss: 0.6394349
speed: 0.0654s/iter; left time: 341.2403s
Epoch: 2 cost time: 18.83457350730896
Epoch: 2, Steps: 285 | Train Loss: 0.5097023 Vali Loss: 0.5010504 Test Loss: 0.2251554
Validation loss decreased (0.505049 --> 0.501050). Saving model ...
Updating learning rate to 0.005206619683914479
iters: 100, epoch: 3 | loss: 0.5027322
speed: 0.1605s/iter; left time: 807.3658s
iters: 200, epoch: 3 | loss: 0.5735677
speed: 0.0655s/iter; left time: 322.8571s
Epoch: 3 cost time: 18.84622883796692
Epoch: 3, Steps: 285 | Train Loss: 0.4948312 Vali Loss: 0.4692470 Test Loss: 0.2095508
Validation loss decreased (0.501050 --> 0.469247). Saving model ...
Updating learning rate to 0.008601126519745959
iters: 100, epoch: 4 | loss: 0.7092599
speed: 0.1600s/iter; left time: 759.4899s
iters: 200, epoch: 4 | loss: 0.3938503
speed: 0.0655s/iter; left time: 304.3535s
Epoch: 4 cost time: 18.848021268844604
Epoch: 4, Steps: 285 | Train Loss: 0.4878404 Vali Loss: 0.4703723 Test Loss: 0.2100072
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.009999998813389152
iters: 100, epoch: 5 | loss: 0.4158416
speed: 0.1604s/iter; left time: 715.7460s
iters: 200, epoch: 5 | loss: 0.4023744
speed: 0.0654s/iter; left time: 285.3155s
Epoch: 5 cost time: 18.826069593429565
Epoch: 5, Steps: 285 | Train Loss: 0.4828563 Vali Loss: 0.4683839 Test Loss: 0.2124947
Validation loss decreased (0.469247 --> 0.468384). Saving model ...
Updating learning rate to 0.009903253591993106
iters: 100, epoch: 6 | loss: 0.4359638
speed: 0.1606s/iter; left time: 670.6529s
iters: 200, epoch: 6 | loss: 0.5145217
speed: 0.0655s/iter; left time: 266.8324s
Epoch: 6 cost time: 18.856943607330322
Epoch: 6, Steps: 285 | Train Loss: 0.4796506 Vali Loss: 0.4690022 Test Loss: 0.2101424
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.009618079853421842
iters: 100, epoch: 7 | loss: 0.5960991
speed: 0.1601s/iter; left time: 623.0693s
iters: 200, epoch: 7 | loss: 0.6308466
speed: 0.0655s/iter; left time: 248.4005s
Epoch: 7 cost time: 18.844536066055298
Epoch: 7, Steps: 285 | Train Loss: 0.4764077 Vali Loss: 0.4654915 Test Loss: 0.2081809
Validation loss decreased (0.468384 --> 0.465492). Saving model ...
Updating learning rate to 0.009155436664521378
iters: 100, epoch: 8 | loss: 0.4419442
speed: 0.1602s/iter; left time: 577.6258s
iters: 200, epoch: 8 | loss: 0.5641533
speed: 0.0654s/iter; left time: 229.2836s
Epoch: 8 cost time: 18.828977584838867
Epoch: 8, Steps: 285 | Train Loss: 0.4711395 Vali Loss: 0.4669213 Test Loss: 0.2122254
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.008533103143587874
iters: 100, epoch: 9 | loss: 0.3767900
speed: 0.1602s/iter; left time: 531.9960s
iters: 200, epoch: 9 | loss: 0.4241773
speed: 0.0655s/iter; left time: 210.8604s
Epoch: 9 cost time: 18.84018850326538
Epoch: 9, Steps: 285 | Train Loss: 0.4696788 Vali Loss: 0.4655947 Test Loss: 0.2091171
EarlyStopping counter: 2 out of 10
Updating learning rate to 0.007774995218822139
iters: 100, epoch: 10 | loss: 0.3299536
speed: 0.1606s/iter; left time: 487.4349s
iters: 200, epoch: 10 | loss: 0.4966879
speed: 0.0654s/iter; left time: 192.1428s
Epoch: 10 cost time: 18.850160121917725
Epoch: 10, Steps: 285 | Train Loss: 0.4663261 Vali Loss: 0.4718109 Test Loss: 0.2086317
EarlyStopping counter: 3 out of 10
Updating learning rate to 0.006910246552621103
iters: 100, epoch: 11 | loss: 0.3497610
speed: 0.1603s/iter; left time: 441.0321s
iters: 200, epoch: 11 | loss: 0.3784502
speed: 0.0655s/iter; left time: 173.7020s
Epoch: 11 cost time: 18.853699684143066
Epoch: 11, Steps: 285 | Train Loss: 0.4630501 Vali Loss: 0.4703967 Test Loss: 0.2108531
EarlyStopping counter: 4 out of 10
Updating learning rate to 0.005972088951270229
iters: 100, epoch: 12 | loss: 0.3815632
speed: 0.1602s/iter; left time: 395.0873s
iters: 200, epoch: 12 | loss: 0.4500147
speed: 0.0656s/iter; left time: 155.1679s
Epoch: 12 cost time: 18.86597967147827
Epoch: 12, Steps: 285 | Train Loss: 0.4593053 Vali Loss: 0.4724175 Test Loss: 0.2148597
EarlyStopping counter: 5 out of 10
Updating learning rate to 0.004996575285264588
iters: 100, epoch: 13 | loss: 0.3511541
speed: 0.1607s/iter; left time: 350.4397s
iters: 200, epoch: 13 | loss: 0.3464415
speed: 0.0656s/iter; left time: 136.5284s
Epoch: 13 cost time: 18.88262128829956
Epoch: 13, Steps: 285 | Train Loss: 0.4552088 Vali Loss: 0.4763499 Test Loss: 0.2151347
EarlyStopping counter: 6 out of 10
Updating learning rate to 0.004021193997714411
iters: 100, epoch: 14 | loss: 0.5604454
speed: 0.1611s/iter; left time: 305.4688s
iters: 200, epoch: 14 | loss: 0.3495321
speed: 0.0656s/iter; left time: 117.8210s
Epoch: 14 cost time: 18.897520542144775
Epoch: 14, Steps: 285 | Train Loss: 0.4506181 Vali Loss: 0.4754393 Test Loss: 0.2156542
EarlyStopping counter: 7 out of 10
Updating learning rate to 0.003083428444500124
iters: 100, epoch: 15 | loss: 0.4728407
speed: 0.1609s/iter; left time: 259.2434s
iters: 200, epoch: 15 | loss: 0.3594473
speed: 0.0655s/iter; left time: 98.9966s
Epoch: 15 cost time: 18.869282245635986
Epoch: 15, Steps: 285 | Train Loss: 0.4469513 Vali Loss: 0.4774691 Test Loss: 0.2158166
EarlyStopping counter: 8 out of 10
Updating learning rate to 0.002219316429926769
iters: 100, epoch: 16 | loss: 0.5374044
speed: 0.1606s/iter; left time: 212.9617s
iters: 200, epoch: 16 | loss: 0.3515621
speed: 0.0655s/iter; left time: 80.3071s
Epoch: 16 cost time: 18.862897157669067
Epoch: 16, Steps: 285 | Train Loss: 0.4417733 Vali Loss: 0.4801658 Test Loss: 0.2175966
EarlyStopping counter: 9 out of 10
Updating learning rate to 0.0014620652941147994
iters: 100, epoch: 17 | loss: 0.4957572
speed: 0.1602s/iter; left time: 166.7883s
iters: 200, epoch: 17 | loss: 0.4278955
speed: 0.0655s/iter; left time: 61.6600s
Epoch: 17 cost time: 18.845292806625366
Epoch: 17, Steps: 285 | Train Loss: 0.4374476 Vali Loss: 0.4815650 Test Loss: 0.2188107
EarlyStopping counter: 10 out of 10
Early stopping
testing : long_term_forecast_weather_96_192_none_TimeMixer_custom_sl96_pl192_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
test 10348
test shape: (80, 128, 192, 21) (80, 128, 192, 21)
test shape: (10240, 192, 21) (10240, 192, 21)
mse:0.2081807404756546, mae:0.2515397369861603
rmse:0.4562682807445526, mape:0.5633121132850647, mspe:25455112.0
Args in experiment:
Namespace(task_name='long_term_forecast', is_training=1, model_id='weather_96_336', model='TimeMixer', data='custom', root_path='./dataset/weather/', data_path='weather.csv', features='M', target='OT', freq='h', checkpoints='./checkpoints/', seq_len=96, label_len=0, pred_len=336, seasonal_patterns='Monthly', inverse=False, top_k=5, num_kernels=6, enc_in=21, dec_in=21, c_out=21, d_model=16, n_heads=4, e_layers=3, d_layers=1, d_ff=32, moving_avg=25, factor=3, distil=True, dropout=0.1, embed='timeF', activation='gelu', output_attention=False, channel_independence=1, decomp_method='moving_avg', use_norm=1, down_sampling_layers=3, down_sampling_window=2, down_sampling_method='avg', num_workers=10, itr=1, train_epochs=20, batch_size=128, patience=10, learning_rate=0.01, des='Exp', loss='MSE', lradj='TST', pct_start=0.2, use_amp=False, comment='none', use_gpu=True, gpu=0, use_multi_gpu=False, devices='0,1', p_hidden_dims=[128, 128], p_hidden_layers=2)
Use GPU: cuda:0
start training : long_term_forecast_weather_96_336_none_TimeMixer_custom_sl96_pl336_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0>>>>>>>>>>>>>>>>>>>>>>>>>>
train 36456
val 4935
test 10204
iters: 100, epoch: 1 | loss: 0.6762619
speed: 0.0802s/iter; left time: 447.6532s
iters: 200, epoch: 1 | loss: 0.7450211
speed: 0.0717s/iter; left time: 392.8241s
Epoch: 1 cost time: 20.772141218185425
Epoch: 1, Steps: 284 | Train Loss: 0.7176838 Vali Loss: 0.6182648 Test Loss: 0.2868061
Validation loss decreased (inf --> 0.618265). Saving model ...
Updating learning rate to 0.00180823692331512
iters: 100, epoch: 2 | loss: 0.6044372
speed: 0.1747s/iter; left time: 925.1899s
iters: 200, epoch: 2 | loss: 0.5523940
speed: 0.0717s/iter; left time: 372.3988s
Epoch: 2 cost time: 20.55257225036621
Epoch: 2, Steps: 284 | Train Loss: 0.5827757 Vali Loss: 0.5536075 Test Loss: 0.2660022
Validation loss decreased (0.618265 --> 0.553607). Saving model ...
Updating learning rate to 0.005206643013182129
iters: 100, epoch: 3 | loss: 0.5766494
speed: 0.1750s/iter; left time: 877.4838s
iters: 200, epoch: 3 | loss: 0.5486959
speed: 0.0716s/iter; left time: 351.8329s
Epoch: 3 cost time: 20.537157773971558
Epoch: 3, Steps: 284 | Train Loss: 0.5633632 Vali Loss: 0.5502650 Test Loss: 0.2656547
Validation loss decreased (0.553607 --> 0.550265). Saving model ...
Updating learning rate to 0.008601151212863664
iters: 100, epoch: 4 | loss: 0.6538562
speed: 0.1747s/iter; left time: 826.1667s
iters: 200, epoch: 4 | loss: 0.6420984
speed: 0.0717s/iter; left time: 331.7201s
Epoch: 4 cost time: 20.538926124572754
Epoch: 4, Steps: 284 | Train Loss: 0.5586641 Vali Loss: 0.5445257 Test Loss: 0.2642392
Validation loss decreased (0.550265 --> 0.544526). Saving model ...
Updating learning rate to 0.009999998805018026
iters: 100, epoch: 5 | loss: 0.5255791
speed: 0.1752s/iter; left time: 778.9302s
iters: 200, epoch: 5 | loss: 0.5437405
speed: 0.0717s/iter; left time: 311.3697s
Epoch: 5 cost time: 20.580398559570312
Epoch: 5, Steps: 284 | Train Loss: 0.5525623 Vali Loss: 0.5473270 Test Loss: 0.2656774
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.009903251217478603
iters: 100, epoch: 6 | loss: 0.5712382
speed: 0.1752s/iter; left time: 729.1598s
iters: 200, epoch: 6 | loss: 0.5956228
speed: 0.0718s/iter; left time: 291.4277s
Epoch: 6 cost time: 20.575769901275635
Epoch: 6, Steps: 284 | Train Loss: 0.5469062 Vali Loss: 0.5537988 Test Loss: 0.2652604
EarlyStopping counter: 2 out of 10
Updating learning rate to 0.009618075204015223
iters: 100, epoch: 7 | loss: 0.6023598
speed: 0.1744s/iter; left time: 675.9986s
iters: 200, epoch: 7 | loss: 0.6505283
speed: 0.0717s/iter; left time: 270.8363s
Epoch: 7 cost time: 20.550930738449097
Epoch: 7, Steps: 284 | Train Loss: 0.5425374 Vali Loss: 0.5475795 Test Loss: 0.2653736
EarlyStopping counter: 3 out of 10
Updating learning rate to 0.009155429918896733
iters: 100, epoch: 8 | loss: 0.4873362
speed: 0.1751s/iter; left time: 628.9643s
iters: 200, epoch: 8 | loss: 0.5438763
speed: 0.0717s/iter; left time: 250.5183s
Epoch: 8 cost time: 20.549409866333008
Epoch: 8, Steps: 284 | Train Loss: 0.5379630 Vali Loss: 0.5472488 Test Loss: 0.2629513
EarlyStopping counter: 4 out of 10
Updating learning rate to 0.008533094560975773
iters: 100, epoch: 9 | loss: 0.4517022
speed: 0.1747s/iter; left time: 578.2332s
iters: 200, epoch: 9 | loss: 0.4840907
speed: 0.0718s/iter; left time: 230.2531s
Epoch: 9 cost time: 20.570077657699585
Epoch: 9, Steps: 284 | Train Loss: 0.5332942 Vali Loss: 0.5556108 Test Loss: 0.2662907
EarlyStopping counter: 5 out of 10
Updating learning rate to 0.007774985129047554
iters: 100, epoch: 10 | loss: 0.4708846
speed: 0.1747s/iter; left time: 528.4759s
iters: 200, epoch: 10 | loss: 0.5694571
speed: 0.0718s/iter; left time: 209.9871s
Epoch: 10 cost time: 20.54496145248413
Epoch: 10, Steps: 284 | Train Loss: 0.5300522 Vali Loss: 0.5519323 Test Loss: 0.2673647
EarlyStopping counter: 6 out of 10
Updating learning rate to 0.00691023534342841
iters: 100, epoch: 11 | loss: 0.5525529
speed: 0.1752s/iter; left time: 480.2941s
iters: 200, epoch: 11 | loss: 0.5092630
speed: 0.0717s/iter; left time: 189.4442s
Epoch: 11 cost time: 20.616445064544678
Epoch: 11, Steps: 284 | Train Loss: 0.5261522 Vali Loss: 0.5618097 Test Loss: 0.2690014
EarlyStopping counter: 7 out of 10
Updating learning rate to 0.0059720770534224185
iters: 100, epoch: 12 | loss: 0.5237783
speed: 0.1754s/iter; left time: 431.0713s
iters: 200, epoch: 12 | loss: 0.5110543
speed: 0.0719s/iter; left time: 169.5107s
Epoch: 12 cost time: 20.627060413360596
Epoch: 12, Steps: 284 | Train Loss: 0.5216495 Vali Loss: 0.5661159 Test Loss: 0.2704441
EarlyStopping counter: 8 out of 10
Updating learning rate to 0.0049965631559892795
iters: 100, epoch: 13 | loss: 0.4331133
speed: 0.1759s/iter; left time: 382.2790s
iters: 200, epoch: 13 | loss: 0.4477478
speed: 0.0718s/iter; left time: 148.9245s
Epoch: 13 cost time: 20.607174396514893
Epoch: 13, Steps: 284 | Train Loss: 0.5160140 Vali Loss: 0.5630207 Test Loss: 0.2732388
EarlyStopping counter: 9 out of 10
Updating learning rate to 0.004021182103132853
iters: 100, epoch: 14 | loss: 0.4574574
speed: 0.1752s/iter; left time: 331.0030s
iters: 200, epoch: 14 | loss: 0.5201182
speed: 0.0718s/iter; left time: 128.4090s
Epoch: 14 cost time: 20.578966856002808
Epoch: 14, Steps: 284 | Train Loss: 0.5108669 Vali Loss: 0.5685348 Test Loss: 0.2741197
EarlyStopping counter: 10 out of 10
Early stopping
testing : long_term_forecast_weather_96_336_none_TimeMixer_custom_sl96_pl336_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
test 10204
test shape: (79, 128, 336, 21) (79, 128, 336, 21)
test shape: (10112, 336, 21) (10112, 336, 21)
mse:0.2642389237880707, mae:0.29182228446006775
rmse:0.5140417814254761, mape:0.6117508411407471, mspe:22384474.0
Args in experiment:
Namespace(task_name='long_term_forecast', is_training=1, model_id='weather_96_720', model='TimeMixer', data='custom', root_path='./dataset/weather/', data_path='weather.csv', features='M', target='OT', freq='h', checkpoints='./checkpoints/', seq_len=96, label_len=0, pred_len=720, seasonal_patterns='Monthly', inverse=False, top_k=5, num_kernels=6, enc_in=21, dec_in=21, c_out=21, d_model=16, n_heads=4, e_layers=3, d_layers=1, d_ff=32, moving_avg=25, factor=3, distil=True, dropout=0.1, embed='timeF', activation='gelu', output_attention=False, channel_independence=1, decomp_method='moving_avg', use_norm=1, down_sampling_layers=3, down_sampling_window=2, down_sampling_method='avg', num_workers=10, itr=1, train_epochs=20, batch_size=128, patience=10, learning_rate=0.01, des='Exp', loss='MSE', lradj='TST', pct_start=0.2, use_amp=False, comment='none', use_gpu=True, gpu=0, use_multi_gpu=False, devices='0,1', p_hidden_dims=[128, 128], p_hidden_layers=2)
Use GPU: cuda:0
start training : long_term_forecast_weather_96_720_none_TimeMixer_custom_sl96_pl720_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0>>>>>>>>>>>>>>>>>>>>>>>>>>
train 36072
val 4551
test 9820
iters: 100, epoch: 1 | loss: 0.8142495
speed: 0.0949s/iter; left time: 524.2079s
iters: 200, epoch: 1 | loss: 0.6766396
speed: 0.0866s/iter; left time: 469.3050s
Epoch: 1 cost time: 24.730847358703613
Epoch: 1, Steps: 281 | Train Loss: 0.8068021 Vali Loss: 0.7239532 Test Loss: 0.3527675
Validation loss decreased (inf --> 0.723953). Saving model ...
Updating learning rate to 0.001808262037764916
iters: 100, epoch: 2 | loss: 0.6173640
speed: 0.2044s/iter; left time: 1071.2935s
iters: 200, epoch: 2 | loss: 0.6137844
speed: 0.0867s/iter; left time: 445.8729s
Epoch: 2 cost time: 24.55042862892151
Epoch: 2, Steps: 281 | Train Loss: 0.6680108 Vali Loss: 0.6862536 Test Loss: 0.3416217
Validation loss decreased (0.723953 --> 0.686254). Saving model ...
Updating learning rate to 0.005206713998138916
iters: 100, epoch: 3 | loss: 0.6730509
speed: 0.2076s/iter; left time: 1029.5066s
iters: 200, epoch: 3 | loss: 0.6434111
speed: 0.0866s/iter; left time: 420.6864s
Epoch: 3 cost time: 24.582441329956055
Epoch: 3, Steps: 281 | Train Loss: 0.6507671 Vali Loss: 0.6802924 Test Loss: 0.3408227
Validation loss decreased (0.686254 --> 0.680292). Saving model ...
Updating learning rate to 0.008601226346554308
iters: 100, epoch: 4 | loss: 0.7849593
speed: 0.2058s/iter; left time: 962.6568s
iters: 200, epoch: 4 | loss: 0.6803224
speed: 0.0878s/iter; left time: 401.9479s
Epoch: 4 cost time: 24.905867099761963
Epoch: 4, Steps: 281 | Train Loss: 0.6441614 Vali Loss: 0.6722143 Test Loss: 0.3388726
Validation loss decreased (0.680292 --> 0.672214). Saving model ...
Updating learning rate to 0.009999998779366193
iters: 100, epoch: 5 | loss: 0.6364537
speed: 0.2161s/iter; left time: 950.2600s
iters: 200, epoch: 5 | loss: 0.6571795
speed: 0.0883s/iter; left time: 379.2287s
Epoch: 5 cost time: 25.106192588806152
Epoch: 5, Steps: 281 | Train Loss: 0.6346934 Vali Loss: 0.6763712 Test Loss: 0.3437357
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.009903243992354873
iters: 100, epoch: 6 | loss: 0.6608462
speed: 0.2095s/iter; left time: 862.1168s
iters: 200, epoch: 6 | loss: 0.5328134
speed: 0.0879s/iter; left time: 352.8371s
Epoch: 6 cost time: 24.89567756652832
Epoch: 6, Steps: 281 | Train Loss: 0.6301392 Vali Loss: 0.6720090 Test Loss: 0.3452646
Validation loss decreased (0.672214 --> 0.672009). Saving model ...
Updating learning rate to 0.009618061057077049
iters: 100, epoch: 7 | loss: 0.5821897
speed: 0.2097s/iter; left time: 804.1047s
iters: 200, epoch: 7 | loss: 0.6629183
speed: 0.0870s/iter; left time: 324.9126s
Epoch: 7 cost time: 24.728896141052246
Epoch: 7, Steps: 281 | Train Loss: 0.6234477 Vali Loss: 0.6766704 Test Loss: 0.3424388
EarlyStopping counter: 1 out of 10
Updating learning rate to 0.009155409393803014
iters: 100, epoch: 8 | loss: 0.6022717
speed: 0.2096s/iter; left time: 745.0661s
iters: 200, epoch: 8 | loss: 0.6708240
speed: 0.0878s/iter; left time: 303.3604s
Epoch: 8 cost time: 24.855897903442383
Epoch: 8, Steps: 281 | Train Loss: 0.6200137 Vali Loss: 0.6743950 Test Loss: 0.3449188
EarlyStopping counter: 2 out of 10
Updating learning rate to 0.008533068446494351
iters: 100, epoch: 9 | loss: 0.6271792
speed: 0.2133s/iter; left time: 698.0489s
iters: 200, epoch: 9 | loss: 0.5900708
speed: 0.0876s/iter; left time: 277.9912s
Epoch: 9 cost time: 24.90035605430603
Epoch: 9, Steps: 281 | Train Loss: 0.6172251 Vali Loss: 0.6732223 Test Loss: 0.3422192
EarlyStopping counter: 3 out of 10
Updating learning rate to 0.0077749544287433045
iters: 100, epoch: 10 | loss: 0.6388667
speed: 0.2089s/iter; left time: 625.1309s
iters: 200, epoch: 10 | loss: 0.5596918
speed: 0.0877s/iter; left time: 253.6024s
Epoch: 10 cost time: 24.834704160690308
Epoch: 10, Steps: 281 | Train Loss: 0.6112832 Vali Loss: 0.6812492 Test Loss: 0.3471961
EarlyStopping counter: 4 out of 10
Updating learning rate to 0.006910201237096809
iters: 100, epoch: 11 | loss: 0.6107982
speed: 0.2092s/iter; left time: 567.1717s
iters: 200, epoch: 11 | loss: 0.7271204
speed: 0.0874s/iter; left time: 228.1348s
Epoch: 11 cost time: 24.82628321647644
Epoch: 11, Steps: 281 | Train Loss: 0.6062498 Vali Loss: 0.6967529 Test Loss: 0.3520924
EarlyStopping counter: 5 out of 10
Updating learning rate to 0.005972040851750663
iters: 100, epoch: 12 | loss: 0.5930983
speed: 0.2091s/iter; left time: 508.2303s
iters: 200, epoch: 12 | loss: 0.5886881
speed: 0.0874s/iter; left time: 203.6228s
Epoch: 12 cost time: 24.776528120040894
Epoch: 12, Steps: 281 | Train Loss: 0.6009362 Vali Loss: 0.6849611 Test Loss: 0.3488447
EarlyStopping counter: 6 out of 10
Updating learning rate to 0.00499652625018731
iters: 100, epoch: 13 | loss: 0.5866392
speed: 0.2081s/iter; left time: 447.2292s
iters: 200, epoch: 13 | loss: 0.5042546
speed: 0.0875s/iter; left time: 179.2445s
Epoch: 13 cost time: 24.757347345352173
Epoch: 13, Steps: 281 | Train Loss: 0.5950525 Vali Loss: 0.7007942 Test Loss: 0.3564042
EarlyStopping counter: 7 out of 10
Updating learning rate to 0.004021145911469944
iters: 100, epoch: 14 | loss: 0.5368530
speed: 0.2076s/iter; left time: 387.8565s
iters: 200, epoch: 14 | loss: 0.6062331
speed: 0.0877s/iter; left time: 155.0381s
Epoch: 14 cost time: 24.7646701335907
Epoch: 14, Steps: 281 | Train Loss: 0.5889814 Vali Loss: 0.7063530 Test Loss: 0.3574873
EarlyStopping counter: 8 out of 10
Updating learning rate to 0.0030833831550158746
iters: 100, epoch: 15 | loss: 0.4924599
speed: 0.2067s/iter; left time: 328.1095s
iters: 200, epoch: 15 | loss: 0.5690606
speed: 0.0870s/iter; left time: 129.3131s
Epoch: 15 cost time: 24.61445379257202
Epoch: 15, Steps: 281 | Train Loss: 0.5833323 Vali Loss: 0.6996056 Test Loss: 0.3548250
EarlyStopping counter: 9 out of 10
Updating learning rate to 0.0022192756776522196
iters: 100, epoch: 16 | loss: 0.5421556
speed: 0.2064s/iter; left time: 269.5861s
iters: 200, epoch: 16 | loss: 0.4972541
speed: 0.0871s/iter; left time: 105.0962s
Epoch: 16 cost time: 24.679931163787842
Epoch: 16, Steps: 281 | Train Loss: 0.5771793 Vali Loss: 0.7160063 Test Loss: 0.3596286
EarlyStopping counter: 10 out of 10
Early stopping
testing : long_term_forecast_weather_96_720_none_TimeMixer_custom_sl96_pl720_dm16_nh4_el3_dl1_df32_fc3_ebtimeF_dtTrue_Exp_0<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
test 9820
test shape: (76, 128, 720, 21) (76, 128, 720, 21)
test shape: (9728, 720, 21) (9728, 720, 21)
mse:0.345264196395874, mae:0.3470550775527954
rmse:0.5875918865203857, mape:0.677718460559845, mspe:23126632.0