Aim tensorboard tracker stop logging metrics after certain number of epochs

[aswanthkrishna]

Aim tensorboard tracker stop logging metrics after certain number of epochs

[SGevorg]

Hi @aswanthkrishna are there any traces in the terminal. Maybe some exception or something? How can we reproduce this?

[aswanthkrishna]

@SGevorg i could not find annything particular in the logs

I am running this mmdetection tutorial

this create tensorboard logs of the following format

./work_dirs/20240621_150242/vis_data
│
├── 20240621_150242.json
├── config.py
├── events.out.tfevents.1718982168.gpu02.2571.0
└── scalars.json

i am using following code for aim tensorboard tracker based on the tutorial

from aim.ext.tensorboard_tracker import Run as AimRun
work_dir="./work_dirs"
run = AimRun(sync_tensorboard_log_dir=work_dir, system_tracking_interval=10, force_resume=True, experiment='my-mmdetection-trial')