CODEWITHSUNDEEP
tensorflowdeep-learningpytorchtensorboard
Noob
Noob

Reputation: 19

How to overwrite checkpoint of same global step for Tensorboard?

If you resume training from a specific epoch (same global step) and run tensorboard, tensorboard (add_scalar) will end up plotting 2 points for that particular global step.

Example, I want trying to test whether changing the learning rate halfway through training will improve/worsen the accuracy:

Plot example

The plots for same time step are plotted twice (I resumed from +15 epochs behind the latest epoch).

Search up the web, cannot find any commands that can ask Tensorboard to just overwrite the previous saved checkpoint for the new one. My expectation is that Tensorboard would know to overwrite the same global step point but it is plotting it together.

Upvotes: 1

Views: 1055

Answers (1)

Kseniya Maus
Kseniya Maus

Reputation: 1

You can delete the log file running the script (before creating model). And then it will be created empty. Or you can add time in the name of the log:

import time
NAME = 'my_cnn-{}'.format(int(time.time()))
tensorboard = TensorBoard(log_dir='logs/{}'.format(NAME))

Upvotes: 0

Related Questions