CODEWITHSUNDEEP
pythontensorflowkeras
Nathan monnier
Nathan monnier

Reputation: 37

Does the learning rate reset when I stop training in jupyter? Tensorflow.Keras

Does the learning rate reset when I stop training in jupyter?
I said during training to lower it by * 0.1 when my model starts to stagnate.
If I stop training and then restart it right after, does that reset the learning rate?

Upvotes: 0

Views: 146

Answers (1)

mujjiga
mujjiga

Reputation: 16876

Yes, ideally it will restart again if you are not initializing with new value.

This of this as a function which is stopped and rerun again. If you don't write the custom logic to restart again from the old LR it will continue from its initialized value which is the begging again.

Upvotes: 1

Related Questions