CODEWITHSUNDEEP
machine-learningneural-networkartificial-intelligencetensorflownormalization
Kendall Weihe
Kendall Weihe

Reputation: 2075

Does Tensorflow normalize input data by default?

Does anyone know if Tensorflow normalizes input data by default?

I have grayscale images that values range from roughly 20000-28000. When I normalized the data something really odd happened. The network trained for a couple hundred iterations, was doing well in terms of making accurate predictions, but suddenly all predictions went to NaN. Of course it couldn't recover because TF can't optimize from NaN.

When I didn't normalize the data training went fine and converged.

Any ideas?

Upvotes: 4

Views: 1400

Answers (1)

Davis Yoshida
Davis Yoshida

Reputation: 1785

To answer the title question, tensorflow does not normalize input data by default. With regard to the NaNs, there's not much to say without seeing more details of what computation you are performing.

Upvotes: 3

Related Questions