CODEWITHSUNDEEP
iterationconv-neural-networkmnistdl4j
Chee Wei Han
Chee Wei Han

Reputation: 1

CNN: Unstable of model score vs iteration

I got my model score vs iteration graph is unstable. How can I improve it?

This is what I get

Here is my code

Code 1

Code 2

Code 3

Code 4

Code 5

Upvotes: -1

Views: 35

Answers (1)

Adam Gibson
Adam Gibson

Reputation: 3205

Your network looks fairly stock/copy and pasted. I'm pretty sure I've seen this code before.

Without knowing much about your input data I'm not sure if you're solving a classification problem or not but try first switching it to softmax and negative log likelihood on the output.

The output activation and loss function are mainly for binary classification.

You can also get rid of the ReNormalizeL2PerLayer. That might hinder the network from learning depending on your data.

It's also hard to help without knowing much about your input data but sometimes unit mean zero variance may not be suitable for your data set. Consider switching to a zero to 1 scaling instead.

Lastly, for quick iteration times consider overfitting on a small amount of data first when testing. That will help you see if there's any signal in your data and if your network can learn.

Upvotes: 0

Related Questions