CODEWITHSUNDEEP
machine-learningneural-networkmnist
Demon
Demon

Reputation: 89

MNIST hidden layer intuitive understanding

For the simplest MNIST solution with 1 hidden layer, can I understand the number of hidden neurons as how many parts we divide the inputs? For example: [784,30,10] Can I say I divide 784 pixels into 30 small images (784/30 pixels in each image) then do the calculation? Thanks!

Upvotes: 0

Views: 300

Answers (1)

Thomas Wagenaar
Thomas Wagenaar

Reputation: 6769

I'm not entirely sure what you mean. If you have a network that is layered like [784, 30, 10], you have 784 input neurons, 30 hidden neurons and 10 output neurons. The neurons don't know anything about 'pixels', they are just parameters. The network is basically calculating 30 values from the first input, and the output calculates 10 values from the previous 30 values.

Can I say I divide 784 pixels into 30 small images (784/30 pixels in each image) then do the calculation?

No, as a neuron is not an image.

Upvotes: 1

Related Questions