CODEWITHSUNDEEP
neural-network
Rachelle
Rachelle

Reputation: 267

Feedforward Neural Network

Will there ever come a point in my epoch where my weights would become greater than 1 if i used the logistic function as my sigmoid? Just wanna check if i'm coding the proper way for my feedforward implementation. Thanks.

Upvotes: 1

Views: 243

Answers (1)

Franck Dernoncourt
Franck Dernoncourt

Reputation: 83157

That's possible. E.g. If you have a 1-input, 1-output feedforward network that has no bias, your only training input is 0.1 and the corresponding output is 1, then the higher the weight, the better. The logistic function simply ensures that the output is between 0 and 1.

Upvotes: 2

Related Questions