CODEWITHSUNDEEP
neural-network
user1873073
user1873073

Reputation: 3660

What values do you supply to the sigmoid activation function?

I have my sigmoid activation function:

s(x) = 1/(1+e^(-x))

I have my output neuron:

Expecting = 1
Actual = 1.13

I know the value that comes out of the sigmoid activation function is 1.1254 but I can't figure out which values to plug in to get that result.

enter image description here

Upvotes: 1

Views: 2131

Answers (1)

beaker
beaker

Reputation: 16791

x = 1.1254

If you plug this x into your sigmoid function you get:

s(x) = 1 / (1 + e^x)
     = 1 / (1 + 2.71828^(-1.1254))
     = 0.7550

The derivative of the sigmoid, s'(x) is:

s'(x) = s(x) * (1 - s(x)), or
s'(x) = 0.7550 * (1 - 0.7550)
      = 0.1850

As @Engineero points out in the comments, e is the base of natural logarithms and is approximately equal to 2.71828.

Upvotes: 2

Related Questions