CODEWITHSUNDEEP
kerasgaussian
D.Laupheimer
D.Laupheimer

Reputation: 1074

Does the GaussianDropout Layer in Keras retain probability like the Dropout Layer?

I was wondering, if the GaussianDropout Layer in Keras retains probability like the Dropout Layer. The Dropout Layer is implemented as an Inverted Dropout which retains probability.

If you aren't aware of the problem you may have a look at the discussion and specifically at the linxihui's answer. The crucial point which makes the Dropout Layer retaining the probability is the call of K.dropout, which isn't called by a GaussianDropout Layer.

Is there any reason why GaussianDropout Layer does not retain probability? Or is it retaining but in another way being unseen?

Similar - referring to the Dropout Layer: Is the Keras implementation of dropout correct?

Upvotes: 2

Views: 1599

Answers (1)

Marcin Możejko
Marcin Możejko

Reputation: 40516

So Gaussian dropout doesn't need to retain probability as its origin comes from applying Central Limit Theorem to inverted dropout. The details might be found here in 2nd and 3rd paragraph of Multiplicative Gaussian Noise chapter (chapter 10, p. 1951).

Upvotes: 2

Related Questions