CODEWITHSUNDEEP
pytorch
zongjie
zongjie

Reputation: 13

Implementing Curriculum Dropout in Pytorch

Is there anyone who can help me implement Curriculum Dropout by Pytorch. Thanks in advance, and any kind of help will be appreciable.

I want to do some experiments of Curriculum Dropout in Pytorch. Curriculum Dropout tries to use a time scheduling for adjusting the dropout rate in the neural networks. The related paper can be downloaded from here. The source code in python can be found here

Upvotes: 0

Views: 777

Answers (1)

twink_ml
twink_ml

Reputation: 512

I took a quick look at the paper and it seems like the main idea is to use a scheduled dropout rate instead of a fixed dropout rate.

Torch already has a Dropout module: torch.nn.modules.dropout.Dropout.

For your custom neural net using a Dropout module dropout, you can schedule the dropout rate simply by modifying dropout.p between optimization steps.

Upvotes: 1

Related Questions