CODEWITHSUNDEEP
neural-networkdeep-learningrecurrent-neural-network
Tanmay Bhatnagar
Tanmay Bhatnagar

Reputation: 2470

What is a time step with reference to a Recurrent Neural Network?

I am fairly new to RNNs and LSTMs but have spent quite some time studying from various resources I could find on the internet. What I gathered was that a time step in a recurrent neural network was the same as a forward pass in a feed forward neural network. But this turned out to be wrong. Then what is it ?

Upvotes: 2

Views: 2476

Answers (1)

Prune
Prune

Reputation: 77837

A forward pass involves running one data item (e.g. a full sentence) entirely through the network, until the item is fully processed (i.e. we have classification output).

A time step is the portion of a pass in which node inputs are processed into outputs, and then those outputs are fed to the next node -- often feeding back to a prior input.

Upvotes: 2

Related Questions