CODEWITHSUNDEEP
pythontensorflow
OliasailO
OliasailO

Reputation: 512

List of Differentiable Ops in Tensorflow

Is there a master list of Tensorflow ops that are differentiable (i.e., will auto-differentiate)?

Two other ways to phrase this:

For example, I'd assume that all the Control Flow ops are not differentiable (e.g., tf.where). How would I find this other than by manually running them all through tf.gradients to see if they throw the LookupError.

"Commonsense" is not a valid answer.

Thanks.

EDIT:

tf.where is differentiable so my intuitions are wrong. Perhaps the correct question here is which ops in Tensorflow are not differentiable.

Thanks.

Upvotes: 20

Views: 8239

Answers (3)

Ben
Ben

Reputation: 193

It appears that, for TensorFlow 2, such a list is available in the documentation for the tf.raw_ops module.

Upvotes: 3

Mainak Dutta
Mainak Dutta

Reputation: 194

I have devised the entire list of Differentiable and Non-Differentiable Ops using python code.

You will find the compact list here. Also the code which generated it.

https://github.com/Mainak431/List-of-Differentiable--OPs-and-Non-differentiable-OPs--in-Tensorflow

Upvotes: 15

Salvador Dali
Salvador Dali

Reputation: 222581

No, there is no list (you can be the first one to create it). Also as far as I am aware, documentation of each function also does not tell it (tf.size is non-differentiable but does not tell about it).

Apart from the way you suggested, you can also extract this data from the source code. For example all the ops that have gradient implemented, have @ops.RegisterGradient in front of the method declaration. For ops which do not have gradient you will have ops.NotDifferentiable(

Not related, but probably helpful.

Upvotes: 7

Related Questions