Ben Dodson
Ben Dodson

Reputation: 25

Meaning of y-axis in in Tensorboard Activation Summary

I'm having trouble interpreting the y-axis for my activation summaries. I understand that the x-axis is values and the z-axis is the global step. I thought the y-axis is a density chart of activated nodes in the layer, but that doesn't seem right.

When I look at the histogram for my last layer (an FC layer with 10 outputs), it shows fractional values. How is that possible if there are only 10 outputs? Is it possible for only part of a node to be activated? I'm not sure what is going on here.

Thanks for any explanation!

activation histogram

Upvotes: 1

Views: 517

Answers (1)

Allen Lavoie
Allen Lavoie

Reputation: 5808

This happens in the histogram example too, I get a bin with 91.4 points in it for the Gaussian example. It's an artifact of smooth/soft binning, like with the Poisson integers spread out over multiple bins.

Upvotes: 1

Related Questions