Reputation: 25
I'm having trouble interpreting the y-axis for my activation summaries. I understand that the x-axis is values and the z-axis is the global step. I thought the y-axis is a density chart of activated nodes in the layer, but that doesn't seem right.
When I look at the histogram for my last layer (an FC layer with 10 outputs), it shows fractional values. How is that possible if there are only 10 outputs? Is it possible for only part of a node to be activated? I'm not sure what is going on here.
Thanks for any explanation!
Upvotes: 1
Views: 517
Reputation: 5808
This happens in the histogram example too, I get a bin with 91.4 points in it for the Gaussian example. It's an artifact of smooth/soft binning, like with the Poisson integers spread out over multiple bins.
Upvotes: 1