PeriodicExponential#
- class sinabs.activation.PeriodicExponential(grad_width: float = 0.5, grad_scale: float = 1.0)[source]#
Surrogate gradient as defined in Weidel and Sheik, 2021.
https://arxiv.org/abs/2111.01456
- Parameters:
grad_width (float)
grad_scale (float)