PeriodicExponential
PeriodicExponential#
- class sinabs.activation.PeriodicExponential(grad_width: float = 0.5, grad_scale: float = 1.0)[source]#
Surrogate gradient as defined in Weidel and Sheik, 2021.
https://arxiv.org/abs/2111.01456
- Parameters
grad_width (float) –
grad_scale (float) –
- Return type
None