PeriodicExponential#

class sinabs.activation.PeriodicExponential(grad_width: float = 0.5, grad_scale: float = 1.0)[source]#

Surrogate gradient as defined in Weidel and Sheik, 2021.

https://arxiv.org/abs/2111.01456

Parameters
  • grad_width (float) –

  • grad_scale (float) –

Return type

None