SingleExponential#

class sinabs.activation.SingleExponential(grad_width: float = 0.5, grad_scale: float = 1.0)[source]#

Surrogate gradient as defined in Shrestha and Orchard, 2018.

https://papers.nips.cc/paper/2018/hash/82f2b308c3b01637c607ce05f52a2fed-Abstract.html

Parameters

  • grad_width (float) –

  • grad_scale (float) –

Return type

None