activation_CELU

Continuously Differentiable Exponential Linear Unit (CELU) activation function helps to mitigate the vanishing gradient problem for negative input values and has mean activations near zero.

Equation

For an input vector x, the CELU activation function computes:

output = max(0, x) + min(0, αlpha * (e^(x/αlpha) − 1))

Inputs

x

The input vector to the CELU activation function.

alpha

A hyperparameter (commonly set to 1.0).

Outputs

output

The activated vector after applying the CELU function.