Activation Functions

Contents

Activation Functions#

Softmax Function#

The softmax function is similar to the sigmoid function but for multiple classes.

\[ z_j = \frac{e^{h_j}}{\sum_{i=1}^k e^{h_i}} \]