Activation Functions - AI

Functions and their accompanying graphs

Function	Goes By	Graph
Rectified Linear Unit	ReLU, relu

Softmax

Softmax converts vector of values to probability distribution.
It can therefore be used as the last layer in a network to provide a probability distribution among possible outcomes.