Activation Fields

Activation Fields

The Activation type exposes the following members.

Fields

	Name	Description
	Linear	The identity activation function, g(x) = x.
	Logistic	The logistic activation function, $g(x)=\frac{1}{1+e^{-x}}$ .
	LogisticTable	The logistic activation function computed using a table.
	Softmax	The softmax activation function. ${\rm{softmax}}_{\rm{i}}=\frac{{{\mathop{\rm e}\nolimits} ^{Z_i } }} {{\sum\limits_{j = 1}^C {e^{Z_j } } }}$ .
	Squash	The squash activation function, $g(x)=\frac{x}{1+\|x\|}$
	Tanh	The hyperbolic tangent activation function, $g(x)=\tanh{x}= \frac{e^x-e^{-x}}{e^x+e^{-x}}$ .