The Fully Connected layer is a traditional Multi Layer Perceptron that uses a softmax activation function in the output layer. The term “Fully Connected” implies that every neuron in the previous layer is connected to every neuron on the next layer. A softmax function is a generalization of the logistic function that “squashes” a *K*-dimensional vector, of arbitrary real values to a *K*-dimensional vector of real values in the range (0, 1) that add up to 1.