PerceptronA type of artificial neuron
Definitions:
A neural network of one or multiple layers producing a binary output
GradientMeasure of change
Definitions:
In mathematics, the rate at which a value is changing at any given point.
BackpropagationNeural network learning process
Definitions:
A method used in artificial neural networks to calculate a gradient that is needed in the calculation of the weights to be used in the network.
OverfittingModel excessively fits to the training data
Definitions:
A modeling error in statistics when a function is too closely aligned to a limited set of data points.
ReLUA type of activation function
Definitions:
Short for Rectified Linear Unit, is a piecewise linear function that will output the input directly if it is positive, otherwise, it will output zero.