## Backpropagation, Batch Training, and Incremental Training

Preliminaries Calculus 1,2 Linear Algebra Batch v.s. Incremental Training1 In both LMS and BP algorithms, the error in each update process step is not MSE but SE $$e=t_i-a_i$$ which is calculated just by a data point of the training set. This is called a stochastic gradient descent algorithm. And why it is called ‘stochastic’ is because error at every iterative step is approximated by randomly selected train data points but not the whole data set....

January 2, 2020 · (Last Modification: May 3, 2022) · Anthony Tan