pdfcoffee

Chapter 1
Figure 29: Test accuracy for increasing the values of internal hidden neurons
Increasing the size of batch computation
Gradient descent tries to minimize the cost function on all the examples provided in
the training sets and, at the same time, for all the features provided in input. SGD is a
much less expensive variant that considers only BATCH_SIZE examples. So, let us see
how it behaves when we change this parameter. As you can see, the best accuracy
value is reached for a BATCH_SIZE=64 in our four experiments (see Figure 30):
Figure 30: Test accuracy for different batch values
[ 35 ]