pdfcoffee

Chapter 1
Figure 25: Accuracy for different models and optimizers
Controlling the optimizer learning rate
There is another approach we can take that involves changing the learning parameter
for our optimizer. As you can see in Figure 26, the best value reached by our three
experiments [lr=0.1, lr=0.01, lr=0.001] is 0.1, which is the default learning rate for
the optimizer. Good! adam works well out of the box:
Figure 26: Accuracy for different learning rates
[ 33 ]