Optimizer#
What are optimizers?#
Optimizers are responsible for making the updates to your model. A good optimizer can help your model converge faster by using momentum to roll past terrain where gradients are small, while not skipping the convergence point. A good optimizing strategy is essential in training effectively.