Optimizer

An algorithm used to update model parameters during training. Select and evaluate it alongside the loss function, data and training configuration rather than assuming one method is best for every task.