What should an optimizer callback monitor beyond the objective value?
MathematicsLevel: IntermediateMultivariate optimizer reasoning
What should an optimizer callback monitor beyond the objective value?
Hints
- Progress is multidimensional.
- Check validity as well as improvement.
Answer
Feasibility, step or gradient diagnostics, evaluation cost and nonfinite values. A falling objective can still accompany constraint violations or numerical instability.
Source and licence: SciPy — scalar and multivariate minimization · BSD-3-Clause · answer: Quantoros editorial