Intrinsic First-Order Optimization: Differentials, Gradients, Constraints, and Multipliers
A geometric reconstruction of first-order optimization centered on the differential as the intrinsic first-order object. The notes connect differentials, metric gradients, preconditioning, Newton directions, equality constraints, conormal spaces, Lagrange multipliers, tangent projection, and retractions.