Line search

Line search is an optimization technique used to find a minimum (or maximum) of a function along a specified direction. It is commonly employed in gradient-based optimization algorithms, especially in the context of iterative methods like gradient descent, where the goal is to minimize a differentiable function. ### Key Components of Line Search: 1. **Objective Function**: The function \( f(x) \) that we want to minimize.