Derivative-free optimization

Derivative-free optimization (DFO) refers to a set of optimization techniques used to find the minimum or maximum of a function without relying on the calculation of derivatives (i.e., gradients or Hessians). This approach is particularly useful for optimizing functions that are complex, noisy, discontinuous, or where derivatives are difficult or impossible to compute. ### Key Features of Derivative-Free Optimization: 1. **No Derivative Information**: DFO methods do not require information about the function's derivatives.