The form is as follows:
minimise
subject to
The optimisation variable of the problem is the following vector:
The objective function is
The constraint functions are
The constrants are
Note that the constrants are the limits or bounds for the constraints.
The smallest objective value among all vectors that satisfy the constraints is the optimal or solution of the problem:
For example,

The following convex function (red coloured quadratic function) is
The constraint function (black coloured linear function) is
The feasible area is coloured in yellow:
for any z, we have
'MachineLearning > Optimisation' 카테고리의 다른 글
Gradient Vector, Hessian Matrix, and Jacobian Matrix (2) | 2025.07.03 |
---|---|
SGD, ADAM, HN ADAM (3) | 2025.06.27 |
Regularised least squares (RLS) (0) | 2024.01.22 |
Least-squares problems (0) | 2024.01.16 |