The form is as follows:

minimise f0(x)

subject to f1(x)bi,i=1,...,m

 

The optimisation variable of the problem is the following vector:

x=(x1,...,xn)

The objective function is

f0:RnR

The constraint functions are

fi:RnR

The constrants are

b1,...,bm

Note that the constrants are the limits or bounds for the constraints.

 

The smallest objective value among all vectors that satisfy the constraints is the optimal or solution of the problem:

x

 

For example,

The following convex function (red coloured quadratic function) is

f(x)=22/5

The constraint function (black coloured linear function) is

f(x)=0.5x+7

The feasible area is coloured in yellow:

f1(z)b1,...,fm(z)bm

for any z, we have

f1(z)f0(x)

'MachineLearning > Optimisation' 카테고리의 다른 글

Gradient Vector, Hessian Matrix, and Jacobian Matrix  (2) 2025.07.03
SGD, ADAM, HN ADAM  (3) 2025.06.27
Regularised least squares (RLS)  (0) 2024.01.22
Least-squares problems  (0) 2024.01.16

+ Recent posts