As far as I know, most machine learning algorithms solve unconstrained optimisation problems, i.e., if we were to unroll all the neurons into symbolic expressions we would end up with a massive objective function and no constraints.

I read somewhere that SVM algorithms solve constrained problems instead, so I am wondering:

which machine learning algorithms actually solve constrained optimisation problems?

Just to clarify, my question is with respect to using constrained optimisation as part of the algorithm, not feeding constrained problems in.

  • 3
    $\begingroup$ w.r.t. to your last paragraph you may wish to rephrase the title; my natural answer to your current title question is: none of them. $\endgroup$ Oct 24, 2019 at 13:22
  • 2
    $\begingroup$ Good point, updated the title. $\endgroup$ Oct 24, 2019 at 16:22

1 Answer 1


As the borders between statistics and machine learning are diffuse, I take freedom to include statistics. Some links:


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.