Unconstrained Optimization minimize or maximize an objective function that depends on variables or set or variables with no restriction on their values. Mathematically, the value of such that the function takes the smallest value is given by

may be scalar in or vector in while is always a scalar in . Unconstrained optimization has many applications like finance, nonlinear equations, similarity transformations, etc. Unconstrained optimization problems arises directly in some applications but they also arise indirectly from reformulations of constrained optimization problems. Often it is practical to replace the constraints of an optimization problem with penalized terms in the objective function and to solve the problem as an unconstrained problem. Many constrained optimaization problems and algorithims involves solving unconstrained optimization as a subproblem.