Loss function in machine learning

In a simplest way, we can say that a loss function in machine learning is a method of evaluating how well your algorithm models your dataset.

In terms of optimization techniques, the function which is used to evaluate a solution is referred to as the objective function. Now we may want to maximize or minimize the objective function so to get the highest or lowest score respectively.