机器学习笔记之代价函数（三）

Cost Function - Intuition II

A contour plot is a graph that contains many contour lines. A contour line of a two variable function has a constant value at all points of the same line. An example of such a graph is the one to the right below.

Taking any color and going along the 'circle', one would expect to get the same value of the cost function. For example, the three green points found on the green line above have the same value for  J(θ0,θ1)  and as a result, they are found along the same line. The circled x displays the value of the cost function for the graph on the left when  θ0  = 800 and  θ1 = -0.15. Taking another h(x) and plotting its contour plot, one gets the following graphs:

When  θ0  = 360 and  θ1  = 0, the value of  J(θ0,θ1)  in the contour plot gets closer to the center thus reducing the cost function error. Now giving our hypothesis function a slightly positive slope results in a better fit of the data.

The graph above minimizes the cost function as much as possible and consequently, the result of  θ1  and  θ0  tend to be around 0.12 and 250 respectively. Plotting those values on our graph to the right seems to put our point in the center of the inner most 'circle'.