pytorch学习笔记3--回归问题

回归问题

1. linear regression
   1. $y\in [-\infty ,+\infty ]$
2. logistics regression
   1. 把y值压缩到[0,1]，变为概率问题
3. 代码：
   1. $loss=(WX+b-y{)}^2$
      代码实现如下：

        def compute_error_for_line_given_points(b,w,points):
        	totalError = 0
        	for i in range(0,len(points)):
        		x = points[i,0]
        		y = points[i,1]
        		totalError += (y-(w*x+b)) ** 2
        	return totalError / float(len(points))
        ```
      

   2. $w^{\prime }=w-lr\ast \frac{\partial loss}{\partial w}$

      def step_gradient(b_current,w_current,points,learningRate):
      	b_gradient = 0
      	w_gradient = 0
      	N = float(len(points))
      	for i in range(0,len(points)):
      		x = point[i,0]
      		y = point[i,1]
      		b_gradient += -(2/N) * (y-(w_current * x) + b_current)
      		w_gradient += -(2/N) * x * (y - ((w_current * x) + b_current))
      	new_b = b_current - (learningRate * b_gradient)
      	new_m = w_current - (learningRate * w_gradient)
      

   3. Iterate to optimize

      	def gradient_descent_runner(points,starting_b,starting_m,learning_rate,num_iterations):
      		b = starting_b
      		m = starting_m
      		for i in range(num_iterations):
      			b, m = step_gradient(b,m,np.array(points),learning_rate)
      		return [b,m]