吴恩达Machine Learning week 3 review答案: Logistic Regression

1。

Suppose that you have trained a logistic regression classifier, and it outputs on a new example  x  a prediction  hθ(x)  = 0.4. This means (check all that apply):

[Y]Our estimate for  P(y=0|x;θ)  is 0.6.

[Y]Our estimate for  P(y=1|x;θ)  is 0.4.

Our estimate for  P(y=1|x;θ)  is 0.6.

Our estimate for  P(y=0|x;θ)  is 0.4.

1
point

2。

θ(x)=g(θ0+θ1x1+θ2

Which of the following are true? Check all that apply.

J(θ) will be a convex function, so gradient descent should converge to the global minimum.

【right】 Adding polynomial features (e.g., instead using hθ(x)=g(θ0+θ1x1+θ2x2+θ3x21+θ4x1x2+θ5x22) ) could increase how well we can fit the training data.

【right】The positive and negative examples cannot be separated using a straight line. So, gradient descent will fail to converge.

 WRONG Because the positive and negative examples cannot be separated using a straight line, linear regression will perform as well as logistic regression on this data.

1
point

3。

For logistic regression, the gradient is given by  ∂∂θjJ(θ)=1m∑mi=1(hθ(x(i))−y(i))x(i)j . Which of these is a correct gradient descent update for logistic regression with a learning rate of  α ? Check all that apply.

θj:=θj−α1m∑mi=1(hθ(x(i))−y(i))x(i)  (simultaneously update for all  j ).

[Y] θj:=θj−α1m∑mi=1(11+e−θTx(i)−y(i))x(i)j  (simultaneously update for all  j ).

θ:=θ−α1m∑mi=1(θTx−y(i))x(i) .

θj:=θj−α1m∑mi=1(hθ(x(i))−y(i))x(i)j  (simultaneously update for all  j ).

1
point

4。

Which of the following statements are true? Check all that apply.

[Y]The cost function  J(θ)  for logistic regression trained with  m≥1  examples is always greater than or equal to zero.

For logistic regression, sometimes gradient descent will converge to a local minimum (and fail to find the global minimum). This is the reason we prefer more advanced optimization algorithms such as fminunc (conjugate gradient/BFGS/L-BFGS/etc).

Since we train one classifier when there are two classes, we train two classifiers when there are three classes (and we do one-vs-all classification).

[Y]The one-vs-all technique allows you to use logistic regression for problems in which each  y(i)  comes from a fixed, discrete set of values.

1
point

5。

Suppose you train a logistic classifier  hθ(x)=g(θ0+θ1x1+θ2x2) . Suppose  θ0=−6,θ1=0,θ2=1 . Which of the following figures represents the decision boundary found by your classifier?

Figure:

Figure:

Figure:

[Y]Figure: