Coursera Machine Learning Week 4 - Neural Networks

Neural Networks: Representation

1. Which of the following statements are true? Check all that apply.

• (OK) In a neural network with many layers, we think of each successive layer as being able to use the earlier layers as features, so as to be able to compute increasingly complex functions.
• (OK) If a neural network is overfitting the data, one solution would be to increase the regularization parameter λ.
• If a neural network is overfitting the data, one solution would be to decrease the regularization parameter λ.
• Suppose you have a multi-class classification problem with three classes, trained with a 3 layer network. Let a(3)1=(hΘ(x))1 be the activation of the first output unit, and similarly a(3)2=(hΘ(x))2 and a(3)3=(hΘ(x))3. Then for any input x, it must be the case that a(3)1+a(3)2+a(3)3=1.

2. Consider the following neural network which takes two binary-valued inputs x1,x2∈{0,1} and outputs hΘ(x). Which of the following logical functions does it (approximately) compute?

+1     -20
x1      30     ()     hΘ(x)
x2      30

• (OK) OR
• AND
• NAND (meaning “NOT AND”)
• XOR (exclusive OR)