Backpropagation Algorithm

Backpropagation Algorithm

"Backpropagation" is neural-network terminology for minimizing our cost function, just like what we were doing with gradient descent in logistic and linear regression. Our goal is to compute:

<math xmlns="http://www.w3.org/1998/Math/MathML">
  <munder>
    <mo movablelimits="true">min</mo>
    <mi mathvariant="normal">Θ<!-- Θ --></mi>
  </munder>
  <mi>J</mi>
  <mo stretchy="false">(</mo>
  <mi mathvariant="normal">Θ<!-- Θ --></mi>
  <mo stretchy="false">)</mo>
</math>