文章标题

$Algorithm \quad SGD$

---

$1.\quad init \quad pa=\{w_0,w_m,v_{m,k},itr,K\},m=1,...M,k=1,....K;$
$2.\quad input \quad tr=\{X[n],Y[n]\}; ,n=1,...N;$
$3.\quad for \quad it=1,...,pa.itr \quad do$
$4.\quad for \quad n=1,...,N \quad do$
$5.\quad \quad calc \quad \phi= F(X[n]|w_m,v_{m,k},K);$
$6.\quad \quad if \quad update \quad w_0$
$7.\quad \quad \quad calc \quad g=\frac {-2Y[n]exp(-2Y[n] \phi)}{1+exp(-2Y[n] \phi)};$
$8.\quad \quad \quad w_0=w_0-\eta g;$
$9.\quad \quad if \quad update \quad w_m$
$10.\quad \quad \quad calc\quad g=\frac {-2Y[n]exp(-2Y[n] \phi)}{1+exp(-2Y[n] \phi)}x_{n,m};$
$11.\quad \quad \quad w_m=w_m-\eta g;$
$12.\quad \quad if \quad update \quad v_{m,k}$
$13.\quad \quad \quad calc\quad g=\frac {-2Y[n]exp(-2Y[n] \phi)}{1+exp(-2Y[n] \phi)}(x_{n,m}\sum_{j=1}^Mv_{j,k}x_{n,j}-v_{m,k}x_{n,m}^2);$
$14.\quad \quad \quad v_{m,k}=v_{m,k}-\eta g;$
$15.\quad \quad end \quad for$
$16.\quad end \quad for$

---