Mercurial > hg > tvii

comparison tvii/gradient_descent.py @ 44:857a606783e1

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
[documentation] notes + stubs on gradient descent
author Jeff Hammel <k0scist@gmail.com>
date Mon, 04 Sep 2017 15:06:38 -0700
parents
children
comparison
equal deleted inserted replaced
43:2f0caec46e26 44:857a606783e1
1 """
2 gradient descent for neural networks
3 """
4
5 # Each loop:
6 # - computes predictions
7 # - compute derivatives: dw, db
8 # update: w = w - alpha * dw; b = b - ....
9