Mercurial > hg > tvii

diff tvii/gradient_descent.py @ 44:857a606783e1

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
[documentation] notes + stubs on gradient descent
author Jeff Hammel <k0scist@gmail.com>
date Mon, 04 Sep 2017 15:06:38 -0700
parents
children
line wrap: on
line diff
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/tvii/gradient_descent.py	Mon Sep 04 15:06:38 2017 -0700
@@ -0,0 +1,9 @@
+"""
+gradient descent for neural networks
+"""
+
+# Each loop:
+# - computes predictions
+# - compute derivatives: dw, db
+# update: w = w - alpha * dw; b = b - ....
+