Mercurial > hg > tvii

view docs/matrix.txt @ 43:2f0caec46e26

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
[activation functions] add ReLU
author Jeff Hammel <k0scist@gmail.com>
date Mon, 04 Sep 2017 14:53:32 -0700
parents 59044f78d587
children 857a606783e1
line wrap: on
line source

    [|  |     | ]
X = [x1 x2 ...xm] = A0
    [|  |     | ]

Z1 = w'X + b1

A1 = sigmoid(Z1)

Z2 = W2 A1 + b2

     [---]
W1 = [---]
     [---]

`W1x1` gives some column vector, where `x1`
is the first training example.