Mercurial > hg > tvii

annotate docs/matrix.txt @ 43:2f0caec46e26

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
[activation functions] add ReLU
author Jeff Hammel <k0scist@gmail.com>
date Mon, 04 Sep 2017 14:53:32 -0700
parents 59044f78d587
children 857a606783e1
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
35
37a9fb876f54 [documentation] add notes for matrices + vectorization
Jeff Hammel <k0scist@gmail.com>
parents:
diff changeset
1 [| | | ]
37
59044f78d587 documentation
Jeff Hammel <k0scist@gmail.com>
parents: 36
diff changeset
2 X = [x1 x2 ...xm] = A0
35
37a9fb876f54 [documentation] add notes for matrices + vectorization
Jeff Hammel <k0scist@gmail.com>
parents:
diff changeset
3 [| | | ]
36
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
4
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
5 Z1 = w'X + b1
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
6
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
7 A1 = sigmoid(Z1)
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
8
37
59044f78d587 documentation
Jeff Hammel <k0scist@gmail.com>
parents: 36
diff changeset
9 Z2 = W2 A1 + b2
59044f78d587 documentation
Jeff Hammel <k0scist@gmail.com>
parents: 36
diff changeset
10
36
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
11 [---]
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
12 W1 = [---]
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
13 [---]
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
14
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
15 `W1x1` gives some column vector, where `x1`
433c475f42db [documentation] more matrix notes
Jeff Hammel <k0scist@gmail.com>
parents: 35
diff changeset
16 is the first training example.