x_1
x1x_1
x_2
x2x_2
v_0
v0v_0
v_1
v1v_1
v_2
v2v_2
v_3
v3v_3
v_4
v4v_4
v_5
v5v_5
v_6
v6v_6
X
XX
Y_1 = W_1X + b_1
Y1=W1X+b1Y_1 = W_1X + b_1
A_1 = max(0,Y_1)
A1=max(0,Y1)A_1 = max(0,Y_1)
Y_2 = W_2X + b_2
Y2=W2X+b2Y_2 = W_2X + b_2
\text{softmax}
softmax\text{softmax}
L1
L1L1
ReLU
ReLUReLU
L2
L2L2

deck

By Suchin Gururangan