Automatic Differentation

Tutorial on autodiff: forward and reverse mode, dual numbers, backpropagation, recurrent and residual networks, adjoint method, argmin layers.