Reverse mode Automatic Differentiation
Automatic Differentiation AD is an important algorithm for calculating the derivatives of arbitrary functions that can be expressed by a computer program. One of my favorite CS papers is quot;Automatic differentiation in machine learning: a survey quot; by Baydin, Perlmutter, Radul and Siskind ...