#48 · Primary category: Deep Learning Frameworks

autograd

autograd automatic-differentiation backpropagation deep-learning derivative differentiation jax machine-learning neural-network numpy numpy-arrays python scipy ufunc

Efficiently computes derivatives of NumPy code.

Project last updated:08/29/26

GitHub Stars

7.5K

Forks

940

Contributors

71

License

MIT

Why we included this project

Autograd brings automatic differentiation to plain NumPy. You write the forward pass as ordinary Python and NumPy with the usual control flow, and the library returns a function that computes gradients. It supports both reverse-mode (backpropagation) and forward-mode, and the two compose, which covers most gradient-based optimization work in research and prototyping without dragging in a heavyweight framework. Since it can keep differentiating, higher-order derivatives come free, which matters for some optimization and sensitivity analyses. It also works well as a teaching tool: the README's tanh example makes backpropagation concrete in a few lines. For anyone already comfortable in the NumPy ecosystem, it is a pragmatic way to add derivatives without changing how you write math.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category