#48 · Primary category: Deep Learning Frameworks
autograd
Efficiently computes derivatives of NumPy code.
Project last updated:08/29/26
GitHub Stars
7.5K
Forks
940
Contributors
71
License
MIT
Why we included this project
Autograd brings automatic differentiation to plain NumPy. You write the forward pass as ordinary Python and NumPy with the usual control flow, and the library returns a function that computes gradients. It supports both reverse-mode (backpropagation) and forward-mode, and the two compose, which covers most gradient-based optimization work in research and prototyping without dragging in a heavyweight framework. Since it can keep differentiating, higher-order derivatives come free, which matters for some optimization and sensitivity analyses. It also works well as a teaching tool: the README's tanh example makes backpropagation concrete in a few lines. For anyone already comfortable in the NumPy ecosystem, it is a pragmatic way to add derivatives without changing how you write math.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
tensorflow
An Open Source Machine Learning Framework for Everyone
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
keras
Deep Learning for humans
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.