#22 · Primary category: Education & Research

annotated_deep_learning_paper_implementations

attention deep-learning deep-learning-tutorial gan literate-programming lora machine-learning neural-networks optimizers pytorch reinforcement-learning transformer transformers

60+ annotated deep learning paper implementations with side-by-side notes, covering transformers, optimizers, GANs, and reinforcement learning in PyTorch.

Project last updated:01/22/26

GitHub Stars

67.4K

Forks

6.8K

Contributors

42

License

MIT

Why we included this project

Most people internalize a paper only when they can read the math and then watch it run in real code, and this collection makes that path unusually direct. Each entry pairs a clean PyTorch implementation with explanatory notes running alongside it, so you can follow how multi-head attention, a diffusion denoising loop, or PPO's advantage estimation is actually built. The range is broad enough to double as a map of the field: attention variants, optimizers, GANs, normalization layers, graph networks, and reinforcement learning all live in one place. Researchers brushing up on a technique, students preparing for interviews, and engineers porting an idea into their own code will all find the walkthroughs useful. And because each implementation is self-contained and documented, it's also a solid reference to return to when you need a concrete starting point for a specific architecture.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category