#332 · Primary category: Education & Research
sutskever-30-implementations
Sutskever 30 implementations inspired by https://papercode.vercel.app/ | For Agents, use https://github.com/pageman/Sutskever-Agent | Polyglot / Multi-Backed version at https://github.com/pageman/sutskever-30-beyond-numpy
Project last updated:03/15/26
GitHub Stars
4.5K
Forks
589
Contributors
3
License
Other
Why we included this project
This collection works through all 30 papers on Ilya Sutskever's well-known reading list, with each one implemented as a Jupyter notebook that relies only on NumPy. That constraint keeps the mechanics visible: attention heads, recurrent cells, and residual blocks show up as plain Python arrays rather than opaque framework calls. Every notebook includes synthetic data and plots, so you can watch activations and gradients build up line by line as you step through a transformer or a neural Turing machine. It suits engineers refreshing their fundamentals and educators looking for runnable examples to hand out. This is a study aid for deep learning's foundations, not production code.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
JavaGuide
Java Interview & Backend General Interview Guide, covering computer fundamentals, databases, distributed systems, high concurrency, system design, and AI application development.
system-prompts-and-models-of-ai-tools
A curated collection of system prompts, internal tools, and AI models from popular AI assistants and coding agents.
30-seconds-of-code
Coding articles to level up your development skills
generative-ai-for-beginners
21 Lessons, Get Started Building with Generative AI