#25 · Primary category: Foundation Models

CodeGen

codex generativemodel languagemodel llm programsynthesis tpu-acceleration

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

Project last updated:06/02/26

GitHub Stars

5.2K

Forks

422

Contributors

11

License

Apache-2.0

Why we included this project

The CodeGen models from Salesforce AI Research span three generations, from the original CodeGen1 through CodeGen2 and CodeGen2.5, with checkpoints ranging from 350M up to 16B parameters. They turn natural-language descriptions into working code, which makes them a practical way to experiment with program synthesis locally instead of depending on a closed API. CodeGen2 brought fill-in-the-middle infill generation, and the 7B CodeGen2.5 checkpoint is worth a look because Salesforce reports it outperforms 16B models, giving you a sensible spread of sizes to match whatever GPU you have. Every checkpoint loads directly through the Hugging Face transformers API in a few lines of Python, so self-hosting is straightforward. Just remember this is research software rather than a supported product, so budget time to test the output on your own workload before trusting it in production.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category