#244 · Primary category: AI Tool Directories & Curated Lists

awesome-transformer-nlp

attention-mechanism awesome awesome-list bert chatgpt gpt-2 gpt-3 gpt-4 language-model llama natural-language-processing neural-networks nlp pre-trained-language-models transfer-learning transformer xlnet

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

Project last updated:10/27/24

GitHub Stars

1.1K

Forks

132

Contributors

10

License

MIT

Why we included this project

For anyone getting oriented in the Transformer side of NLP, this hand-curated index collects the papers, tutorials, videos, and community code you would otherwise have to dig up yourself. The topic sections, from attention mechanisms and architecture to pretraining and specific tasks like named-entity recognition and question answering, let you jump straight to the material that matches your current project. It also pulls together official and community implementations across PyTorch, TensorFlow, and Keras, which helps when you want to go from reading a paper to running a reference model. As a reading guide and a pointer to repositories worth cloning, it saves time for developers and researchers mapping out the field.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category