#749 · Primary category: Education & Research

NLP-Tutorials

attention bert elmo gpt nlp seq2seq transformer tutorial w2v

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Project last updated:05/22/23

GitHub Stars

952

Forks

316

Contributors

8

License

MIT

Why we included this project

This repo is essentially a set of teaching scripts rather than a library you'd deploy. Each classic NLP model, from TF-IDF and word embeddings up through seq2seq, attention, the Transformer, and contextual pretrained models like ELMo, GPT, and BERT, comes as a compact standalone Python file. Paired with the author's Chinese tutorials on mofanpy.com, the code shows exactly how the math and architecture translate into working implementations. The deliberately minimal style makes it easy to follow the mechanism inside each algorithm before you move on to heavier frameworks. If you're trying to understand the inner workings of these models by reading and running small examples, this is a handy companion.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category