#83 · Primary category: NLP Tools & Text Processing
ecco
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
Project last updated:08/15/24
GitHub Stars
2.1K
Forks
176
Contributors
12
License
BSD-3-Clause
Why we included this project
Ecco is for people who work with transformer language models and want to see what is happening inside them, not just call them. It runs inside Jupyter notebooks and turns model internals into interactive visualizations: which input tokens drove a prediction, how output token probabilities shift layer by layer, and which neurons respond to particular text patterns. It works with GPT2, BERT, RoBERTa, T5, T0, and other Hugging Face PyTorch models, and it can load your own local checkpoints too. Integrated Gradients and Saliency are built in, so you can trace a prediction back to the words that actually mattered. The library deliberately skips training and fine-tuning, which keeps it focused and easy to pick up. That focus is what makes it useful whether you are debugging a model's behavior, writing about interpretability, or showing students how attention and layers work.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量