#669 · Primary category: Education & Research
PPLM
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
Project last updated:02/20/24
GitHub Stars
1.2K
Forks
203
Contributors
9
License
Apache-2.0
Why we included this project
PPLM is the reference implementation of a widely cited approach to controlled text generation. Instead of retraining a language model, you steer its output by plugging in one or more small attribute models that push generation toward a chosen topic, sentiment, or other property. The repo ships working code for topic steering, sentiment control, and detoxification on GPT-2, along with the discriminator models and hyperparameters from the paper. Because the base model is used as-is, it offers a practical way to study how to influence generation without the hardware that fine-tuning a large model would demand. It also integrates with Hugging Face Transformers, so it is easy to try in an existing setup.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
JavaGuide
Java Interview & Backend General Interview Guide, covering computer fundamentals, databases, distributed systems, high concurrency, system design, and AI application development.
system-prompts-and-models-of-ai-tools
A curated collection of system prompts, internal tools, and AI models from popular AI assistants and coding agents.
30-seconds-of-code
Coding articles to level up your development skills
generative-ai-for-beginners
21 Lessons, Get Started Building with Generative AI