#112 · Primary category: MLOps & Evaluation
hallucination-leaderboard
Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents
Project last updated:05/11/26
GitHub Stars
3.3K
Forks
109
Contributors
20
License
Apache-2.0
Why we included this project
If you are picking a model for summarization-heavy RAG or other document-grounded work, hallucination rate is often the number that matters more than a flashy benchmark score. Vectara feeds each LLM the same short documents, then uses its HHEM evaluator to count how often the model invents facts in the summaries. The table reports hallucination rate, factual consistency, answer rate, and average summary length for every entry, and the ranking is refreshed as new models appear. Older versions of the leaderboard are kept around, so you can see how a candidate has trended over time. It is a reference rather than a tool you deploy, but it is a handy way to shortlist a few models before running your own tests, and the interactive version on Hugging Face makes scanning the results easy.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models