#179 · Primary category: MLOps & Evaluation
chatgpt-comparison-detection
Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥
Project last updated:12/01/23
GitHub Stars
1.4K
Forks
128
Contributors
4
License
Other
Why we included this project
HC3, the Human ChatGPT Comparison Corpus at the heart of this repository, pairs human-written answers with ChatGPT responses across English and Chinese. It comes from the paper "How Close is ChatGPT to Human Experts?" and was one of the first datasets built specifically for measuring how far model output drifts from human writing, with examples drawn from sources like ELI5, Wikipedia, and medical and finance Q&A. The repo also ships a couple of working detectors, a RoBERTa-based classifier and a variant using linguistic features, that give you a reasonable baseline for flagging synthetic text on a single passage or a question-answer pair. This is research code rather than a production API, so expect to fine-tune the models and treat the corpus itself as the reference material for your own evaluation.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models