#178 · Primary category: Computer Vision
donut
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
Project last updated:07/11/24
GitHub Stars
6.9K
Forks
565
Contributors
9
License
MIT
Why we included this project
Most document parsers chain together separate OCR steps, first detecting and recognizing text, then feeding the results into a layout or extraction model. Donut skips that pipeline: it is a single transformer that takes a document image and outputs structured data directly, trained end to end without any external OCR engine. The repo ships pre-trained checkpoints for document classification, parsing, and document VQA, so a small team can get a working parser running without standing up OCR services of their own. There is also SynthDoG, a companion generator that produces realistic training documents in English, Chinese, Japanese, and Korean, which helps when you have little annotated data. The model is integrated into Hugging Face Transformers, which keeps deployment and fine-tuning within a familiar toolchain.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
opencv
Open Source Computer Vision Library
RuView
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
PaddleOCR
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
tesseract
Tesseract Open Source OCR Engine (main repository)