#178 · Primary category: Computer Vision

donut

computer-vision document-ai eccv-2022 multimodal-pre-trained-model nlp ocr

Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022

Project last updated:07/11/24

GitHub Stars

6.9K

Forks

565

Contributors

9

License

MIT

Why we included this project

Most document parsers chain together separate OCR steps, first detecting and recognizing text, then feeding the results into a layout or extraction model. Donut skips that pipeline: it is a single transformer that takes a document image and outputs structured data directly, trained end to end without any external OCR engine. The repo ships pre-trained checkpoints for document classification, parsing, and document VQA, so a small team can get a working parser running without standing up OCR services of their own. There is also SynthDoG, a companion generator that produces realistic training documents in English, Chinese, Japanese, and Korean, which helps when you have little annotated data. The model is integrated into Hugging Face Transformers, which keeps deployment and fine-tuning within a familiar toolchain.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category