#414 · Primary category: Computer Vision
lightning-sam
Fine-tune Segment-Anything Model with Lightning Fabric.
Project last updated:03/25/24
GitHub Stars
574
Forks
53
Contributors
5
License
Apache-2.0
Why we included this project
Stock Segment-Anything handles some images poorly, and the author's example is text on documents. This library adapts SAM to your own data by fine-tuning it on any COCO-format dataset, using bounding boxes as prompts, and it runs on Lightning Fabric. The README is honest that this is an experiment, a proof of concept to see whether box-prompt fine-tuning improves mask quality. It supports only box prompts and includes training and validation loops, so treat it as a reference implementation rather than a production pipeline. The reported IoU gains on TrashCan and WGISD give a concrete sense of what fine-tuning can buy you, which helps you judge whether the effort is worth it for your own domain.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
opencv
Open Source Computer Vision Library
RuView
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
PaddleOCR
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
tesseract
Tesseract Open Source OCR Engine (main repository)