#414 · Primary category: Computer Vision

lightning-sam

Fine-tune Segment-Anything Model with Lightning Fabric.

Project last updated:03/25/24

GitHub Stars

574

Forks

53

Contributors

5

License

Apache-2.0

Why we included this project

Stock Segment-Anything handles some images poorly, and the author's example is text on documents. This library adapts SAM to your own data by fine-tuning it on any COCO-format dataset, using bounding boxes as prompts, and it runs on Lightning Fabric. The README is honest that this is an experiment, a proof of concept to see whether box-prompt fine-tuning improves mask quality. It supports only box prompts and includes training and validation loops, so treat it as a reference implementation rather than a production pipeline. The reported IoU gains on TrashCan and WGISD give a concrete sense of what fine-tuning can buy you, which helps you judge whether the effort is worth it for your own domain.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category