#421 · Primary category: Computer Vision

GroupViT

image-text-matching semantic-segmentation transformers zero-shot-learning

Official PyTorch implementation of GroupViT: Semantic Segmentation Emerges from Text Supervision, CVPR 2022.

Project last updated:05/10/22

GitHub Stars

790

Forks

59

Contributors

2

License

Other

Why we included this project

GroupViT tackles a problem most segmentation models avoid: learning to segment images without any pixel-level mask labels. It trains on image-text caption pairs and learns to group visually similar regions into semantic segments, the approach behind the CVPR 2022 paper. The repository carries the official implementation, pretrained checkpoints, and evaluation scripts for PASCAL VOC and COCO, so reproducing the reported zero-shot results is fairly direct. It is a research codebase rather than a production segmentation service. Teams working on weakly supervised or zero-shot vision will get the most from studying how the hierarchical grouping and text alignment are implemented.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category