#416 · Primary category: Computer Vision

swin-transformer-pytorch

artificial-intelligence attention-model deep-learning machine-learning pytorch transformer-architecture transformer-pytorch

Implementation of the Swin Transformer in PyTorch.

Project last updated:03/29/21

GitHub Stars

861

Forks

129

Contributors

1

License

MIT

Why we included this project

Anyone who wants to dissect the Swin Transformer's shifted-window attention will appreciate this early PyTorch implementation, which came out before Microsoft's official release. Self-attention is confined to local windows, and those windows shift between blocks, so the model stays efficient on high-resolution images while still letting information flow across window boundaries as the hierarchy deepens. The repository provides a clean network class rather than a full training pipeline; you set stage depths, head counts, window sizes, and downscaling factors, then drop it into classification, detection, or segmentation experiments. It installs via pip, carries an MIT license, and remains close enough to the paper to be a reliable reference for verifying the architecture or prototyping custom variants.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category