#26 · Primary category: Deep Learning Frameworks

ms-swift

deepseek-r1 embedding grpo internvl liger llama llama4 llm lora megatron moe multimodal open-r1 peft qwen3 qwen3-6 qwen3-omni qwen3-vl reranker sft

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Project last updated:08/29/26

GitHub Stars

15.4K

Forks

1.6K

Contributors

203

License

Apache-2.0

Why we included this project

ms-swift is a fine-tuning and deployment framework from the ModelScope community that covers the full path from a raw checkpoint to a tuned, deployable model. It handles pre-training, instruction tuning, preference alignment, and GRPO-style reinforcement learning through a consistent command-line and web interface, so you do not have to stitch together separate training scripts. The breadth is what stands out: hundreds of text and multimodal architectures work out of the box, and lightweight methods like LoRA and QLoRA keep memory needs modest on a single GPU. It also covers inference acceleration through vLLM or SGLang, quantization, and evaluation, which makes it a practical choice for teams that want one tool to carry a model from training through deployment. It is especially convenient if you already work with ModelScope models, but it accepts models from other sources too.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category