#26 · Primary category: Deep Learning Frameworks
ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Project last updated:08/29/26
GitHub Stars
15.4K
Forks
1.6K
Contributors
203
License
Apache-2.0
Why we included this project
ms-swift is a fine-tuning and deployment framework from the ModelScope community that covers the full path from a raw checkpoint to a tuned, deployable model. It handles pre-training, instruction tuning, preference alignment, and GRPO-style reinforcement learning through a consistent command-line and web interface, so you do not have to stitch together separate training scripts. The breadth is what stands out: hundreds of text and multimodal architectures work out of the box, and lightweight methods like LoRA and QLoRA keep memory needs modest on a single GPU. It also covers inference acceleration through vLLM or SGLang, quantization, and evaluation, which makes it a practical choice for teams that want one tool to carry a model from training through deployment. It is especially convenient if you already work with ModelScope models, but it accepts models from other sources too.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
tensorflow
An Open Source Machine Learning Framework for Everyone
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
keras
Deep Learning for humans
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.