#88 · Primary category: Foundation Models
XrayGLM
The first Chinese Medical Multimodal Model that Chest Radiographs Summarization.
Project last updated:11/20/24
GitHub Stars
1.1K
Forks
144
Contributors
2
License
Other
Why we included this project
XrayGLM is one of the few openly available multimodal models tuned for chest X-ray reading in Chinese. It starts from VisualGLM-6B and fine-tunes it on X-ray images paired with diagnostic radiology reports, so given a chest radiograph it writes a natural-language summary of the findings rather than a class label. The repo is worth more than the weights alone: it also ships cleaned bilingual training data built from MIMIC-CXR and OpenI, along with scripts to reproduce the LoRA fine-tuning on your own data. That makes it a solid starting point for a radiology-assist prototype and a quick way to see how a 6B-scale medical vision-language model behaves before committing to something larger. One caveat: the CC BY-NC-SA license rules out commercial use, so review it before building on top of XrayGLM.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities