#69 · Primary category: Deep Learning Frameworks

mmf

captioning deep-learning dialog hateful-memes multi-tasking multimodal pretrained-models pytorch textvqa vqa

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Project last updated:07/07/26

GitHub Stars

5.6K

Forks

938

Contributors

131

License

Other

Why we included this project

Researchers getting into vision and language models often lose days to setup before they can test an idea. MMF from Facebook AI Research is built to cut that overhead. It ships reusable building blocks for tasks like visual question answering, image captioning, and hateful meme detection, along with reference implementations of leading models you can fine-tune rather than train from scratch. Data loaders for familiar benchmarks such as VQA, TextVQA, and TextCaps come ready to use, and distributed training is handled for you, so the effort goes into model design instead of infrastructure. It has also served as the starter codebase for several VQA-style challenges. Research teams starting a multimodal project, and challenge participants, will save real time building on it.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category