#77 · Primary category: Speech & Audio
lhotse
Tools for handling multimodal data in machine learning projects.
Project last updated:08/26/26
GitHub Stars
1.1K
Forks
277
Contributors
109
License
Apache-2.0
Why we included this project
Speech researchers often burn more time moving data into a trainable format than they do training. Lhotse handles that layer for you: it turns audio and transcripts into plain-text manifest files, and lets you slice, pad, and augment recordings as flexible units before feeding them to PyTorch dataloaders. It ships ready-made recipes for many common corpora, and its focus has expanded beyond speech to video, image, and text, so a single pipeline can serve multimodal projects. If you are building on the modern Kaldi ecosystem, it works alongside k2 and icefall, but it also integrates with ESPnet and other frameworks.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production