#199 · Primary category: Speech & Audio
lora-svc
singing voice change based on whisper, and lora for singing voice clone
Project last updated:11/03/23
GitHub Stars
645
Forks
80
Contributors
6
License
MIT
Why we included this project
Singing voice conversion is the trick here: you take a recording of someone singing and re-render it in a different voice without losing the melody or the words. lora-svc strings together Whisper for the linguistic content, a speaker encoder for timbre, and a neural source-filter BigVGAN vocoder for the final synthesis. For hobbyists and small teams, the practical part is that you can fine-tune a pretrained model on a small set of clips from the voice you want to clone, after the usual prep work of separating the accompaniment and slicing the audio into short segments. A GUI script covers the train-and-infer flow, and a pitch-shift argument lets you transpose the result. One honest caveat: LoRA-style adapter fine-tuning is referenced but not fully implemented here, so treat this as a working conversion toolkit rather than a finished adapter framework.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production