I trained the singing voice clone AI on voice clips of the Sentry Bot from Fallout 4. I used the default training settings meaning 10000 epochs- though with the simplicity of the Sentry Bot's voice that was probably overkill...
Anyway, It works pretty well and the AI holds on to the "audio detail" of the Sentry Bot's voice, and where it messes up it still sounds believable (since the Sentry Bot's voice is already "noisy" and "imprecise" in a way). However, if you want those pitch changes found in the Sentry Bot's voice it needs to be included in the input audio. More on output quality, slow clear speaking is recommended for the input audio, since that's how the Sentry Bot speaks as its voice is hard to understand otherwise.
As per comment recommendations here is a link to a good repo that can run this model: https://github.com/voicepaw/so-vits-svc-fork
You can either install from source or use the pip commands that the README specifies
It has a GUI where you can specify the Weights, its associate config file, and the input audio you want to transform
If you can run Stable Diffusion then this AI should run fine under 5 minutes of input audio, where you need more vram for longer audios (though you can just cut up longer clips)
Here is the source:
Image source: https://www.nexusmods.com/fallout4/mods/56150
Description
FAQ
Comments (12)
It is allowed and you are awesome for uploading it, we need more AI voices. For people that aren't aware on how it's used or what it is, it would be a good idea to include a link to the repo at the bottom.
what software do you use
@PlushBanshee It's so-vits-svc-fork.
That's good, I edited the description to include the repository that can easily use this model (https://github.com/voicepaw/so-vits-svc-fork)
@Razgrits @Xyzonox thank you
Well, I wish there was a Sentry Bot LoRA...
Hello! And thanks for bringing something new (not image based) here but... I don't get it.... What is this about? I'm a dark ambient composer and I'm interested about voices... Is it based on TTS (text-to-speech)? Sorry for being such a newbie... :)
No its my bad for not describing it, I edited the description to include information:
"As per comment recommendations here is a link to a good repo that can run this model: https://github.com/voicepaw/so-vits-svc-fork
You can either install from source or use the pip commands that the README specifies
It has a GUI where you can specify the Weights, its associate config file, and the input audio you want to transform
If you can run Stable Diffusion then this AI should run fine under 5 minutes of input audio, where you need more vram for longer audios (though you can just cut up longer clips)"
From what I understand This model is for an AI that transforms audio, instead of text to speech its more like speech to speech, and it's designed to be really good at preserving inflection, pitch, accents, and other vocal nuisances that make work even with singing. If this technology becomes mainstream then the music and dubbing industry is going to be transformed, but I don't know I just grabbed audio clips and put it in an AI.
@Xyzonox Thank you so much for your explanations! I get it now ;)
now this is cool but i don't know what program to use with this is there an open source software on github for this or what please help
https://github.com/voicepaw/so-vits-svc-fork
Set this model at "Model path" and "Config path", then set your "Input audio path" to what you want to be converted, and then click the "Infer" button
@wier thank you
Details
Files
sentryBotVoiceSoVits_v10.zip
Mirrors
entpnoonnaaa_Soft.safetensors
Jungt BUS - Weights Model.zip
Betty%20-%20Regina%20Ruiz%20%5BHey%20Duggee%20%2F%20Latino%5D%20-%20Weights%20Model.zip
Pr%C3%ADncipe%20Zuko-Prince-Pablo%20Andr%C3%A9s%20Ausensi%20Mart%C3%ADnez-Avatar%3A%20La%20leyenda%20de%20Aang-%20The%20Last%20Airbender%20(Latin%20Americ-American%20Spanish%20Dub-Espa%C3%B1ol%20latino)%20-%20Weights%20Model.zip
pornmasterProFP32V4_fp32V4.safetensors
28DSTABLEBESTVERSION_28dv5.safetensors
10_v1010.safetensors
sortLycorisFromLORA_v30.zip
yinmixreal_v10.safetensors
yuzufinetune_v12.safetensors
mixtapeSalsa_v10FusOBakedVAE.safetensors
Tr1st1n_M4ys.pt
mixRealistic_v10.safetensors
avatarStyle_v15.ckpt
sentryBotVoiceSoVits_v10.zip
entpnoonnaaa_Soft.safetensors
elegantrpganimemagic_v10.safetensors
kawaiiRealisticAsian_v04.safetensors
analogporn_v20.ckpt
foolkatGODOF_v1.safetensors
superHeroComicStyle_v10.ckpt
envyanimexl_v09.safetensors
entpnoonnaaa_Hard.safetensors
SLD.safetensors
mobaGameEquipment_v10.safetensors
paint_V17.safetensors
pornmasterProFULLV4_fullV4.safetensors
rosedrawnmix_v11.safetensors
sweetMix_v21.safetensors
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.
