Note: I am not the original creator or owner of this model. Credit goes to Seth Forsgren and Hayk Martiros https://www.riffusion.com/about
I put together a quick Riffusion tutorial explaining how to get started, with some samples, etc - The Ally's Riffusion Tutorial
This is a novel txt2audio model - and it's wild. Select the model, give it a prompt: "Chill Beats", for example, and it'll output Spectrogram images.
These images can be used in Automatic 1111's SD WebUI, in conjunction with the WebUI Riffusion extension (https://github.com/enlyth/sd-webui-riffusion) to generate music inside the interface.
"Clips" (Spectrogram images) can be chained together using the Seed Travel script, and merged into a single audio file from the extension Riffusion tab.
Here's an awesome example of what's possible - https://youtu.be/Je1CD-gZI6o
Checkpoint has been pickle scanned, is legit, but Safetensors version also available, just in case!
Please consider joining my Patreon! Advanced SD tutorials, settings explanations, adult-art, from a female content creator (me!) patreon.com/theally - Riffusion tutorial to go live soon!
Description
FAQ
Comments (12)
How did you make checkpoint file weight 10 gb less than the checkpoint file on riffusion huggingface?
That checkpoint isn't pruned. It contains training data not required for inference (running prompts). Mine doesn't have all that extra data.
Thanks!
Can you say how to make pruned checkpoints please?
@somefan check out https://github.com/Akegarasu/sd-webui-model-converter as a extension for A1111 webui
@twilightBOO Already found it, but thanks!
这啥啊这是？？？
强，文本生成音乐！不过我还没用，不知道效果怎么样，但感觉这ai真是越来越强了
Hello, where should I put the model inside web1111? Is there a tutorial on how to use it?
it's a checkpoint, so just put it in your checkpoints folder.
ya la pude hacer funcionar : )
Eres grande entre los grandes
when I run the Riffusion script, I get an error that there is an unexpected variable in the python code. Any ideas on how to resolve that?
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.