RDBT [Anima]
A general finetuned model, better overall quality, better prompt adherence, less artifacts and errors.
Dataset contains ~10k images, handpicked by professional amateur artists, captioned by latest LLM. Accurate body/hands anatomy. Complete background.
Some cover images look ridiculous; they're just for demonstration purposes for corner cases.
Update log and version info: link.
For advanced users: RDBT model is trained as LoRA natively. link.
Usage:
Settings:
Base version: has a suffix "base". Not distilled. CFG 4 and steps 24+ is recommended.
Distilled version: CFG: 1~1.5. Steps: 16+. FYI: CFG 1 = Disable CFG = run the model 2x faster. Cover images are without CFG for demonstration. "RenormCFG" node is highly recommended if CFG is enabled (CFG > 1), set "renorm_cfg" value to 1.1.
Sampler: Euler (best diversity), Euler a/er_sde etc. (better stability)
Res: 1MP
Prompt:
Always specify @style in prompt, or use a style LoRA. Otherwise, you will get random/mixed style.
Quality tags:
Omit ALL quality tags. The fine-tuning dataset has higher quality than "masterpiece". Thus quality tags don't have effects. Omitting those redundant tokens allows LLM to pay more attention on other words.
FAQ:
Why I won't bake a default style:
If a model has a "default" style (ignores prompt and is always active). We call it "overfitted". Technically, it's not a feature, it's a bug. This means the training dataset is not big enough, and the model has lost its ability to generate other styles.
The goal of RDBT model is to "perfectly" reproduce styles. As some of you know, I use this model to aid in drawing. I need unique textures and details, instead of uniformed 2.5D AI slop style.
This model has excellent compatibility. You can stack any type of Lora on it. After all, it's you who decide what style you want, not me.
RDBT can't remove nor resist overwhelming Al slop effects
Too long, see: link.
My homemade distillation vs Anima official turbo model:
Official turbo: 8 steps. High stability, low entropy. Adds a strong 2D anime filter that will overwrite style and cause style shifting.
My homemade distillation: 16 steps. High diversity, low stability. Minimal style shifting.
Sharing merges using this model is not allowed.
This mode is a free and it will always be free. This "restriction" won't affect anyone. It's only aimed at those who steal others' models to sell.
Known model thieves: NukeA.I (selling this model behind paywall on tensorart).
Because he is such a jerk I wrote a story about it. Also contains a guide for trainers about "how to bake special trigger word into your model".
Description
FAQ
Comments (13)
this poster claims to have made the nag work with anima using turbo and 1 cfg but with your model at least , it changes the output too much. Can you take a look at it , maybe we need specific settings for it to work with your model ? https://www.reddit.com/r/StableDiffusion/comments/1sto22j/i_implemented_nag_normalized_attention_guidance/?
I feel like the v27 model is losing its anime style
The further away from V0.24, the less anime it is and the more 3D and 2.5D pollution in data there is :(
Your the stability king for a reason. You have experience on all preview models so I trust yours the most. The official turbo Lora is decent But it isn't as detailed and doesn't follow the prompt exactly unlike yours. Also this is the official NAG that's finally got anima support However, my experience with it has been a little bit mixed:
https://github.com/BigStationW/ComfyUI-NAG-Extended/tree/main
The official Turbo LoRa has the superior style preservation. RDBT the superior compositions. And something went horribly wrong with the NAG implementation. Hope it gets fixed.
@deitychaser I noticed that with I noticed that with NAG. To be honest, I don't think it's really great on anima I think it's more designed for distilled models like Flux Klein 9b/4b and z Imege turbo not really the base model with a distilled LORA.
@AnimaXx Maybe, not sure. It works better on non-distilled Chroma as a negative conditioning guidance than CFG though, in my experience. Simply because you can go up the NAG guidance to 6.0 or something which you can't do with CFG without frying your image, thus in my tests with NAG i could get more control.
Hi boss, is there any possibility that lora version will be released again? Being able to control the strength of lora/distilled model at any time is really useful.
For example, I also use the lore for distillation and it seems to be better, because the built-in lore in the model, it seems to me, has less power overall.
Probably, the reason I decided to release a ckpt because I think mixing distilled models is not a good idea. Distilled lora is not style lora. Distilled lora changes how model works.
@reakaakasky there seems to be many people thinking that RDBT makes @artist less effective, and actually it seems that you don't cite the artists in your work, and that's how your distill different from the official version, what do you think about this issue?
@reakaakasky so putting a distilled lora in a non-distilled base model or vice-versa, either is a bad idea?
@m4rbleye mixing different distilled models, e.g. 0.5 rdbt + 0.5 turbo
@jimzlf if I have 100x compute, I might consider taking care all 20k+ @ tags, but I don't.