AnyLoRA
Add a ❤️ to receive future updates.
Do you like what I do? Consider supporting me on Patreon 🅿️ or feel free to buy me a coffee ☕
For LCM read the version description.
Available on the following websites with GPU acceleration:
Remember to use the pruned version when training (less vram needed).
Also this is mostly for training on anime, drawings and cartoon.
I made this model to ensure my future LoRA training is compatible with newer models, plus to get a model with a style neutral enough to get accurate styles with any style LoRA. Training on this model is much more effective compared to NAI, so at the end you might want to adjust the weight or offset (I suspect that's because NAI is now much diluted in newer models). I usually find good results at 0.65 weigth that I later offset to 1 (very easy to do with ComfyUI).
This is good for inference (again, especially with styles) even if I made it mainly for training. It ended up being super good for generating pics and it's now my go-to anime model. It also eats very little vram.
Get the pruned versions for training, as they consume less VRAM.
Make sure you use CLIP skip 2 and booru style tags when training.
Remember to use a good vae when generating, or images wil look desaturated. Or just use the baked vae versions.
Description
Inpainting version, NOT for training or inference, just inpainting and outpainting.
Can be used to more easily edit anime and manga images.
FAQ
Comments (38)
Can you upload at .safetensors?
There isn't any excuse anymore for .ckpt only uploads.
You can download it here.
use model converter extension in sd webui
only the no-vae is ckpt. All the others are safetensors. I'll upload the safetensors novae too.
done
Great!Thank you for your work!It performs well on various styles of Lora!
Hello, @Lykon. You're one of my absolute favorite authors/creators. I know you consider it one of your older kids now, but I'm still so in love with DreamShaper, it has literally NEVER failed me, like EVER! I'd love to give you an honest review over on its page as soon as I get the time. But as I've told another very kind creator, I'm still really new to the AI Community. My family, friends & classmates know NOTHING about the AI World, so I started TOTALLY blind, just a couple of weeks ago (though effectively just days ago,coz ya know,IRL). I learn very fast, but I'm still figuring out all the OBSCURE nuances of SD, A1111, prompts, CN, extensions, upscalers, etc. (this field came out of... left field,so hard & so fast,even Google/Bing/YouTube can't provide me with enough info about it). So it's a modern-day Miracle then, that 90% of the Community (especially the open-source part of it), just happens to be so kind and generous and welcoming. Thank you for your service, sensei. Rest assured that you have the appreciation and gratitude of at least one person.
Anyway, if you don't mind--and if you have the time, I'd like to ask a newbie query? I've been rotating through a lot of popular checkpoint models these past days just to get a feel for each before I settle on the main team, and most of 'em are awesome; heck, even URPM is shockingly good at non-porn things. And as I've said, DreamShaper has always done right by me, so it's earned a permanent seat at the table, as the NPR Hime-sama. (If you'd one day give it PR powers, I have no doubt it'd be the undisputed SD Oujo-sama. And I'd be among the first to bend the knee, hah.) In any case, I wanna put a "purely 2D" anime model upon a 2nd permanent seat, and needless to say, your children are on the short list. I have nothing but respect for NED, but for traditional, flat, cel-shaded anime, I think it's between Anime Pastel Dream (both flavors) & AnyLoRA, isn't it? And I can't decide which is better for my purposes. So after that long-ass context setup (& I apologize for it), my question is this: If I were to do a "For Dummies" summary (in anime/manga style), would it be fair to say that AnyLoRA is the more-accommodating tareme imouto who plays well with other models (as the name implies), but cannot stand (well) on her own? And Anime Pastel Dream is the fiercely-independent tsurime onee-chan who's a beautiful genius, but is a total tsundere b*tch to work with? Or, can AnyLoRA be just as creatively independent as APD, and APD be just as cooperative as AnyLoRA (especially with novel-length prompts,like DreamShaper can,lol)? As their creator, may I ask for your personal insights or advice? (And yes, I HAVE read your tips for them, at least twice.)
Thanks in advance, stay awesome and cheers! 🤩
Hello and welcome. For anime "cel shading" style you can either try AnyLoRA using prompts such as "anime coloring", or even better you can try using AnyLoRA + any of the countless anime style LoRA I made. You can also find a video on how to use them in my lora descriptions.
@Lykon First of all, thanks for the VERY quick response, heh. Anyway, I see. So it CAN do flat cel-shading stuff with or without LoRAs (but works better with 'em). Okay, got it. It's not that I'm trying to avoid using LoRAs; it's more like I wanna see how far a model can "obey" my commands BEFORE needing the help of a LoRA or even a TI, CN, etc. And like I said, your DreamShaper has SPOILED me rotten. It's never NOT done what I wanted to happen, period. (Yes, even without additional networks. Though I DID have to write a book-length prompt, I'm okay with that). At least in the NPR department (or to be more specific,Semi or 2.5D). Which is why I'm trying to find candidates to wear the PR and anime/western animation crowns, respectively. 'Cause I know you didn't design DreamShaper for that role or purpose.
And don't worry, I HAVE read and watched everything you suggested; I'm super-OCD that way, hah. Thanks again, sensei. Have a great day and cheers.
@CaL9Mi7Y if I understand what you mean by "semi 2d" you might try using NED as it's an in-between anime-real life model https://civitai.com/images/114070?modelVersionId=11925&prioritizedUserIds=53515&period=AllTime&sort=Most+Reactions&limit=20
But loras are always gonna be better
@Lykon My bad, my bad, my apologies, sensei. I abbreviated my sentences too much because I didn't wanna bother you with another long-ass post! Hahah. What I meant was: DreamShaper does everything I want it to. But since you didn't design it for PR (Photorealistic) and "pure 2D" (like cel-shaded anime/western animation), I can only use it for my NPR (Nonphotorealistic) needs. But since NPR technically includes "2D" also, I wanted to be more specific for you. So I clarified, that by "NPR", I was actually referring to its Semi-realistic (SR) or 2.5D "subcategory". But yeah, my shortcuts made it more confusing in the end, hah. In short, I use DreamShaper for NPR/SR/2.5D, plus sometimes NED too, since I followed your description/suggestion on NED's page.
But anyway, I hope I cleared it all up, heheh. 😅 And thanks for the additional advice. Yes, I saw your new Lam style LoRA. Not only is it CRAZY, but since it's cel-shaded as well, it's like you read my mind (because presumably,you started on it way before we even talked)! Wait, are you DreamShaper pretending to be your creator? Heh, again, stay awesome and cheers, @Lykon-sensei. 😜
@CaL9Mi7Y sounds good. Anyway, dreamshaper5 is pretty good at photorealism.
@Lykon Really?? It's my most-used model BY FAR--nothing else even comes close, and as mentioned, it always gives me what I want. But the one thing I've never been able to make it do is to go beyond "almost Photorealistic", aka, uncanny valley. (Except for its backgrounds & lighting; they've always been right up there w/ Realistic Vision, URPM, aEros/Liberty, Analog Madness, etc.) And since other SD veterans I've talked to have always described DS as an "artistic model", aka, NPR/Semi-realistic model, I was never surprised. But now that I think about it, I don't think you ever actually described it as an NPR/SR model. Hmm... Apparently, that means I haven't pushed it far enough, and I thought I had, hah. Alright, I'll give it a last PR push later or tomorrow. Though TBH, I don't know what else to try (and I don't wanna veer too off-topic from AnyLoRA). Like I said, it's done everything I commanded, except that LAST millimeter through the PR "veil". Hmm... 😒
@CaL9Mi7Y look at the examples, there are some realistic ones.
@Lykon Yes, I have seen 'em all (multiple times actually,told ya I'm a big fan so I'm always dropping by its page to see what's new,lol). Please don't take this the wrong way Lykon-sensei, as I really LOVE DreamShaper, but except for the monochrome guy image, I don't see the others (even the ones by the Community) as full-on photorealism. Uncanny Valley-level (which essentially means 97% PR), DEFINITELY yes, but not enough to "pierce the Veil" at 100%, at least for me. Maybe it's just a matter of personal perception? (Like the YouTuber Bycloud, if you know him.) I mean heck, even Deliberate, which I really like as well, and is considered by many as PR, I can still "see" its uncanny-ness. So I really don't know sensei, maybe it's just in our eyes or something? Hahah. But as a sidenote, I DO perceive models like Realistic Vision as PR, but jeez, it FIGHTS me every single (sampling) step of the way, hah. It's almost like the opposite of DreamShaper. Surprisingly (or maybe NOT surprisingly), URPM & the other hornier PR models are actually very "obedient" even for wholesome stuff. So I may actually end up choosing a couple of them as my PR mains, hah. We'll see.
But anyway, with that said, I'm glad we talked about that b&w image (it's always been at the back of my mind after I first saw it weeks ago). What makes it "real" to my senses, and NOT the rest? Is it SIMPLY the lack of colors, the grain, the lofi, old-timey analog camera effect that's fooling my eyes? (Because I've seen those things before, and I could still catch the uncanny-ness.) And even if that's true, then how come the other PR models I mentioned didn't need to use those same tricks (they're still fully colored,for example). In any case, I'm gonna study that image one of these days sensei, and try to re-create its PR effect, but on different images. Maybe I can unlock its (& DreamShaper's) PR secret, at least for MY own perception, heh. Thanks again for the tips, cheers! 😁
@CaL9Mi7Y good lighting is mostly what makes a picture "realistic". That and details. https://civitai.com/images/481912?period=AllTime&periodMode=published&sort=Newest&view=categories&modelVersionId=43888&modelId=4384&postId=141650
This was before the detail adder lora.
@Lykon Yes, I agree, sensei. Even as a really young naïve kid messing around with my big sis' Maya suite, I've always believed it's all about lighting, and THEN the other stuff, like precision/accuracy (thru high polycount,the new Nanite,etc), resolution, textures, et al. I mean, no amount of good lighting is gonna cure a pixel art character of its NPR-ness (remember that ray-traced Doom/Quake they released a couple of years back? lawl). Which is why my prompts ALWAYS start with those things (regardless of the "rules",hah). So thanks for confirming my strategy. Coming from a veteran creator, that means a lot. Though obviously, I still need to learn more, and fast. 😤
@Lykon Oh by the way, regarding that image you linked to me, I never responded coz I was really busy that time. Yes, it's really beautiful, from the lights hitting the strands of the hair, to the very subtle eye bags, to the slightly-dry lips, to the lines/creases on the neck, I can see AND appreciate them all. In fact, I recognize not just that same "character", but also its accompanying prompt (except the model used ofc). It's from that popular example (it's a series of examples actually) from the Level4 model, but on extreme close-up. (Yes,I've been reading & memorizing a ton of prompts/parameters,hahah.) If it was an actual lady, I'd probably have a mild girl-crush on her, lol. However, with all that said, again-please-don't-take-this-the-wrong-way-sensei, but yes... it's still Uncanny Valley to me. In fact--beyond that, I REALLY like Level4 (it's on my backup list even) and I also really like its author @AreThoseLevel4Plates--I follow him/her too, but yeah, I consider that model NPR or more specifically, SR (Semi-realistic). Its "sister" model HOWEVER (Edge of Realism), is a different story. I DO "see" it as full-fledged Photorealistic, or at least 98-99% PR, so good enough. I even read the author acknowledging that very SLIGHT difference. As I've said before (& briefly alluded to by the YouTuber), Uncanny Valley is essentially 95-97% Photorealistic, so it IS right up there. But, some of us CAN see that 3-5% difference. I think it's just a biological sensitivity thing? It's the same thing with our other senses, like with the ears, nose, etc, right? Some people can SMELL the difference between 10 different glasses of wine, etc., while most people drink entire cases of Bud Light without caring about the taste, heheh. 😁 Anyway, have a great day Lykon-san, cheers!
I am a complete newbie using LoRa, I really got used to use HyperNetwork, I have been trying to train using Lora for two weeks now, but I can't get considerable results, but this Checkpoint slightly improved what I tried to "train". can anyone help me what settings I should have in LoRa to train anime characters? I would appreciate it very much.
Hey Lykon, nice model, have you thought about making a similar base model for LoCons ? I hear they can produce better results than LoRa's in general, AnyLoCon so to speak and it could be great to have a alternative option. :)
locon is still lora :D
plus the naming is just to indicate that this model is flexible and good for training and inference
@Lykon Thanks for the explanation! I've been using it for my LoCons and they work amazingly well! I saw in your description you mention perhaps offsetting the LoRA? Could you explain how to? Lowering the weight to around 0.6 also works as you said but I'm curious how to go about offsetting. Is it just by lowering the initial learning rate? Thanks!
@Baxter after you train the lora, hit it with kohya merger at a ratio equal to the square root of your preferred weight
How can i make any version pruned?
Just get model converter plugin in a1111. If you just want this checkpoint pruned, go to noVae fp16 and download the smaller file - 2GB one
@Ywinel what does the pruned version stand for?
@GSwan It's just cropped version of a model to massively reduce its size, it helps with training. Pruning removes weights in model that have almost non-existent impact on image generation. Generated images may be a tiny little bit different so if you are not planning to train it yourself then get not-prunned one.
@Ywinel yeah ema layers are only needed if you do large scale finetuning.
fucking amazing
I'm new into making LoRAs, but is there any tips/settings that you use to train the style LoRAs? I tried make my own style LoRA using this checkpoint and when i tried to make an image on Stable Diffusion it had a bad quality (like blurry/pixelated), when my dataset is not blurry/pixelated. Is there any solution to fix this problem?
Linaqruf notebok has basically all the good settings to use with this model, which is also the default one.
Your mistake is either in the dataset or in generation. Try adjusting the weight and the negative prompt. Linaqruf 's notebook has also a setup for testing (the typical blonde girl with the hat you see on many of my models)
Could you please upload the pruned model as a safetensor file?
done :)
+rep solid checkpoint might use this as my main one now
Can you make a model of Lora, a model, start? I want a model of Cocotama Kanna. She is not human, but I love her very much. Please, I am sorry for the request, but I do not know that
you can definitely make a lora of Cocotama Kanna or any non human character if you have enough data. I made a Pokémon LoRA.
@Lykon Well, you could not create a Lora model for this character if you wanted to I was very hoping that there would be a model for Lora for the entire anime kamisama minarai himitsu no cocotama. I love this anime so much. I wish you would make a model for this anime.
@elperfct580939 I'll think about it :)
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.


