your loras are good but I think you should jump to using loras xl with DPO implemented.

here is a list of all the models that I have seen and tested that have DPO

1-AutismMix SDXL

https://civitai.com/models/288584?modelVersionId=324619 (all three of their model mixes have DPO)

2-Confetti Comrade Mix

https://civitai.com/models/280344/confetti-comrade-mix(here I had left some comments giving ideas to move the community forward, anyway I will leave my ideas in this post in case someone reads it and wants to know more about it)

3-Js2Prony

https://civitai.com/models/280321/js2prony

4-Comradeship XL

https://civitai.com/models/246299/comradeship-xl(my favorite so far)

5-[0.8(ponyDiffusionV6XL_v6) + 0.2(reproginexl_v10)] > NAI 3 !

https://civitai.com/models/263797/08ponydiffusionv6xlv6-02reproginexlv10-greater-nai-3

6-Hassaku XL

https://civitai.com/models/140272/hassaku-xl-sfwandnsfw-beta(this model understands prompts well but is not good at replicating characters without loras,the other models in the list including the Pony Diffusion V6 XL can replicate characters perfectly,even better than Loras already made in the civitai community)

the list I just left have good implementation of (DPO) the idea of this post is that the creators already famous in civitai begin to implement this technology,98% of civitai models are mediocre but with this technology the existing models can make magic,genitals,legs,hands,expressions,poses, concepts etc make more sense with these models already named(Pony Diffusion V6 XL was the first to implement the technology to a XL model) but the ones already named here are of very good quality also it would be great to continue seeing models with many different styles and more polished in the future) researching I discovered that if you mix a model that already has(DPO) with another model already existing civitai gives results like these. ..the technology works very well with XL but as far as I can see very bad with 1.5(for the moment) I think the future this year is XL I think the other model and lora creators should all work for XL,it feels good when you put indications and you get almost everything as you want,that with 1.5 is impossible,I am using XL,without controlnet and without Lora I have had incredible results,the mixes with the DPO models I think it is better to do them in Comfyui,I hope this post can help you,there are many people who still don't know about the technology

I took the time to test about 50 XL models and all were exactly the same as the 1.5,bad anatomy etc,in search of DPO models I did my tests by replicating famous characters,an effective way to test is using as a prompt:

cammy,chun li,jinx,league of legends,etc,if characters like that replicate perfectly the model has DPO,if the replica of the character doesn't come out then it doesn't,the models in this list can replicate the characters already named and many many more,(just do your list of character tests)....

PS:there are models in civitai that claim to have DPO and don't have them or are very bad,all of them were tested by me so I save you time

here you can read the post of this page to know a little more about DPO

https://civitai.com/models/242825/dpo-direct-preference-optimization-lora-for-xl-and-15-openrail

currently there are many underestimated models, little by little they are creating models with DPO,

2.5D_Prony

https://civitai.com/models/298707/25dprony?modelVersionId=335499

2.6D_Prony

https://civitai.com/models/298908/26dprony?modelVersionId=335720

2.7D_Prony

https://civitai.com/models/298717/27dprony?modelVersionId=335508

also this other one that is very recent that I have to try out

https://civitai.com/models/299991/astro-lance-xl?modelVersionId=336926

many people still don't know that DPO exists,but I'm sure it will be a standard in a few months,there are incredibly good models with DPO with very few downloads,people are still downloading the most popular XL models without DPO,I had more than 400 1.5 models and I have deleted almost all of them and I am only downloading the XL models that have DPO

about those cat ears: checkpoints get confused about "usagi". mentioned that on my article "japanese words as prompts".

most of the time, they mix up "usagi tsukino", rabbit- or animal ears in general or simply hairbuns. i only got those results when testing "usagi" as a prompt on any checkpoint.