first time trying my hand at preference optimization RL... this one was trained at 25 samples (i tried to get more, it's painful to pick by hand). should have slightly improved anatomy, text and aesthetics. will implement proper DPO and make a new version later, for now this is the best i could do. works with flash as wellupdate: turns out the quality of this lora is limited by the dataset, as of now. Better loss didn't produce better results. So, unfortunately i have to do a bunch more work.

Files with SHA256: 0fbd22d370d1af2e71a7120cdf3308641716dffaa3d90669132f26b3adb099fa