first time trying my hand at preference optimization RL... this one was trained at 25 samples (i tried to get more, it's painful to pick by hand). should have slightly improved , text and aesthetics. will implement proper DPO and make a new version later, for now this is the best i could do.
works with flash as well