<h1 id="balanced-clip-(1m)">Balanced CLIP (1M)</h1>Training CLIP-G took &gt;15KwH of energy, CLIP-L took far less &lt;1KwHThe full negative reinforcement (Cosine Dissimilarity) is available on my <a target="_blank" rel="ugc" href="https://huggingface.co/datasets/Felldude/22k_CLIP_Negitive">huggingface</a>, this was paired with a positive reinforcement (Contrastive Loss) using the full frozen vision model in latent space.PONY CLIP-L has a further 10 epochs using ASGD for very fine-tuned loss.

Balanced CLIP (Updated)

balancedCLIP1M_ponyCLIPL.safetensors

balancedCLIPUpdated_ponyCLIPL.safetensors

Files with SHA256: 7cccf9c6a3fa6f8a640597f116de4c2de2b9ddac8a7ba692cdba0fc0c86985d1