<h1 id="balanced-clip-(1m)">Balanced CLIP (1M)</h1>Training CLIP-G took &gt;15KwH of energy, CLIP-L took far less &lt;1KwHThe full negative reinforcement (Cosine Dissimilarity) is available on my <a target="_blank" rel="ugc" href="https://huggingface.co/datasets/Felldude/22k_CLIP_Negitive">huggingface</a>, this was paired with a positive reinforcement (Contrastive Loss) using the full frozen vision model in latent space.PONY CLIP-L has a further 10 epochs using ASGD for very fine-tuned loss.

Balanced CLIP (Updated)

balancedCLIP1M_ponyCLIPL.safetensors

balancedCLIPUpdated_ponyCLIPL.safetensors

Files with SHA256: 1f01af6f36d55166b77ef1dd49c268e8162630ee165010dbe8204dd6ea9c246e