GGUF Quants of the new Stable Diffusion 3.5 Large model. Pardon my image samples, I'm on a mac so diffuse'ing sd3 takes a while, so I didn't do much tweaking or many steps, but I'm gonna update them to be all the same seed/size and workflow to compare at least. Thanks to city96 for all his hard work for the conversion utility work an getting things working with me on his github, all the thanks in the world to him for the incredible help. <a target="_blank" rel="ugc" href="https://stability.ai/news/introducing-stable-diffusion-3-5">Stable Diffusion 3.5 Large</a> is a Multimodal Diffusion Transformer (MMDiT) text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency.Please note: This model is released under the <a target="_blank" rel="ugc" href="https://stability.ai/community-license-agreement">Stability Community License</a>. Visit <a target="_blank" rel="ugc" href="https://stability.ai/license">Stability AI</a> to learn or <a target="_blank" rel="ugc" href="https://stability.ai/enterprise">contact us</a> for commercial licensing details.<h3 id="model-description-sgc7l17om">Model Description</h3><ul><li>Developed by: Stability AI</li><li>Model type: MMDiT text-to-image generative model</li><li>Model Description: This model generates images based on text prompts. It is a <a target="_blank" rel="ugc" href="https://arxiv.org/abs/2403.03206">Multimodal Diffusion Transformer</a> that use three fixed, pretrained text encoders, and with QK-normalization to improve training stability.</li></ul><h3 id="license-x4ic0w270">License</h3><ul><li>Community License: Free for research, non-commercial, and commercial use for organizations or individuals with less than $1M in total annual revenue. More details can be found in the <a target="_blank" rel="ugc" href="https://stability.ai/community-license-agreement">Community License Agreement</a>. Read more at <a target="_blank" rel="ugc" href="https://stability.ai/license">https://stability.ai/license</a>.</li><li>For individuals and organizations with annual revenue above $1M: please <a target="_blank" rel="ugc" href="https://stability.ai/enterprise">contact us</a> to get an Enterprise License.</li></ul><h3 id="implementation-details-andovpruh">Implementation Details</h3><ul><li>QK Normalization: Implements the QK normalization technique to improve training Stability.</li><li>Text Encoders：<ul><li>CLIPs: <a target="_blank" rel="ugc" href="https://github.com/mlfoundations/open_clip">OpenCLIP-ViT/G</a>, <a target="_blank" rel="ugc" href="https://github.com/openai/CLIP/tree/main">CLIP-ViT/L</a>, context length 77 tokens</li><li>T5: <a target="_blank" rel="ugc" href="https://huggingface.co/google/t5-v1_1-xxl">T5-xxl</a>, context length 77/256 tokens at different stages of training</li></ul></li><li>Training Data and Strategy:This model was trained on a wide variety of data, including synthetic data and filtered publicly available data.</li></ul>For more technical details of the original MMDiT architecture, please refer to the <a target="_blank" rel="ugc" href="https://stability.ai/news/stable-diffusion-3-research-paper">Research paper</a>.

Stable Diffusion 3.5 Large (GGUF)

stableDiffusion35Large_fp16Gguf.gguf

FP16 (gguf)

Q4_0

Q4_1

Q5_0

Q5_1

Q8_0

Source: <a target="_blank" rel="ugc" href="https://huggingface.co/city96/stable-diffusion-3.5-large-gguf">https://huggingface.co/city96/stable-diffusion-3.5-large-gguf</a> from <a target="_blank" rel="ugc" href="https://huggingface.co/city96">city96</a> This is a direct GGUF conversion of <a target="_blank" rel="ugc" href="https://huggingface.co/stabilityai/stable-diffusion-3.5-large/tree/main">stabilityai/stable-diffusion-3.5-large</a> As this is a quantized model not a finetune, all the same restrictions/original license terms still apply. The model files can be used with the <a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">ComfyUI-GGUF</a> custom node. Place model files in <code>ComfyUI/models/unet</code> - see the GitHub readme for further install instructions. Please refer to <a target="_blank" rel="ugc" href="https://github.com/ggerganov/llama.cpp/blob/master/examples/perplexity/README.md#llama-3-8b-scoreboard">this chart</a> for a basic overview of quantization types. ☕ Buy me a coffee: <a target="_blank" rel="ugc" href="https://ko-fi.com/ralfingerai">https://ko-fi.com/ralfingerai</a> 🍺 Join my discord: <a target="_blank" rel="ugc" href="https://discord.com/invite/pAz4Bt3rqb">https://discord.com/invite/pAz4Bt3rqb</a>

SD 3.5 Large GGUF Q4/Q4.1 Q5/Q5.1 Q8 F16

sd35LargeGGUFQ4Q41Q5Q5_f16.gguf

Q5.1

Q4.1

Files with SHA256: 5f9b889b934a2ebe3f4aa3cab4aee24903e419aba3f331ddd9eb5aea2d95f154