This is a GGUF quantized version of <a target="_blank" rel="ugc" href="https://huggingface.co/black-forest-labs/FLUX.2-klein-4B">FLUX.2-klein-4B</a>. unsloth/FLUX.2-klein-4B-GGUF uses <a target="_blank" rel="ugc" href="https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs">Unsloth Dynamic 2.0</a> methodology for SOTA performance.<ul><li>Important layers are upcasted to higher precision.</li><li>Uses tooling from <a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">ComfyUI-GGUF</a> by city96.</li></ul>

Unsloth - FLUX.2-Klein-4B-GGUF (Distilled)

unslothFLUX2Klein4BGGUF_q3KM.gguf

Q3_K_M

FP16

BF16

Q8_0

Q6_K

Q5_K_S

Q5_K_M

Q5_1

Q5_0

Q4_K_M

Q4_1

Q4_0

Q4_K_S

Q3_K_S

Q2_K

Files with SHA256: 0f27104f7b5842b7bfd5909645c60208cbb6b8d43f5d65f58b085f45ed18c9e1