<h3 id="rebels-w4a8-collection">Rebels w4a8 Collection</h3><h3 id="(check-back-frequently-as-i-will-update-whenever-i-quant-a-new-model)">(Check back frequently as i will update whenever i quant a new model)</h3> - CURRENT LIST:<ul><li>Krea-2-Turbo</li><li>Z-Image-Turbo</li><li>Flux Klein 9B</li><li>Flux Klein 4B</li><li>Wan Animate 2 (Distilled)</li><li>Qwen Image 2512</li><li>Scail-2 (Needs Work, Not Perfect)</li><li>LTX-2.5 Distilled (2 versions, 1 with better audio at higher compute)</li><li>MiniMax-Music-3 Four-bit weights. Eight-bit math. Native ComfyUI kernels. No custom nodes.</li></ul>W4A8 conversions of current diffusion and video models, quantized to run on ComfyUI's native <code>asym_w4a8_int8</code> path — where int8 tensor cores do the work instead of a dequantize-then-fp16 fallback.Roughly 0.56 bytes per parameter, and it runs at that size rather than merely storing at it.<hr /><h2 id="why-w4a8-instead-of-gguf">Why W4A8 instead of GGUF</h2>GGUF is excellent and I ship plenty of it. But every GGUF forward pass unpacks weights back to fp16 before the matmul — the file is small, the math is not. W4A8 keeps compute in int8 end to end.GGUF Q4_K_MW4A8Storage~0.60 B/elem~0.56 B/elemCompute pathdequant → fp16 GEMMint8 GEMMLoaderComfyUI-GGUF nodestock Load Diffusion ModelWeight error (measured)varies by tensor~7% relL2The format comes from Kijai's <code>AsymW4A8Int8Layout</code> work in comfy-kitchen. This collection is about applying it correctly to models nobody has converted yet, and being explicit about what was verified.<hr /><h2 id="what's-inside-a-file">What's inside a file</h2>Each quantized Linear stores five pieces:TensorPurpose<code>weight</code>int4 codes, two per byte<code>weight_s_rel</code>fp8 scale, one per group of 16<code>weight_s_channel</code>one scale per output channel<code>weight_codebook</code>16 Lloyd-Max levels, fit to the tensor<code>comfy_quant</code>layout config the loader readsThree ideas stacked: a ConvRot Hadamard rotation that flattens outliers so four bits go further, a codebook of non-uniform levels fit to the actual weight distribution instead of an even grid, and per-group fp8 scales preserving local dynamic range. Calibration-free — no activation dataset, so nothing in the conversion biases the model toward one kind of prompt.<hr /><h2 id="what-i-do-differently">What I do differently</h2>Sensitive layers are never quantized. Timestep embeddings, conditioning projections, patch projections, final output layers and rotary tables stay high precision. On a few-step model the timestep embedder has only a handful of sigma values to distinguish — crushing it to four bits corrupts every step of the schedule. Every file is checked after conversion to confirm those layers really are stored at F16/F32, because quantizers do not preserve them automatically.Mixed formats where the kernel demands it. The fused W4A8 kernel accepts a ConvRot group of exactly 256, so any layer whose input dimension isn't divisible by 256 cannot use it. Rather than silently shipping a file that errors on load, those layers are written as <code>int8_tensorwise</code> — also native, no group constraint, ~1% error. Each model card states which layers took that path.Every file is measured. Conversion reports per-layer reconstruction error against the original bf16 weights. Anything that doesn't land where it should doesn't get uploaded.<hr /><h2 id="requirements">Requirements</h2><ul><li>ComfyUI 0.30.0+ with <code>asym_w4a8_int8</code> in its native quant registry</li><li>comfy-kitchen installed (ships the kernels)</li><li>An NVIDIA GPU or AMD GPU.</li></ul>On startup ComfyUI prints its available formats. You want <code>asym_w4a8_int8</code> in the Native ops list — under emulated it still runs, without the int8 speed advantage.<hr /><h2 id="usage">Usage</h2><ol><li>Drop the <code>.safetensors</code> in <code>ComfyUI/models/diffusion_models</code></li><li>Load it with Load Diffusion Model — the stock node, no custom loader</li><li>Text encoder, VAE and sampler settings are unchanged from the base model</li></ol>Per-model notes (step counts, CFG, resolution) live in each model's card. Distilled models have fixed schedules that must be respected — base-model settings on them produce poor results regardless of quantization.<hr /><h2 id="models">Models</h2>Collection in progress. Each conversion has its own repo with exact sizes, measured error, and the list of layers kept at high precision.<hr /><h2 id="licensing">Licensing</h2>These are quantized derivatives. Every original license and usage restriction carries over unchanged, and each model repo states the license of its base model. Check the specific model's card before commercial use — several bases in this collection are not permissive.<hr /><h2 id="credits">Credits</h2><ul><li>Kijai — the W4A8 int8-codebook layout and kernels</li><li>Comfy-Org / comfyanonymous — comfy-kitchen and the native quantization registry</li><li>city96 — ComfyUI-GGUF, which taught most of us how quantized loading works in ComfyUI</li><li>Original model authors — all base licenses apply</li></ul>Quantized by <a target="_blank" rel="ugc" href="https://huggingface.co/realrebelai">RealRebelAI</a> · <a target="_blank" rel="ugc" href="https://github.com/RealRebelAI">GitHub</a> · <a target="_blank" rel="ugc" href="https://x.com/realrebelai">X</a>

Files with SHA256: 468bf97902559bfab6566b71fe10601a6098b221b27a9cd1aaaef49c14cef056