<h3 id="versions">Versions</h3><ul><li>int8: recommended. Fast, accurate, compatible with almost any GPU.</li><li>mxfp8: added for comparison. In theory (and according to nVidia PR) should be more accurate than int8, but in practice I was not able to spot any definitive advantages. A bit slower than int8, but still faster than original bf16. Compatible only with RTX 50xx series (Blackwell).</li></ul><h3 id="performance-on-my-setup">Performance on my setup</h3><ul><li>original bf16 (baseline): 2.20 it/s +0%</li><li>int8: 3.23 it/s +46%</li><li>int8 + torch compile (comfy core): 3.59 it/s +63%</li><li>int8 + turbo lora, cfg=1: 6.50 it/s +295%</li><li>int8 + turbo lora, cfg=1 + torch compile (comfy core): 7.55 it/s +343%</li><li>mxfp8: 2.58 it/s +17%</li></ul><hr />This is high quality int8 quantized version of base Anima v1.0 model. It retains ~90% of original model quality, but uses about 50% less VRAM and also runs faster on almost any nVidia GPU (AMD not tested). Nice trade-off, especially for low-end GPUs.Can be used as a drop-in replacement for original Anima model in latest ComfyUI, no custom nodes required. If you have troubles running the model make sure that you updated both ComfyUI itself and its dependencies (e.g.<code>pip install -U -r requirements.txt</code> on manual linux install).Converted to int8 / mxfp8 using <a target="_blank" rel="ugc" href="https://github.com/silveroxides/convert_to_quant">convert_to_quant</a> script.

Anima int8 / mxfp8

Anima-Turbo v1.0.int8, ConvRot group size 256, rowwise, learned rounding SVD

Files with SHA256: 376c82281e834beae91b621e1944f47fec42b92aa59b6f67d32d9150e58276b7