<h1 id="qwen3-vl-32b-h3-compatible-int8-tensorwise-text-encoder">Qwen3-VL-32B H3-Compatible INT8 TensorWise Text Encoder</h1>The target hardware assumed to be Ryzen-AI workstations (entry level starting at ~64GB vram like AMD Strix-halo or similar).<h2 id="enable-triton">Enable Triton</h2>For the intended accelerated INT8 TensorWise path, start ComfyUI with:<pre><code>python main.py --enable-triton-backend
</code></pre>Container example:<pre><code>python /root/ComfyUI/main.py --listen 0.0.0.0 --enable-triton-backend
</code></pre>On startup, confirm that ComfyUI reports that Triton was found and that the comfy-kitchen Triton backend is enabled.Do not assume that simply having a Python package called <code>triton</code> installed means that ComfyUI is actually using the accelerated INT8 path.For ROCm INT8 use, Triton 3.7 or newer is recommended.If your ComfyUI launch command includes <code>--disable-triton-backend</code>, remove it.<hr /><h2></h2>Canonical Hugging Face release, full provenance, hashes, and supporting files: <a target="_blank" rel="ugc" href="https://huggingface.co/PuppetVision/qwen3vl-32b-minimax-h3-amd-rocm-optimized-comfy-triton">https://huggingface.co/PuppetVision/qwen3vl-32b-minimax-h3-amd-rocm-optimized-comfy-triton</a><h2 id="what-this-is">What this is</h2>This release contains a Qwen3-VL-32B-derived INT8 TensorWise text/vision conditioning encoder for MiniMax H3 workflows in stock ComfyUI.It is designed to substantially reduce memory use while retaining the quality and behavior of the validated H3-compatible encoder, with AMD ROCm 7-capable GPUs using Triton as the primary target audience.This file is not a standalone Qwen chat model and does not include the MiniMax H3 diffusion model, VAE, LoRA, or sampler. It is a text-encoder file intended for MiniMax H3 ComfyUI workflows using <code>CLIPLoader</code> with type <code>minimax</code>.<code>H3-compatible</code> refers to the retained Qwen topology, key layout, and conditioning contract expected by ComfyUI MiniMax H3. The released encoder weights were derived from the official <code>Qwen/Qwen3-VL-32B-Instruct</code> checkpoint. No MiniMax-trained tensor values were introduced into these encoder weights.<hr /><h2 id="included-model">Included model</h2><code>qwen3vl_32b_h3_compatible_int8_tensorwise.safetensors</code><ul><li>Size: 24.726 GiB</li><li>SHA256: <code>438036c50abff3292ebc9d891ad8454fb5e7ff53fe6e7622643358ea9d2f2e55</code></li><li>467 linear weights quantized to INT8</li><li>FP32 per-output-channel weight scales</li><li>Dynamic rowwise INT8 activation quantization at runtime</li><li>ConvRot disabled</li><li>Requires a working comfy-kitchen Triton backend for the intended accelerated path</li></ul>This is the performance-oriented H3-compatible encoder and is the only model file included in this Civitai release.<hr /><h2 id="how-it-was-built">How it was built</h2>Official source:<code>Qwen/Qwen3-VL-32B-Instruct</code>Pinned revision:<code>0cfaf48183f594c314753d30a4c4974bc75f3ccb</code>The quantization source was first reconstructed as a clean H3-compatible BF16 checkpoint directly from the official Qwen weights using a lossless structural extraction/repack:<pre><code>Qwen3-VL token embedding retained
full Qwen3-VL vision tower retained
language layers 0..49 retained
language layers 50..63 omitted
final language-model RMSNorm omitted
lm_head omitted
</code></pre>ComfyUI MiniMax H3 consumes the unnormalized hidden state after language layer 50, so the H3-compatible encoder intentionally ends at layer index <code>49</code> and does not contain the final language-model norm or LM head.All 902/902 retained BF16 source tensors were verified as exact dtype, shape, and value matches to the pinned official Qwen checkpoint.The INT8 TensorWise model in this Civitai release was then quantized from that independently reconstructed clean BF16 source.The BF16 checkpoint itself is not included in this Civitai release. It is documented and available through the canonical Hugging Face repository linked above.<hr /><h2 id="int8-tensorwise-details">INT8 TensorWise details</h2><pre><code>format int8_tensorwise
ConvRot false
quantized linear weights 467
language-model matrices 350
vision matrices 117
stored weight scale FP32 [out_features, 1]
activation quantization dynamic rowwise INT8
reproducible quantization source-dtype division on CPU
</code></pre>The 350 language-model matrices correspond to 50 layers × 7 projections:<pre><code>q_proj
k_proj
v_proj
o_proj
gate_proj
up_proj
down_proj
</code></pre>The release tensor data was validated against the known-good high-quality/high-performance INT8 TensorWise baseline.<hr /><h2 id="comfyui-installation">ComfyUI installation</h2>Place the file in:<pre><code>ComfyUI/models/text_encoders/
</code></pre>Example:<pre><code>cp qwen3vl_32b_h3_compatible_int8_tensorwise.safetensors /path/to/ComfyUI/models/text_encoders/
</code></pre>Restart ComfyUI.In your MiniMax H3 workflow, use <code>CLIPLoader</code> with:<pre><code>clip_name: qwen3vl_32b_h3_compatible_int8_tensorwise.safetensors
type: minimax
device: default
</code></pre><hr /><h2 id="amd-rocm-users:-check-your-own-gpu-environment">AMD ROCm users: check your own GPU environment</h2>Do not blindly copy GPU-specific environment variables from another AMD system.ROCm behavior can vary based on:<ul><li>GPU architecture</li><li>ROCm version</li><li>PyTorch build</li><li>kernel</li><li>native vs containerized runtime</li><li>whether your PyTorch build contains native support for your architecture</li></ul>Identify your actual hardware and software stack first:<pre><code>rocminfo | grep -m1 -E 'gfx[0-9]+'
</code></pre><pre><code>python - &lt;&lt;'PY'
import torch
print('torch:', torch.__version__)
print('HIP:', torch.version.hip)
print('GPU:', torch.cuda.get_device_name(0) if torch.cuda.is_available() else 'not visible')
if torch.cuda.is_available():
 print('arch:', torch.cuda.get_device_properties(0).gcnArchName)
PY
</code></pre>Then research the recommended environment variables for your specific GPU architecture + ROCm/PyTorch combination.In particular, do not blindly set <code>HSA_OVERRIDE_GFX_VERSION</code>. Some compatibility stacks may require an override, while architecture-aware ROCm/PyTorch builds may not.<h3 id="strix-halo-example-from-this-project">Strix Halo example from this project</h3>The Strix Halo build/validation environment used a dedicated ROCm 7.2.4 userspace under <code>$HOME</code> with:<pre><code>ROCM_ROOT="$HOME/amd-rocm/rocm-7.2.4"

export ROCM_PATH="$ROCM_ROOT"
export HIP_PATH="$ROCM_ROOT"
export PATH="$ROCM_ROOT/bin:$PATH"
export LD_LIBRARY_PATH="$ROCM_ROOT/lib:$ROCM_ROOT/lib64:$ROCM_ROOT/llvm/lib${LD_LIBRARY_PATH:+:$LD_LIBRARY_PATH}"
</code></pre>This is an example from the validation system, not a universal prescription for every Strix Halo or AMD GPU.Use the paths, architecture settings, and overrides appropriate for your own ROCm installation.<hr /><h2 id="provenance-and-exact-hash">Provenance and exact hash</h2>Official upstream:<pre><code>Repository: Qwen/Qwen3-VL-32B-Instruct
Revision: 0cfaf48183f594c314753d30a4c4974bc75f3ccb
License: Apache-2.0
Source shards verified: 14/14 by SHA256
Official source tensors: 1058
</code></pre>Clean H3-compatible BF16 quantization source:<pre><code>Retained tensors: 902
Retained: embedding + full vision tower + language layers 0..49
Omitted: language layers 50..63 + final LM norm + lm_head
Repack numerical loss: 0.0
</code></pre>Civitai release artifact:<pre><code>File:
qwen3vl_32b_h3_compatible_int8_tensorwise.safetensors

SHA256:
438036c50abff3292ebc9d891ad8454fb5e7ff53fe6e7622643358ea9d2f2e55

Size:
24.726 GiB

Tensors:
1836

INT8 weights:
467

FP32 scales:
467

Quantization markers:
467
</code></pre>For the full provenance record, validation history, BF16 reference build, and canonical release metadata:<a target="_blank" rel="ugc" href="https://huggingface.co/PuppetVision/qwen3vl-32b-minimax-h3-amd-rocm-optimized-comfy-triton">https://huggingface.co/PuppetVision/qwen3vl-32b-minimax-h3-amd-rocm-optimized-comfy-triton</a><hr /><h2 id="scope-and-limitations">Scope and limitations</h2><ul><li>This release contains one INT8 H3 conditioning encoder.</li><li>It is not a full MiniMax H3 checkpoint.</li><li>It does not contain the H3 diffusion model, VAE, LoRA, or sampler.</li><li>The BF16 reference checkpoint is not included in this Civitai release.</li><li>H3-specific prompt/tokenizer behavior is implemented by ComfyUI and is not contained solely in this safetensors file.</li><li>Hardware/runtime support depends on ComfyUI, comfy-kitchen, Triton, PyTorch, ROCm, and your GPU architecture.</li><li>Performance and behavior claims apply to the validated TensorWise recipe represented by this artifact.</li></ul><hr /><h2 id="license-and-attribution">License and attribution</h2>The upstream <code>Qwen/Qwen3-VL-32B-Instruct</code> repository is released under the Apache License 2.0.This artifact is a modified/repacked derivative:<ul><li>the clean BF16 source changes topology/key layout for H3-compatible conditioning;</li><li>this release additionally applies the documented TensorWise INT8 quantization.</li></ul><code>Qwen</code>, <code>MiniMax</code>, <code>ComfyUI</code>, AMD, and ROCm names are used only to describe source, compatibility, and target runtime. No endorsement by those projects or companies is implied.The canonical Hugging Face release contains the complete license, notice, provenance, BF16 reference, and checksum information:<a target="_blank" rel="ugc" href="https://huggingface.co/PuppetVision/qwen3vl-32b-minimax-h3-amd-rocm-optimized-comfy-triton">https://huggingface.co/PuppetVision/qwen3vl-32b-minimax-h3-amd-rocm-optimized-comfy-triton</a><hr /><h2 id="work-with-me-more-projects">Work with me / More projects</h2>If this model saved you VRAM, debugging time, or helped make a demanding AI workflow more practical, I build a lot more systems like this.I’m currently looking for full-time opportunities as an AI Systems Engineer, particularly roles involving model optimization, inference systems, GPU acceleration, quantization, generative AI infrastructure, and the engineering required to make large models run reliably in real-world environments.LinkedIn — full-time employment opportunities: <a target="_blank" rel="ugc" href="https://www.linkedin.com/in/allen-b-3a35505a/">https://www.linkedin.com/in/allen-b-3a35505a/</a>PuppetVisionAI on YouTube — more projects and experiments: <a target="_blank" rel="ugc" href="https://www.youtube.com/@PuppetVisionAI">https://www.youtube.com/@PuppetVisionAI</a>Website: <a target="_blank" rel="ugc" href="https://puppetvision.nl">https://puppetvision.nl</a>

Files with SHA256: 438036c50abff3292ebc9d891ad8454fb5e7ff53fe6e7622643358ea9d2f2e55