<div data-youtube-video><iframe width="640" height="480" allowfullscreen="true" autoplay="false" disablekbcontrols="false" enableiframeapi="false" endtime="0" ivloadpolicy="0" loop="false" modestbranding="false" origin playlist src="https://www.youtube.com/embed/H_d_at2F3Pg?si=OvpNEqsL-Ob26lLR" start="0"></iframe></div><h1 id="joyai-echo-gguf-(for-low-vram-comfyui)">JoyAI-Echo — GGUF (for low-VRAM ComfyUI)</h1>Quantized GGUF weights and extracted components for running JD's <a target="_blank" rel="ugc" href="https://github.com/jd-opensource/JoyAI-Echo">JoyAI-Echo</a> — a text → video + audio model — on consumer GPUs.The original release is a single ~46 GB bf16 checkpoint built for ~48 GB-class hardware. These files let it run on 8 GB VRAM + 16 GB RAM through the companion ComfyUI nodes.▶ Nodes / how to run: <a target="_blank" rel="ugc" href="https://github.com/RealRebelAI/ComfyUI_JoyAI_Echo_GGUF_Nodes">https://github.com/RealRebelAI/ComfyUI_JoyAI_Echo_GGUF_Nodes</a> ▶ Model Files: <a target="_blank" rel="ugc" href="https://huggingface.co/realrebelai/JoyAI-Echo_GGUF/tree/main">https://huggingface.co/realrebelai/JoyAI-Echo_GGUF/tree/main</a>▶ Colorful Int Nodes (IN WORKFLOW): <a target="_blank" rel="ugc" href="https://github.com/RealRebelAI/Rebels_Better_Int_Node">https://github.com/RealRebelAI/Rebels_Better_Int_Node</a>▶ Animated Nodes (IN WORKFLOW): <a target="_blank" rel="ugc" href="https://github.com/RealRebelAI/Rebels_Animated_Nodes">https://github.com/RealRebelAI/Rebels_Animated_Nodes</a>⚠️ Experimental. These run, but on small hardware loads and the first encode are slow. See the node repo for expectations and troubleshooting.<hr /><h2 id="what's-in-this-repo">What's in this repo</h2>Files<code>JoyAI-Echo-DiT-Q2_K.gguf</code>Diffusion transformer, Q2_KSmallest / lowest RAM. Start here on 8 GB.<code>JoyAI-Echo-DiT-Q4_K_M.gguf</code>Diffusion transformer, Q4_K_MHigher quality, more RAM.<code>joyai_echo_video_vae.safetensors</code>Video VAERequired.<code>joyai_echo_audio_vae.safetensors</code>Audio VAERequired.<code>joyai_echo_vocoder.safetensors</code>VocoderRequired for audio.<code>joyai_echo_embeddings_processor.safetensors</code>Text-embedding connectorRequired.<code>joyai_echo_config.json</code>Architecture configAlso ships inside the node pack.(Sizes are approximate; check the file listing. Q2_K is the lighter option, Q4_K_M the heavier/higher-quality one.)<h2></h2><h2 id="why-gguf-(and-why-these-specific-files)">Why GGUF (and why these specific files)</h2>Stock ComfyUI GGUF loaders build the wrong architecture for JoyAI-Echo — it's a modified LTX-2.3 (different <code>scale_shift_table</code> and connector dimensions). The companion nodes rebuild it correctly with JoyAI's own configurator and keep the DiT weights packed in GGUF form, dequantizing on the fly so the model fits in limited RAM/VRAM.The VAEs, vocoder, and connector are extracted from the original checkpoint as standalone files so you don't need the 46 GB bundle at runtime.<hr /><h2 id="usage">Usage</h2><ol><li>Install the <a target="_blank" rel="ugc" href="https://github.com/RealRebelAI/ComfyUI_JoyAI_Echo_GGUF_Nodes">ComfyUI nodes</a>.</li><li>Download the files above and place them in the ComfyUI folders listed in the node README (<code>models/unet</code>, <code>models/vae</code>, <code>models/audio_encoders</code>, <code>models/text_encoders</code>).</li><li>Add the RebelsJE_StagedPipeline node → <code>CreateVideo</code> → <code>SaveVideo</code>, pick the files from the dropdowns, prompt, and queue.</li></ol>Pick Q2_K first if you're on 8 GB; move up to Q4_K_M if you have RAM headroom and want better quality.<hr /><h2 id="hardware">Hardware</h2><ul><li>Minimum target: 8 GB VRAM + 16 GB RAM (RTX 3070 class).</li><li>SSD strongly recommended — the files load much faster than from a spinning disk.</li></ul><hr /><h2 id="acknowledgements">Acknowledgements</h2><ul><li><a target="_blank" rel="ugc" href="https://github.com/jd-opensource/JoyAI-Echo">JoyAI-Echo</a> — Echo Team @ Joy Future Academy, JD</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/Lightricks/LTX-2.3">LTX-2.3</a> — Lightricks</li><li><a target="_blank" rel="ugc" href="https://huggingface.co/google/gemma-3-12b-it">Gemma-3</a> — Google</li><li>GGUF tooling: <a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">city96/ComfyUI-GGUF</a></li><li><a target="_blank" rel="ugc" href="https://www.youtube.com/@realrebelai">Rebel AI</a> - Quantization of model and accompanying model files</li><li><a target="_blank" rel="ugc" href="https://www.youtube.com/@realrebelai">Rebel AI</a> - GGUF format Custom Node Set</li></ul><hr /><h2 id="license">License</h2>These quantized weights are derived from JoyAI-Echo and are released for academic research and non-commercial use only, following the <a target="_blank" rel="ugc" href="https://github.com/jd-opensource/JoyAI-Echo">upstream JoyAI-Echo license</a>. Gemma components (downloaded separately) are governed by <a target="_blank" rel="ugc" href="https://ai.google.dev/gemma/terms">Google's Gemma license</a>. By downloading you agree to those terms.

Files with SHA256: 18bcb8a01a3b8caa701ad97003c1b1adc325dab81806f174c424d07888f73c7e