JoyAI-Echo's video branch married to LTX-2.3-distilled-1.1's audio branch. Echo brings the cross-shot identity behaviour and the audio memory bank; the LTX audio and cross-modal branches are kept stock, so the TalkVid ID-LoRA still adapts the pathway it was trained against.This is the model the <a target="_blank" rel="ugc" href="https://github.com/jlucasmcrell/joyai-echo-multishot-patch">JoyAI-Echo multishot pack</a> is built around: one recurring character across completely different locations, same face, same voice, audio generated with the picture rather than dubbed.Which of my two merges do you want? This one for multishot work through the node pack — generated-voice sequences, the memory bank, the pack's slower and more deliberate delivery. At that pacing it scores 9.5+ on sync and is not outclassed by anything else I publish. The e50 build if you are driving a character from a supplied voice clip at conversational speed. That is a narrower case, and it is the only case where this merge measurably under-performs.<h2 id="what-was-merged">What was merged</h2><ul><li>Video / conditioning branch — JoyAI-Echo, which is what holds one identity across shots and drives the memory bank</li><li>Audio branch and cross-modal attention — stock LTX-2.3-distilled-1.1, untouched, so the TalkVid ID-LoRA behaves normally</li><li>Full checkpoints: DiT, video VAE, audio VAE, vocoder and the four <code>text_embedding_projection</code> tensors are all inside. No companion downloads.</li></ul><h2 id="files">Files</h2><ul><li><code>ltx23_echoVid-ltxAud_surgical_bf16.safetensors</code> — 43 GB, reference precision. Pair with <code>fp8_scaled_mm</code> ON.</li><li><code>ltx23_echoVid-ltxAud_surgical_fp8.safetensors</code> — 23.4 GB. For stock ComfyUI, or the pack with the toggles off.</li><li><code>ltx23_echoVid-ltxAud_surgical_talkinghead_bf16 / _fp8</code> — the base merge with the c72 video-only distill LoRA baked in at 0.5. An earlier route to the articulation fix; see below.</li><li>Quantized builds (Q8_0 / Q5_0 / Q4_0 GGUF, INT8 ConvRot) are in the sibling repos on Hugging Face.</li></ul><h2 id="speed:-turn-on-fp8_scaled_mm">Speed: turn on <code>fp8_scaled_mm</code></h2>If your renders crawl in the JoyAI-Echo pack, this is almost always why. It is off by default. It stores the DiT linears as <code>float8_e4m3fn</code> and computes the matmuls natively via <code>torch._scaled_mm</code> on RTX 40/50-series — unlike <code>fp8_transformer</code> there is no per-layer upcast tax.<ul><li>bf16 + toggle ON — linears downcast at load, native fp8 compute: ~22 GB resident, <code>sequential_offload</code> can go OFF</li><li>INT8 ConvRot + toggle ON — reconstructs to bf16, then downcasts: identical to bf16, at ~60% of the download</li><li>bf16 or INT8, toggle off — runs bf16: ~40 GB staged, streams over PCIe on a 32 GB card</li><li>fp8 file, toggle off — upcasts to bf16 at load: saves download size only</li><li>fp8 file + toggle ON — hard error. The toggle must start from bf16</li></ul>Short version: feed it bf16 or INT8 and turn the toggle on. The fp8 file is for running without the toggles.<h2 id="the-talkinghead-variants">The TALKINGHEAD variants</h2>These are the base merge with the c72 video-only distilled LoRA baked in at 0.5 — weight-equivalence verified per module against fp32 compute. Measured across two independent seed draws: shot-start articulation 4.8 → 6.9–7.5 (stock distilled-1.1 = 9.3) with envelope timing preserved at 0.23–0.27 against a 0.25 no-LoRA baseline. Face untouched.They and the e50 build attack the same deficit by different routes and have not been benchmarked head-to-head at equal settings. e50 is the newer one and the one in current use here. If you already have a tuned TALKINGHEAD setup, there is no measured reason to switch.<h2 id="known-behaviour-worth-reading-before-you-render">Known behaviour worth reading before you render</h2><ul><li>At conversational speech rates with reference audio, mouths under-articulate Why: JoyAI-Echo is a dev-lineage finetune, so on the 8-step distilled sigma ladder its video stack is under-distilled. Mouth-region motion measures 4.8–5.2 against stock's 9.3 on the same seed, prompt and settings. Fix: use the e50 build, the TALKINGHEAD build, or the c72 LoRA at 0.5. At the pack's own slower pacing this does not surface — sync is already 9.5+.</li><li>Occasional robotic voice on long runs Why: it happens, rarely, and Echo's own finetune is what suppresses it. Fix: this merge keeps Echo's finetune in full, so it is the safest of the family here. e50 keeps half of it.</li><li>Lip sync breaks about 9.6 s into every shot Why: not the weights. The pack's video RoPE clock was hardcoded to 24 fps while audio runs in true seconds, so a 25 fps render drifts ~4%/s. Fix: apply the <a target="_blank" rel="ugc" href="https://github.com/jlucasmcrell/joyai-echo-multishot-patch">multishot patch</a> (Bug fix #0). With it, 60–105 s multishot masters hold sync.</li><li>Chaining shots on the previous shot's last frame does not lip-sync Why: that guide is pixel-continuable, so the sampler reproduces it instead of animating. True on any checkpoint. Fix: extend with real audio+video latent context — see <a target="_blank" rel="ugc" href="https://huggingface.co/joeygambino/ltx23-multishot-lite">Multishot Lite v2</a>.</li></ul><h2 id="sampling">Sampling</h2><pre><code>1.0, 0.99375, 0.9875, 0.98125, 0.975, 0.909375, 0.725, 0.421875, 0.0</code></pre>8-step distilled ladder, cfg 1, euler. Note cfg 1 makes negative prompts inert — raise to ~1.3 if you need one, for example to suppress burned-in subtitles.<h2 id="requirements">Requirements</h2>The LTX-2.3 VAEs are bundled. You still need a Gemma-3-12B text encoder, and the TalkVid ID-LoRA for reference-voice mode. For multishot, the JoyAI-Echo node pack with the patch applied.<h2 id="license">License</h2>LTX-2 Community License, inherited. Non-commercial: LTX-2 itself permits commercial use below $10M ARR, but the JoyAI-Echo weights this is merged from are non-commercial, so the merge is too.<h2 id="everything-else-i've-published">Everything else I've published</h2><ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/joeygambino">All models on Hugging Face</a></li><li><a target="_blank" rel="ugc" href="https://github.com/jlucasmcrell/joyai-echo-multishot-patch">JoyAI-Echo multishot patch</a> — nodes, releases, issues</li><li><a target="_blank" rel="ugc" href="https://github.com/jlucasmcrell/ltx23-multishot-lite">LTX-2.3 Multishot Lite</a> — the core-node workflow</li></ul><h2 id="support-this-work">Support this work</h2>Everything I publish — workflows, merges, quants, patches — is free and stays free. The models are non-commercial by license and I have no plans to change that.If something here saved you an evening:<ul><li><a target="_blank" rel="ugc" href="https://github.com/sponsors/jlucasmcrell">GitHub Sponsors</a> — recurring, no platform cut</li><li><a target="_blank" rel="ugc" href="https://ko-fi.com/joeygambino">Ko-fi</a> — one-off, no account needed</li><li><a target="_blank" rel="ugc" href="https://liberapay.com/joeygambino">Liberapay</a> — recurring, open-source and non-profit</li></ul>Bug reports are worth as much as money. Most of the fixes in these packages exist because somebody posted a log.

JoyAI-Echo x LTX-2.3 - echoVid + ltxAud surgical merge

Two files. fp8 (23.4 GB) fits a 24 GB card and is the practical choice for most people. bf16 (43 GB) is full precision, for anyone with the VRAM or the patience for offload. Both are complete checkpoints: DiT, video VAE, audio VAE, vocoder and text connectors, so either loads as a single model file. Needs the multishot memory path to show the identity benefit.

Files with SHA256: 4a45e4ac1adb0b4b9b3ec92b536eda84079c25f1f7de9e4b450d0589f6b3e250