beta 6:
More in-line with beta3/4 than 5. It does not replace b5, it does just does everything it couldn't do well and trades off generation speed to do it. It is not good to run on smaller cards and is a heavily modified reference model more than the normal hybrids. Uses 10/3 shift and higher sampling targets of 8-12 steps across multiple sampling combinations. Either full dense or VSA sparsity, the correct sampling setup can be found in the "FastH3" comfyui templates, just add more steps. VSA will work better over SLA or Sol. That is the result coming from a different turbo mix that avoids the 4-step issues (audio, plastic skin, lack of motion detail). It is not a rapidly quick-gen model like beta 5, it is designed more for professional level and higher quality use with references and higher end systems that can churn higher steps quicker and optionally run an upscale pass to clean up reference noise and details. It is also designed to be unique since it actually shifts the H3 model significantly and is not like any of the dozens of fully base-aligned models, including previous beta5 - prompt outputs will be different and may require adjustment to align to it's behavior.
If you want the max quality possible the full unpruned bf16 is here.
Everything was done differently and from scratch on the release full bf16 fl2va model as a base. Reference timestep, viggle deltas, turbo deltas, and Lora mix were integrated and then pruned. The Lora mix uses a unique application with a shared strength cap and a contribution 'noise floor'. It prevents H3’s self-guided architecture from decaying as is experienced with multi-Lora stacks. Each Lora’s character comes through while model coherence mostly stays intact under stacks that would normally destabilize the output. They bring in their data without the full level of disruption that 20+ Loras would do and instead homogenizes them into a shared capped strength per-tensor. This is as far as you can really push the model without visual and prompt degradation, so far. It already does sacrifice some visual quality in the form of some higher levels of noise and noised edges on objects, especially in the background common with the initial release Reference deltas. That is more or less the reality of H3 Loras and reference model right now. Half model H3 hybrids sacrifice that quality for much much lesser reference ability, and the typical late-block hybrid format was abandoned on this one. This is essentially a true hybrid, i.e. just a Reference model with T2V ability. If I2V is having issues it should be transferred to reference generation since it still has issues with starting image style first-frame continuity that reference mode does not have.
Full credits to these lora makers for having data involved, even in possibly miniscule contributions, in the merge of beta_6 version:
alcaitiff, MisticRain69, diogod, FourBunny, HearmemanAI, tazmannner, simonishere, QualityControl, blo01, ComfyTinker, kermitfrog1202, qdr1en, coachbate, salttaro, alternative_penguin, misterxrex, freek22, definitelynotadog, The Midnight Lab.
beta 5:
Use TURBO-hybrid_int8 by default. Other options are for experimenting. Full versions here.
beta_5 is built with a different normalization technique. It's also built off 7 different concept-grouped grafts and consensus merges from over 20 Loras, no full direct lora merges. It allows for a non-turbo version which is available. The files with TURBO have a hybrid turbo-delta fusion baked in saving 4.2 gigabytes of memory instead of having to load both ref/fl turbos. Other concept Loras will also load on top more readily, usually needing lower strength 0.2-0.6. For t2v and even some i2v you should 100% be loading mystic_v4, anatomy enhancer, or a related concept lora on top.
Also consider using the non-turbo with PDD, 6 warmup and 4 PDD turbo steps.
Prompt is the entire key to quality and success. Any issues you'd want to blame on a model or workflow, you can go ahead and take a look at the prompt instead. Describe things cleanly and literally:
❌ He puts his penis in her pussy, make hot sex
✅ Live-action pornographic explicit sexual and sensual intimate POV recording: The man slowly moves his lower body forward with his finger on the base of his penis shaft. The tip of the penis slowly disappears into her pussy hole and her wet labia open allowing it entry. He keeps swinging his pelvis forward until his crotch touches hers. Then he backstrokes and starts a repeated thrusting sex motion. The sex act makes her whole body recoil into the couch, bouncing her breasts wildly. She stares lustfully into the camera.
Prompt in temporal sequence on a linear time flow. The longer and more embellished the prompt, the better the output will be usually. 100% use some kind of LLM enhancer; Grok is the one I use since he has a skill preset for reference prompting.
The version just labeled 'hybrid' is non-turbo. Non-turbo full step audio will always be better than audio on turbo versions.
Some working sampling setups:
er_sde/beta57 4-6 steps (seems to be best preservation of style and reduced drift)
res_multistep/simple 6-9 steps (good motion quality, beta will be the sharpest fast motion at 8-9 steps but will give a plastic/burned look)
LCM/simple 6-8 steps (best turbo audio)
Euler/simple 4-8 steps
Next version should be mainly powered by the first round of Sulphur training. From what I've seen it will fix most missing audio and missing concept issues.
Updated - Full credits to these lora makers for having deltas involved in a consensus merge in beta_5 version:
alcaitiff, MisticRain69, diogod, FourBunny, HearmemanAI, tazmannner, simonishere, QualityControl, blo01, ComfyTinker, kermitfrog1202, qdr1en, coachbate, salttaro, alternative_penguin, misterxrex, freek22, definitelynotadog
beta 4:
rebuilt on beta3 config with some loras changed out for newer versions. Turbo was consensus merged to construct a ref/t2va hybrid turbo lora. That's the key element to the merge, there is no non-turbo version. The non-turbo version is bad and doesn't work since the turbo weight is normalizing the merge by it's strength. That custom turbo merge will need further improvement. This one preforms video, reference, and motion well in 6-8 steps without the issues from beta3, but audio needs shift configuration.
Use sampling like Euler/simple 8 steps with sampling shift - 12 video/ 7+ audio. LCM/simple or beta with 6-8 steps and no shift can also be better for audio and drawn styles.
Audio is lackluster and it's becoming somewhat apparent that H3's integrated audio is not good, like terrible actually. Any future multimodal models should avoid integrated audio if they intend to open source. I have almost no control over how the audio works inside the model. Don't post about it. I focused on motion and prompt response and of course when I get those working well, the audio ends up bad, go figure. I'll look at what kind of different turbo configs can enable more audio crispness to come back or likely will have to wait for Sulphur to replace MysticXXX which is contributing to the audio quality drop.
beta 3:
Rebuilt on the delta1024 reference hybrid model. Does t2va and reference. Treat i2v as a single image reference, don't do i2v prompting. Silver's merged turbo is integrated and tuned for 6 steps with simple schedule with the extra _emb layers tacked on to the model, not sure if they're needed.
Samplers like er_sde or multires or other turbo sampling setups work. Best imo is just er_sde/simple 6 steps, no shift, no spectrum, no cache, only a comfy_kitchen backend selection node. 3 video references in a 15+ second outputs can be done in under 10-15 minutes now on larger cards with no extra cache or quality hit needed.
Many (like a lot, all the good ones) on-site loras were fully combined into a consensus weighted merge with ranked drop-out to form an initial part. That merge is put against new, more powerful Wan and LTX grafts as a blend/reshape that uses the loras to consensus shape the grafts, but it also allowed some of the better loras clean pass-through. This is not a linear list of loras just merged. The main element that can present most is probably MysticXXX which was given the most pass-through weight since it's just good--and all 3 release steps of that are inside it. However, they're all-combined with a ton of other loras with agreement and consensus of shape and then it's only reshaping the grafts parts. The results of that are the actual weighted loras that are used to make the model.
Due to drop-out and consensus merge, pretty much all of the loras can all still be used easily on top if needed, and might work better even. All of this was only done to create a large rank dummy lora similar to what sulphur data will look like as a lora or extracted lora so I can start looking at how to apply it cleanly.
It's definitely not a few on-site loras that are linear merged, uncredited, and then renamed with some emojis. I'll only do this until sulphur tuning steps are in my hands and I can work with more targeted and shifted stuff, plus I was tired of waiting and I wanted fast easy i2v.
There is one quirk of the hybrid h3 usage: don't use it i2v. It should either be always used in reference prompting mode, or t2va prompting mode. Even if there is just one single image input it needs to be used as reference and prompted in the ref2va format. If you run an underdeveloped or manually written prompt you will get odd outputs, random camera changes, and blue lighting color shifts when you use the i2v prompt style.
Full credits to these lora makers for being involved somewhat in beta3 version:
alcaitiff, MisticRain69, diogod, FourBunny, HearmemanAI, tazmannner, simonishere, QualityControl, blo01, ComfyTinker, kermitfrog1202
Beta2 and previous:
This started a finetune-by-graft. Or maybe a GST - grafted shift of transformer (cross-architecture). I made both up, because there aren't any projects that have done it that I know, except one reddit post that made me look into it. I experimented with Wan and LTX on the side which led to the initial LTX Eros scripts that became what powered this, all before H3 ever came out. It seems like unified unbiased models like MMH3 can technically take attention influence from any other DiT without breaking if done correctly. Anima, Krea2, LTX, Wan2.2, Flux1 were all tried out, configs tested, about ~40 hours maybe of working in the dark without any paper or technical documents from Minimax. Eventually I developed linear-magnitude blend application and specific block and head gate targets allowing for a smoother graft on an attn-triplet-unfused version of H3 output as a patch file. That sent to lora extraction, then merged to checkpoint at taste. This is a merge but a merge of LoRas I extracted that interact to produce this current shift. I saved 5 ponds of water by recycling data in a few minutes on a single card instead of toasting a server up.
Turbo not recommended yet for i2v, especially when used with other LoRas. T2V use with turbo is better. Use 20-25 steps normal sampling with no dialogue, 25 steps with dialogue along with cache nodes and attn modes. More steps over 25 are not neccessarily better, and can be worse. Use full int8: int8 model, int8 VAE (if it doesn't crash comfy), int8 qwen3vl along with current cache or attn mode nodes. For smaller cards: quants, macOS ports, and Wan2gp support will likely appear on huggingface but not from me.
Known quirks:
Audio difference v.s. Base - This model's audio changes come from attention shifts seeking alternate audio pairing. Attn triplets were unfused before graft, both standard and triplet q_attn was grafted holding about maybe 10-15% audio influence, attn_k was frozen and MLP fc2 layers were untouched resulting in minimal audio interference. This was the main issue with the entire transformer graft and protecting audio. However this version is slightly louder overall than the base model.
Low resolution detail smearing - Some finger digits and fine motion will smear more at low resolution, also a problem in base model. As memory use gets more efficient increase resolution or work on the composition to get around it.
Odd outputs - This can attempt certain concepts more liberally than base model, but that can lead to some undesirable outputs in bad prompting and certain contexts. Data shift comes from completely different transformers and architecture. This shouldn't even work, so it is what it is.
This model is not dedicated to NSFW as that would violate community license agreement. Sure it can do it, just like base. Any NSFW generations are purely the result of advanced reasoning and tokenization resulting from experimental changes. All terms from the H3 community license also still apply to the users of this version. Don't be a dumbass.
H3 usage still requires very intense prompting for maximum effect. Every motion, every interaction, every sound plainly and fully described. Not with slang terms; with proper actionable words that can be tokenized. Refer to the h3 developer prompting guide, hand that .md file to an LLM or Chat agent and have them enhance or refine prompts along the released H3 developer prompt guide styles using the model's tag system. Certain concepts can be made from pure token reasoning. Consult the prompts in my previews to see certain physical descriptions that I use for some things. When using enhancement give the agent feedback about any issues in the generation and get them to describe motions in alternate fashion, or manually edit it yourself adding a negative like "no X, no Y". Still requires prompt refinement and trial/error for best outcomes.
Sulphur Project has 10k banked to attempt actual tuning. Right now training pipelines are sub-optimal. As always Eros is my personal side project, and this beta was also essentially a speed-run of finetuning, figuring out exactly in what configurations and target areas do you get helpful/harmful changes in the model. This is also a proof-of-concept of what and where to target while leaving the reinforcement quality of base unharmed by being additive.
Description
Completely rebuilt off of base full unpruned fl2va H3 release model. Reference deltas added at full blocks level as opposed to hybrid, viggle deltas, and a fastv2 structured merged 8+4 step turbos fused together and targeting an 8-12 step, 10/3 shift sampling target. 4 step possible with added turbo on top. Multi-LoRA composition was added with a strength cap bordering on the edge of H3’s self-guiding architecture becoming warped. Preserves base model coherence under heavy stacking (25+ Loras) while allowing per-LoRA character to come through cleanly. Resistant to the compound distortion typical of large LoRA stacks because of a noise floor that cuts stacking Lora noise out and leaves more room for their concentrated data changes.