What this is?

My H3 workflow, designed to have quick generations on my relatively low VRAM (12gb 3060).

On my setup, this workflow has the following generation times (compared to a basic 4 step workflow), rounded to the nearest 30 seconds:

5 seconds, I2V
| Megapixels: | Basic 4 Step | V1.0   | V2.0 No Refine | V2.0 With Refine |
---------------------------------------------------------------------------
| 0.5         | 3:30         | 2:30   | 3:00           | 3:30             |
| 1.0         | 9:30         | 5:30   | 4:00           | 5:00             |
| 2.0         | 30:00        | 13:30  | 10:00          | 13:30            |

10 seconds, I2V
| Megapixels: | Basic 4 Step | V1.0   | V2.0 No Refine | V2.0 With Refine |
---------------------------------------------------------------------------
| 0.5         | 9:00         | 4:30   | 4:30           | 5:30             |
| 1.0         | 27:30        | 10:00  | 10:00          | 14:30            |
| 2.0         | OOM, DNF     | 20:30  | 19:30          | 29:00            |

Update 2.0:

- Changed how the reference scaling works, now you can choose to match the aspect ratio of the generated video (for first/last frame/video editing) and separately scale the reference (for saving vram and increasing generation times).

- Added the ability to trim video and audio references.

- Video and audio references are now checked for length, an longer than 15s are trimmed to 15s, and if the total length exceeds 15s the references that push it over are disabled.

- Added live generation preview. It always works for the hi-res steps, and sometimes works for the lo-res steps. I think it has to do with the final size whether it will preview the lo-res steps or not.

- Added the option to do an extra, slower, refining step for better quality around moving things at the cost of generation time.

Features

Supports both ref2va and fl2va

Select a fl2va model and toggle the 'use fl2va?' option to run in fl2va mode, leave it off and load a ref2va model for ref2va mode.

Automatically constructs prompts

Each section of a H3 prompt (subject_descriptions, retention_analysis, etc.) has it's own input, all of which are combined to construct the prompt, making it easier to keep track of everything.

Dynamic prompts

Uses the dynamic prompts extension to do some pretty neat things, the most useful in this case is using variables in your prompt.

LoRA Support

Supports any LoRAs you want. Note: Adding LoRAs will increase generation time.

Easy references

Supports the maximum amount of references ref2va uses (9 image, 3 video and 3 audio), and will automatically disable image references 9, 8 and 7 for each reference over the maximum of 12. Additionally, any video or audio references longer than 15s will be trimmed to 15s, and if the total length of all audio or video references exceeds 15s (Calculated separately for both video and audio) it will disable the ones that push it over.

Reference Control

Allows the cropping of image and video references to match the target aspect ratio, additionally, allows image and video references to be scaled to save vram and decrease generation time (Especially useful when doing vid 2 vid stuff). Video and audio references can also be trimmed to only use the section most relevant to the generation.

Refine step

An extra, slower refining step can be enabled to clean up motion around fast moving objects, especially noticeable with things like hair. It is not always needed, but it does make a difference.

Required node packs

Uses the following node packs:

🟢 Will be auto-detected by comfyui-manager
🟡 Can be installed using comfyui-manager, but is not auto-detected (you will have to search for it). Manual installation may be easier to avoid getting the wrong pack.
🔴 Requires manual installation

🟢 Impact Pack

🟢 KJ Nodes

🟢 RGThree Comfy

🟢 Video Helper Suite

🟢 FPS Frame Drop

🟡 Dynamic Prompts Note: If installing through comfyui-manager, get the one with the description "Nodes that implement functionality similar to the Dynamic Prompts extension for A1111"

🟡 Fictiverse Nodes Note: The nodes from this pack are incorrectly detected as belonging to another pack. Make sure you have this one installed before installing auto detected packs.

🔴 MiniMax H3 Audio T8 Note: This one can be installed using comfyui-manager (it is not auto-detected), but reports it's compatibility requirements incorrectly so it cannot easily be enabled. Manual installation bypasses that.

🔴 YC Nodes MiniMax H3

🔴 Selflift Avatar Important note: This packs latest update has broken it somehow, either use git checkout 8e01c09 if you've already download it to revert to an older commit where it still works correctly, or if you're downloading for the first time use git clone --revision=8e01c093f027c0281025741b025f117475ea044b https://github.com/slmonker/selflift-Avatar.git when installing. Note 2: This workflow was made with an older version of the pack, either revert to commit dc8e545 to use the workflow as is, or recreate the 'selflift-avatar sampler' node, toggle the 'hires_tiling' option and select 'spatial tiling (legacy)' for 'hires_tiling_mode' if you want to use a more up to date version.

Required models

Diffusion model

Any int8-convrot model, I use these hybrid models or this one for ref2va, and the basic fl2va one or this one for fl2va. These go in models/diffusion_models

Text encoder

This one. Goes in models/text_encoders

Vae

Video, audio. Goes in models/vae

Latent upscaler

This one. Goes in models/latent_upscale_models

4 Step LoRA

Any pruned LoRA model (must be pruned, will crash otherwise). I use this one, this one is also pretty good. Goes in models/loras

Full model paths

📂 ComfyUI
├── 📂 models
|   ├── 📂 diffusion_models
|   |    ├── DIFFUSION MODELS GO HERE
|   |
|   ├── 📂 latent_upscale_models
|   |    ├── LATENT UPSCALER GOES HERE
|   |
|   ├── 📂 loras
|   |    ├── 4 STEP LORA GOES HERE
|   |
|   ├── 📂 text_encoders
|   |    ├── TEXT ENCODER GOES HERE
|   |
|   ├── 📂 vae
|   |    ├── VAE MODELS GO HERE