FLUX COMPACT
I am excited to present a collection of compact Flux models, with Clips and VAE included in a single model, optimized to integrate seamlessly into a variety of existing workflows. These compact versions come with the various combinations of Clips and Models, ensuring that they can be easily loaded directly via nodes such as 'CheckpointLoaderSimple' and others, without the need for additional configuration.
As Sampler Node you can use the ones already present for SDXL using CFG 1, or you can use 'SamplersCustomAdvanced' that is dedicated to FLUX.
If you use the dedicated FLUX node above , you can use one of the 'Guiders' as nodes to manage the guidance instead of the 'CFG of the sampler'
if not, you can use the 'FluxGuidance' node placed between the prompt and the sampler to manage the guidance on the other samplers already present for SDXL, keeping their CFG at 1 and modifying that of the new node.

By reducing the final size by about 30%, these models are also accessible on less powerful machines, although I am not sure how this is possible. In my tests, I have not observed any differences in the generated outputs compared to the full versions.
Let me know more with your experiments.
I claim no credit for the original creation and publication of these models; all rights are reserved to 'Black Forest Labs' and their talented team. My goal is to make their excellent work more accessible to the community.
I hope these compact Flux models will be useful to you and contribute to your creative and technical endeavors. Your feedback is greatly appreciated as we continue to explore and refine these tools together.
Flux.1-Dev Compact
MAIN SAMPLER: Euler + Simple
NORMAL CFG: 1
FLUX GUIDANCE: 2+
BETTER STEPS: 20+
Flux.1-Schnell Compact
MAIN SAMPLER: Euler + Simple
NORMAL CFG: 1
FLUX GUIDANCE: 2+
BETTER STEPS: 4+
VERSIONS CONTENTS:
Flux.1-Dev fp8
Unet: Flux.1-Dev
weight_dtype: fp8_e4m3fn
Clip1: t5xxl_fp8_e4m3fn
Clip2: clip_l
VAE: ae_Dev
Flux.1-Dev fp16
Unet: Flux.1-Dev
weight_dtype: fp8_e4m3fn
Clip1: t5xxl_fp16
Clip2: clip_l
VAE: ae_Dev
Flux.1-Schnell fp8
Unet: Flux.1-Schnell
weight_dtype: fp8_e4m3fn
Clip1: t5xxl_fp8_e4m3fn
Clip2: clip_l
VAE: ae_Schnell
Flux.1-Schnell fp16
Unet: Flux.1-Schnell
weight_dtype: fp8_e4m3fn
Clip1: t5xxl_fp16
Clip2: clip_l
VAE: ae_Schnell
Flux.1-Dev fp16 ALT
Unet: Flux.1-Dev
weight_dtype: fp8_e5m2
Clip1: t5xxl_fp16
Clip2: clip_l
VAE: ae_Dev
Flux.1-Dev fp8 ALT
Unet: Flux.1-Dev
weight_dtype: fp8_e5m2
Clip1: t5xxl_fp8_e4m3fn
Clip2: clip_l
VAE: ae_Dev
Description
FAQ
Comments (8)
i'm searching for flux dev merged with schnell that run on 4step , also is there issue with all flux models that it's step is way way slower than sdxl step time ? or just i want to use the right flux model ? before downloading a 16gb , i need to be sure about that flux step is supposed be the same as sdxl step with same hw ?
I'm gradually uploading the various compact versions of Flux, stop by every now and then to check the updates, that one will arrive soon too, in the meantime you can use the normal version 'Shnell fp8' if you prefer speed. The generation time for steps has increased slightly with the same hardware, depending on the machine you have it is more or less noticeable in terms of seconds/minutes, but still greater than that of XL, especially if you have less VRam than what is needed to load the entire model, so 16+
@ALIENHAZEÂ appreciate your great effort , waiting for schnell merge that guarantee neat quality with only 4steps , about the memory ..i'm using the cpu can handle more than 32gb with no problem..even the duoble with swap , but problem is i need some 4step model that it's step close to usual sdxl step speed. thanks again
Any suggestion on how to do it with a diffuser?
Is there any chance of this working on a 6GB of VRAM?
when I try to generate an image in fp16 version I get the following error from cmd;
12:37:04.089 [Error] Self-Start ComfyUI-0 on port 7823 failed. Restarting per configuration AutoRestart=true...
12:37:04.099 [Init] Self-Start ComfyUI-0 on port 7824 is loading...
12:37:12.364 [Init] Self-Start ComfyUI-0 on port 7824 started.
When I want to reproduce it, the same error again, does anyone know? I couldn't find it on google, different topics come up. my system is rtx 3060 12gb, 48gb ram :/
When using the CheckpointLoaderSimple, i get horrible speed, and noticed this from the console: "model weight dtype torch.float8_e4m3fn, manual cast: torch.bfloat16"
Shouldn't it stick to torch.float8_e4m3fn or with the model defaults?








