Project: GGUF presents FasciumKLEIN4B
Please visit the core model page for ongoing discussions and feedback. Please support the authors there!
Brought to you by the Project: GGUF Tools
The goal of Project: GGUF is to make image generation easier on gamer/consumer hardware. We are currently focusing on Flux 2 Klein models, and have successfully converted and run many 9b models at Q5_K_M on a 3070ti Mobile (laptop) with 8gb VRAM and 32gb RAM, also Q8_0 4b models! That's both converted AND used the models on the hardware.
This is a GGUF version of the model to run on lower end hardware, that's it - nothing more. I take no credit for the model or the hard work others have put into the training or curation.
If you are the author of an original model I have uploaded and want it taken down, please get in touch! Would love to see ongoing support for the low-end hardware :)
Description
FAQ
Comments (6)
Posted the Q8_0 - if you need another Quant, let me know!
Thanks for release, can you share quant 2-4 if possible? Thanks
@Tukangcode Yep! I will make a 2 and a 4, the 3 will likely have little difference.
@Tukangcode Q4 uploaded. Anything lower was just behaving badly. Hope it works well enough for you!
Add the Q5 version🤩🤩
When will you release a stable version? From what I read, it's still in alpha 🤔
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.