
<video controls src="https://i.gyazo.com/748e50cd59976f45acabd7cf39d45bc6.mp4" title="Demo video"></video>

# FLUX.2 Klein 9B 360 ERP Outpaint LoRA

[![ComfyUI Node](https://img.shields.io/badge/ComfyUI-Panorama--Stickers-blue)](https://github.com/nomadoor/ComfyUI-Panorama-Stickers)
[![4B Model](https://img.shields.io/badge/Hugging%20Face-4B%20Model-green)](https://huggingface.co/nomadoor/flux-2-klein-4B-360-erp-outpaint-lora)
[![README JA](https://img.shields.io/badge/README-日本語-lightgrey)](./README_ja.md)

This is a LoRA for FLUX.2 Klein 9B that generates 360-degree panoramas.

It uses an approach where reference images are placed on an empty ERP canvas, and the surrounding area is filled by outpainting. This makes it possible to generate panorama images from a flexible layout.

## Examples

### Example 1

| Input | Output |
| --- | --- |
| ![example 1 input](https://i.gyazo.com/d2f8b13debee5e8ef733110f72ffe87a.png) | ![example 1 output](https://i.gyazo.com/0ad707176d21bf6d6d2d02fbb141aa81.png) |

### Example 2

| Input | Output |
| --- | --- |
| ![example 2 input](https://i.gyazo.com/5d7cad2a6b5c174f03e4231c57b43e6a.png) | ![example 2 output](https://i.gyazo.com/7efab674312384dc03e12ff94d0b9f0a.png) |

## Usage

1. Prepare a `2:1` ERP control image with projected reference images placed on a green canvas.
2. Put the trigger words below at the beginning of your prompt.
3. Add any extra prompt text you want after it.

Notes:

- The reference image is expected to be projected into ERP from a **pinhole view** based on its intended panorama placement.
- A UI for this workflow is available as a Gradio app / ComfyUI custom node.
- [nomadoor/ComfyUI-Panorama-Stickers](https://github.com/nomadoor/ComfyUI-Panorama-Stickers)

## Trigger Word

```text
Fill the green spaces according to the image. Outpaint as a seamless 360 equirectangular panorama (2:1). Keep the horizon level. Match left and right edges.
```

## Recommended Resolution

- Generation: `2048x1024` (2K ERP)
- For panorama use, 2K may still look coarse in some cases, so use upscaling if needed

## Notes

- 🚨Distilled models do not produce good results in most cases. I am still looking for a solution, but for now you should use it with the base model.
- Most of the training data is realistic scenery, so non-photoreal domains may be less stable.
- Perfect seam matching is still difficult, and some outputs may benefit from post-processing such as inpainting.

## Training Setup

- [TRAINING_NOTES.md](./TRAINING_NOTES.md)

## Sample Dataset

- [samples/](./samples)

## Workflow

- [flux-2-klein-9B-360-erp-outpaint.json](./workflow/flux-2-klein-9B-360-erp-outpaint.json)
- `Upsace_Seam-inpainting (WIP)`

## License

Please follow the license and usage terms of the base model:

- ModelScope: [`flux-community/FLUX.2-klein-base-9B`](https://www.modelscope.ai/models/flux-community/FLUX.2-klein-base-9B)
- Hugging Face: [`black-forest-labs/FLUX.2-klein-base-9B`](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B)

## Support

I ended up spending a bit too much on GPU rentals 🫠  
If you would like to support the project, I would really, really appreciate it if you use [☕Ko-fi](https://ko-fi.com/nomadoor) or [❤GitHub Sponsors](https://github.com/sponsors/nomadoor/).



nomadoor/flux-2-klein-9B-360-erp-outpaint-lora

A LoRA for FLUX.2 Klein base 9B for 360-degree ERP panorama outpainting.

Files with SHA256: 204e8b96027f7f329a9327bad763bd2461f7bb0ed3e09e1c6d0a7b9f7ee1a148