
# 

## Model Introduction

This model is trained using the [Civision/model training](https://modelscope.ai/civision/modelTraining) environment and computing resources provided by ModelScope.

* Model Type: LoRA
* Base Model: [openmoss/MOSS-Image-SFT](https://modelscope.ai/models/openmoss/MOSS-Image-SFT)
* Training Code: [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio)
* Data amount：220
* Total training steps：10000
* License: Apache-2.0

## Inference Code

Install [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio):

```bash
pip install diffsynth
```

Inference:

```python
from diffsynth.pipelines.moss_image import MOSSImagePipeline, ModelConfig
import torch

pipe = MOSSImagePipeline.from_pretrained(
    torch_dtype=torch.bfloat16,
    device="cuda",
    model_configs=[
        ModelConfig(model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="transformer/diffusion_pytorch_model*.safetensors"),
        ModelConfig(model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="text_encoder/model*.safetensors"),
        ModelConfig(model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="vae/diffusion_pytorch_model.safetensors", computation_dtype=torch.float32),
    ],
    tokenizer_config=ModelConfig(model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="tokenizer/"),
)
pipe.load_lora(pipe.dit, ModelConfig(model_id="zxy261/moss-gpt2", origin_file_pattern="moss-gpt2_c1-st10000.safetensors"))

prompt = "a cat"
image = pipe(prompt, height=1024, width=1024, seed=0, num_inference_steps=50, cfg_scale=3.0)
image.save("image.jpg")
```


moss-gpt2

moss-gpt2_c1-st5000.safetensors

c1-st5000

c1-st1000

c1-st2000

c1-st3000

c1-st4000

c1-st6000

c1-st7000

c1-st8000

c1-st9000

c1-st10000

Files with SHA256: 961bb79724cc997c97f03940a47b49fb82b3d677f348bacf3c6e4f0d8c822a53