<h2 id="model-overview">Model Overview</h2>This model was trained using the training environment and computing resources provided by the <a target="_blank" rel="ugc" href="https://modelscope.cn/aigc/modelTraining?utm_source=chatgpt.com">Model Training</a> section of the ModelScope AIGC platform<ul><li>Model Type: LoRA</li><li>Base Model: <a target="_blank" rel="ugc" href="https://modelscope.cn/models/openmoss/MOSS-Image-SFT?utm_source=chatgpt.com">openmoss/MOSS-Image-SFT</a></li><li>Training Framework: <a target="_blank" rel="ugc" href="https://github.com/modelscope/DiffSynth-Studio?utm_source=chatgpt.com">DiffSynth-Studio</a></li><li>Training Dataset Size: 100</li><li>Total Training Steps: 9,000</li><li>Open-Source License: Apache-2.0</li></ul><h2 id="inference-code">Inference Code</h2>Install <a target="_blank" rel="ugc" href="https://github.com/modelscope/DiffSynth-Studio?utm_source=chatgpt.com">DiffSynth-Studio</a><pre><code>pip install diffsynth</code></pre>Run inference<pre><code>from diffsynth.pipelines.moss_image import MOSSImagePipeline, ModelConfigimport torchpipe = MOSSImagePipeline.from_pretrained( torch_dtype=torch.bfloat16, device="cuda", model_configs=[ ModelConfig( model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="transformer/diffusion_pytorch_model*.safetensors" ), ModelConfig( model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="text_encoder/model*.safetensors" ), ModelConfig( model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="vae/diffusion_pytorch_model.safetensors", computation_dtype=torch.float32 ), ], tokenizer_config=ModelConfig( model_id="openmoss/MOSS-Image-SFT", origin_file_pattern="tokenizer/" ),)pipe.load_lora( pipe.dit, ModelConfig( model_id="synthesia/Ryohka_Suzuya", origin_file_pattern="Ryohka_Suzuya_c1-st9000.safetensors" ))prompt = "a cat"image = pipe( prompt, height=1024, width=1024, seed=0, num_inference_steps=50, cfg_scale=3.0)image.save("image.jpg")</code></pre>

凉屋/涼香/Ryohka/Suzuya

Ryohka_Suzuya_c1-st7000.safetensors

Runs_1_st7000

Runs_1_st9000

Runs_1_st8000

Runs_1_st6000

Runs_1_st5000

Runs_1_st4000

Runs_1_st3000

Runs_1_st2000

Runs_1_st1000

Files with SHA256: d8024446ed6af9dbc768bafa56f7b1ba5bfa5d24ee26439ea5568a60e0fe9fef