<h1 id="moss-image-sft-lineart-control-lora">MOSS-Image-SFT — Lineart Control LoRA</h1><h2 id="short-description">Short description</h2><p>A lineart Control LoRA for <strong>MOSS-Image-SFT</strong>. Feed a fine white line drawing on black. The model follows those lines, and the prompt sets color, material and style.</p><p>This is a ControlNet-style <strong>edit LoRA</strong>, not the official MOSS color/depth concat adapter. Load it with a LoRA loader and pass one control image through <strong>Text Encode MOSS-Image Edit</strong>.</p><p>Selected checkpoint: training step <strong>5000</strong>.</p><h2 id="files">Files</h2><ul><li><p><strong>Weights:</strong> <a target="_blank" rel="ugc" href="https://huggingface.co/thedeoxen/MOSS-Image-lineart-controlnet/blob/main/moss_image_sft_lineart_control_lora.safetensors">moss_image_sft_lineart_control_lora.safetensors</a></p></li><li><p><strong>ComfyUI workflow:</strong> <a target="_blank" rel="ugc" href="https://huggingface.co/thedeoxen/MOSS-Image-lineart-controlnet/blob/main/moss_image_lineart_control.json">moss_image_lineart_control.json</a></p></li><li><p><strong>Repo:</strong> <a target="_blank" rel="ugc" href="https://huggingface.co/thedeoxen/MOSS-Image-lineart-controlnet">thedeoxen/MOSS-Image-lineart-controlnet</a></p></li></ul><h2 id="examples">Examples</h2><p>Each preview is one combined image, left to right: <strong>control</strong>, then three prompts.</p><h2 id="extended-description">Extended description</h2><p>Follows a clean line drawing: contours without the extra speckle of a raw Canny map. Appearance, materials, clothing and the world come from the text prompt.</p><p>The LoRA is rank 64 on linear layers and rank 16 on convolutions. It was trained as an edit adapter: the control image is the reference, and the prompt describes the picture to generate.</p><h2 id="how-to-use">How to use</h2><ol><li><p>Load <strong>MOSS-Image-SFT</strong>: UNet <code>moss_image_sft_int8_convrot.safetensors</code>, text encoder <code>qwen3.5_9b_w4a8_gptq.safetensors</code> with type <code>moss_image</code>, VAE <code>flux2-vae_small.safetensors</code>.</p></li><li><p>Load this LoRA on the UNet at strength <strong>1.0</strong>.</p></li><li><p>Build the control map and pass it as the single reference image in <strong>Text Encode MOSS-Image Edit</strong>.</p></li><li><p>Set <strong>edit format</strong> to <code>ai-toolkit</code> on both the positive and the negative encode. This LoRA was trained with kv cache on.</p></li><li><p>Sample with <strong>30 steps</strong>, <strong>CFG 4</strong>, <code>euler</code> + <code>simple</code>.</p></li></ol><p>No trigger word. The control image sets the structure. The prompt sets identity, materials, clothing and the world.</p><h2 id="comfyui">ComfyUI</h2><p>The workflow in this repo loads a photo, builds the control map, encodes it with the prompt, and samples.</p><p>The included workflow uses <strong>Realistic Lineart</strong> with <strong>coarse</strong> enabled. That setting matches the training maps more closely than the fine lineart mode. Lines are white on black.</p><p>Also uses the built-in <strong>Text Encode MOSS-Image Edit</strong> node. Set the edit format to <code>ai-toolkit</code>.</p><h3 id="base-model">Base model</h3><p>Trained on and recommended with <a target="_blank" rel="ugc" href="https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT"><strong>OpenMOSS-Team/MOSS-Image-SFT</strong></a>.</p><p>Typical settings from the included workflow: <strong>30 steps</strong>, <strong>CFG 4</strong>, <code>euler</code> + <code>simple</code>, LoRA strength <strong>1.0</strong>.</p><p>Negative prompt used in training samples:</p><pre><code>nsfw, worst quality, bad anatomy, watermark, jpeg artifact</code></pre><h3 id="example-prompt">Example prompt</h3><pre><code>Full-body photograph of a circus ringmaster in scarlet tails, gold braid and a tall black hat, standing three-quarter view in front of a painted circus tent. One arm raised high, the other holding a slender black cane down at the side. Confetti, saturated color, entire body in frame.</code></pre><h2 id="what-it-does">What it does</h2><ul><li><p>Follows a clean line drawing: contours without the extra speckle of a raw Canny map.</p></li><li><p>Lets the prompt define identity, materials, clothing and style.</p></li><li><p>Works as a single-image control adapter for MOSS-Image-SFT.</p></li></ul><h2 id="tips">Tips</h2><ul><li><p>Sparse white lines on black match training better than a dense sketch.</p></li><li><p>Coarse realistic lineart is the preprocessor used for the release workflow.</p></li><li><p>Drawings and extracted lineart both work if the line weight stays light.</p></li><li><p>Lower the LoRA strength toward 0.7 if the control is too rigid. Strength 1.0 is the trained value.</p></li></ul><h2 id="use-cases">Use cases</h2><ul><li><p>Coloring a line drawing.</p></li><li><p>Turning a photo into a new scene that keeps the same line structure.</p></li><li><p>Design sketches where the drawing, not the lighting, should lead.</p></li></ul><p></p>

Files with SHA256: c32aa35e0ca1adb1a9c284ff81c84a848d50282368eca647dd15bce0c113878a