<h1 id="moss-image-sft-openpose-dwpose-control-lora">MOSS-Image-SFT — OpenPose / DWPose Control LoRA</h1><h2 id="short-description">Short description</h2><p>An OpenPose Control LoRA for <strong>MOSS-Image-SFT</strong>. Feed a DWPose skeleton on a black background. The model follows the body pose, and the prompt sets the character, clothing and scene.</p><p>This is a ControlNet-style <strong>edit LoRA</strong>, not the official MOSS color/depth concat adapter. Load it with a LoRA loader and pass one control image through <strong>Text Encode MOSS-Image Edit</strong>.</p><p>Selected checkpoint: training step <strong>4500</strong>.</p><h2 id="files">Files</h2><ul><li><p><strong>Weights:</strong> <a target="_blank" rel="ugc" href="https://huggingface.co/thedeoxen/MOSS-Image-pose-controlnet/blob/main/moss_image_sft_pose_control_lora.safetensors">moss_image_sft_pose_control_lora.safetensors</a></p></li><li><p><strong>ComfyUI workflow:</strong> <a target="_blank" rel="ugc" href="https://huggingface.co/thedeoxen/MOSS-Image-pose-controlnet/blob/main/moss_image_pose_control.json">moss_image_pose_control.json</a></p></li><li><p><strong>Repo:</strong> <a target="_blank" rel="ugc" href="https://huggingface.co/thedeoxen/MOSS-Image-pose-controlnet">thedeoxen/MOSS-Image-pose-controlnet</a></p></li></ul><h2 id="examples">Examples</h2><p>Each preview is one combined image, left to right: <strong>control</strong>, then three prompts.</p><h2 id="extended-description">Extended description</h2><p>Follows body, hand and face keypoints from an OpenPose / DWPose skeleton. Appearance, materials, clothing and the world come from the text prompt.</p><p>The LoRA is rank 64 on linear layers and rank 16 on convolutions. It was trained as an edit adapter: the control image is the reference, and the prompt describes the picture to generate.</p><h2 id="how-to-use">How to use</h2><ol><li><p>Load <strong>MOSS-Image-SFT</strong>: UNet <code>moss_image_sft_int8_convrot.safetensors</code>, text encoder <code>qwen3.5_9b_w4a8_gptq.safetensors</code> with type <code>moss_image</code>, VAE <code>flux2-vae_small.safetensors</code>.</p></li><li><p>Load this LoRA on the UNet at strength <strong>1.0</strong>.</p></li><li><p>Build the control map and pass it as the single reference image in <strong>Text Encode MOSS-Image Edit</strong>.</p></li><li><p>Set <strong>edit format</strong> to <code>ai-toolkit</code> on both the positive and the negative encode. This LoRA was trained with kv cache on.</p></li><li><p>Sample with <strong>30 steps</strong>, <strong>CFG 4</strong>, <code>euler</code> + <code>simple</code>.</p></li></ol><p>No trigger word. The control image sets the structure. The prompt sets identity, materials, clothing and the world.</p><h2 id="comfyui">ComfyUI</h2><p>The workflow in this repo loads a photo, builds the control map, encodes it with the prompt, and samples.</p><p>The included workflow extracts the skeleton with <strong>DWPose</strong> (body, hands and face enabled) via <a target="_blank" rel="ugc" href="https://github.com/Fannovel16/comfyui_controlnet_aux">comfyui_controlnet_aux</a>. A colored skeleton on a black background matches the training controls.</p><p>Also uses the built-in <strong>Text Encode MOSS-Image Edit</strong> node. Set the edit format to <code>ai-toolkit</code>.</p><h3 id="base-model">Base model</h3><p>Trained on and recommended with <a target="_blank" rel="ugc" href="https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT"><strong>OpenMOSS-Team/MOSS-Image-SFT</strong></a>.</p><p>Typical settings from the included workflow: <strong>30 steps</strong>, <strong>CFG 4</strong>, <code>euler</code> + <code>simple</code>, LoRA strength <strong>1.0</strong>.</p><p>Negative prompt used in training samples:</p><pre><code>nsfw, worst quality, bad anatomy, watermark, jpeg artifact</code></pre><h3 id="example-prompt">Example prompt</h3><pre><code>Two glass-winged night-market spirits sitting on a wet curb, one leaning against the other, bare glass feet in the street, neon signs behind, both bodies entirely in frame.</code></pre><h2 id="what-it-does">What it does</h2><ul><li><p>Follows body, hand and face keypoints from an OpenPose / DWPose skeleton.</p></li><li><p>Lets the prompt define identity, materials, clothing and style.</p></li><li><p>Works as a single-image control adapter for MOSS-Image-SFT.</p></li></ul><h2 id="tips">Tips</h2><ul><li><p>Black background, colored bones, face and hands included.</p></li><li><p>If a limb is missing in the skeleton, the prompt cannot reliably invent that joint.</p></li><li><p>Describe the character and the world. The skeleton already carries the pose, so the prompt does not have to repeat every joint.</p></li><li><p>Lower the LoRA strength toward 0.7 if the control is too rigid. Strength 1.0 is the trained value.</p></li></ul><h2 id="use-cases">Use cases</h2><ul><li><p>Posing a character while changing outfit and style.</p></li><li><p>Turning a photo's pose into another person.</p></li><li><p>Keyframes and storyboards where the body has to match.</p></li></ul><p></p>

Files with SHA256: f6f19bfd69be592d229b080e2a5b8388724f939795dac7233a454b08985d80ef