<h1 id="complete-guide:-next-scene-generation-from-images-in-comfyui">🎨 Complete Guide: Next Scene Generation from Images in ComfyUI</h1>This workflow enables the creation of sequential scenes (next scene generation) based on an input image while preserving composition, style, and atmosphere. Perfect for creating comics, storyboards, book illustrations, and visual storytelling. Developed on the Qwen Image Edit foundation using specialized LoRA adapters for ultra-fast generation in just 4 steps! 📦 Required Components Before Starting<h3 id="1.-required-models-(mandatory!)">1. Required Models (mandatory!)</h3>Download and place in the specified folders: 📂 ComfyUI/└── 📂 models/ ├── 📂 diffusion_models/ │ └── qwen_image_edit_2509_fp8_e4m3fn.safetensors ├── 📂 loras/ │ ├── Qwen-Image-Lightning-4steps-V1.0.safetensors │ └── next-scene_lora_v1-3000.safetensors ├── 📂 vae/ │ └── qwen_image_vae.safetensors └── 📂 text_encoders/ └── qwen_2.5_vl_7b_fp8_scaled.safetensors Download Links:<ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/Qwen-Image-Edit_ComfyUI/tree/main/split_files/diffusion_models">Diffusion Model</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/lightx2v/Qwen-Image-Lightning/resolve/main/Qwen-Image-Edit-2509/Qwen-Image-Edit-2509-Lightning-4steps-V1.0-bf16.safetensors">LoRA for Speed (4 steps)</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/lovis93/next-scene-qwen-image-lora-2509/blob/main/next-scene_lora_v1-3000.safetensors">LoRA for Next Scenes</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI/resolve/main/split_files/text_encoders/qwen_2.5_vl_7b_fp8_scaled.safetensors">Text Encoder</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI/resolve/main/split_files/vae/qwen_image_vae.safetensors">VAE</a></li></ul><h3 id="2.-hardware-requirements">2. Hardware Requirements</h3><ul><li>Minimum: GPU with 8 GB VRAM</li><li>Recommended: GPU with 12+ GB VRAM (RTX 3080/4080 or better)</li><li>Disk space: ~3.5 GB for all models</li><li>RAM: 16+ GB</li></ul><hr /><h2 id="step-by-step-setup-and-usage-instructions">🛠️ Step-by-Step Setup and Usage Instructions</h2><h3 id="step-1:-import-workflow-into-comfyui">Step 1: Import workflow into ComfyUI</h3><ol><li>Save the JSON code to a file named <code>next_scene_generation.json</code></li><li>Open ComfyUI in your browser</li><li>Right-click on empty space → Load → select the saved file</li><li>The workflow will automatically load with correct settings</li></ol><h3 id="step-2:-upload-source-image">Step 2: Upload Source Image</h3><ol><li>Find the group "Step 2 - Upload image for editing" (left side of interface)</li><li>Click on the <code>LoadImage</code> node (pink block)</li><li>Press the <code>📁 Choose an image to upload</code> button</li><li>Select an image from your computer<ul><li>Supported formats: PNG, JPG, JPEG, WEBP</li><li>Recommended sizes: from 512×512 to 1280×720 pixels</li><li>Tip: The higher the quality of the source image, the better the result</li></ul></li></ol><h3 id="step-3:-load-models">Step 3: Load Models</h3><ol><li>Verify all models are correctly installed in ComfyUI folders</li><li>In the "Step1 - Load models" group, ensure:<ul><li>In the <code>UNETLoader</code> node, model <code>qwen_image_edit_2509_fp8_e4m3fn.safetensors</code> is selected</li><li>In the <code>CLIPLoader</code> node, select:<ul><li>Model: <code>qwen_2.5_vl_7b_fp8_scaled.safetensors</code></li><li>Clip Type: <code>qwen_image</code></li></ul></li><li>In the <code>VAELoader</code> node, model <code>qwen_image_vae.safetensors</code> is selected</li></ul></li><li>If any models aren't loaded, restart ComfyUI after installation</li></ol><h3 id="step-4:-configure-lora-adapters-(critically-important!)">Step 4: Configure LoRA Adapters (critically important!)</h3><ol><li>In the first <code>LoraLoaderModelOnly</code> node:<ul><li>Select <code>Qwen-Image-Lightning-4steps-V1.0.safetensors</code></li><li>Strength Model: <code>1.0</code> (maximum influence)</li></ul></li><li>In the second <code>LoraLoaderModelOnly</code> node:<ul><li>Select <code>next-scene_lora_v1-3000.safetensors</code></li><li>Strength Model: <code>0.8</code> (recommended value for balance)</li></ul></li><li>Important: Do not change the order of LoRA adapter application! First Lightning, then next-scene.</li></ol><h3 id="step-5:-craft-your-prompt-(key-step!)">Step 5: Craft Your Prompt (key step!)</h3><ol><li>Find the <code>TextEncodeQwenImageEditPlus</code> node (blue block)</li><li>In the prompt input field, enter text starting with "Next Scene:" Example of a correct prompt:<pre><code>Next Scene: The camera holds a tight close-up on the man's face as he lies in bed, eyes open. His head rests near the lower right corner of the frame, with the pillow sketched in soft, curved lines. The rest of the canvas is empty, emphasizing the quiet of morning.</code></pre> Rules for effective prompts:<ul><li>Always start with "Next Scene:" (mandatory requirement for LoRA)</li><li>Specify camera direction: "close-up", "wide shot", "medium shot", "low angle"</li><li>Describe lighting: "morning light", "dramatic shadows", "soft golden hour glow"</li><li>Indicate atmospheric changes: "light morning mist", "gentle breeze moving the curtains"</li><li>Maintain continuity: mention elements from the source image</li><li>Use specific details: character poses, object placement, emotions</li></ul></li><li>For negative prompt (in the <code>CLIPTextEncode</code> node):<ul><li>Leave empty for basic version</li><li>Or add: <code>deformed, blurry, low quality, distorted perspective, extra limbs</code></li><li>Recommended CFG value: <code>1.0</code> (very low due to LoRA specifics)</li></ul></li></ol><h3 id="step-6:-verify-image-dimensions">Step 6: Verify Image Dimensions</h3><ol><li>The <code>GetImageSize</code> node will automatically determine dimensions of your source image</li><li>The <code>EmptySD3LatentImage</code> node creates latent space of the same size</li><li>Important: If you want to change aspect ratio, manually replace width/height values in the <code>EmptySD3LatentImage</code> node, disconnecting the input links</li></ol><h3 id="step-7:-configure-generation-parameters">Step 7: Configure Generation Parameters</h3><ol><li>Find the <code>KSampler</code> node (orange block)</li><li>Check key parameters:<ul><li>Steps: <code>4</code> (do not change, this is optimal value for LoRA)</li><li>CFG: <code>1.0</code> (very low, but critical for quality)</li><li>Sampler: <code>euler</code></li><li>Scheduler: <code>simple</code></li><li>Noise Seed: <code>randomize</code> (or specify a number for reproducibility)</li></ul></li><li>Warning from workflow: Do not arbitrarily increase Steps and CFG values! This will disrupt LoRA adapter functionality.</li></ol><h3 id="step-8:-start-generation">Step 8: Start Generation</h3><ol><li>Click the QUEUE PROMPT button (top right corner of interface)</li><li>Monitor progress in the ComfyUI console:<ul><li>First models load (~10-15 seconds)</li><li>Then generation runs (typically 5-15 seconds on RTX 3090/4090)</li></ul></li><li>Finished image appears in the <code>SaveImage</code> node on the right side</li><li>Result is automatically saved to folder <code>ComfyUI/output/ComfyUI/</code></li></ol><hr /><h2 id="tips-for-achieving-best-quality">🎯 Tips for Achieving Best Quality</h2><h3 id="1.-prompting-rules-for-next-scenes">1. Prompting Rules for Next Scenes</h3>For maximum continuity between frames:<ul><li>Start with camera description: <code>"Next Scene: The camera slowly pulls back to reveal..."</code> <code>"Next Scene: Switching to a low angle shot, we see..."</code></li><li>Preserve key elements: <code>"Next Scene: Maintaining the same warm sunset lighting, the character now stands near a window..."</code></li><li>Specify character movement: <code>"Next Scene: The woman has turned her head slightly to the left, her expression now showing concern..."</code></li><li>Avoid radical changes: don't completely change setting, lighting style, or angle unnecessarily</li></ul><h3 id="2.-hardware-optimization">2. Hardware Optimization</h3><ul><li>For weak GPUs (8 GB VRAM):<ul><li>Reduce source image resolution to 768×512</li><li>Disable preview in the <code>SaveImage</code> node</li></ul></li><li>For powerful GPUs (24+ GB VRAM):<ul><li>Can increase resolution to 1280×720</li><li>Use batch size=2 for parallel generation of variants</li></ul></li></ul><h3 id="3.-common-problems-and-solutions">3. Common Problems and Solutions</h3><ul><li>Problem: Blurry or fuzzy results Solution: Ensure you're using correct VAE (<code>qwen_image_vae.safetensors</code>), check source image quality</li><li>Problem: No connection between source image and result Solution: Strengthen description in prompt, adding specific details from source frame</li><li>Problem: Artifacts or distortions Solution: Reduce strength of second LoRA to 0.6-0.7</li><li>Problem: "CUDA out of memory" Solution: Reduce image resolution or restart ComfyUI to clear memory</li></ul><h3 id="4.-advanced-techniques">4. Advanced Techniques</h3><ul><li>Creating mini-animations (3-5 frames):<ol><li>Generate first next scene</li><li>Save result and upload as new source image</li><li>Modify prompt, adding movement description: <code>"Next Scene: Continuing the movement, the character now..."</code></li></ol></li><li>Style blending:<ul><li>Add to prompt style instructions: <code>in the style of impressionist painting</code>, <code>with cinematic bokeh</code></li><li>Experiment with second LoRA strength (0.5-1.0) to control style influence</li></ul></li><li>Creating panoramic scenes:<ul><li>Use prompt: <code>"Next Scene: The camera pans horizontally to reveal..."</code></li><li>Post-process generated image through panorama stitching tools 🌟 Examples of Effective Prompts<h3 id="for-angle-change:">For angle change:</h3><pre><code>Next Scene: The camera pulls back to a medium shot, revealing the character standing on a cliff edge overlooking a misty valley at dawn. The morning sun casts long shadows behind him, highlighting the texture of his coat. The composition maintains the same left-to-right balance as the previous scene.</code></pre><h3 id="for-continuing-action:">For continuing action:</h3><pre><code>Next Scene: Following the character's movement, we now see him stepping through an ancient stone archway into a sunlit garden. The camera angle remains consistent, but the lighting shifts to warm afternoon tones. Butterflies flutter around blooming flowers in the foreground, maintaining the soft dreamlike atmosphere of the previous frame.</code></pre><h3 id="for-time-of-day-change:">For time of day change:</h3><pre><code>Next Scene: The scene transitions to night time. The same character sits by a window, but now illuminated only by candlelight and moonbeams. Outside, stars are visible in the clear night sky. The camera maintains the same close-up framing, but the color palette shifts to deep blues and warm yellows, preserving the emotional tone of quiet contemplation.</code></pre><pre><code></code></pre><hr /></li></ul></li></ul><h2 id="conclusion-and-best-practices">🚀 Conclusion and Best Practices</h2>This workflow represents a revolutionary approach to visual storytelling creation. Here are the key principles for success:<ol><li>Source image quality is critical – use clear, well-lit photos</li><li>Prompting is an art – practice writing detailed, continuous descriptions</li><li>Respect technical limitations – 4 steps and CFG=1.0 aren't arbitrary, they're optimum for LoRA</li><li>Experiment with lighting and angles, not radical content changes</li><li>Save intermediate results for creating sequential stories</li></ol>Pro tip: For creating full comics or storyboards:<ul><li>Generate 3-5 sequential frames</li><li>Export them to software like Photoshop or Canva</li><li>Add speech bubbles, transitions, and color correction</li><li>Save as PDF or PNG sequence for animation</li></ul><hr />🎉 Congratulations! You now possess a powerful tool for generating visual stories. Start with simple scenes and gradually increase complexity. Remember: best results come from deep understanding of workflow capabilities and meticulous prompt crafting.P.S. Don't forget to experiment! Try uploading screenshots from favorite movies and imagine what the next frame of this story would look like. Inspiration often comes during the creative process! ✨🎬

Files with SHA256: 7b1619313ca01393abacca7490ff366e51caf6cd1c2dd4071aa92c2b87aed3b6