# Score to Screen — One prompt → one song → a 1–4 scene music video (YuE2 × MiniMax H3)Write one prompt and pick your images. You get an original song made with YuE2 and a music video of 1 to 4 scenes made with MiniMax H3. The singer lip-syncs, the band plays along with the music, and every scene change lands exactly on a bar line.v4.0 Simple: only 5 switches. Everything else is automatic, or set to the values that worked best.---## ⚠ CUSTOM NODES ARE NOT IN COMFYUI MANAGER21 of the nodes come from 4 custom node packages in custom_nodes_en_<a target="_blank" rel="ugc" href="http://v4.0.zip">v4.0.zip</a> (included in the download). Manager can't find them; that is normal. Install them by hand:1. Close ComfyUI.2. Unzip, then copy the 4 folders directly into ComfyUI/custom_nodes/: ComfyUI-PromptSplitter / ComfyUI-ABCTiming / ComfyUI-ABCScoreIO / ComfyUI-ABCInstrumentalize ✅ ComfyUI/custom_nodes/ComfyUI-PromptSplitter/__init__.py ❌ ComfyUI/custom_nodes/custom_nodes_en_v4.0/ComfyUI-PromptSplitter/... (one folder too deep, the nodes stay red)3. Install demucs into ComfyUI's Python: portable: .\python_embeded\python.exe -m pip install demucs4. "Image Saver Save Video" is ComfyUI-Image-Saver; install it from Manager.5. Restart ComfyUI.Still red? Look for "IMPORT FAILED" in the console at startup and paste that error in the comments.---## 🎬 WHAT IT DOES- One prompt, two models: a local LLM (LM Studio) splits your prompt into YuE2 style tags and lyrics, plus an H3 video prompt for each scene- One song, 1–4 scenes: YuE2 writes a single song. H3 renders each scene from its own image, and the scenes are joined while the song plays straight through (no audible seam)- Choose the scene count each run: 1 scene this time, 4 the next. Unused scenes don't run at all- The score drives the picture: YuE2 also writes an ABC sheet-music plan. The workflow reads its tempo, time signature and chords, then turns them into timed cues in each scene's H3 prompt ("At 4s the vocals come in, and at the same moment…")- Bar-accurate cuts: every scene change snaps to the start of a bar- Band performance: write who plays what ("the white-haired woman plays the drums") and each player gets cues- 🥁 Drum sync: an on-screen drummer follows the song's real drums. It tries STRUM (optional AI transcription) first, then the Demucs drum stem, then the score- Drum cues are written in a way H3 can actually draw: fills as one sweep across the kit, big crashes, a few strong accents- 🎹 Piano sync: an on-screen pianist follows the song's real key strikes (STRUM + Basic Pitch, optional)- Singing on screen: auto / yes / no. A song can have vocals while nobody on screen lip-syncs- Instrumentals: write "Instrumental." The workflow then: - removes the lyrics - moves the vocal melody to an instrument in the score - keeps everyone's mouth closed- Skips the intro automatically: vocal onset detection (Demucs) starts the clip just before the singing, and leaves enough song for all your scenes- Use your own songs: - load a song you made earlier; its .abc score is saved next to it and loaded automatically - ▶ Start at lets you begin from the chorus, or any second you choose- A/V sync: H3's motion lags the sound by about 0.2 s, so the final audio is shifted to match. You can adjust this- Run log inside the workflow: - 📺 Runs so far adds one line per run: video file name, seeds, steps, memo - queue several runs, walk away, and check later which video came from which seed - the log is also saved as a CSV- Civitai-ready output: the MP4 is saved with metadata (the prompts of every scene used, YuE2 style and lyrics, H3 + YuE2 model hashes)## ⚙️ HOW IT FLOWS1. Prompt Splitter (LLM): makes the YuE2 style and lyrics, plus one H3 prompt per scene2. YuE2: writes the ABC score, then sings the song (skipped when you pick a pre-made song)3. Vocal onset detection: trims the song, then cuts the scenes on bar lines4. ABC Timing: adds tempo, chord and band cues to each scene's H3 prompt5. H3 ref2va: renders scene 1…N, one per image. The scenes are joined, the song is laid over them, and the video is savedThe internals are packed into subgraphs. Day to day, you only touch the input panel and the 🎛 switches.## 🎛 THE 5 SWITCHES- ⚡ Turbo: fast drafts (off = 20 steps)- 🎤 On-screen singing: auto / yes / no- 🥁 Drum sync: auto / off (piano sync follows this switch too)- 🎵 Song delay: seconds of silence at the start of the video- 🎬 Scene count: 1–4Seeds (video, vocals, score) can be locked separately in the 🎲 Seed details group. Rarely used settings live in 🔧 Details:- bar snapping- longest scene length- drum cue style- A/V sync- song volume curve## 📦 REQUIREMENTSCustom nodes (my own, included in the download; not in ComfyUI Manager, see ⚠ above):- ComfyUI-PromptSplitter: prompt split and vocal onset. Run pip install demucs in ComfyUI's Python- ComfyUI-ABCTiming: score → rhythm, band, drum and piano cues- ComfyUI-ABCInstrumentalize: instrumental score and bar-snapped scene cuts (1–4 scenes)- ComfyUI-ABCScoreIO: switches, saving and loading scores, pre-made songs, run log, A/V sync, scene picturesOther custom nodes:- ComfyUI-Image-Saver (final save with Civitai metadata; install it from Manager)Models:- diffusion_models: minimax_h3_ref2va_pruned_int8_convrot- loras: minimax_h3_ref2v_turbo_4step (⚡ Turbo)- text_encoders: qwen3vl_32b_minimax_h3_nvfp4_awq- vae: minimax_h3_video_vae_fp16, minimax_h3_audio_vae_fp32- checkpoints: yue2_3b_bf16 or yue2_3b_int8_convrotLLM: LM Studio (or another OpenAI-compatible server). Load a vision model (Qwen2.5-VL, Qwen3-VL, Gemma 3…) so the LLM can see your images. A text-only model works too, but it can't look at the pictures.Optional: STRUM, for more precise drum and piano sync. A setup guide is included. Without it, the workflow uses Demucs or the score.## 🚀 QUICK START1. Copy the four custom node folders directly into ComfyUI/custom_nodes (see ⚠ above), install demucs and ComfyUI-Image-Saver, then restart ComfyUI2. Start LM Studio's server (default <a target="_blank" rel="ugc" href="http://127.0.0.1:1234/v1">http://127.0.0.1:1234/v1</a>)3. Write scene 1's text: the scene AND the song (mood, genre, vocals or "Instrumental.")4. Write the text for the other scenes: the scene only5. Choose your images and the seconds for each scene. Set the 🎬 scene count; for 3–4 scenes, also fill in the 🎛 ①b group6. Run. Check the 📺 previews: the scene cuts, the detected start, the prompts H3 got, and Runs so far## 💡 TIPS- Prompts can be English or Japanese. Add "Lyrics in English." to be sure of the lyric language- "Instrumental break" or "instrumental solo" in a song with vocals is fine; it stays a song- For a band, always write who plays what- Turbo LoRA ON for drafts, OFF for final renders- Scene length: the default limit is 15 s (max_scene_sec in 🔧 Details); up to 24 s has worked- For a long song, 4 shorter scenes usually look better than 2 long ones. H3 runs once per scene, so 4 scenes take about 4× as long- Fine finger work is still hard for H3: avoid long close-ups of hands- Resolution: multiples of 32, short side up to 768 (1024×768 recommended)- English and Japanese versions of the workflow are both included## 🗂 ALSO INCLUDED: v2.34 Full / LegacyThe older "every option" workflow is still in the download and uses the same custom nodes. Use it if you need the modes the Simple line dropped:- H3-made music (fl2va)- song only- sound effects only- frozen audio- 17 switches with fine settings---Version history- v4.0: choose 1–4 scenes (🎬 scene count switch)- v3.8: drum cues H3 can draw- v3.7: piano sync- v3.6: A/V sync- v3.4 / v3.5: run log in the workflow- v3.2: ▶ Start at for pre-made songs- v3.0: the new Simple line (4 switches)- v2.4: first public release

One prompt → one song → a two-scene music video (YuE2 × MiniMax H3)

# Score to Screen v4.0 Simple — Changelog (from v3.7)One prompt → an original song + a 1–4 scene music video (YuE2 × MiniMax H3)This update has two parts:- v3.8: drum cues that H3 can actually draw- v4.0: choose 1 to 4 scenes per run (one scene this time, four the next) without changing workflowsWith the scene count left at 2, the workflow works like before.---## 🎬 v4.0: choose 1 to 4 scenes- 🎛 ② Switches gets a 5th switch, 🎬 Scene count (1–4, default 2) - 1: one scene from image 1 only. Scene 2's LLM split and H3 don't run at all - 2: the same as before - 3 / 4: fill in image 3 / 4, the scene 3 / 4 text and its seconds in the new 🎛 ①b group- Unused scenes are skipped completely: no LLM split, no H3 run, no check saves. Their image can stay at <code>(none)</code> and their text can stay as it is- If a scene within the count has no picture, the run stops with a clear message: "🖼 Scene N: no picture selected"### 🎼 Timing for every scene- Every cut snaps to a bar line. The new 🎬 Snap the scene cuts to bars (1–4 scenes) node works the same way as the 2-scene cut. With 2 scenes it gives exactly the same result- The vocal onset check uses the total length of all the scenes you use. The start moves earlier only when the scenes would run past the end of the song- Works with pre-made songs and ▶ Start at, the same as before- Rhythm / playing cues and lyric timing follow each scene's own start- STRUM (drum and key transcription) still runs once per song. Later scenes reuse scene 1's result, so extra scenes add no STRUM time### 🏷 Civitai metadata- The saved prompt contains only the scenes you used, joined with <code>[Scene 2]</code> … <code>[Scene 4]</code> headings- A skipped scene never blocks the final save### 🔁 Other changes- Image 2 now uses the new 🖼 Scene picture node, like images 3 and 4. When you open v4.0 for the first time, pick image 2 again- 📺 New previews for scenes 3 and 4: the prompt H3 received, plus an H3-only check video- Corrected the in-workflow notes: a scene is not limited to 15 s. The limit is <code>max_scene_sec</code> in 🔧 Details (default 15 s; 24 s scenes have worked)## 🥁 v3.8: drum cues H3 can draw- What we found from v3.7 videos: - H3 doesn't tell a snare from a tom - it can't follow one hit every 0.25 s, or 16 timed hits per shot - the drummer's sticks stayed on the same front drums- New in 🔧 Details: 🥁 Drum cue style, default simple - A fill is one simple sentence: "both sticks sweep across the drums from left to right, then a big swing onto the crash cymbal" - Up to 3 big accent hits per shot (at least 1.5 s apart) replace the long kick / snare list - No drum names (high tom etc.) - Times come from STRUM or Demucs when available (e.g. the crash), otherwise from the score- detailed brings back the v3.7 style, so you can compare## 💡 Tips- H3 runs once per scene, so 4 scenes take about 4× the time of one scene- For a long song, 4 shorter scenes (12–14 s) usually look more stable than 2 long ones- Write who plays what in every scene's text (e.g. "the white-haired woman plays the drums")## 📦 Requirements / How to update- custom_nodes v4.0 (included zip): - ComfyUI-PromptSplitter v2.12 - ComfyUI-ABCTiming v2.21 - ComfyUI-ABCScoreIO v1.24 - ComfyUI-ABCInstrumentalize v1.4- Replace your old folders with these, then restart ComfyUI. Full install steps are in <code>README.md</code> inside the zip- The v3.8 (2-scene) and v2.34 Full / Legacy workflows still open with these nodes- STRUM is optional, as before. Piano sync (v3.7) still needs Basic Pitch; see section 3b of the STRUM guide- The JA and EN versions of the workflow are both included

Files with SHA256: 1b1b138317edbdbe3c65363eb8a39761ff07de9763b98d06614b334b9ccae286