I have 12 gb of VRAM 4070 and 32 GB of RAM, with this workflow i never get OOM, as long as you don't go past 864 x 573 in resolution ( from my testing ).

I solely use this workflow on comfyUI v0.3.49 as the newer version i almost guarantee to get Invalid Cast and Black Screen in every Generation that i do :(