DONT USE THIS
It was a fun run. I2V proper is released, download that. I'll leave this up only for a weird old initial way of janking a i2v process before it was released
Final version! (probably)
V4 introduces the Refinement speed hack (works great with a guiding video which depthflow uses)
Flux re-enabled
More electrolytes!
This I think is where I will stop. I have had a lot of frustrating fun playing with this and my other backend workflow for the speed hack, but I think this is finally at a place I am fairly okay with. I hope you enjoy it and post your results down below. If there are problems (always problems), post in the comments also. I or others will try to help out.
Alright Hunyuan. balls in your court. how about the official release to make this irrelevant. We're all doing this janky workarounds, so just pop it out already. btw, if you use this for your official workflow, cut me a check, I like eating.
btw, check out the other workflow on here, the leapfusion thing It actually works pretty well. less control over what you're going for, but closer to the original picture. both are cool to have.
Final update: (HA!)
Added Hunyuan Refiner step for awesomeness
Streamlined
Minor update:
V3.1 is more about refining.
Removed Reactor (pulled from Github
Removed Flux (broken)
Removed Florence (huge memory issue)
Denoodled
Added a few new options to depthflow.
V3: ITS THE FINAL COUNTDOWN!
Alright, this is probably enough. someone else get creative and go from here, but I think I am done messing around with this overall and am happy with it...(until I am not. Come on Hunyuan...release the actual image 2 video)
Anyhow, tweaks and thangs:Added in Florence for recommendation prompt (not attached, just giving you suggestions if you have it on for the hunyuan bit)
Added switches for turning things on and off
More logical flow (slight overhead save)
Shrink image after Depthflow for better preservation of picture elements
Made more stroking colors (Follow the black) and organization for important settings areas
Various tweaks and nudges that I didn't note.
V2:
More optimized, a few more settings added, some pointless nodes removed, and overall a better workflow. Also added in optional Flux group if you want to use that instead of XL
Added in also some help with Teacache (play around with that for speed, but don't go crazy with the thresh..small increments upwards)
Anyhow, give this a shot, its actually pretty impressive. I am not expecting much difference between this vs whenever they come out with I2V natively...(hopefully theirs will be faster though, the depthflow step is a hangup)
Thanks to the person who tipped me 1k buzz btw. I am not 100% sure what to do with it, but that was cool!
Anyhow
(NOTE: I genuinely don't know what I am doing regarding the HunyuanFast vs Regular and Lora. I wrote don't use it, and that remains true if you leave it on the fast model..but use it if using the full model. Ask for others, don't take my word as gospel. consider me GPT2.0 making stuff up. all I know is that this process works great for a hacky image2video knockoff)
XL HunYuan Janky I2V DepthFlow: A Slightly Polished Janky Workflow
This is real Image-to-Video. It’s also a bit of sorcery. It’s DepthFlow warlock rituals combined with HunYuan magic to create something that looks like real motion (well, it is real motion..sort of). Whether it’s practical or just wildly entertaining, you decide.
Key Notes Before You Start
Denoising freedom. Crank that denoising up if you want sweeping motion and dynamic changes. It won’t slow things down, but it will alter the original image significantly at higher settings (0.80+). Keep that in mind. Even with 80+, it'll still be similar to the pic though.
Resolution matters. Keep the resolution (post XL generation) to 512 or lower in the descale step before it shoots over to DepthFlow for faster processing. Bigger resolutions = slower speeds = why did you do this to yourself?
Melty faces aren’t the problem. Higher denoising changes the face and other details. If you want to keep the exact face, turn on Reactor for face-swapping. Otherwise, turn it off, save some time, and embrace the chaos.
DepthFlow is the magic wand. The more steps you give DepthFlow, the longer the video becomes. Play with it—this is the key to unlocking wild, expressive movements.
Lora setup tips.
Don’t use the FastLoRA—it wont work using the fast Hunyuan model which is on by default. Use it if you change the model though
Load any other LoRA, even if you’re not directly calling it. The models use the LoRA’s smoothness for better results.
For HunYuan, I recommend Edge_Of_Reality LoRA or similar for realism.
XL LoRAs behave normally. If you’re working in the XL phase, treat it like any other workflow. Once it moves into HunYuan, it uses the LoRA as a secondary helper. Experiment here—use realism or stylistic LoRAs depending on your vision.
WARNING: REACTOR IS TURNED OFF IN WORKFLOW!
(turn on to lose sanity or leave off and save tons of time if you're not partial to the starting face)
How It Works
Generate your starting image.
Be detailed with your prompt in the XL phase, or use an image2image process to refine an existing image.
Want Flux enhancements? Go for it, but it’s optional. The denoising from the Hunyuan bit will probably alter most of the Flux magic anyhow, so I went with XL speed over Flux's clarity, but sure, give it a shot. enable the group, alter things, and its ready to go. really just a flip of a switch.
DepthFlow creates movement.
Add exaggerated zooms, pans, and tilts in DepthFlow. This movement makes HunYuan interpret dynamic gestures, walking, and other actions.
Don’t make it too spazzy unless chaos is your goal.
HunYuan processes it.
This is where the magic happens. Noise, denoising, and movement interpretation turn DepthFlow output into a smooth, moving video.
Subtle denoising (0.50 or lower) keeps things close to the original image. Higher denoising (0.80+) creates pronounced motion but deviates more from the original.
Reactor (optional).If you care about keeping the exact original face, Reactor will swap it back in, frame by frame.If you’re okay with slight face variations, turn Reactor off and save some time.
Upscale the final result.
The final step upscales your video to 1024x1024 (or double your original resolution).
Why This Exists
Because waiting for HunYuan’s true image-to-video feature was taking too long, and I needed something to tinker with. This (less) janky process works, and it’s a blast to experiment with.
Second warning:
You're probably gonna be asked to download a bunch of nodes you don't have installed yet (DepthFlow, Reactor, and possibly some others). Just a heads up.
Final Thoughts
This workflow is far from perfect, but it gets the job done. If you have improvements, go wild—credit is appreciated but not required. I just want to inspire people to experiment with LoRAs and workflows.
And remember, this isn’t Hollywood-grade video generation. It’s creative sorcery for those of us stuck in the "almost but not quite" phase of technology. Have fun!
Description
Removed Reactor
Removed Flux (sadly. couldn't get it to work)
Removed Florence
De-noodled
Streamlined
Added in a leprechaun (hidden)
FAQ
Comments (29)
nice work! appreciate the effort!
Thanks. Glad you're enjoying the flow. The work of course goes to DepthFlow and Hunyuan guys...I am a simple guy slapping nodes together to see what happens, then dancing around when something cool is a result (ignore the 10 disasters to the 1 interesting result). Always hated Comfy...until I didn't.
@saturngfx yeah the same here i feel like we are dumps while doing this :(
Thank you very much! Everything is great, but I have a small request.
Instead of the classic upscale, we would like to see an upscale using hunyan technology and a refiner. This would significantly improve the quality!
Sounds cool, but at the cost of even more delay? My other workflow (Janky Lightning) gives (for me) over 2 times faster speed from prompt to video than other workflows out there without quality loss because for me, speed is key to rendering. 5 second video in 2.5 minutes, or 50 seconds type thing, which is better if the output is the same.
But thanks for the suggestion, and I will in fact test some..perhaps an optional node. Got a workflow you would refer to that nails the upscaling?
Also..."we"? (just found that curious)
@saturngfx
here you are, there it is present,but unfortunately there is no XL and dephimage. With these settings, there would be no price) The quality of the upscale is really impressive, and then the details are added. I was pleasantly surprised to see the first render.
@dirtysem tested it a bit, yeah, that is quite the upgrade...I'll see what I can do. gotta find that right mix of speed vs quality...but it seems pretty fast. doing test runs now and optimizing.
@saturngfx
Thank you for paying attention to this issue. If you do this, the result will be amazing.
@dirtysem Oh, I am already sold. this is going in all my things, just tweaking and messing with it...its outstanding by comparison. not a fake upscale, but a full detailer. new fan here.
@dirtysem new model has the good stuff :)
any chance to add the link for the power lora ?
edge of reality please?
and the upscale model ?
https://civitai.com/models/1129944/edge-of-reality-amateur-styles-body-types-concepts-hyvid-hunyuan-video-lora
power lora? you mean the fastvideo lora?
https://civitai.com/models/1063735/hunyuan-fastvideo-fp8-accelerated-hunyuanvideo-6-10steps-lora
and upscale
https://openmodeldb.info/models/2x-realesrgan-x2plus
thanks
May be a runpod issue, i am not sure, i keep getting Depthflow
libEGL.so not loaded
I...yeah, no clue. umm..does depthflow run on its own? just try a blank canvas. just XL and depthflow.
@saturngfx after some research, and some chatgpt, i found that running "apt update && apt install -y libegl1-mesa libglvnd-dev libglvnd0" in terminal of runpod fixes the issue!
still not sure how vid2vid works here. do i have to have both T2V and V2V groups running to get V2V?
not following. can you clarify? I don't, in this workflow, have a video 2 video option. you sure you're commenting under the right workflow?
Generally speaking, for a video, you will need either XL group or your own image to upload. in the toggle, choose which one, either XL or image 2 video...make sure your number reflects what you're using.
Then just make sure depthflow and hunyuan are turned on. upscaler optional.
Also, if you are using your own image verses XL, its best to shut the XL group off.
Hey brother I know I am dumb, I am also new to comfy, i get it to go through depthflow, but it never hooks into hunyuan, and yes is clicked on all options.
So, you get a depthflow video, but then what, does it show it simply stops (job complete) after it produces the depthflow video?
@saturngfx Sorry, had to log on to another account, as I am on my mobile, but yeah, no error or anything. Just simple says complete and goes to Idle. I confirmed it did the same on my actual Desktop as well. I was testing it on 12gb cloud and my desktop has 12gb, but doesnt come up with any error.
The only thing I changed was the model for sdxl, using pony, but had the same result with sdxl. I plugged in the same Hunyuan models as well. Hope this helps. Thanks for your time. If i get it working Ill post to let everyone know in case they run into the same issue.
@jamesmanx842 so no error or anything, just...like its off? hmm. is the group on or bypassed? might want to delete and redownload and save noodle troubleshooting? sounds like something possibly detached (although the console would say something about that).
@jamesmanx842 Confirm the get model and set model for hunyuan are connected
@atradsfasdfasdf Grab the new update and see if everything is fixed.
@saturngfx After reading about the TeaCache issue, in your latest version, i fixed it and it worked. It doesnt work on my 12GB 3060 or whatever I have, but after switching it with a GGUF it worked! Thanks for your hard work and helping me along the way. It is truly appreciated!
@jamesmanx842 Thanks. I am not an expert here, or even good at this...kinda dumb really, but trying to support as best I can. I am finding the people using this are actually helping me troubleshoot :)
We are all beta testers for Hunyuan I guess.
thanks for the update I'm trying to test it and I'm using this version but keep saying that the tea cache node is missing
you will need to install the missing nodes of course, but also, I had an issue with teacache not sending over values (seems its a thing), so alter the teacache to reflect on, 0.15 and 4 steps. there is one in the main hunyuan area, and another down in the refiner.
I have no clue why the values don't auto transfer
yeah i had to remove the current nodes and add new ones and link them again, seems you have to update to this version
https://github.com/facok/ComfyUI-TeaCacheHunyuanVideo

