Convert flat videos to VR workflow: here
PLEASE READ: for 2.0: all you have to do is upscale and apply depth via Custome nodes
for 1.0: Download my Custome nodes and use the workflow thats in it to fix the video so its usable in VR. Despite my best efforts this dosnt work right out of the box but the good news is you can just drop it in the video cropper and then apply the Depth. you'll see the nodes in my workflow.
also i created a git because i plan to update it with essential tools to make VR videos so follow me on here or my patreon for updates.
TL/DR:
my custom nodes in repo
use workflow to fix video in said repo
crop in half then apply depth.
meta data already applied if used SBS
????
profit in VR
Anyway, as always, if you like what I do and want to support the work, feel free to buy me a coffee โ
https://ko-fi.com/aidepository35
or support me on patreon
https://www.patreon.com/c/aitrepreneur/posts
So many of you have been asking for a 180 degree version of this lora so i made one. i had a difficult time finding flat panoramas to use for the training data but there was an abundance of them in cross eyed format.
for the videos made you can just crop the video in half, upscale it, then re-apply the cross eyed depth. I'm sorry i couldn't make this an easy one click but i do plan on improving this lora in the future if it dose well.
Actually from testing it out i kind of realized i can literally just crop half of it and train another model on that. maybe i'll give it a shot later.
important links:
https://github.com/google/spatial-media/releases
https://github.com/Ragamuffin20/MuffinsVRFixes/tree/main
Rant:
Dude wtf man this lora took 4 god dam days to train and i almost gave up because my run pod timed out and i thought i lost all the data for a second. Like you guys have no idea how mad i was. 4 days in and $50 almost down the drain but luckily everything was saved on the volume disc. i really whish it would automatically create identical cross eyed videos and tbh it probably would have with more training but i cant afford it tbh. 0.40 cents an hour adds up to alot if your training something for days straight. actually funny thing, i was using the A40 to trian it and still had to toggle low vram and offloading. but yeah here yall go, hope you can make some cool things.
Description
Now its just a panoramic and needs depth applied
FAQ
Comments (4)
Coming back to pano180 with depth is actually going a step back. True VR vids need both eyes :/
No actually this is a goood think because now you have thinf single pano that you can upscale and then after you upscale it you can apply the depth weather that be cross eyed or etc. the duo panel ver kept coming out unsynced so youd be forced to cut it in half anyway. this way you can skip that process and just upscale it and apply the depth
This is amazing! Thanks so much for doing this! <3
Glad you like it, lmk if you have any feedback