2D IMG/Video to 180°/360° real 3D Stereoscopic conversion Experiment
Just drag and drop the images in Comfyui for the workflow or in your MetaQuest/Apple VR to test.
step 1
changing the regular 2D image/video Perspective to Panoramic image
https://github.com/9nate-drake/ComfyUI-PanoTools
https://github.com/nomadoor/ComfyUI-Panorama-Stickers
Step 2: First Frame Out painting to 180°
use flux or SDXL to out paint
Flux fill model
https://huggingface.co/yichengup/flux.1-fill-dev-OneReward/tree/main
360 panorama flux Lora
https://github.com/Insta360-Research-Team/DiT360
https://huggingface.co/Insta360-Research/DiT360-Panorama-Image-Generation/tree/main
https://huggingface.co/crafiq/flux-2-klein-9b-360-panorama-lora
https://huggingface.co/kalle07/FLUX.2-klein-9B-turbo-lora-set/tree/main
https://huggingface.co/nomadoor/flux-2-klein-9B-360-erp-outpaint-lora/tree/main
360 images dataset to train your own lora
https://huggingface.co/datasets/Insta360-Research/Matterport3D_polished
Flux-klein
https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9b-fp8/tree/main
Text-Encoder
https://huggingface.co/Comfy-Org/vae-text-encorder-for-flux-klein-9b/tree/main/split_files
VAE
https://huggingface.co/Comfy-Org/vae-text-encorder-for-flux-klein-9b/tree/main/split_files/vae
WAN-VACE for video out painting
https://huggingface.co/QuantStack/Wan2.2-VACE-Fun-A14B-GGUF/tree/main
https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/vae
OTHER links
https://huggingface.co/rehan-fal/minimax-h3-vr180-sbs-lora
Pls buy me 8X B200s ;(
Description
v1
Comments (4)
Hi. Thanks for posting but I'm not seeing any 3D effect in your example images. As far as I can tell, both eyes are getting exactly the same image. Can you clarify if this lora should produce pictures with actual 3D depth?
You can see there is 3D, check the left and right edges ; they're all different, that's where depth comes from 🪵🐸🪵
Thanks for getting back to me. I've tried both cross-eyed (probably not how these are configured) and parallel SBS view on my PC and I'm not seeing any 3D at the centre (or the edges for that matter). I'll copy a few of these across to my Quest headset to see what it looks like there and will report back. Perhaps, if it's a relatively subtle 3D effect, it will spring to life on a VR headset.
It only works on your VR headset. Also make sure to turn on 3D, side-by-side, 180°, when you view it on the app that you are using. Otherwise you won't see the effect.