comfy_mtb
comfy_mtb copied to clipboard
feat: ✨ 3D Tools
UV Tools
Some basic STMap related math and nodes for disorting images, could be used for many things from simple transforms, complex wraps, planar replacement in videos (currently looking into cotracker)
3D Tools
Core 3D Toolset too allow I/O between JS and Python. For now the frontend (js) relies on threejs and the backend (python) on open3D, I'm building a POC engine in rust currently using WGPU with python bindings, very early work.
Inspirations
Some new extensions implement 3D it would be nice to adopt a similar/compatible approach:
- The awesome ComfyUI-TripoSR
- ComfyUI-3D-Pack
Wow, I love you. Slowly turning Comfy more and more into TouchDesigner (great source of inspiration if you've never heard of it), making my dreams come true.
It would be really amazing if there was a "Image to UV" node as well, so we could import our own displacement maps.
Eventually the ability to set borders as "mirror" or "extend" to the "Distort Image with UV" node would really great, to avoid black bits to appear/bleed into the image.
This is all done in private extensions now, might open source some of it at some point