comfy_mtb icon indicating copy to clipboard operation
comfy_mtb copied to clipboard

feat: ✨ 3D Tools

Open melMass opened this issue 1 year ago • 1 comments

UV Tools

Some basic STMap related math and nodes for disorting images, could be used for many things from simple transforms, complex wraps, planar replacement in videos (currently looking into cotracker)

uvtools

3D Tools

Core 3D Toolset too allow I/O between JS and Python. For now the frontend (js) relies on threejs and the backend (python) on open3D, I'm building a POC engine in rust currently using WGPU with python bindings, very early work.

geotools

Inspirations

Some new extensions implement 3D it would be nice to adopt a similar/compatible approach:

melMass avatar Aug 12 '23 22:08 melMass

Wow, I love you. Slowly turning Comfy more and more into TouchDesigner (great source of inspiration if you've never heard of it), making my dreams come true.

It would be really amazing if there was a "Image to UV" node as well, so we could import our own displacement maps.

Eventually the ability to set borders as "mirror" or "extend" to the "Distort Image with UV" node would really great, to avoid black bits to appear/bleed into the image.

thelemuet avatar Aug 14 '23 20:08 thelemuet

This is all done in private extensions now, might open source some of it at some point

melMass avatar Aug 01 '24 14:08 melMass