GPU acceleration for palletizattion

Open 0seba opened this issue 2 months ago • 1 comments

would help a lot to speed up compression. my current plan is to use nvidia gpu since they have more compute, but support for apple silicon gpus would probably be useful for more people. also i know it is currently possible to compress weights externally, but i think it is more user friendly to integrate in the cto api

Oct 10 '25 13:10 0seba

Please give us some more details here. How big is your model? What are you trying to do? What code are you running to do that? How long is it taking? What are the rough specs of the machine you are using?

Oct 10 '25 16:10 TobyRoseman