ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

Published 20 hours ago • verified publisher icon comfyanonymous

CoreML intergration?

Open Maki9009 opened this issue 1 year ago • 2 comments

Any plans on allowing to run CoreML models on ur Ui? since Apple CoreML models run waay better than normal safetensors on mac.. much more faster

Maki9009 avatar Jul 07 '23 21:07 Maki9009

I would like to but I don't have a mac.

comfyanonymous avatar Jul 07 '23 23:07 comfyanonymous

I would like to but I don't have a mac.

Any way I could like help? In like being a tester or something like that? Cuz I just attempted to to generate on the SDXL model... took 45min to make 1 image. I know Coreml model doesn't exist for SDXL yet. But it would be soon and 1.5 generation are 50% faster on coreml on Mac

Maki9009 avatar Jul 07 '23 23:07 Maki9009

SDXL 1.0 will be officially supported on https://github.com/apple/ml-stable-diffusion soon, with optimized models for ANE. These can run directly from python via coremltools, so might be a good option for folks without a cuda device. Happy to help out with the integration

ZachNagengast avatar Jul 27 '23 17:07 ZachNagengast

@comfyanonymous is there a way now in ComfyUI to select backends? If so, a coreml backend wrapper can be plugged.

amitkot avatar Sep 07 '23 07:09 amitkot