swift-coreml-diffusers Not running on a 2017 MacBook Pro

I’m trying run the following setup:

App version: Version 1.1 (20230222.140932), from the App Store
model: stability/stable-diffusion-2-base or the 2.1 model
13-inch, 2017 MacBook Pro: - Processor: 2.3 GHz Dual-Core Intel Core i5 - Graphics: Intel Iris Plus Graphics 640 1536 MB - Memory: 16 GB 2133 MHz LPDDR3
macOS: 13.2.1 (Ventura)

What I did:

I downloaded from the App Store, ran the app, waited for it to install the default initial model, and then hit generate to generate an image with all default prompt and settings. It says “Preparing Model” and then says “Generation Error” and when I hit info the error message says it’s from com.apple.CoreML domain and that the error message is “Error computing NN outputs”. I got the same error when I switched to the 2.1 model, waited for it to download, and tried to generate with it.

Is this configuration expected to work?

Feb 26 '23 21:02 algal

Hello, @algal! I have the feeling that 1.5 GB of GPU RAM won't be enough to run the model, but I haven't been able to test on such a configuration myself. There are some tricks that could be applied for memory reduction (model offloading to CPU), but I'm not sure if they will be enough. I can create a test build that exposes an advanced setting to enable it and see if it works. Another option would be to just use the CPU in this case, but I'm afraid it would be too slow.

Did you try the smaller OFA-Sys/small-stable-diffusion model? It's a distilled model whose quality is not as good as Stable Diffusion's, but it uses a smaller UNet.