bark.cpp Support iOS and Android?

Hi, Is it possible to support iOS and Android? General guidelines on how you'd approach that.

Thanks, Hussain

Nov 12 '23 17:11 hussain-mustafa990

Hi @hussain-mustafa990 !

This should be possible, but I doubt the model would be very fast even with quantized weights.

Apr 10 '24 13:04 PABannier

@PABannier did you know sono later published a small model variant too?

Apr 11 '24 09:04 Green-Sky

Oh no, I did not know that. Well, there are many things to do, lol. Bark Small, Audiocraft, AudioLDM2, Piper/Vits, etc. I'll try to have a look this week-end

Apr 11 '24 12:04 PABannier

FYI, I just merged instructions to run bark-small with bark.cpp. This model should be more suited for mobile platforms, provided we support CoreML.

Apr 20 '24 13:04 PABannier

Very nice, will test it later!

Apr 20 '24 13:04 Green-Sky

Very nice, will test it later!

@Green-Sky Have you tried it yet? I'm very curious. I am considering to try leveraging bark.cpp in an open source project of mine. If anyone could confirm that this small model is running, with okay'ish speed, on your average mid-range (or otherwise high-end) phone 🤔 🤠 - that'd be awesome. Thanks

May 21 '24 09:05 BrutalCoding

Hello @BrutalCoding ! There is a demo of Bark.cpp running on the iPhone.

May 22 '24 09:05 PABannier