mlx-swift-examples icon indicating copy to clipboard operation
mlx-swift-examples copied to clipboard
verified publisher icon ml-explore

Is it possible to support concurrency in model container

Open Remember2015 opened this issue 4 months ago • 10 comments

https://github.com/ml-explore/mlx-swift-examples/blob/42b0d21a607b97c3b99d1e20626b7d9b14827b81/Libraries/MLXLMCommon/ModelContainer.swift#L9

As comment above mentioned, now it is single thread access only, but in some cases, concurrency is really useful to speed up.

Thanks for reply

Remember2015 avatar Jul 16 '25 06:07 Remember2015