milvus-io
[Feature]: Apple Silicone GPU (Metal Framework) & Apple Nural Engine (ANE)
Is there an existing issue for this?
- [X] I have searched the existing issues
Is your feature request related to a problem? Please describe.
Milvus can utilize NVIDIA/CUDA to enhance processing speed with GPU. Having Milvus running on M1/M2/M3/M4 ARM arhitecture can speedup development as many developers are using Apple macOS platform.
Describe the solution you'd like.
Run Milvus locally on macOS ARM64 architecture and utilize GPU (via Metal Framework) and ANE accelerators.
Describe an alternate solution.
Runing on servers with nvidia or CPU-only processing.
Anything else? (Additional Context)
No response
https://developer.apple.com/documentation/apple-silicon/cpu-optimization-guide
@qdrddr what is the use case? running vector db on laptop doesn't really make sense.
@xiaofan-luan it might make sense in the future, though
https://appleinsider.com/articles/24/05/07/secret-apple-project-acdc-to-pioneer-ai-chips-for-data-centers
Under the internal name "Project ACDC," Apple is developing Apple Silicon designed specifically for server farms dedicated to AI processing. The company aims to optimize AI applications within its data centers for future versions of its platforms.
@qdrddr what is the use case? running vector db on laptop doesn't really make sense.
What If it's a Maximum config of MaxStudio or Mac Pro with M2 Ultra and 196GB RAM available for GPU with 60 cores?