text-generation-inference
text-generation-inference copied to clipboard
Image for arm64 (Macbook Pro)
System Info
Which image should I use on Macbook Pro? I can't find arm64 image. Please see the below error I'm having:
1 warning found (use docker --debug to expand):
- InvalidBaseImagePlatform: Base image ghcr.io/huggingface/text-generation-inference:sha-f3c5d7d@sha256:7c169c536de65dbdb867302aedf9ad0a7472df5d7c7dfd85c080037215b18c16 was pulled with platform "linux/amd64", expected "linux/arm64" for current build (line 1)
Containerfile:67
I'm trying to install it using NVIDIA AI Workbench.
Information
- [X] Docker
- [ ] The CLI directly
Tasks
- [ ] An officially supported command
- [ ] My own modifications
Reproduction
Clone https://github.com/NVIDIA/workbench-example-hybrid-rag using NVIDIA AI Workbench on Macbook Pro
Expected behavior
The environment is built successfully.