qdrant icon indicating copy to clipboard operation
qdrant copied to clipboard

Standalone GPU docker images

Open TinyServal opened this issue 2 months ago • 0 comments

Is your feature request related to a problem? Please describe. It's possible to build qdrant with GPU support with cargo build --release --features gpu according to the docs. The Dockerfile currently only accepts amd or nvidia, so building a docker image that has GPU support without CUDA or ROCm doesn't seem to be supported. It would be nice to have a generic image for that.

Describe the solution you'd like

  • Accept something like generic for the GPU build argument in the Dockerfile, which installs the vulkan headers and builds qdrant with GPU support without bundling them in CUDA or ROCm images.
  • Optionally build this variant on CI as well so it can be offered on the container registry.

Describe alternatives you've considered There isn't one without giving up on the docker image.

Additional context ROCm is not strictly required to use vulkan on AMD GPUs, having the radv driver from mesa within the container is sufficient. The AMDVLK driver has already been discontinued, RADV is currently the vulkan driver recommended by AMD: https://github.com/GPUOpen-Drivers/AMDVLK/discussions/416.

TinyServal avatar Oct 19 '25 09:10 TinyServal