deep-learning-containers icon indicating copy to clipboard operation
deep-learning-containers copied to clipboard

[feature-request] TGI DLC requirements.txt

Open austinmw opened this issue 1 year ago • 0 comments

Checklist

  • [X] I've prepended issue tag with type of change: [feature]
  • [X] (If applicable) I've documented below the DLC image/dockerfile this relates to
  • [X] (If applicable) I've documented the tests I've run on the DLC image
  • [X] I'm using an existing DLC image listed here: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
  • [ ] I've built my own container based off DLC (and I've attached the code used to build my own image)

Concise Description: It doesn't seem that the HuggingFace TGI DLCs support a requirements.txt file? I've tried to upload one with my model package, but it isn't updating the transformers version.   DLC image/dockerfile: 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:2.0-transformers4.28-gpu-py310-cu118-ubuntu20.04

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] I'm not able to load a model with model.safetensors instead of pytorch_model.bin with the current transformers version

Describe the solution you'd like I'd like to be able to include a requirements file instead of needing to build a custom image

austinmw avatar Dec 14 '23 15:12 austinmw