oci-data-science-ai-samples icon indicating copy to clipboard operation
oci-data-science-ai-samples copied to clipboard

Published 20 hours ago • verified publisher icon oracle-samples

Text generation inference needs version 1.1.0 or greated for mistral

Open revnav opened this issue 1 year ago • 0 comments
trafficstars

Mistral is not supported in v.0.9.3 since the model came with v1.1.0. Please fix these files:

model-deployment/containers/llm/inference-images/Makefile model-deployment/containers/llm/inference-images/tgi/Dockerfile.tgi

and make sure to pick up latest inference images from hugging face repo...

revnav avatar Feb 13 '24 23:02 revnav