Alvaro Bartolome

Yes that's right @vrdn-23, I'll validate and approve ✅

Hey @vrdn-23 awesome thanks! I'll release a patch with some fixes this week, then start merging some PRs for v1.9.0 including this one 🤗

> In Reference > API Reference > HTTP API Reference > OpenAI Messages API > Cloud Provider, I would just point to https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/call-vertex-using-openai-library#supported-model-garden-models Agree @pagezyhf, also the AWS SageMaker section...

> I wonder if it would be good to have separate sections in the Getting Started bar for AWS and GCP. It is an important feature that seems very hidden....

Hey @danielealbano, thanks for the changes, I'll take a look and test those over the week (as I just got back from a 2-week break), thanks for the contribution (and...

Hi here @BeylasanRuzaiqi, so that's most likely because you didn't specify the model id or path properly; could you check that the `$model` variable contains the actual model name? [Here's...

Could you try to just run `text-generation-launcher --model-id meta-llama/Meta-Llama-3.1-8B-Instruct`, not sure if that's something related to the variable handling? Additionally, could you just send the `ls -la` output of the...

Are you running via Docker? Or are you inside an instance with TGI? Could you clean `/data`, then run `text-generation-launcher --model-id meta-llama/Meta-Llama-3.1-8B-Instruct`, and after that share the logs? Thanks!

Hi @BeylasanRuzaiqi thanks for sharing the logs! So apparently the `--model-id` arg is properly picked now, but you have something else deployed within the same host being 0.0.0.0 on the...

Could you share the full stack trace of the error @BeylasanRuzaiqi? Thanks in advance 🤗