llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

completion() for tgi

Open dineshyv opened this issue 1 year ago • 0 comments

test plan:

PROVIDER_ID=test-tgi PROVIDER_CONFIG=tests/inference/provider_config_example.yaml MODEL_IDS="Llama3.2-1B-Instruct" pytest -s tests/inference/test_inference.py --tb=short --disable-warnings -rs

dineshyv avatar Oct 23 '24 19:10 dineshyv