llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

Docker compose scripts for remote adapters

Open yanxi0830 opened this issue 1 year ago • 0 comments

Script Usage

$ cd scripts/docker/tgi
$ ls
compose.yaml  tgi-run.yaml
$ docker compose up

Expected output

  • TGI container is spawn up in port 5009
  • Llama Stack connects to TGI server image

yanxi0830 avatar Oct 12 '24 01:10 yanxi0830