llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

docker images are too large

Open nikolaydubina opened this issue 1 year ago • 2 comments

how come docker image is 9GB?

this is not model itself, right?

it is odd to have docker image 20x larger than model itself (e.g. 1B/3B INT4)

image

nikolaydubina avatar Oct 16 '24 07:10 nikolaydubina