dstack icon indicating copy to clipboard operation
dstack copied to clipboard
verified publisher icon dstackai

[Examples] Add TGI example

Open peterschmidt85 opened this issue 1 year ago • 5 comments

peterschmidt85 avatar Oct 01 '24 08:10 peterschmidt85

@peterschmidt85 could you please explain what I have to do in this issue?

theharshdadhich avatar Oct 04 '24 10:10 theharshdadhich

@peterschmidt85 can you explain in more detaill so that i can work on this issue i wanna contribute

wenayy avatar Oct 07 '24 01:10 wenayy

Clarify @peterschmidt85

k0msenapati avatar Oct 10 '24 13:10 k0msenapati

We have https://dstack.ai/examples The idea is to add there a category "Deployment" (similar to other categories, such as Fine-tuning, Accelerators, etc.) Under the "Deployment" category, we plan to add a card "TGI" which will lead to https://dstack.ai/examples/deployment/tgi - where must be an example of how to use TGI - similar and in style with other examples. What is not clear?

peterschmidt85 avatar Oct 10 '24 13:10 peterschmidt85

Keep in mind, if you want to work on example, this means you understand how both dstack and TGI work, and can use dstack to test the TGI example.

peterschmidt85 avatar Oct 10 '24 13:10 peterschmidt85

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] avatar Dec 04 '24 02:12 github-actions[bot]

Already implemented: https://dstack.ai/examples/deployment/tgi/

peterschmidt85 avatar Dec 04 '24 08:12 peterschmidt85