dstack icon indicating copy to clipboard operation
dstack copied to clipboard

[Examples] Add NVIDIA Nim example

Open peterschmidt85 opened this issue 1 year ago • 6 comments

peterschmidt85 avatar Oct 01 '24 08:10 peterschmidt85

Hi @peterschmidt85 ,

I’ve worked with NVIDIA Nim before and would love to take on this issue. Could you please assign it to me?

AKASH722 avatar Oct 02 '24 16:10 AKASH722

Hi @peterschmidt85 ,

I’ve worked with NVIDIA Nim before and would love to take on this issue. Could you please assign it to me?

Would be great!

We'd like to have it as a separate example under the Deployment category (in addition to other categories such as Fine-tuning, Accelerators, etc.).

The example should feature most essential information around using NIM with dstack.

Note, dstack allows to use NIM with both tasks and services. Should we show both, also explaining briefly the difference?

peterschmidt85 avatar Oct 02 '24 16:10 peterschmidt85

@AKASH722 Contributing to documentation might be tricky as we don't explain how to do this. Let me know if you need help with it.

peterschmidt85 avatar Oct 02 '24 17:10 peterschmidt85

The sourcecode must be in examples/examples/deployment/nim/README.md (it's copied to the docs when docs are built). See other cards on https://dstack.ai/examples/ to follow the structure and style.

peterschmidt85 avatar Oct 02 '24 17:10 peterschmidt85

Thanks, @peterschmidt85!

I’ll add the example to examples/examples/deployment/nim/README.md and follow the structure from dstack. I’ll include both tasks and services, with a brief explanation.

I’ll reach out if I need help with the docs.

AKASH722 avatar Oct 02 '24 17:10 AKASH722

@peterschmidt85 do you need all the examples in the frontend UI of the website here - https://dstack.ai/examples/ ? If yes I would like to make changes

ishpreet36752 avatar Oct 06 '24 06:10 ishpreet36752

#1853

r4victor avatar Nov 13 '24 06:11 r4victor