Adding an example of NIM

[deep-diver]

trafficstars

Adding an example of NIM

[Bihan]

Hey @deep-diver,

1. I’ve created a sample README.md that follows dstack's structure. Please note that it assumes the reader is already familiar with NIM. Feel free to update it accordingly.
2. I tested the sample configuration with a 24GB GPU, and it worked. Kindly update the GPU requirement to 24GB.
3. Could you also provide the source-code for the development environment (.dstack.yml), task (task.dstack.yml), and service (service.dstack.yml)

Thanks!

[deep-diver]

@Bihan cc: @peterschmidt85

Sorry for delayed response, and thanks for the comments.

• 2. update 48GB to 24GB is done
• 3. provided service.dstack.yml since I wrote this for only deployment purpose with service.

for the first point, your README.md assumes the reader is already familiar with NIM like you said. But, I think giving a bit about the background to readers never hurts anything. Actually, I think it is a good thing.

However, if you think this violates dstack's blogging/writing policy, and this MUST be modified accordingly, feel free to adjust the contents.

[r4victor]

@deep-diver, @Bihan what's the status of this PR? Should we merge it?

[Bihan]

@deep-diver, @Bihan what's the status of this PR? Should we merge it?

@r4victor I will adjust the content till tomorrow morning and let you know.

[deep-diver]

I think this is ready to be merged cc: @peterschmidt85