bikash119

icon indicating an email [email protected]

Results 43 comments of bikash119

[Examples] Add vLLM example

Apologies for being a noob here. Under `Deployment` category means, to provide vllm as a serverless inference service on dstack?

[Examples] Add vLLM example

Ok, so under `Deployment` , we should have 2 examples shown - How to use vLLM for `service` - How to use vLLM for `task` Does this sound ok?

[Examples] Add vLLM example

Thank you @peterschmidt85 for being patient with my questions.

[Examples] Add vLLM example

@peterschmidt85 : I have made the required changes. Verifed by executing `mkdocs serve`

[Examples] Add TensorRT-LLM example (end-to-end)

@peterschmidt85 : May I take this up?

[Examples] Add TensorRT-LLM example (end-to-end)

Thank you @peterschmidt85 for giving me the heads up. Will give it a try and keep you posted on how it goes. May I request you to point to any...

[Examples] Add TensorRT-LLM example (end-to-end)

Thank you @peterschmidt85.

[Hacktoberfest 2024] How to contribute

Created a new issue #1759. Will raise PR soon.

[FEATURE] add `llama-cpp` to `distilabel.embeddings`

@davidberenstein1957 : Can I take a stab at it?

[EXAMPLE] Add `CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation` example

hi @plaguss : Can I take this up?