Bhimraj Yadav

Hi @aniketmaurya, It seems litserve already handle multiple specs, but the worker setup currently accepts only a single one. Do we have plans to support multiple/array of specs? ```python for...

> Hi @arkohut, > > You can add an additional endpoint by implementing a LitSpec API, similar to the [OpenAISpec](https://github.com/Lightning-AI/LitServe/blob/6bdd8f3ed29256e003140aeff109304f8f52dfeb/src/litserve/specs/openai.py#L260). Currently, it only takes a single spec. Oh, sorry! It...

Hi @arkohut, agreed on the multi-endpoints feature, but not sure if it's in the plan. I did a quick hack for this, though it’s not perfect since the extra endpoints...

Thanks so much, @lantiga, for the great idea! I’m excited about the direction and look forward to doing some research and making a contribution to it.

Sure, @aniketmaurya! I'll start drafting a PR. Also, I do have a few confusions related to it, but I'll first review the details to gain a clearer understanding and then...

Closing due to inactivity 🙂 Feel free to reopen if the issue persists or if more details become available.

Hi @JackUrb, we recently added a few fixes related to cache clearance. It's not released yet, but available on the `main` branch—feel free to give it a try and let...

> Hi [@bhimrazy](https://github.com/bhimrazy) - launching a new run on litdata `main` this week, will report back. Thank you @JackUrb

Thank you, @JackUrb, for the detailed follow-up. If possible, could you also share a bit more about your training setup? Specifically: - Number of nodes - Number of CPU cores...

Thank you again, @JackUrb — this is really helpful. Just a few more clarifications if you don't mind: 1. Could you share the approximate number of `StreamingDataset`s used in the...