Ajay Patel

@ParikhKadam Yes, please. Could you make close the PR here and make it on GitLab. I will review it there and I can get it merged in! Thanks, that's great...

@ParikhKadam You should be able to go here https://gitlab.com/Plasticity/magnitude/merge_requests and hit 'New Merge Request'. Then, you should see a screen like this that lets you pick what source repository /...

Hi @zfang, Thanks for this PR, this likely broke at some point when I modified the underlying LRU cache. Sorry, I've been on travel for the last week or so,...

This import may also need updating: https://github.com/huggingface/setfit/blob/107ca56c8cf6f2d3e79e2519d7e5ec24a95ccc56/src/setfit/trainer.py#L20

This is possible to do on our [DataDreamer](https://datadreamer.dev/docs/latest/) package which can load vLLM in parallel (different models on different GPUs). It does this by always instantiating vLLM in a background...