preemware
preemware
I made a mistake. I believe the intent of the function was to return as a `Iterable[dict[str, Any]]`. I can make this change.
Referencing the original documentation. The intent appears to have it return as `Iterable[dict[str, Any]]` into `dict_to_elements`. If it returned as just a list, the code might not work as intended....
Same problem. Entire balance was wiped from ``` 2024-02-09 21:00:26.435 [5hhq44ockiqu67] [info] OSError: /models/huggingface-cache/hub/models--anthonylx--Proximus-2x7B-v1/snapshots/43bf1965176b15634df97107863d4e3972eecebb does not appear to have a file named config.json. Checkout 'https://huggingface.co//models/huggingface-cache/hub/models--anthonylx--Proximus-2x7B-v1/snapshots/43bf1965176b15634df97107863d4e3972eecebb/None' for available files. 2024-02-09 21:00:26.435...
> This is why we abandoned the serverless VLLM worker. We are now using a custom TGI serverless worker that hasn't experienced this issue. Link? Because I've lost a lot...
> > Same problem. Entire balance was wiped from > > ``` > > > > 2024-02-09 21:00:26.435 > > > > [5hhq44ockiqu67] > > > > [info] > >...
> We will be adding a maximum number of worker restarts and job length limits to RunPod Serverless next week, this should solve the issue. Thank you. This would solve...