Alexander Borzunov

@barsuna, I'll launch the conversion procedure on one of our machines. It also has limited bandwidth, so this may take a couple of days.

Hi @sa1utyeggs, The actual `past_key_values` are stored on servers and can't be viewed from clients at the moment. In theory, it's possible to extend the server to send them when...

Hi @limcheekin @amit4aws, Sorry, we didn't have a time to have a closer look yet. Are you sure that the code keeps an open Petals inference session and doesn't rerun...

Relevant discussion in Discord:

@slush0 on Discord: > Regarding this feature request, I have one comment/idea: It would be great to be able to set "family" of the node and use this set as...

For the record: it is easy to set up a new bootstrap peer on port 80 (accessible from HF Spaces) but it won't help because Petals servers ran by users...

See also this space made by @slush0: https://huggingface.co/spaces/slush0/petals-bloom-playground It uses the websocket API `http://chat.petals.ml/api/v2` instead of running the Petals client directly.

Hi @roy-shih, We have just released v1.1.3 with multiple bug fixes, could you please try running prompt tuning again? If it doesn't help, please share the full logs (the error...

Hi @scuty2000! The server already has a flag for the cache dir, its name is `--cache_dir`. Regarding the flag to only use already cached blocks, could you please clarify why...

@tijszwinkels No worries, thanks for taking the time to help anyway!