petals

petals copied to clipboard

Ways to view: total GPU capacity, total GPU utilization, and personal speedup on public Petal Network?

1

Really cool project! Feels like it has the potential to be a game-changer for poor students like myself 😮 Does anyone know how/where to view the following statistics of the...

davidleejy

Running on SLURM

4

Having to specifically hard code IP adresses makes it very hard to run petals on a SLURM cluster. There I submit batch jobs that are then run on some node...

ghost

Is it possible to run on macos?

6

The primary motivation, is - to get as much high bandwidth memory, in a low cost way (thanks to its unified memory model) - to be easily used for training...

PicoCreator

Inference issues on Volta-based swarm

6

Hello folks, Trying to run a private swarm on a 7x Volta-generation GPUs. As suggested by docs, i've set torch_dtype to float16 and NUM_BLOCKS to 10 (these are 32GB GPUs)...

barsuna

* task_pool * [x] remove interate_minibatches, once https://github.com/learning-at-home/hivemind/pull/506 is merged * [ ] batch sequences of similar length * runtime * [x] do not log "0 parameters" on init (misleading)...

justheuristic

Roadmap (tentative)

4

__Current tasks:__ - [ ] prototype bloom points system @borzunov (#6 ) - [x] local tensor parallelism ( #143 , using [BlackSamorez/tesnor_parallel](https://github.com/BlackSamorez/tensor_parallel) by @blacksamorez and @IaroslavLisniak ) - [x] increase...

justheuristic

artek0chumak

max token input token length

3

[in consultation with @mryab] The max input token length is 2048 right now. It would be nice to process more than 2048 tokens through the distributed BLOOM. Increasing the max...

barthfab

This PR is intended as a backup if we experience any problems with finetuning in the current branch. TL;DR previously we tested that finetuning works with compression as in this...

justheuristic

Automatic test for failed backward

1

dbaranchuk