Ma Jiayu comments

Repositories
Issues
Comments

Results 2 comments of


                                            Ma Jiayu

Error happens when running examples with multi-gpu

@pacman100 using peft0.3.0.dev0 ``` DataParallel( (module): PeftModelForSequenceClassification( (base_model): LoraModel( (model): BloomForSequenceClassification( (transformer): BloomModel( (word_embeddings): Embedding(250880, 1024) (word_embeddings_layernorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) (h): ModuleList( (0-23): 24 x BloomBlock( (input_layernorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)...

LLaMA-7B-q4 inference only 4 threads are used

Thanks a lot.