Mohammad Yousuf issues

Repositories
Issues
Comments

Results 1 issues of


                                            Mohammad Yousuf

Unable to load on multiple GPUs using HuggingFace Transformers

When I try to load on multiple GPUS, I get the following error: tokenizer = AutoTokenizer.from_pretrained('BAAI/bge-reranker-base') model = AutoModelForSequenceClassification.from_pretrained('BAAI/bge-reranker-base', device_map='auto') error: `RuntimeError: Expected all tensors to be on the same...