FedNLP icon indicating copy to clipboard operation
FedNLP copied to clipboard

Come up problems in Running Text Classification model with distilbert

Open MuleiOnline opened this issue 4 years ago • 2 comments

Our environment: Win10 During the installation, strictly follow the python version and configuration steps in the README.md file.

  1. When we run the test the dependencies command: python -m model.fed_transformers.test report an error: Some weights of the model checkpoint at distilbert-base-uncased were not used when initializing DistilBertForSequenceClassification: ['vocab_transform.weight', 'vocab_transform.bias', 'vocab_layer_norm.weight', 'vocab_layer_norm.bias', 'vocab_projector.weight', 'vocab_projector.bias']
  2. When we run Text Classification model with distilbert. Report an error: requests.exceptions.ProxyError: HTTPSConnectionPool(host='api.wandb.ai', port=443): Max retries exceeded with url: /graphql (Caused by ProxyError('Cannot connect to proxy.', OSError(0, 'Error'))) wandb: Network error (ProxyError), entering retry loop. wandb: Network error (ProxyError), entering retry loop. The specific error can be found in the file error_log.txt.error log.txt We have studied for a long time but have no clue, which is very confusing. Please give us some advice. Thank you!

MuleiOnline avatar Nov 03 '21 14:11 MuleiOnline

Sorry, I do not think we support for windows environment. Can you rent a server on Alibaba Cloud and try it there?

DeviRule avatar Dec 28 '21 00:12 DeviRule

Hi! We at FedML have launched a new platform for FedNLP. Can you please check whether you face the same issue there? Here is the new FedNLP platform: https://github.com/FedML-AI/FedML/tree/master/python/app/fednlp

MrigankRaman avatar Jul 14 '22 12:07 MrigankRaman