Error encountered running DeepSpeedExamples/HelloDeepSpeed/train_bert.py

[jeyblu]

Error encountered running DeepSpeedExamples/HelloDeepSpeed/train_bert.py

$ python train_bert.py --checkpoint_dir ./experiments
Traceback (most recent call last):
  File "train_bert.py", line 9, in <module>
    import datasets
ModuleNotFoundError: No module named 'datasets'

[tjruwase]

@jeyblu, is this still a problem? Thanks!

[jeyblu]

Yes it's still a problem. Thanks.

[gugarosa]

It looks like that datasets package is missing from your current environment, which is specified in this requirements.txt file.

Did you do pip install -r requirements.txt prior to running python train_bert.py --checkpoint_dir ./experiments?