bert icon indicating copy to clipboard operation
bert copied to clipboard

Errors when pre-training Bert on local GPU

Open suchunxie opened this issue 2 years ago • 1 comments

I got this error "ImportError: cannot import name 'trace' from 'tensorflow.python.profiler" when runing [python run_pretraining.py]. My environment is anaconda, with tensorflow-gpu==1.15.0, python==3.9.7.

I did't do something particular, just git clone google/bert, and cd bert, then python run_pretraining.py.. I downgraded the tensorflow-estimator from 2.4.0-->1.15.1. But the proplem still on.

Can anyone be help? Much appreciated.

suchunxie avatar Jun 07 '22 10:06 suchunxie

I solved this problem by referenced others blogs. (sorry I forgot the link.) I tried many envs on conda with different kinds of tensorflow-gpu and python's combination, but its all failed. The only method workable it's tensorflow-gpu=1.11.0(which original bert team applied), and python=3.6

suchunxie avatar Jun 14 '22 06:06 suchunxie