google-research
code error in version of tensorflow?
Hello google research~ Thanks for code for big bird. But i've got in trouble with the code. Below is the error message in terminal
my python version is 3.9.7 and version of packages are in below.
if you have a answer for this problem, please let me know ..
---------------------------------------VERSION OF PACKAGES----------------------------------------------------
Name Version Build Channel
_libgcc_mutex 0.1 main
_openmp_mutex 4.5 1_gnu
absl-py 0.12.0 pypi_0 pypi
aiohttp 3.8.1 pypi_0 pypi
aiosignal 1.2.0 pypi_0 pypi
ale-py 0.7.3 pypi_0 pypi
astunparse 1.6.3 pypi_0 pypi
async-timeout 4.0.1 pypi_0 pypi
attrs 21.2.0 pypi_0 pypi
bigbird 0.0.1 pypi_0 pypi
blessings 1.7 py39h06a4308_1002
bz2file 0.98 pypi_0 pypi
ca-certificates 2021.10.26 h06a4308_2
cachetools 4.2.4 pypi_0 pypi
certifi 2021.10.8 py39h06a4308_0
charset-normalizer 2.0.8 pypi_0 pypi
chex 0.1.0 pypi_0 pypi
click 8.0.3 pypi_0 pypi
cloudpickle 2.0.0 pypi_0 pypi
configparser 5.1.0 pypi_0 pypi
cycler 0.11.0 pypi_0 pypi
datasets 1.16.1 pypi_0 pypi
decorator 5.1.0 pypi_0 pypi
dill 0.3.4 pypi_0 pypi
dm-tree 0.1.6 pypi_0 pypi
docker-pycreds 0.4.0 pypi_0 pypi
dopamine-rl 3.2.1 pypi_0 pypi
filelock 3.4.0 pypi_0 pypi
flask 2.0.2 pypi_0 pypi
flatbuffers 2.0 pypi_0 pypi
flax 0.3.6 pypi_0 pypi
fonttools 4.28.2 pypi_0 pypi
frozenlist 1.2.0 pypi_0 pypi
fsspec 2021.11.1 pypi_0 pypi
future 0.18.2 pypi_0 pypi
gast 0.4.0 pypi_0 pypi
gevent 21.8.0 pypi_0 pypi
gin-config 0.5.0 pypi_0 pypi
gitdb 4.0.9 pypi_0 pypi
gitpython 3.1.24 pypi_0 pypi
google-api-core 2.2.2 pypi_0 pypi
google-api-python-client 2.31.0 pypi_0 pypi
google-auth 2.3.3 pypi_0 pypi
google-auth-httplib2 0.1.0 pypi_0 pypi
google-auth-oauthlib 0.4.6 pypi_0 pypi
google-pasta 0.2.0 pypi_0 pypi
googleapis-common-protos 1.53.0 pypi_0 pypi
gpustat 0.6.0 pyhd3eb1b0_1
greenlet 1.1.2 pypi_0 pypi
grpcio 1.42.0 pypi_0 pypi
gunicorn 20.1.0 pypi_0 pypi
gym 0.21.0 pypi_0 pypi
h5py 3.6.0 pypi_0 pypi
httplib2 0.20.2 pypi_0 pypi
huggingface-hub 0.2.0 pypi_0 pypi
idna 3.3 pypi_0 pypi
importlib-metadata 4.8.2 pypi_0 pypi
importlib-resources 5.4.0 pypi_0 pypi
itsdangerous 2.0.1 pypi_0 pypi
jax 0.2.25 pypi_0 pypi
jaxlib 0.1.74 pypi_0 pypi
jinja2 3.0.3 pypi_0 pypi
joblib 1.1.0 pypi_0 pypi
keras 2.7.0 pypi_0 pypi
keras-preprocessing 1.1.2 pypi_0 pypi
kfac 0.2.0 pypi_0 pypi
kiwisolver 1.3.2 pypi_0 pypi
ld_impl_linux-64 2.35.1 h7274673_9
libclang 12.0.0 pypi_0 pypi
libffi 3.3 he6710b0_2
libgcc-ng 9.3.0 h5101ec6_17
libgomp 9.3.0 h5101ec6_17
libstdcxx-ng 9.3.0 hd4cf53a_17
markdown 3.3.6 pypi_0 pypi
markupsafe 2.0.1 pypi_0 pypi
matplotlib 3.5.0 pypi_0 pypi
mesh-tensorflow 0.1.19 pypi_0 pypi
mpmath 1.2.1 pypi_0 pypi
msgpack 1.0.3 pypi_0 pypi
multidict 5.2.0 pypi_0 pypi
multiprocess 0.70.12.2 pypi_0 pypi
natsort 8.0.0 pypi_0 pypi
ncurses 6.3 h7f8727e_2
nltk 3.6.5 pypi_0 pypi
numpy 1.21.4 pypi_0 pypi
nvidia-ml 7.352.0 pyhd3eb1b0_0
oauth2client 4.1.3 pypi_0 pypi
oauthlib 3.1.1 pypi_0 pypi
opencv-python 4.5.4.60 pypi_0 pypi
openssl 1.1.1l h7f8727e_0
opt-einsum 3.3.0 pypi_0 pypi
optax 0.1.0 pypi_0 pypi
optimizers 2.1 pypi_0 pypi
packaging 21.3 pypi_0 pypi
pandas 1.3.4 pypi_0 pypi
pathtools 0.1.2 pypi_0 pypi
pillow 8.4.0 pypi_0 pypi
pip 21.2.4 py39h06a4308_0
promise 2.3 pypi_0 pypi
protobuf 3.19.1 pypi_0 pypi
psutil 5.8.0 py39h27cfd23_1
pyarrow 6.0.1 pypi_0 pypi
pyasn1 0.4.8 pypi_0 pypi
pyasn1-modules 0.2.8 pypi_0 pypi
pygame 2.1.0 pypi_0 pypi
pyparsing 3.0.6 pypi_0 pypi
pypng 0.0.21 pypi_0 pypi
python 3.9.7 h12debd9_1
python-dateutil 2.8.2 pypi_0 pypi
pytz 2021.3 pypi_0 pypi
pyyaml 6.0 pypi_0 pypi
readline 8.1 h27cfd23_0
regex 2021.11.10 pypi_0 pypi
requests 2.26.0 pypi_0 pypi
requests-oauthlib 1.3.0 pypi_0 pypi
rouge-score 0.0.4 pypi_0 pypi
rsa 4.8 pypi_0 pypi
sacremoses 0.0.46 pypi_0 pypi
scikit-learn 1.0.1 pypi_0 pypi
scipy 1.7.3 pypi_0 pypi
sentencepiece 0.1.96 pypi_0 pypi
sentry-sdk 1.5.0 pypi_0 pypi
setuptools 58.0.4 py39h06a4308_0
setuptools-scm 6.3.2 pypi_0 pypi
shortuuid 1.0.8 pypi_0 pypi
six 1.16.0 pyhd3eb1b0_0
sklearn 0.0 pypi_0 pypi
smmap 5.0.0 pypi_0 pypi
sqlite 3.36.0 hc218d9a_0
subprocess32 3.5.4 pypi_0 pypi
sympy 1.9 pypi_0 pypi
tensor2tensor 1.15.7 pypi_0 pypi
tensorboard 2.7.0 pypi_0 pypi
tensorboard-data-server 0.6.1 pypi_0 pypi
tensorboard-plugin-wit 1.8.0 pypi_0 pypi
tensorflow 2.7.0 pypi_0 pypi
tensorflow-addons 0.15.0 pypi_0 pypi
tensorflow-datasets 4.4.0 pypi_0 pypi
tensorflow-estimator 2.7.0 pypi_0 pypi
tensorflow-gan 2.1.0 pypi_0 pypi
tensorflow-hub 0.12.0 pypi_0 pypi
tensorflow-io-gcs-filesystem 0.22.0 pypi_0 pypi
tensorflow-metadata 1.5.0 pypi_0 pypi
tensorflow-probability 0.7.0 pypi_0 pypi
tensorflow-text 2.7.3 pypi_0 pypi
termcolor 1.1.0 pypi_0 pypi
tf-slim 1.1.0 pypi_0 pypi
tfds-nightly 4.4.0.dev202112010107 pypi_0 pypi
threadpoolctl 3.0.0 pypi_0 pypi
tk 8.6.11 h1ccaba5_0
tokenizer 3.3.2 pypi_0 pypi
tokenizers 0.10.3 pypi_0 pypi
tomli 1.2.2 pypi_0 pypi
toolz 0.11.2 pypi_0 pypi
torch 1.10.0 pypi_0 pypi
tqdm 4.62.3 pypi_0 pypi
transformers 4.12.5 pypi_0 pypi
typeguard 2.13.2 pypi_0 pypi
typing-extensions 3.10.0.2 pypi_0 pypi
tzdata 2021e hda174b7_0
uritemplate 4.1.1 pypi_0 pypi
urllib3 1.26.7 pypi_0 pypi
wandb 0.12.7 pypi_0 pypi
werkzeug 2.0.2 pypi_0 pypi
wheel 0.37.0 pyhd3eb1b0_1
wrapt 1.13.3 pypi_0 pypi
xxhash 2.0.2 pypi_0 pypi
xz 5.2.5 h7b6447c_0
yarl 1.7.2 pypi_0 pypi
yaspin 2.1.0 pypi_0 pypi
zipp 3.6.0 pypi_0 pypi
zlib 1.2.11 h7b6447c_3
zope-event 4.5.0 pypi_0 pypi
zope-interface 5.4.0 pypi_0 pypi
---------------------------------------ERROR MESSAGE---------------------------------------------------- (bigbird) kjk88@gpu2:~/bigbird$ sh -x bigbird/classifier/base_size.sh
- python3 bigbird/classifier/run_classifier.py --data_dir=tfds://imdb_reviews/plain_text --output_dir=gs://bigbird-transformer-training/classifier/imdb
WARNING:tensorflow:From /home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/tensorflow/python/compat/v2_compat.py:111: disable_resource_variables (from tensorflow.python.ops.variable_scope) is deprecated and will be removed in a future version.
Instructions for updating:
non-resource variables are not supported in the long term
Traceback (most recent call last):
File "/home/kjk88/bigbird/bigbird/classifier/run_classifier.py", line 460, in
app.run(main) File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/absl/app.py", line 303, in run _run_main(main, args) File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "/home/kjk88/bigbird/bigbird/classifier/run_classifier.py", line 375, in main bert_config = flags.as_dictionary() File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/bigbird/core/flags.py", line 187, in as_dictionary FLAGS.vocab_model_file = str(importlib_resources.files(bigbird).joinpath( File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/importlib/resources.py", line 147, in files return _common.from_package(_get_package(package)) File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/importlib/_common.py", line 14, in from_package return fallback_resources(package.spec) File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/importlib/_common.py", line 18, in fallback_resources package_directory = pathlib.Path(spec.origin).parent File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/pathlib.py", line 1082, in new self = cls._from_parts(args, init=False) File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/pathlib.py", line 707, in _from_parts drv, root, parts = self._parse_args(args) File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/pathlib.py", line 691, in _parse_args a = os.fspath(a) TypeError: expected str, bytes or os.PathLike object, not NoneType - --attention_type=block_sparse --max_encoder_length=4096 --num_attention_heads=12 --num_hidden_layers=12 --hidden_size=768 --intermediate_size=3072 --block_size=64 --train_batch_size=2 --eval_batch_size=2 --do_train=True --do_eval=True --use_tpu=True --tpu_name=bigbird --tpu_zone=europe-west4-a --gcp_project=bigbird-project bigbird/classifier/base_size.sh: 8: bigbird/classifier/base_size.sh: --attention_type=block_sparse: not found
- --num_tpu_cores=32 --init_checkpoint=gs://bigbird-transformer/pretrain/bigbr_base/model.ckpt-0 bigbird/classifier/base_size.sh: 24: bigbird/classifier/base_size.sh: --num_tpu_cores=32: not found
