llama
llama copied to clipboard
Published
20 hours ago •
meta-llama
meta-llama
Unable to run example.py
I am running torchrun --nproc_per_node 1 example.py --ckpt_dir ./7B/ --tokenizer_path ./tokenizer.model
and my output is
NOTE: Redirects are currently not supported in Windows or MacOs.
Traceback (most recent call last):
File "/opt/homebrew/bin/torchrun", line 33, in <module>
sys.exit(load_entry_point('torch==1.13.0a0+git49444c3', 'console_scripts', 'torchrun')())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 346, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/run.py", line 762, in main
run(args)
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/run.py", line 753, in run
elastic_launch(
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 132, in __call__
return launch_agent(self._config, self._entrypoint, list(args))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 237, in launch_agent
result = agent.run()
^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/metrics/api.py", line 129, in wrapper
result = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/api.py", line 709, in run
result = self._invoke_run(role)
^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/api.py", line 844, in _invoke_run
self._initialize_workers(self._worker_group)
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/metrics/api.py", line 129, in wrapper
result = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/api.py", line 681, in _initialize_workers
worker_ids = self._start_workers(worker_group)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/metrics/api.py", line 129, in wrapper
result = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/local_elastic_agent.py", line 271, in _start_workers
self._pcontext = start_processes(
^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/__init__.py", line 207, in start_processes
redirs = to_map(redirects, nprocs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/api.py", line 162, in to_map
map[i] = val_or_map.get(i, Std.NONE)
^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
(base)
Any idea what's happening here?
You need to provide more information about your OS, python, the libraries and their versions and your GPU.
@neuhaus Thank you for suggesting that. Here is the information:
MacOS Ventura 13.2.1 (22D68) with M1 Pro, 16 core GPU, 16 GB RAM
Python 3.11.2
Here's my output from pip list
Package Version
---------------------------------- ---------------
alabaster 0.7.12
anaconda-client 1.7.2
anaconda-navigator 1.9.6
anaconda-project 0.8.2
appnope 0.1.0
appscript 1.0.1
asn1crypto 0.24.0
astroid 2.1.0
astropy 3.1
atomicwrites 1.2.1
attrs 18.2.0
Babel 2.6.0
backcall 0.1.0
backports.os 0.1.1
backports.shutil-get-terminal-size 1.0.0
beautifulsoup4 4.6.3
bitarray 0.8.3
bkcharts 0.2
blaze 0.11.3
bleach 3.0.2
bokeh 1.0.2
boto 2.49.0
Bottleneck 1.2.1
certifi 2022.12.7
cffi 1.11.5
chardet 3.0.4
Click 7.0
cloudpickle 0.6.1
clyent 1.2.2
colorama 0.4.1
conda 23.1.0
conda-build 3.23.3
conda-package-handling 2.0.2
conda_package_streaming 0.7.0
conda-verify 3.1.1
contextlib2 0.5.5
cryptography 2.4.2
cycler 0.10.0
Cython 0.29.2
cytoolz 0.9.0.1
dask 1.0.0
datashape 0.5.4
decorator 4.3.0
defusedxml 0.5.0
distributed 1.25.1
docutils 0.14
entrypoints 0.2.3
et-xmlfile 1.0.1
fairscale 0.4.6
fastcache 1.0.2
filelock 3.0.10
fire 0.5.0
Flask 1.0.2
Flask-Cors 3.0.7
flit_core 3.6.0
fsspec 2022.11.0
future 0.17.1
gevent 1.3.7
glob2 0.6
gmpy2 2.0.8
greenlet 0.4.15
h5py 2.8.0
heapdict 1.0.0
html5lib 1.0.1
idna 2.8
imageio 2.4.1
imagesize 1.1.0
importlib-metadata 6.0.0
ipykernel 5.1.0
ipython 7.2.0
ipython_genutils 0.2.0
ipywidgets 7.4.2
isort 4.3.4
itsdangerous 1.1.0
jdcal 1.4
jedi 0.13.2
Jinja2 2.10
joblib 1.1.1
json5 0.9.6
jsonschema 2.6.0
jupyter 1.0.0
jupyter-client 5.2.4
jupyter-console 6.0.0
jupyter-core 4.4.0
jupyterlab 0.35.3
jupyterlab-server 0.2.0
keyring 17.0.0
kiwisolver 1.0.1
lazy-object-proxy 1.3.1
libarchive-c 2.8
lief 0.9.0
llvmlite 0.26.0
locket 0.2.0
lxml 4.2.5
MarkupSafe 1.1.0
matplotlib 3.0.2
mccabe 0.6.1
mistune 0.8.4
mkl-fft 1.0.6
mkl-random 1.0.2
mkl-service 2.3.0
mock 4.0.3
more-itertools 4.3.0
mpmath 1.1.0
msgpack 0.5.6
multipledispatch 0.6.0
navigator-updater 0.2.1
nbconvert 5.4.0
nbformat 4.4.0
networkx 2.2
nltk 3.4
nose 1.3.7
notebook 5.7.4
numba 0.41.0
numexpr 2.6.8
numpy 1.19.2
numpydoc 0.8.0
odo 0.5.1
olefile 0.46
openpyxl 2.5.12
packaging 18.0
pandas 0.23.4
pandocfilters 1.4.2
parso 0.3.1
partd 0.3.9
path.py 11.5.0
pathlib2 2.3.3
patsy 0.5.1
pep8 1.7.1
pexpect 4.6.0
pickleshare 0.7.5
Pillow 5.3.0
pip 23.0.1
pkginfo 1.4.2
pluggy 1.0.0
ply 3.11
prometheus-client 0.5.0
prompt-toolkit 2.0.7
psutil 5.4.8
ptyprocess 0.6.0
py 1.7.0
pycodestyle 2.4.0
pycosat 0.6.3
pycparser 2.19
pycrypto 2.6.1
pycurl 7.43.0.2
pyflakes 2.0.0
Pygments 2.3.1
pylint 2.2.2
pyodbc 4.0.25
pyOpenSSL 18.0.0
pyparsing 2.3.0
pyrsistent 0.18.0
PySocks 1.6.8
pytest 4.0.2
pytest-arraydiff 0.3
pytest-astropy 0.5.0
pytest-doctestplus 0.2.0
pytest-openfiles 0.3.1
pytest-remotedata 0.3.1
python-dateutil 2.7.5
pytz 2018.7
PyWavelets 1.0.1
PyYAML 3.13
pyzmq 17.1.2
QtAwesome 0.5.3
qtconsole 4.4.3
QtPy 1.5.2
requests 2.21.0
rope 0.11.0
ruamel.yaml 0.17.21
ruamel_yaml 0.15.46
ruamel.yaml.clib 0.2.6
scikit-image 0.14.1
scikit-learn 0.20.1
scipy 1.1.0
seaborn 0.9.0
Send2Trash 1.5.0
sentencepiece 0.1.97
setuptools 67.4.0
simplegeneric 0.8.1
singledispatch 3.4.0.3
six 1.12.0
snowballstemmer 1.2.1
sortedcollections 1.0.1
sortedcontainers 2.1.0
soupsieve 2.3.2.post1
Sphinx 1.8.2
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
sphinxcontrib-websupport 1.1.0
spyder 3.3.2
spyder-kernels 0.3.0
SQLAlchemy 1.2.15
statsmodels 0.9.0
sympy 1.3
tables 3.4.4
tblib 1.3.2
termcolor 2.2.0
terminado 0.8.1
testpath 0.4.2
toml 0.10.2
toolz 0.9.0
torch 1.13.1
torchaudio 0.7.0a0+a853dff
torchvision 0.8.2
tornado 5.1.1
tqdm 4.28.1
traitlets 4.3.2
typing_extensions 4.5.0
unicodecsv 0.14.1
urllib3 1.24.1
wcwidth 0.1.7
webencodings 0.5.1
Werkzeug 1.0.1
wheel 0.32.3
widgetsnbextension 3.4.2
wrapt 1.10.11
wurlitzer 1.0.2
xlrd 1.2.0
XlsxWriter 1.1.2
xlwings 0.15.1
xlwt 1.3.0
zict 0.1.3
zipp 3.15.0
zstandard 0.19.0
To avoid this issue, downgrade python. try 3.7~ (use a version manager like asdf, rtx). then make sure to install the requirements using the command.
Same here, I am using a MacBook M1, I will try to downgrade my python to 3.7 to see.
