Quickstart Guide

[ArturNiederfahrenhorst]

Tried to follow the steps provided in https://doc.fedml.ai/deploy/quickstart.

Steps to reproduce:

conda create -c conda-forge python=3.10 -n fedml conda activate fedml pip install fedml fedml model create -n hf_model -m hf:EleutherAI/pythia-70m fails with the following error:

Traceback (most recent call last):
  File "/Users/artur/miniforge3/envs/fedml/bin/fedml", line 8, in <module>
    sys.exit(cli())
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/fedml/cli/modules/model.py", line 42, in fedml_model_create
    fedml.api.model_create(name, model, model_config)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/fedml/api/__init__.py", line 244, in model_create
    model_module.create(name, model, model_config)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/fedml/api/modules/model.py", line 17, in create
    if create_from_hf(name, model[3:]):
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/fedml/api/modules/model.py", line 55, in create_from_hf
    shutil.copytree(hf_templ_fd_src, dst_fd)
  File "/Users/artur/miniforge3/envs/fedml/lib/python3.10/shutil.py", line 557, in copytree
    with os.scandir(src) as itr:
FileNotFoundError: [Errno 2] No such file or directory: '/Users/artur/miniforge3/envs/fedml/lib/python3.10/site-packages/fedml/api/modules/../../serving/templates/hf_template'

pip freeze:

aiohttp==3.9.3
aiosignal==1.3.1
anyio==4.2.0
async-timeout==4.0.3
attrdict==2.0.1
attrs==23.2.0
blis==0.7.11
boto3==1.34.36
botocore==1.34.36
Brotli==1.1.0
cachetools==5.3.2
catalogue==2.0.10
certifi==2024.2.2
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cloudpathlib==0.16.0
confection==0.1.4
contourpy==1.2.0
cycler==0.12.1
cymem==2.0.8
dill==0.3.8
docker==6.1.3
docker-pycreds==0.4.0
exceptiongroup==1.2.0
fastapi==0.92.0
fedml==0.8.23
filelock==3.13.1
fonttools==4.48.1
frozenlist==1.4.1
fsspec==2024.2.0
gensim==4.3.2
gevent==23.9.1
geventhttpclient==2.0.9
gitdb==4.0.11
GitPython==3.1.41
GPUtil==1.4.0
graphviz==0.8.4
greenlet==3.0.3
h11==0.14.0
h5py==3.10.0
httpcore==1.0.2
httpx==0.26.0
idna==3.6
Jinja2==3.1.3
jmespath==1.0.1
joblib==1.3.2
kiwisolver==1.4.5
langcodes==3.3.0
MarkupSafe==2.1.5
matplotlib==3.8.2
mpmath==1.3.0
multidict==6.0.5
multiprocess==0.70.16
murmurhash==1.0.10
networkx==2.8.8
ntplib==0.4.0
numpy==1.26.4
onnx==1.15.0
packaging==23.2
paho-mqtt==1.6.1
pandas==2.2.0
pathtools==0.1.2
pillow==10.2.0
preshed==3.0.9
prettytable==3.9.0
promise==2.3
protobuf==3.20.3
psutil==5.9.8
py-machineid==0.5.1
pydantic==1.10.14
pyparsing==3.1.1
python-dateutil==2.8.2
python-rapidjson==1.14
pytz==2024.1
PyYAML==6.0.1
redis==5.0.1
requests==2.31.0
s3transfer==0.10.0
scikit-learn==1.4.0
scipy==1.12.0
sentry-sdk==1.40.1
setproctitle==1.3.3
shortuuid==1.0.11
six==1.16.0
smart-open==6.3.0
smmap==5.0.1
sniffio==1.3.0
spacy==3.7.3
spacy-legacy==3.0.12
spacy-loggers==1.0.5
SQLAlchemy==2.0.25
srsly==2.4.8
starlette==0.25.0
sympy==1.12
thinc==8.2.2
threadpoolctl==3.2.0
toposort==1.10
torch==2.2.0
torchvision==0.17.0
tqdm==4.66.1
tritonclient==2.42.0
typer==0.9.0
typing_extensions==4.9.0
tzdata==2023.4
tzlocal==5.2
urllib3==2.0.7
uvicorn==0.27.0.post1
wandb==0.13.2
wasabi==1.1.2
wcwidth==0.2.13
weasel==0.3.4
websocket-client==1.7.0
wget==3.2
yarl==1.9.4
zope.event==5.0
zope.interface==6.1