OpenLLM feat(build): support absolute adapter path

feat(build): support absolute adapter path

Open QLutz opened this issue 1 year ago • 3 comments

Describe the bug

Trying to build a Bento from a LLaMa 13B model with a locally stored adapter, it appears some package is missing.

To reproduce

openllm build llama --model-id huggyllama/llama-13b --adapter-id /my/local/adapter/ --debug

Logs

Usage: openllm build [OPTIONS] {chatglm|dolly-v2|falcon|flan-t5|gpt-neox|llama|mpt|opt|stablelm|starcoder|baichuan}
Try 'openllm build -h' for help.

Error: 'build_ctx' is required when '--adapter-id' is passsed.

Environment

Environment variable

BENTOML_DEBUG=''
BENTOML_QUIET=''
BENTOML_BUNDLE_LOCAL_BUILD=''
BENTOML_DO_NOT_TRACK=''
BENTOML_CONFIG=''
BENTOML_CONFIG_OPTIONS=''
BENTOML_PORT=''
BENTOML_HOST=''
BENTOML_API_WORKERS=''

System information

bentoml: 1.1.3 python: 3.10.12 platform: Linux-5.10.0-23-cloud-amd64-x86_64-with-glibc2.31 uid_gid: 1004:1005 conda: 23.7.2 in_conda_env: True

conda_packages

name: base
channels:
  - file:///tmp/conda-pkgs
  - conda-forge
  - defaults
dependencies:
  - _libgcc_mutex=0.1=conda_forge
  - _openmp_mutex=4.5=2_gnu
  - anyio=3.7.1=pyhd8ed1ab_0
  - argon2-cffi=21.3.0=pyhd8ed1ab_0
  - argon2-cffi-bindings=21.2.0=py310h5764c6d_3
  - arrow=1.2.3=pyhd8ed1ab_0
  - asttokens=2.2.1=pyhd8ed1ab_0
  - async-lru=2.0.4=pyhd8ed1ab_0
  - attrs=23.1.0=pyh71513ae_1
  - babel=2.12.1=pyhd8ed1ab_1
  - backcall=0.2.0=pyh9f0ad1d_0
  - backports=1.0=pyhd8ed1ab_3
  - backports.functools_lru_cache=1.6.5=pyhd8ed1ab_0
  - beautifulsoup4=4.12.2=pyha770c72_0
  - bleach=6.0.0=pyhd8ed1ab_0
  - boltons=23.0.0=pyhd8ed1ab_0
  - brotli-python=1.0.9=py310hd8f1fbe_9
  - bzip2=1.0.8=h7f98852_4
  - ca-certificates=2023.7.22=hbcca054_0
  - cached-property=1.5.2=hd8ed1ab_1
  - cached_property=1.5.2=pyha770c72_1
  - certifi=2023.7.22=pyhd8ed1ab_0
  - cffi=1.15.1=py310h255011f_3
  - charset-normalizer=3.2.0=pyhd8ed1ab_0
  - colorama=0.4.6=pyhd8ed1ab_0
  - comm=0.1.4=pyhd8ed1ab_0
  - conda=23.7.2=py310hff52083_0
  - conda-package-handling=2.2.0=pyh38be061_0
  - conda-package-streaming=0.9.0=pyhd8ed1ab_0
  - cryptography=41.0.3=py310h75e40e8_0
  - decorator=5.1.1=pyhd8ed1ab_0
  - defusedxml=0.7.1=pyhd8ed1ab_0
  - dlenv-base=1.0.20230807=py310_0
  - entrypoints=0.4=pyhd8ed1ab_0
  - exceptiongroup=1.1.2=pyhd8ed1ab_0
  - executing=1.2.0=pyhd8ed1ab_0
  - flit-core=3.9.0=pyhd8ed1ab_0
  - fqdn=1.5.1=pyhd8ed1ab_0
  - icu=72.1=hcb278e6_0
  - idna=3.4=pyhd8ed1ab_0
  - importlib_metadata=6.8.0=hd8ed1ab_0
  - importlib_resources=6.0.1=pyhd8ed1ab_0
  - ipykernel=6.25.1=pyh71e2992_0
  - ipython=8.14.0=pyh41d4057_0
  - isoduration=20.11.0=pyhd8ed1ab_0
  - jedi=0.19.0=pyhd8ed1ab_0
  - jinja2=3.1.2=pyhd8ed1ab_1
  - json5=0.9.14=pyhd8ed1ab_0
  - jsonpatch=1.32=pyhd8ed1ab_0
  - jsonpointer=2.0=py_0
  - jsonschema=4.19.0=pyhd8ed1ab_0
  - jsonschema-specifications=2023.7.1=pyhd8ed1ab_0
  - jsonschema-with-format-nongpl=4.19.0=pyhd8ed1ab_0
  - jupyter-lsp=2.2.0=pyhd8ed1ab_0
  - jupyter_client=8.3.0=pyhd8ed1ab_0
  - jupyter_core=5.3.1=py310hff52083_0
  - jupyter_events=0.7.0=pyhd8ed1ab_1
  - jupyter_server=2.7.0=pyhd8ed1ab_0
  - jupyter_server_terminals=0.4.4=pyhd8ed1ab_1
  - jupyterlab_pygments=0.2.2=pyhd8ed1ab_0
  - jupyterlab_server=2.24.0=pyhd8ed1ab_0
  - ld_impl_linux-64=2.40=h41732ed_0
  - libffi=3.4.2=h7f98852_5
  - libgcc-ng=13.1.0=he5830b7_0
  - libgomp=13.1.0=he5830b7_0
  - libnsl=2.0.0=h7f98852_0
  - libsodium=1.0.18=h36c2ea0_1
  - libsqlite=3.42.0=h2797004_0
  - libstdcxx-ng=13.1.0=hfd8a6a1_0
  - libuuid=2.38.1=h0b41bf4_0
  - libuv=1.44.2=hd590300_1
  - libzlib=1.2.13=hd590300_5
  - markupsafe=2.1.3=py310h2372a71_0
  - matplotlib-inline=0.1.6=pyhd8ed1ab_0
  - nb_conda=2.2.1=unix_6
  - nb_conda_kernels=2.3.1=py310hff52083_2
  - nbclient=0.8.0=pyhd8ed1ab_0
  - nbconvert-core=7.7.3=pyhd8ed1ab_0
  - nbformat=5.9.2=pyhd8ed1ab_0
  - ncurses=6.4=hcb278e6_0
  - nodejs=18.16.1=hf52ce11_0
  - notebook-shim=0.2.3=pyhd8ed1ab_0
  - openssl=3.1.2=hd590300_0
  - overrides=7.4.0=pyhd8ed1ab_0
  - packaging=23.1=pyhd8ed1ab_0
  - pandocfilters=1.5.0=pyhd8ed1ab_0
  - parso=0.8.3=pyhd8ed1ab_0
  - pexpect=4.8.0=pyh1a96a4e_2
  - pickleshare=0.7.5=py_1003
  - pip=23.2.1=pyhd8ed1ab_0
  - pkgutil-resolve-name=1.3.10=pyhd8ed1ab_0
  - platformdirs=3.10.0=pyhd8ed1ab_0
  - pluggy=1.2.0=pyhd8ed1ab_0
  - prometheus_client=0.17.1=pyhd8ed1ab_0
  - prompt-toolkit=3.0.39=pyha770c72_0
  - prompt_toolkit=3.0.39=hd8ed1ab_0
  - ptyprocess=0.7.0=pyhd3deb0d_0
  - pure_eval=0.2.2=pyhd8ed1ab_0
  - pycosat=0.6.4=py310h5764c6d_1
  - pycparser=2.21=pyhd8ed1ab_0
  - pygments=2.16.1=pyhd8ed1ab_0
  - pyopenssl=23.2.0=pyhd8ed1ab_1
  - pysocks=1.7.1=pyha2e5f31_6
  - python=3.10.12=hd12c33a_0_cpython
  - python-dateutil=2.8.2=pyhd8ed1ab_0
  - python-fastjsonschema=2.18.0=pyhd8ed1ab_0
  - python-json-logger=2.0.7=pyhd8ed1ab_0
  - python_abi=3.10=3_cp310
  - pytz=2023.3=pyhd8ed1ab_0
  - readline=8.2=h8228510_1
  - referencing=0.30.2=pyhd8ed1ab_0
  - requests=2.31.0=pyhd8ed1ab_0
  - rfc3339-validator=0.1.4=pyhd8ed1ab_0
  - rfc3986-validator=0.1.1=pyh9f0ad1d_0
  - rpds-py=0.9.2=py310hcb5633a_0
  - ruamel.yaml=0.17.32=py310h2372a71_0
  - ruamel.yaml.clib=0.2.7=py310h1fa729e_1
  - send2trash=1.8.2=pyh41d4057_0
  - setuptools=68.0.0=pyhd8ed1ab_0
  - six=1.16.0=pyh6c4a22f_0
  - sniffio=1.3.0=pyhd8ed1ab_0
  - stack_data=0.6.2=pyhd8ed1ab_0
  - terminado=0.17.1=pyh41d4057_0
  - tinycss2=1.2.1=pyhd8ed1ab_0
  - tk=8.6.12=h27826a3_0
  - tomli=2.0.1=pyhd8ed1ab_0
  - toolz=0.12.0=pyhd8ed1ab_0
  - tornado=6.3.2=py310h2372a71_0
  - tqdm=4.65.0=pyhd8ed1ab_1
  - traitlets=5.9.0=pyhd8ed1ab_0
  - typing-extensions=4.7.1=hd8ed1ab_0
  - typing_extensions=4.7.1=pyha770c72_0
  - typing_utils=0.1.0=pyhd8ed1ab_0
  - uri-template=1.3.0=pyhd8ed1ab_0
  - wcwidth=0.2.6=pyhd8ed1ab_0
  - webcolors=1.13=pyhd8ed1ab_0
  - websocket-client=1.6.1=pyhd8ed1ab_0
  - wheel=0.41.1=pyhd8ed1ab_0
  - xz=5.2.6=h166bdaf_0
  - yaml=0.2.5=h7f98852_2
  - zeromq=4.3.4=h9c3ff4c_1
  - zipp=3.16.2=pyhd8ed1ab_0
  - zlib=1.2.13=hd590300_5
  - zstandard=0.19.0=py310h1275a96_2
  - zstd=1.5.2=hfc55251_7
  - pip:
      - absl-py==1.4.0
      - accelerate==0.22.0
      - aiohttp==3.8.5
      - aiohttp-cors==0.7.0
      - aiorwlock==1.3.0
      - aiosignal==1.3.1
      - ansiwrap==0.8.4
      - appdirs==1.4.4
      - asgiref==3.7.2
      - async-timeout==4.0.2
      - backoff==2.2.1
      - beatrix-jupyterlab==2023.84.194007
      - bentoml==1.1.3
      - bitsandbytes==0.41.1
      - blessed==1.20.0
      - build==0.10.0
      - cachetools==5.3.1
      - cattrs==23.1.2
      - circus==0.18.0
      - click==8.1.6
      - click-option-group==0.5.6
      - cloud-tpu-client==0.10
      - cloudpickle==2.2.1
      - cmake==3.27.2
      - coloredlogs==15.0.1
      - colorful==0.5.5
      - contextlib2==21.6.0
      - contourpy==1.1.0
      - cuda-python==12.2.0
      - cycler==0.11.0
      - cython==3.0.0
      - dacite==1.8.1
      - datasets==2.14.4
      - db-dtypes==1.1.1
      - debugpy==1.6.7
      - deepmerge==1.1.0
      - deprecated==1.2.14
      - dill==0.3.7
      - distlib==0.3.7
      - dm-tree==0.1.8
      - docker==6.1.3
      - docstring-parser==0.15
      - fairscale==0.4.13
      - fastapi==0.101.0
      - fastcore==1.5.29
      - filelock==3.12.2
      - filetype==1.2.0
      - fonttools==4.42.0
      - frozenlist==1.4.0
      - fs==2.4.16
      - fsspec==2023.6.0
      - gcsfs==2023.6.0
      - ghapi==1.0.4
      - gitdb==4.0.10
      - gitpython==3.1.32
      - google-api-core==1.34.0
      - google-api-python-client==1.8.0
      - google-auth==2.22.0
      - google-auth-httplib2==0.1.0
      - google-auth-oauthlib==1.0.0
      - google-cloud-aiplatform==1.29.0
      - google-cloud-artifact-registry==1.8.3
      - google-cloud-bigquery==3.11.4
      - google-cloud-bigquery-storage==2.22.0
      - google-cloud-core==2.3.3
      - google-cloud-datastore==1.15.5
      - google-cloud-language==2.10.1
      - google-cloud-monitoring==2.15.1
      - google-cloud-resource-manager==1.10.3
      - google-cloud-storage==2.10.0
      - google-crc32c==1.5.0
      - google-resumable-media==2.5.0
      - googleapis-common-protos==1.60.0
      - gpustat==1.0.0
      - greenlet==2.0.2
      - grpc-google-iam-v1==0.12.6
      - grpcio==1.56.2
      - grpcio-status==1.48.2
      - gymnasium==0.26.3
      - gymnasium-notices==0.0.1
      - h11==0.14.0
      - htmlmin==0.1.12
      - httpcore==0.17.3
      - httplib2==0.22.0
      - httpx==0.24.1
      - huggingface-hub==0.16.4
      - humanfriendly==10.0
      - imagehash==4.3.1
      - imageio==2.31.1
      - importlib-metadata==6.0.1
      - inflection==0.5.1
      - ipython-genutils==0.2.0
      - ipython-sql==0.5.0
      - ipywidgets==8.1.0
      - jaraco-classes==3.3.0
      - jeepney==0.8.0
      - joblib==1.3.1
      - jupyter-client==7.4.9
      - jupyter-http-over-ws==0.0.8
      - jupyter-server==1.24.0
      - jupyter-server-mathjax==0.2.6
      - jupyter-server-proxy==4.0.0
      - jupyterlab==3.4.8
      - jupyterlab-git==0.41.0
      - jupyterlab-widgets==3.0.8
      - jupytext==1.15.0
      - keyring==24.2.0
      - keyrings-google-artifactregistry-auth==1.1.2
      - kfp==2.0.1
      - kfp-pipeline-spec==0.2.2
      - kfp-server-api==2.0.0
      - kiwisolver==1.4.4
      - kubernetes==26.1.0
      - lazy-loader==0.3
      - lit==16.0.6
      - llvmlite==0.40.1
      - lz4==4.3.2
      - markdown-it-py==3.0.0
      - matplotlib==3.7.2
      - mdit-py-plugins==0.4.0
      - mdurl==0.1.2
      - mistune==3.0.1
      - more-itertools==10.1.0
      - mpmath==1.3.0
      - msgpack==1.0.5
      - multidict==6.0.4
      - multimethod==1.9.1
      - multiprocess==0.70.15
      - mypy-extensions==1.0.0
      - nbclassic==1.0.0
      - nbdime==3.2.0
      - nest-asyncio==1.5.7
      - networkx==3.1
      - ninja==1.11.1
      - notebook==6.5.5
      - notebook-executor==0.2
      - numba==0.57.1
      - numpy==1.23.5
      - nvidia-cublas-cu11==11.10.3.66
      - nvidia-cuda-cupti-cu11==11.7.101
      - nvidia-cuda-nvrtc-cu11==11.7.99
      - nvidia-cuda-runtime-cu11==11.7.99
      - nvidia-cudnn-cu11==8.5.0.96
      - nvidia-cufft-cu11==10.9.0.58
      - nvidia-curand-cu11==10.2.10.91
      - nvidia-cusolver-cu11==11.4.0.1
      - nvidia-cusparse-cu11==11.7.4.91
      - nvidia-ml-py==11.495.46
      - nvidia-nccl-cu11==2.14.3
      - nvidia-nvtx-cu11==11.7.91
      - oauth2client==4.1.3
      - oauthlib==3.2.2
      - opencensus==0.11.2
      - opencensus-context==0.1.3
      - openllm==0.2.27
      - openllm-client==0.2.27
      - openllm-core==0.2.27
      - opentelemetry-api==1.18.0
      - opentelemetry-exporter-otlp==1.19.0
      - opentelemetry-exporter-otlp-proto-common==1.19.0
      - opentelemetry-exporter-otlp-proto-grpc==1.19.0
      - opentelemetry-exporter-otlp-proto-http==1.19.0
      - opentelemetry-instrumentation==0.39b0
      - opentelemetry-instrumentation-aiohttp-client==0.39b0
      - opentelemetry-instrumentation-asgi==0.39b0
      - opentelemetry-proto==1.19.0
      - opentelemetry-sdk==1.18.0
      - opentelemetry-semantic-conventions==0.39b0
      - opentelemetry-util-http==0.39b0
      - optimum==1.12.0
      - orjson==3.9.5
      - pandas==2.0.3
      - pandas-profiling==3.6.6
      - papermill==2.4.0
      - pathspec==0.11.2
      - patsy==0.5.3
      - peft==0.5.0
      - phik==0.12.3
      - pillow==10.0.0
      - pip-requirements-parser==32.0.1
      - pip-tools==7.3.0
      - plotly==5.15.0
      - prettytable==3.8.0
      - proto-plus==1.22.3
      - protobuf==3.20.3
      - psutil==5.9.3
      - py-spy==0.3.14
      - pyarrow==12.0.1
      - pyasn1==0.5.0
      - pyasn1-modules==0.3.0
      - pydantic==1.10.12
      - pyjwt==2.8.0
      - pynvml==11.5.0
      - pyparsing==3.0.9
      - pyproject-hooks==1.0.0
      - python-multipart==0.0.6
      - pywavelets==1.4.1
      - pyyaml==6.0.1
      - pyzmq==24.0.1
      - ray==2.6.2
      - ray-cpp==2.6.2
      - regex==2023.8.8
      - requests-oauthlib==1.3.1
      - requests-toolbelt==0.10.1
      - retrying==1.3.4
      - rich==13.5.2
      - safetensors==0.3.3
      - schema==0.7.5
      - scikit-image==0.21.0
      - scikit-learn==1.3.0
      - scipy==1.11.1
      - seaborn==0.12.2
      - secretstorage==3.3.3
      - sentencepiece==0.1.99
      - shapely==1.8.5.post1
      - simpervisor==1.0.0
      - simple-di==0.1.5
      - smart-open==6.3.0
      - smmap==5.0.0
      - soupsieve==2.4.1
      - sqlalchemy==2.0.19
      - sqlparse==0.4.4
      - starlette==0.27.0
      - statsmodels==0.14.0
      - sympy==1.12
      - tabulate==0.9.0
      - tangled-up-in-unicode==0.2.0
      - tenacity==8.2.2
      - tensorboardx==2.6.2
      - textwrap3==0.9.2
      - threadpoolctl==3.2.0
      - tifffile==2023.7.18
      - tokenizers==0.13.3
      - toml==0.10.2
      - torch==2.0.1
      - transformers==4.32.1
      - triton==2.0.0
      - trl==0.6.0
      - typeguard==2.13.3
      - typer==0.9.0
      - tzdata==2023.3
      - uritemplate==3.0.1
      - urllib3==1.26.16
      - uvicorn==0.23.2
      - virtualenv==20.21.0
      - visions==0.7.5
      - vllm==0.1.4
      - watchfiles==0.20.0
      - webencodings==0.5.1
      - widgetsnbextension==4.0.8
      - wordcloud==1.9.2
      - wrapt==1.15.0
      - xformers==0.0.21
      - xxhash==3.3.0
      - yarl==1.9.2
      - ydata-profiling==4.4.0
prefix: /opt/conda

pip_packages

absl-py==1.4.0
accelerate==0.22.0
aiohttp==3.8.5
aiohttp-cors==0.7.0
aiorwlock==1.3.0
aiosignal==1.3.1
ansiwrap==0.8.4
anyio @ file:///home/conda/feedstock_root/build_artifacts/anyio_1688651106312/work/dist
appdirs==1.4.4
argon2-cffi @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi_1640817743617/work
argon2-cffi-bindings @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi-bindings_1666850768662/work
arrow @ file:///home/conda/feedstock_root/build_artifacts/arrow_1662382474514/work
asgiref==3.7.2
asttokens @ file:///home/conda/feedstock_root/build_artifacts/asttokens_1670263926556/work
async-lru @ file:///home/conda/feedstock_root/build_artifacts/async-lru_1690563019058/work
async-timeout==4.0.2
attrs @ file:///home/conda/feedstock_root/build_artifacts/attrs_1683424013410/work
Babel @ file:///home/conda/feedstock_root/build_artifacts/babel_1677767029043/work
backcall @ file:///home/conda/feedstock_root/build_artifacts/backcall_1592338393461/work
backoff==2.2.1
backports.functools-lru-cache @ file:///home/conda/feedstock_root/build_artifacts/backports.functools_lru_cache_1687772187254/work
beatrix-jupyterlab @ file:///home/kbuilder/miniconda3/conda-bld/dlenv-base_1691445212683/work/packages/beatrix_jupyterlab-2023.84.194007.tar.gz#sha256=304855d9bdf0eb76ca0184e14d438c0d3d4360e3e56a2be5874849677cc8dece
beautifulsoup4 @ file:///home/conda/feedstock_root/build_artifacts/beautifulsoup4_1680888073205/work
bentoml==1.1.3
bitsandbytes==0.41.1
bleach @ file:///home/conda/feedstock_root/build_artifacts/bleach_1674535352125/work
blessed==1.20.0
boltons @ file:///home/conda/feedstock_root/build_artifacts/boltons_1677499911949/work
Brotli @ file:///home/conda/feedstock_root/build_artifacts/brotli-split_1687884021435/work
build==0.10.0
cached-property @ file:///home/conda/feedstock_root/build_artifacts/cached_property_1615209429212/work
cachetools==5.3.1
cattrs==23.1.2
certifi==2023.7.22
cffi @ file:///home/conda/feedstock_root/build_artifacts/cffi_1671179353105/work
charset-normalizer @ file:///home/conda/feedstock_root/build_artifacts/charset-normalizer_1688813409104/work
circus==0.18.0
click==8.1.6
click-option-group==0.5.6
cloud-tpu-client==0.10
cloudpickle==2.2.1
cmake==3.27.2
colorama @ file:///home/conda/feedstock_root/build_artifacts/colorama_1666700638685/work
coloredlogs==15.0.1
colorful==0.5.5
comm @ file:///home/conda/feedstock_root/build_artifacts/comm_1691044910542/work
conda @ file:///home/conda/feedstock_root/build_artifacts/conda_1690552914978/work
conda-package-handling @ file:///home/conda/feedstock_root/build_artifacts/conda-package-handling_1691048088238/work
conda_package_streaming @ file:///home/conda/feedstock_root/build_artifacts/conda-package-streaming_1691009212940/work
contextlib2==21.6.0
contourpy==1.1.0
cryptography @ file:///home/conda/feedstock_root/build_artifacts/cryptography-split_1691444160254/work
cuda-python==12.2.0
cycler==0.11.0
Cython==3.0.0
dacite==1.8.1
datasets==2.14.4
db-dtypes==1.1.1
debugpy==1.6.7
decorator @ file:///home/conda/feedstock_root/build_artifacts/decorator_1641555617451/work
deepmerge==1.1.0
defusedxml @ file:///home/conda/feedstock_root/build_artifacts/defusedxml_1615232257335/work
Deprecated==1.2.14
dill==0.3.7
distlib==0.3.7
dm-tree==0.1.8
docker==6.1.3
docstring-parser==0.15
entrypoints @ file:///home/conda/feedstock_root/build_artifacts/entrypoints_1643888246732/work
exceptiongroup @ file:///home/conda/feedstock_root/build_artifacts/exceptiongroup_1688381075899/work
executing @ file:///home/conda/feedstock_root/build_artifacts/executing_1667317341051/work
fairscale==0.4.13
fastapi==0.101.0
fastcore==1.5.29
fastjsonschema @ file:///home/conda/feedstock_root/build_artifacts/python-fastjsonschema_1690055433477/work/dist
filelock==3.12.2
filetype==1.2.0
flit_core @ file:///home/conda/feedstock_root/build_artifacts/flit-core_1684084314667/work/source/flit_core
fonttools==4.42.0
fqdn @ file:///home/conda/feedstock_root/build_artifacts/fqdn_1638810296540/work/dist
frozenlist==1.4.0
fs==2.4.16
fsspec==2023.6.0
gcsfs==2023.6.0
ghapi==1.0.4
gitdb==4.0.10
GitPython==3.1.32
google-api-core==1.34.0
google-api-python-client==1.8.0
google-auth==2.22.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==1.0.0
google-cloud-aiplatform==1.29.0
google-cloud-artifact-registry==1.8.3
google-cloud-bigquery==3.11.4
google-cloud-bigquery-storage==2.22.0
google-cloud-core==2.3.3
google-cloud-datastore==1.15.5
google-cloud-language==2.10.1
google-cloud-monitoring==2.15.1
google-cloud-resource-manager==1.10.3
google-cloud-storage==2.10.0
google-crc32c==1.5.0
google-resumable-media==2.5.0
googleapis-common-protos==1.60.0
gpustat==1.0.0
greenlet==2.0.2
grpc-google-iam-v1==0.12.6
grpcio==1.56.2
grpcio-status==1.48.2
Gymnasium==0.26.3
gymnasium-notices==0.0.1
h11==0.14.0
htmlmin==0.1.12
httpcore==0.17.3
httplib2==0.22.0
httpx==0.24.1
huggingface-hub==0.16.4
humanfriendly==10.0
idna @ file:///home/conda/feedstock_root/build_artifacts/idna_1663625384323/work
ImageHash==4.3.1
imageio==2.31.1
importlib-metadata==6.0.1
importlib-resources @ file:///home/conda/feedstock_root/build_artifacts/importlib_resources_1691408075105/work
inflection==0.5.1
ipykernel @ file:///home/conda/feedstock_root/build_artifacts/ipykernel_1691424382338/work
ipython @ file:///home/conda/feedstock_root/build_artifacts/ipython_1685727741709/work
ipython-genutils==0.2.0
ipython-sql==0.5.0
ipywidgets==8.1.0
isoduration @ file:///home/conda/feedstock_root/build_artifacts/isoduration_1638811571363/work/dist
jaraco.classes==3.3.0
jedi @ file:///home/conda/feedstock_root/build_artifacts/jedi_1690896916983/work
jeepney==0.8.0
Jinja2 @ file:///home/conda/feedstock_root/build_artifacts/jinja2_1654302431367/work
joblib==1.3.1
json5 @ file:///home/conda/feedstock_root/build_artifacts/json5_1688248289187/work
jsonpatch @ file:///home/conda/feedstock_root/build_artifacts/jsonpatch_1632759296524/work
jsonpointer==2.0
jsonschema @ file:///home/conda/feedstock_root/build_artifacts/jsonschema-meta_1691407964752/work
jsonschema-specifications @ file:///home/conda/feedstock_root/build_artifacts/jsonschema-specifications_1689701150890/work
jupyter-events @ file:///home/conda/feedstock_root/build_artifacts/jupyter_events_1691022782867/work
jupyter-http-over-ws==0.0.8
jupyter-lsp @ file:///home/conda/feedstock_root/build_artifacts/jupyter-lsp-meta_1685453365113/work/jupyter-lsp
jupyter-server==1.24.0
jupyter-server-mathjax==0.2.6
jupyter_client==7.4.9
jupyter_core @ file:///home/conda/feedstock_root/build_artifacts/jupyter_core_1686775611663/work
jupyter_server_proxy==4.0.0
jupyter_server_terminals @ file:///home/conda/feedstock_root/build_artifacts/jupyter_server_terminals_1673491454549/work
jupyterlab==3.4.8
jupyterlab-git==0.41.0
jupyterlab-pygments @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_pygments_1649936611996/work
jupyterlab-widgets==3.0.8
jupyterlab_server @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_server_1690205927615/work
jupytext==1.15.0
keyring==24.2.0
keyrings.google-artifactregistry-auth==1.1.2
kfp==2.0.1
kfp-pipeline-spec==0.2.2
kfp-server-api==2.0.0
kiwisolver==1.4.4
kubernetes==26.1.0
lazy_loader==0.3
lit==16.0.6
llvmlite==0.40.1
lz4==4.3.2
markdown-it-py==3.0.0
MarkupSafe @ file:///home/conda/feedstock_root/build_artifacts/markupsafe_1685769049201/work
matplotlib==3.7.2
matplotlib-inline @ file:///home/conda/feedstock_root/build_artifacts/matplotlib-inline_1660814786464/work
mdit-py-plugins==0.4.0
mdurl==0.1.2
mistune @ file:///home/conda/feedstock_root/build_artifacts/mistune_1686313613819/work/dist
more-itertools==10.1.0
mpmath==1.3.0
msgpack==1.0.5
multidict==6.0.4
multimethod==1.9.1
multiprocess==0.70.15
mypy-extensions==1.0.0
nb-conda @ file:///home/conda/feedstock_root/build_artifacts/nb_conda_1654442778977/work
nb-conda-kernels @ file:///home/conda/feedstock_root/build_artifacts/nb_conda_kernels_1667060632461/work
nbclassic==1.0.0
nbclient @ file:///home/conda/feedstock_root/build_artifacts/nbclient_1684790896106/work
nbconvert @ file:///home/conda/feedstock_root/build_artifacts/nbconvert-meta_1690313290323/work
nbdime==3.2.0
nbformat @ file:///home/conda/feedstock_root/build_artifacts/nbformat_1690814868471/work
nest-asyncio @ file:///home/conda/feedstock_root/build_artifacts/nest-asyncio_1664684991461/work
networkx==3.1
ninja==1.11.1
notebook==6.5.5
notebook-executor @ file:///home/kbuilder/miniconda3/conda-bld/dlenv-base_1691445212683/work/packages/notebook_executor
notebook_shim @ file:///home/conda/feedstock_root/build_artifacts/notebook-shim_1682360583588/work
numba==0.57.1
numpy==1.23.5
nvidia-cublas-cu11==11.10.3.66
nvidia-cuda-cupti-cu11==11.7.101
nvidia-cuda-nvrtc-cu11==11.7.99
nvidia-cuda-runtime-cu11==11.7.99
nvidia-cudnn-cu11==8.5.0.96
nvidia-cufft-cu11==10.9.0.58
nvidia-curand-cu11==10.2.10.91
nvidia-cusolver-cu11==11.4.0.1
nvidia-cusparse-cu11==11.7.4.91
nvidia-ml-py==11.495.46
nvidia-nccl-cu11==2.14.3
nvidia-nvtx-cu11==11.7.91
oauth2client==4.1.3
oauthlib==3.2.2
opencensus==0.11.2
opencensus-context==0.1.3
openllm==0.2.27
openllm-client==0.2.27
openllm-core==0.2.27
opentelemetry-api==1.18.0
opentelemetry-exporter-otlp==1.19.0
opentelemetry-exporter-otlp-proto-common==1.19.0
opentelemetry-exporter-otlp-proto-grpc==1.19.0
opentelemetry-exporter-otlp-proto-http==1.19.0
opentelemetry-instrumentation==0.39b0
opentelemetry-instrumentation-aiohttp-client==0.39b0
opentelemetry-instrumentation-asgi==0.39b0
opentelemetry-proto==1.19.0
opentelemetry-sdk==1.18.0
opentelemetry-semantic-conventions==0.39b0
opentelemetry-util-http==0.39b0
optimum==1.12.0
orjson==3.9.5
overrides @ file:///home/conda/feedstock_root/build_artifacts/overrides_1691338815398/work
packaging @ file:///home/conda/feedstock_root/build_artifacts/packaging_1681337016113/work
pandas==2.0.3
pandas-profiling==3.6.6
pandocfilters @ file:///home/conda/feedstock_root/build_artifacts/pandocfilters_1631603243851/work
papermill==2.4.0
parso @ file:///home/conda/feedstock_root/build_artifacts/parso_1638334955874/work
pathspec==0.11.2
patsy==0.5.3
peft==0.5.0
pexpect @ file:///home/conda/feedstock_root/build_artifacts/pexpect_1667297516076/work
phik==0.12.3
pickleshare @ file:///home/conda/feedstock_root/build_artifacts/pickleshare_1602536217715/work
Pillow==10.0.0
pip-requirements-parser==32.0.1
pip-tools==7.3.0
pkgutil_resolve_name @ file:///home/conda/feedstock_root/build_artifacts/pkgutil-resolve-name_1633981968097/work
platformdirs @ file:///home/conda/feedstock_root/build_artifacts/platformdirs_1690813113769/work
plotly==5.15.0
pluggy @ file:///home/conda/feedstock_root/build_artifacts/pluggy_1687776318736/work
prettytable==3.8.0
prometheus-client @ file:///home/conda/feedstock_root/build_artifacts/prometheus_client_1689032443210/work
prompt-toolkit @ file:///home/conda/feedstock_root/build_artifacts/prompt-toolkit_1688565951714/work
proto-plus==1.22.3
protobuf==3.20.3
psutil==5.9.3
ptyprocess @ file:///home/conda/feedstock_root/build_artifacts/ptyprocess_1609419310487/work/dist/ptyprocess-0.7.0-py2.py3-none-any.whl
pure-eval @ file:///home/conda/feedstock_root/build_artifacts/pure_eval_1642875951954/work
py-spy==0.3.14
pyarrow==12.0.1
pyasn1==0.5.0
pyasn1-modules==0.3.0
pycosat @ file:///home/conda/feedstock_root/build_artifacts/pycosat_1666836542287/work
pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1636257122734/work
pydantic==1.10.12
Pygments @ file:///home/conda/feedstock_root/build_artifacts/pygments_1691408637400/work
PyJWT==2.8.0
pynvml==11.5.0
pyOpenSSL @ file:///home/conda/feedstock_root/build_artifacts/pyopenssl_1685514481738/work
pyparsing==3.0.9
pyproject_hooks==1.0.0
PySocks @ file:///home/conda/feedstock_root/build_artifacts/pysocks_1661604839144/work
python-dateutil @ file:///home/conda/feedstock_root/build_artifacts/python-dateutil_1626286286081/work
python-json-logger @ file:///home/conda/feedstock_root/build_artifacts/python-json-logger_1677079630776/work
python-multipart==0.0.6
pytz @ file:///home/conda/feedstock_root/build_artifacts/pytz_1680088766131/work
PyWavelets==1.4.1
PyYAML==6.0.1
pyzmq==24.0.1
ray==2.6.2
ray-cpp==2.6.2
referencing @ file:///home/conda/feedstock_root/build_artifacts/referencing_1691337268233/work
regex==2023.8.8
requests @ file:///home/conda/feedstock_root/build_artifacts/requests_1684774241324/work
requests-oauthlib==1.3.1
requests-toolbelt==0.10.1
retrying==1.3.4
rfc3339-validator @ file:///home/conda/feedstock_root/build_artifacts/rfc3339-validator_1638811747357/work
rfc3986-validator @ file:///home/conda/feedstock_root/build_artifacts/rfc3986-validator_1598024191506/work
rich==13.5.2
rpds-py @ file:///home/conda/feedstock_root/build_artifacts/rpds-py_1689705060450/work
rsa==4.9
ruamel.yaml @ file:///home/conda/feedstock_root/build_artifacts/ruamel.yaml_1686993901728/work
ruamel.yaml.clib @ file:///home/conda/feedstock_root/build_artifacts/ruamel.yaml.clib_1670412719074/work
safetensors==0.3.3
schema==0.7.5
scikit-image==0.21.0
scikit-learn==1.3.0
scipy==1.11.1
seaborn==0.12.2
SecretStorage==3.3.3
Send2Trash @ file:///home/conda/feedstock_root/build_artifacts/send2trash_1682601222253/work
sentencepiece==0.1.99
Shapely==1.8.5.post1
simpervisor==1.0.0
simple-di==0.1.5
six @ file:///home/conda/feedstock_root/build_artifacts/six_1620240208055/work
smart-open==6.3.0
smmap==5.0.0
sniffio @ file:///home/conda/feedstock_root/build_artifacts/sniffio_1662051266223/work
soupsieve @ file:///home/conda/feedstock_root/build_artifacts/soupsieve_1658207591808/work
SQLAlchemy==2.0.19
sqlparse==0.4.4
stack-data @ file:///home/conda/feedstock_root/build_artifacts/stack_data_1669632077133/work
starlette==0.27.0
statsmodels==0.14.0
sympy==1.12
tabulate==0.9.0
tangled-up-in-unicode==0.2.0
tenacity==8.2.2
tensorboardX==2.6.2
terminado @ file:///home/conda/feedstock_root/build_artifacts/terminado_1670253674810/work
textwrap3==0.9.2
threadpoolctl==3.2.0
tifffile==2023.7.18
tinycss2 @ file:///home/conda/feedstock_root/build_artifacts/tinycss2_1666100256010/work
tokenizers==0.13.3
toml==0.10.2
tomli @ file:///home/conda/feedstock_root/build_artifacts/tomli_1644342247877/work
toolz @ file:///home/conda/feedstock_root/build_artifacts/toolz_1657485559105/work
torch==2.0.1
tornado @ file:///home/conda/feedstock_root/build_artifacts/tornado_1684150054582/work
tqdm @ file:///home/conda/feedstock_root/build_artifacts/tqdm_1677948868469/work
traitlets @ file:///home/conda/feedstock_root/build_artifacts/traitlets_1675110562325/work
transformers==4.32.1
triton==2.0.0
trl==0.6.0
typeguard==2.13.3
typer==0.9.0
typing-utils @ file:///home/conda/feedstock_root/build_artifacts/typing_utils_1622899189314/work
typing_extensions @ file:///home/conda/feedstock_root/build_artifacts/typing_extensions_1688315532570/work
tzdata==2023.3
uri-template @ file:///home/conda/feedstock_root/build_artifacts/uri-template_1688655812972/work/dist
uritemplate==3.0.1
urllib3==1.26.16
uvicorn==0.23.2
virtualenv==20.21.0
visions==0.7.5
vllm==0.1.4
watchfiles==0.20.0
wcwidth @ file:///home/conda/feedstock_root/build_artifacts/wcwidth_1673864653149/work
webcolors @ file:///home/conda/feedstock_root/build_artifacts/webcolors_1679900785843/work
webencodings==0.5.1
websocket-client @ file:///home/conda/feedstock_root/build_artifacts/websocket-client_1687789148259/work
widgetsnbextension==4.0.8
wordcloud==1.9.2
wrapt==1.15.0
xformers==0.0.21
xxhash==3.3.0
yarl==1.9.2
ydata-profiling==4.4.0
zipp @ file:///home/conda/feedstock_root/build_artifacts/zipp_1689374466814/work
zstandard==0.19.0

transformers version: 4.32.1
Platform: Linux-5.10.0-23-cloud-amd64-x86_64-with-glibc2.31
Python version: 3.10.12
Huggingface_hub version: 0.16.4
Safetensors version: 0.3.3
Accelerate version: 0.22.0
Accelerate config: not found
PyTorch version (GPU?): 2.0.1+cu117 (True)
Tensorflow version (GPU?): not installed (NA)
Flax version (CPU?/GPU?/TPU?): not installed (NA)
Jax version: not installed
JaxLib version: not installed
Using GPU in script?: No
Using distributed or parallel set-up in script?: No

System information (Optional)

a2-highgpu-1g from GCP with 1xA100 80GB

Aug 29 '23 08:08 QLutz

This is not a bug. We need to know what the build context is in order to copy the adapter correctly.

Relative path is actually very hard to do !

Not a bug. Closing for irrelevance.

Aug 29 '23 08:08 aarnphm

What is the appropriate way to do it then?

Aug 29 '23 09:08 QLutz

You will need to pass in `--build-context to the path of the build context.

Now thinking more about it, I will reopen this and probably what openllm can do is that we can support absolute path.

Aug 29 '23 11:08 aarnphm

OpenLLM OpenLLM copied to clipboard

feat(build): support absolute adapter path

Describe the bug

To reproduce

Logs

Environment

Environment variable

System information

System information (Optional)

OpenLLM
OpenLLM copied to clipboard