OpenLLM
OpenLLM copied to clipboard
bug: TypeError: environment can only contain strings
Describe the bug
During start openllm and retry to meet same error
(stephen) C:\Users\stephen\LLM\OpenLLM>openllm start opt
Error caught while starting LLM Server:
environment can only contain strings
Traceback (most recent call last):
File "
To reproduce
No response
Logs
No response
Environment
Environment variable
BENTOML_DEBUG=''
BENTOML_QUIET=''
BENTOML_BUNDLE_LOCAL_BUILD=''
BENTOML_DO_NOT_TRACK=''
BENTOML_CONFIG=''
BENTOML_CONFIG_OPTIONS=''
BENTOML_PORT=''
BENTOML_HOST=''
BENTOML_API_WORKERS=''
System information
bentoml: 1.0.22
python: 3.11.3
platform: Windows-10-10.0.22621-SP0
is_window_admin: False
conda: 23.3.1
in_conda_env: True
conda_packages
name: stephen
channels:
- defaults
dependencies:
- aiofiles=22.1.0=py311haa95532_0
- aiosqlite=0.18.0=py311haa95532_0
- anyio=3.5.0=py311haa95532_0
- argon2-cffi=21.3.0=pyhd3eb1b0_0
- argon2-cffi-bindings=21.2.0=py311h2bbff1b_0
- asttokens=2.0.5=pyhd3eb1b0_0
- babel=2.11.0=py311haa95532_0
- backcall=0.2.0=pyhd3eb1b0_0
- beautifulsoup4=4.12.2=py311haa95532_0
- bleach=4.1.0=pyhd3eb1b0_0
- brotlipy=0.7.0=py311h2bbff1b_1002
- bzip2=1.0.8=he774522_0
- ca-certificates=2023.05.30=haa95532_0
- certifi=2023.5.7=py311haa95532_0
- cffi=1.15.1=py311h2bbff1b_3
- charset-normalizer=2.0.4=pyhd3eb1b0_0
- colorama=0.4.6=py311haa95532_0
- comm=0.1.2=py311haa95532_0
- cryptography=39.0.1=py311h21b164f_0
- debugpy=1.5.1=py311hd77b12b_0
- decorator=5.1.1=pyhd3eb1b0_0
- defusedxml=0.7.1=pyhd3eb1b0_0
- entrypoints=0.4=py311haa95532_0
- executing=0.8.3=pyhd3eb1b0_0
- giflib=5.2.1=h8cc25b3_3
- glib=2.69.1=h5dc1a3c_2
- gst-plugins-base=1.18.5=h9e645db_0
- gstreamer=1.18.5=hd78058f_0
- icu=58.2=ha925a31_3
- idna=3.4=py311haa95532_0
- ipykernel=6.19.2=py311h86cfffd_0
- ipython=8.12.0=py311haa95532_0
- ipython_genutils=0.2.0=pyhd3eb1b0_1
- ipywidgets=8.0.4=py311haa95532_0
- jedi=0.18.1=py311haa95532_1
- jinja2=3.1.2=py311haa95532_0
- jpeg=9e=h2bbff1b_1
- json5=0.9.6=pyhd3eb1b0_0
- jsonschema=4.17.3=py311haa95532_0
- jupyter=1.0.0=py311haa95532_8
- jupyter_client=8.1.0=py311haa95532_0
- jupyter_console=6.6.3=py311haa95532_0
- jupyter_core=5.3.0=py311haa95532_0
- jupyter_events=0.6.3=py311haa95532_0
- jupyter_server=2.5.0=py311haa95532_0
- jupyter_server_fileid=0.9.0=py311haa95532_0
- jupyter_server_terminals=0.4.4=py311haa95532_1
- jupyter_server_ydoc=0.8.0=py311haa95532_1
- jupyter_ydoc=0.2.4=py311haa95532_0
- jupyterlab=3.6.3=py311haa95532_0
- jupyterlab_pygments=0.1.2=py_0
- jupyterlab_server=2.22.0=py311haa95532_0
- jupyterlab_widgets=3.0.5=py311haa95532_0
- krb5=1.19.4=h5b6d351_0
- lerc=3.0=hd77b12b_0
- libclang=14.0.6=default_hb5a9fac_1
- libclang13=14.0.6=default_h8e68704_1
- libdeflate=1.17=h2bbff1b_0
- libffi=3.4.4=hd77b12b_0
- libiconv=1.16=h2bbff1b_2
- libogg=1.3.5=h2bbff1b_1
- libpng=1.6.39=h8cc25b3_0
- libsodium=1.0.18=h62dcd97_0
- libtiff=4.5.0=h6c2663c_2
- libvorbis=1.3.7=he774522_0
- libwebp=1.2.4=hbc33d0d_1
- libwebp-base=1.2.4=h2bbff1b_1
- libxml2=2.10.3=h0ad7f3c_0
- libxslt=1.1.37=h2bbff1b_0
- lxml=4.9.2=py311h2bbff1b_0
- lz4-c=1.9.4=h2bbff1b_0
- markupsafe=2.1.1=py311h2bbff1b_0
- matplotlib-inline=0.1.6=py311haa95532_0
- mistune=0.8.4=py311h2bbff1b_1000
- nbclassic=0.5.5=py311haa95532_0
- nbclient=0.5.13=py311haa95532_0
- nbconvert=6.5.4=py311haa95532_0
- nbformat=5.7.0=py311haa95532_0
- nest-asyncio=1.5.6=py311haa95532_0
- notebook=6.5.4=py311haa95532_0
- notebook-shim=0.2.2=py311haa95532_0
- openssl=1.1.1u=h2bbff1b_0
- packaging=23.0=py311haa95532_0
- pandocfilters=1.5.0=pyhd3eb1b0_0
- parso=0.8.3=pyhd3eb1b0_0
- pcre=8.45=hd77b12b_0
- pickleshare=0.7.5=pyhd3eb1b0_1003
- pip=23.1.2=py311haa95532_0
- platformdirs=2.5.2=py311haa95532_0
- ply=3.11=py311haa95532_0
- prometheus_client=0.14.1=py311haa95532_0
- prompt-toolkit=3.0.36=py311haa95532_0
- prompt_toolkit=3.0.36=hd3eb1b0_0
- psutil=5.9.0=py311h2bbff1b_0
- pure_eval=0.2.2=pyhd3eb1b0_0
- pycparser=2.21=pyhd3eb1b0_0
- pygments=2.15.1=py311haa95532_1
- pyopenssl=23.0.0=py311haa95532_0
- pyqt=5.15.7=py311hd77b12b_0
- pyqt5-sip=12.11.0=py311hd77b12b_0
- pyrsistent=0.18.0=py311h2bbff1b_0
- pysocks=1.7.1=py311haa95532_0
- python=3.11.3=h966fe2a_0
- python-dateutil=2.8.2=pyhd3eb1b0_0
- python-fastjsonschema=2.16.2=py311haa95532_0
- python-json-logger=2.0.7=py311haa95532_0
- pytz=2022.7=py311haa95532_0
- pywin32=305=py311h2bbff1b_0
- pywinpty=2.0.10=py311h5da7b33_0
- pyyaml=6.0=py311h2bbff1b_1
- pyzmq=25.1.0=py311hd77b12b_0
- qt-main=5.15.2=he8e5bd7_8
- qt-webengine=5.15.9=hb9a9bb5_5
- qtconsole=5.4.2=py311haa95532_0
- qtpy=2.2.0=py311haa95532_0
- qtwebkit=5.212=h2bbfb41_5
- requests=2.29.0=py311haa95532_0
- rfc3339-validator=0.1.4=py311haa95532_0
- rfc3986-validator=0.1.1=py311haa95532_0
- send2trash=1.8.0=pyhd3eb1b0_1
- setuptools=67.8.0=py311haa95532_0
- sip=6.6.2=py311hd77b12b_0
- six=1.16.0=pyhd3eb1b0_1
- sniffio=1.2.0=py311haa95532_1
- soupsieve=2.4=py311haa95532_0
- sqlite=3.41.2=h2bbff1b_0
- stack_data=0.2.0=pyhd3eb1b0_0
- terminado=0.17.1=py311haa95532_0
- tinycss2=1.2.1=py311haa95532_0
- tk=8.6.12=h2bbff1b_0
- toml=0.10.2=pyhd3eb1b0_0
- tornado=6.2=py311h2bbff1b_0
- traitlets=5.7.1=py311haa95532_0
- typing-extensions=4.6.3=py311haa95532_0
- typing_extensions=4.6.3=py311haa95532_0
- urllib3=1.26.16=py311haa95532_0
- vc=14.2=h21ff451_1
- vs2015_runtime=14.27.29016=h5e58377_2
- wcwidth=0.2.5=pyhd3eb1b0_0
- webencodings=0.5.1=py311haa95532_1
- websocket-client=0.58.0=py311haa95532_4
- wheel=0.38.4=py311haa95532_0
- widgetsnbextension=4.0.5=py311haa95532_0
- win_inet_pton=1.1.0=py311haa95532_0
- winpty=0.4.3=4
- xz=5.4.2=h8cc25b3_0
- y-py=0.5.9=py311hb6bf4ef_0
- yaml=0.2.5=he774522_0
- ypy-websocket=0.8.2=py311haa95532_0
- zeromq=4.3.4=hd77b12b_0
- zlib=1.2.13=h8cc25b3_0
- zstd=1.5.5=hd43e919_0
- pip:
- accelerate==0.20.3
- aiohttp==3.8.4
- aiosignal==1.3.1
- appdirs==1.4.4
- asgiref==3.7.2
- async-timeout==4.0.2
- attrs==23.1.0
- bentoml==1.0.22
- build==0.10.0
- cattrs==23.1.2
- circus==0.18.0
- click==8.1.3
- click-option-group==0.5.6
- cloudpickle==2.2.1
- coloredlogs==15.0.1
- contextlib2==21.6.0
- datasets==2.13.1
- deepmerge==1.1.0
- deprecated==1.2.14
- dill==0.3.6
- django==4.2.2
- filelock==3.12.2
- filetype==1.2.0
- frozenlist==1.3.3
- fs==2.4.16
- fsspec==2023.6.0
- grpcio==1.56.0
- grpcio-health-checking==1.48.2
- h11==0.14.0
- httpcore==0.17.2
- httpx==0.24.1
- huggingface-hub==0.15.1
- humanfriendly==10.0
- importlib-metadata==6.0.1
- inflection==0.5.1
- markdown-it-py==3.0.0
- mdurl==0.1.2
- mpmath==1.3.0
- multidict==6.0.4
- multiprocess==0.70.14
- networkx==3.1
- numpy==1.25.0
- openllm==0.1.13
- opentelemetry-api==1.17.0
- opentelemetry-instrumentation==0.38b0
- opentelemetry-instrumentation-aiohttp-client==0.38b0
- opentelemetry-instrumentation-asgi==0.38b0
- opentelemetry-instrumentation-grpc==0.38b0
- opentelemetry-sdk==1.17.0
- opentelemetry-semantic-conventions==0.38b0
- opentelemetry-util-http==0.38b0
- optimum==1.8.8
- orjson==3.9.1
- pandas==2.0.2
- pathspec==0.11.1
- pillow==9.5.0
- pip-requirements-parser==32.0.1
- pip-tools==6.13.0
- protobuf==3.20.3
- pyarrow==12.0.1
- pydantic==1.10.9
- pymysql==1.0.3
- pynvml==11.5.0
- pyparsing==3.1.0
- pyproject-hooks==1.0.0
- pyreadline3==3.4.1
- python-multipart==0.0.6
- regex==2023.6.3
- rich==13.4.2
- safetensors==0.3.1
- schema==0.7.5
- sentencepiece==0.1.99
- simple-di==0.1.5
- smartchart==6.6.8
- smartdb==0.6
- sqlparse==0.4.4
- starlette==0.28.0
- sympy==1.12
- tabulate==0.9.0
- tokenizers==0.13.3
- torch==2.0.1
- torchvision==0.15.2
- tqdm==4.65.0
- transformers==4.30.2
- tzdata==2023.3
- uvicorn==0.22.0
- watchfiles==0.19.0
- wrapt==1.15.0
- xxhash==3.2.0
- yarl==1.9.2
- zipp==3.15.0
prefix: C:\Users\stephen\anaconda3\envs\stephen
pip_packages
accelerate==0.20.3
aiofiles @ file:///C:/b/abs_9ex6mi6b56/croot/aiofiles_1683773603390/work
aiohttp==3.8.4
aiosignal==1.3.1
aiosqlite @ file:///C:/b/abs_9djc_0pyi3/croot/aiosqlite_1683773915844/work
anyio @ file:///C:/ci_311/anyio_1676425491996/work/dist
appdirs==1.4.4
argon2-cffi @ file:///opt/conda/conda-bld/argon2-cffi_1645000214183/work
argon2-cffi-bindings @ file:///C:/ci_311/argon2-cffi-bindings_1676424443321/work
asgiref==3.7.2
asttokens @ file:///opt/conda/conda-bld/asttokens_1646925590279/work
async-timeout==4.0.2
attrs==23.1.0
Babel @ file:///C:/ci_311/babel_1676427169844/work
backcall @ file:///home/ktietz/src/ci/backcall_1611930011877/work
beautifulsoup4 @ file:///C:/b/abs_0agyz1wsr4/croot/beautifulsoup4-split_1681493048687/work
bentoml==1.0.22
bleach @ file:///opt/conda/conda-bld/bleach_1641577558959/work
brotlipy==0.7.0
build==0.10.0
cattrs==23.1.2
certifi @ file:///C:/b/abs_4a0polqwty/croot/certifi_1683875377622/work/certifi
cffi @ file:///C:/ci_311/cffi_1676423759166/work
charset-normalizer @ file:///tmp/build/80754af9/charset-normalizer_1630003229654/work
circus==0.18.0
click==8.1.3
click-option-group==0.5.6
cloudpickle==2.2.1
colorama @ file:///C:/ci_311/colorama_1676422310965/work
coloredlogs==15.0.1
comm @ file:///C:/ci_311/comm_1678376562840/work
contextlib2==21.6.0
cryptography @ file:///C:/ci_311/cryptography_1679419210767/work
datasets==2.13.1
debugpy @ file:///C:/ci_311/debugpy_1676426137692/work
decorator @ file:///opt/conda/conda-bld/decorator_1643638310831/work
deepmerge==1.1.0
defusedxml @ file:///tmp/build/80754af9/defusedxml_1615228127516/work
Deprecated==1.2.14
dill==0.3.6
Django==4.2.2
entrypoints @ file:///C:/ci_311/entrypoints_1676423328987/work
executing @ file:///opt/conda/conda-bld/executing_1646925071911/work
fastjsonschema @ file:///C:/ci_311/python-fastjsonschema_1679500568724/work
filelock==3.12.2
filetype==1.2.0
frozenlist==1.3.3
fs==2.4.16
fsspec==2023.6.0
grpcio==1.56.0
grpcio-health-checking==1.48.2
h11==0.14.0
httpcore==0.17.2
httpx==0.24.1
huggingface-hub==0.15.1
humanfriendly==10.0
idna @ file:///C:/ci_311/idna_1676424932545/work
importlib-metadata==6.0.1
inflection==0.5.1
ipykernel @ file:///C:/ci_311/ipykernel_1678734799670/work
ipython @ file:///C:/b/abs_d1yx5tjhli/croot/ipython_1680701887259/work
ipython-genutils @ file:///tmp/build/80754af9/ipython_genutils_1606773439826/work
ipywidgets @ file:///C:/b/abs_5awapknmz_/croot/ipywidgets_1679394824767/work
jedi @ file:///C:/ci_311/jedi_1679427407646/work
Jinja2 @ file:///C:/ci_311/jinja2_1676424968965/work
json5 @ file:///tmp/build/80754af9/json5_1624432770122/work
jsonschema @ file:///C:/b/abs_d40z05b6r1/croot/jsonschema_1678983446576/work
jupyter @ file:///C:/ci_311/jupyter_1678249952587/work
jupyter-console @ file:///C:/b/abs_82xaa6i2y4/croot/jupyter_console_1680000189372/work
jupyter-events @ file:///C:/b/abs_4cak_28ewz/croot/jupyter_events_1684268050893/work
jupyter-ydoc @ file:///C:/b/abs_e7m6nh5lao/croot/jupyter_ydoc_1683747253535/work
jupyter_client @ file:///C:/b/abs_059idvdagk/croot/jupyter_client_1680171872444/work
jupyter_core @ file:///C:/b/abs_9d0ttho3bs/croot/jupyter_core_1679906581955/work
jupyter_server @ file:///C:/b/abs_3eh8sm27tx/croot/jupyter_server_1686059851383/work
jupyter_server_fileid @ file:///C:/b/abs_f1yjnmiq_6/croot/jupyter_server_fileid_1684273602142/work
jupyter_server_terminals @ file:///C:/b/abs_ec0dq4b50j/croot/jupyter_server_terminals_1686870763512/work
jupyter_server_ydoc @ file:///C:/b/abs_8ai39bligw/croot/jupyter_server_ydoc_1686767445888/work
jupyterlab @ file:///C:/b/abs_c1msr8zz3y/croot/jupyterlab_1686179674844/work
jupyterlab-pygments @ file:///tmp/build/80754af9/jupyterlab_pygments_1601490720602/work
jupyterlab-widgets @ file:///C:/b/abs_38ad427jkz/croot/jupyterlab_widgets_1679055289211/work
jupyterlab_server @ file:///C:/b/abs_e0qqsihjvl/croot/jupyterlab_server_1680792526136/work
lxml @ file:///C:/b/abs_c2bg6ck92l/croot/lxml_1679646459966/work
markdown-it-py==3.0.0
MarkupSafe @ file:///C:/ci_311/markupsafe_1676424152318/work
matplotlib-inline @ file:///C:/ci_311/matplotlib-inline_1676425798036/work
mdurl==0.1.2
mistune @ file:///C:/ci_311/mistune_1676425149302/work
mpmath==1.3.0
multidict==6.0.4
multiprocess==0.70.14
nbclassic @ file:///C:/b/abs_c8_rs7b3zw/croot/nbclassic_1681756186106/work
nbclient @ file:///C:/ci_311/nbclient_1676425195918/work
nbconvert @ file:///C:/ci_311/nbconvert_1676425836196/work
nbformat @ file:///C:/ci_311/nbformat_1676424215945/work
nest-asyncio @ file:///C:/ci_311/nest-asyncio_1676423519896/work
networkx==3.1
notebook @ file:///C:/b/abs_49d8mc_lpe/croot/notebook_1681756182078/work
notebook_shim @ file:///C:/ci_311/notebook-shim_1678144850856/work
numpy==1.25.0
openllm==0.1.13
opentelemetry-api==1.17.0
opentelemetry-instrumentation==0.38b0
opentelemetry-instrumentation-aiohttp-client==0.38b0
opentelemetry-instrumentation-asgi==0.38b0
opentelemetry-instrumentation-grpc==0.38b0
opentelemetry-sdk==1.17.0
opentelemetry-semantic-conventions==0.38b0
opentelemetry-util-http==0.38b0
optimum==1.8.8
orjson==3.9.1
packaging @ file:///C:/b/abs_ed_kb9w6g4/croot/packaging_1678965418855/work
pandas==2.0.2
pandocfilters @ file:///opt/conda/conda-bld/pandocfilters_1643405455980/work
parso @ file:///opt/conda/conda-bld/parso_1641458642106/work
pathspec==0.11.1
pickleshare @ file:///tmp/build/80754af9/pickleshare_1606932040724/work
Pillow==9.5.0
pip-requirements-parser==32.0.1
pip-tools==6.13.0
platformdirs @ file:///C:/ci_311/platformdirs_1676422658103/work
ply==3.11
prometheus-client @ file:///C:/ci_311/prometheus_client_1679591942558/work
prompt-toolkit @ file:///C:/ci_311/prompt-toolkit_1676425940920/work
protobuf==3.20.3
psutil @ file:///C:/ci_311_rebuilds/psutil_1679005906571/work
pure-eval @ file:///opt/conda/conda-bld/pure_eval_1646925070566/work
pyarrow==12.0.1
pycparser @ file:///tmp/build/80754af9/pycparser_1636541352034/work
pydantic==1.10.9
Pygments @ file:///C:/b/abs_fay9dpq4n_/croot/pygments_1684279990574/work
PyMySQL==1.0.3
pynvml==11.5.0
pyOpenSSL @ file:///C:/b/abs_de215ipd18/croot/pyopenssl_1678965319166/work
pyparsing==3.1.0
pyproject_hooks==1.0.0
PyQt5==5.15.7
PyQt5-sip @ file:///C:/ci_311/pyqt-split_1676428895938/work/pyqt_sip
pyreadline3==3.4.1
pyrsistent @ file:///C:/ci_311/pyrsistent_1676422695500/work
PySocks @ file:///C:/ci_311/pysocks_1676425991111/work
python-dateutil @ file:///tmp/build/80754af9/python-dateutil_1626374649649/work
python-json-logger @ file:///C:/b/abs_cblnsm6puj/croot/python-json-logger_1683824130469/work
python-multipart==0.0.6
pytz @ file:///C:/ci_311/pytz_1676427070848/work
pywin32==305.1
pywinpty @ file:///C:/ci_311/pywinpty_1677707791185/work/target/wheels/pywinpty-2.0.10-cp311-none-win_amd64.whl
PyYAML @ file:///C:/ci_311/pyyaml_1676432488822/work
pyzmq @ file:///C:/b/abs_655zk4a3s8/croot/pyzmq_1686601465034/work
qtconsole @ file:///C:/b/abs_eb4u9jg07y/croot/qtconsole_1681402843494/work
QtPy @ file:///C:/ci_311/qtpy_1676432558504/work
regex==2023.6.3
requests @ file:///C:/b/abs_41owkd5ymz/croot/requests_1682607524657/work
rfc3339-validator @ file:///C:/b/abs_ddfmseb_vm/croot/rfc3339-validator_1683077054906/work
rfc3986-validator @ file:///C:/b/abs_6e9azihr8o/croot/rfc3986-validator_1683059049737/work
rich==13.4.2
safetensors==0.3.1
schema==0.7.5
Send2Trash @ file:///tmp/build/80754af9/send2trash_1632406701022/work
sentencepiece==0.1.99
simple-di==0.1.5
sip @ file:///C:/ci_311/sip_1676427825172/work
six @ file:///tmp/build/80754af9/six_1644875935023/work
smartchart==6.6.8
smartdb==0.6
sniffio @ file:///C:/ci_311/sniffio_1676425339093/work
soupsieve @ file:///C:/b/abs_a989exj3q6/croot/soupsieve_1680518492466/work
sqlparse==0.4.4
stack-data @ file:///opt/conda/conda-bld/stack_data_1646927590127/work
starlette==0.28.0
sympy==1.12
tabulate==0.9.0
terminado @ file:///C:/ci_311/terminado_1678228513830/work
tinycss2 @ file:///C:/ci_311/tinycss2_1676425376744/work
tokenizers==0.13.3
toml @ file:///tmp/build/80754af9/toml_1616166611790/work
torch==2.0.1
torchvision==0.15.2
tornado @ file:///C:/ci_311/tornado_1676423689414/work
tqdm==4.65.0
traitlets @ file:///C:/ci_311/traitlets_1676423290727/work
transformers==4.30.2
typing_extensions @ file:///C:/b/abs_5em9ekwz24/croot/typing_extensions_1686602003259/work
tzdata==2023.3
urllib3 @ file:///C:/b/abs_889_loyqv4/croot/urllib3_1686163174463/work
uvicorn==0.22.0
watchfiles==0.19.0
wcwidth @ file:///Users/ktietz/demo/mc3/conda-bld/wcwidth_1629357192024/work
webencodings==0.5.1
websocket-client @ file:///C:/ci_311/websocket-client_1676426063281/work
widgetsnbextension @ file:///C:/b/abs_882k4_4kdf/croot/widgetsnbextension_1679313880295/work
win-inet-pton @ file:///C:/ci_311/win_inet_pton_1676425458225/work
wrapt==1.15.0
xxhash==3.2.0
y-py @ file:///C:/b/abs_b7f5go6r0j/croot/y-py_1683662173571/work
yarl==1.9.2
ypy-websocket @ file:///C:/b/abs_4e65ywlnv8/croot/ypy-websocket_1684172103529/work
zipp==3.15.0
System information (Optional)
No response
same issue
Duplication of #59 , lets track there