alexng88

yes im using a fresh env. Mac with M1. absl-py==1.4.0 accelerate==0.20.3 aiofiles==23.1.0 aiohttp==3.8.4 aiosignal==1.3.1 alt-profanity-check==1.2.2 altair==5.0.1 anyio==3.7.1 appdirs==1.4.4 APScheduler==3.10.1 arrow==1.2.3 async-timeout==4.0.2 attrs==23.1.0 backoff==2.2.1 beautifulsoup4==4.12.2 better-profanity==0.7.0 bioc==2.0 bitsandbytes==0.39.0 boto3==1.26.101 botocore==1.29.101 bravado==11.0.3...

> Thanks. The langchain version is off. It should be `langchain==0.0.202`. Perhaps some other package updates it due to the order of installation. > > If you have a chance,...

> pytest -s -v tests/test_requirements.py::test_requirements (h2ogpt2) development@Developments-MacBook-Pro h2ogpt % pytest -s -v tests/test_requirements.py::test_requirements ==================================================================== test session starts ===================================================================== platform darwin -- Python 3.10.12, pytest-7.2.2, pluggy-1.2.0 -- /Users/development/opt/anaconda3/envs/h2ogpt2/bin/python cachedir: .pytest_cache rootdir:...

sorry where is the weight file?

ok i found it. tks

Hello, I made the changes of llm.py llm = CTransformers(model=cfg.MODEL_BIN_PATH, model_type=cfg.MODEL_TYPE, config={'max_new_tokens': cfg.MAX_NEW_TOKENS, 'temperature': cfg.TEMPERATURE, 'gpu_layers':24} and reinstall ctransformers (0.2.27) but seems still running very slow seems never use GPU...