shao-shuai

local run failed

3

was trying to run the app locally, got this:  followed each step as specified: `cd chatfiles-ui npm install npm run dev cd chatfiles python3 server.py` my OS is Ubuntu...

model inference is pretty slow

30

```shell 2023-08-20 14:20:27,502 - INFO - run_localGPT.py:180 - Running on: cuda 2023-08-20 14:20:27,502 - INFO - run_localGPT.py:181 - Display Source Documents set to: True 2023-08-20 14:20:27,690 - INFO - SentenceTransformer.py:66...

Tried to run [rag.ipynb](https://github.com/ray-project/llm-applications/blob/main/notebooks/rag.ipynb). Environment: - windows 10 - python-3.11.5 - ray-2.8.0 - pydantic-1.10.13 ```python {'GPU': 1.0, 'node:__internal_head__': 1.0, 'memory': 25100702516.0, 'node:127.0.0.1': 1.0, 'object_store_memory': 12550351257.0, 'CPU': 6.0} ``` Got the...

Hi, Was trying this notebook and couldn't run `QueryAgent`. Seems like there are a few typos, please refer to the changes and let me know if you have any questions....