Yi Wang
Yi Wang
If we can fix https://github.com/sql-machine-learning/sql-machine-learning.github.io/issues/85, we could also rename "ElasticDL" into "Playground".
I had this issue when I ran `python3 qlora.py`. And I second @T-Atlas 's solution. The reason is that the default model in qlora.py is `EleutherAI/pythia-12b` https://github.com/artidoro/qlora/blob/3da535abdfaa29a2d0757eab0971664ed2cd97e8/qlora.py#L53-L55 which depends on...
Yes, that is expected, isn't it? So writers could add or deleted items without the need to renumber the rest, because numbering is the work of markdown renderer.
+1 - looking forward to Bloom in vLLM
That doesn’t work. As described above, the project requires TensorRT-LLM built from the main branch.
It doesn’t build the main branch. It installs a most recent pre release version. On Thu, Feb 8, 2024 at 1:17 AM Yingqiang Ge ***@***.***> wrote: > I used and...
I looks like `pip install -e .` does not automatically trigger [the buiding of the Python binding of the C++ runtime](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/build_from_source.md#build-the-python-bindings-for-the-c-runtime).
Thank you @jdemouth-nvidia and @Shixiaowei02 ! No rush please. It is totally fine after the lunar new year.
Hmm. Should I post this proposal to https://github.com/sizmailov/pybind11-stubgen instead?
I am using the libtorch pre-built for rpi-aarch64. The script `cgotorch/build.sh` generates `libcgotorch.so` successfully. However, `go test ./...` cannot load and use libtorch correctly. By installing `libomp-dev` using `sudo apt-get...