Ivan Zatevakhin
Ivan Zatevakhin
Same issue with `llama_cpp_python==0.1.35` `langchain==0.0.145` (used different older versions, and it leads to same issue) Used code example: ```python from langchain.llms import LlamaCpp llm = LlamaCpp(model_path=model_path) # Basic Q&A answer...
Here is one more similar issue https://github.com/hwchase17/langchain/issues/3241. There is my comment about the identical problem. As a workaround can be used solution below: ```bash export MODEL=.../ggml/ggml-vicuna-7b-4bit.bin python3 -m llama_cpp.server ```...
@JochemLangerak Here is a fix for your issue, just add the `f16_kv=True` parameter. ```python from langchain.llms import LlamaCpp llm = LlamaCpp(model_path="../llama/models/ggml-vicuna-13b-4bit-rev1.bin", f16_kv=True) text = "Question: What NFL team won the...
The same issue is observed with `bionerf`. It happens when connecting to a viewer. ``` ns-viewer --load-config outputs/images/bionerf/2024-05-19_021853/config.yml [11:23:57] Auto image downscale factor of 4 nerfstudio_dataparser.py:484 Setting up training dataset......
@eboasson Thank you for your answer! Install from sources [cyclonedds-python#via-pypi](https://github.com/eclipse-cyclonedds/cyclonedds-python#via-pypi), and [cyclonedds-python#via-git](https://github.com/eclipse-cyclonedds/cyclonedds-python#via-git) works well for me. Btw. Got the same problem when trying to build in `debian:bookworm` `x86_64`, when trying...
@eboasson Btw. I implemented fixes for [buildhelp/cyclone_search.py#L48-L52](https://github.com/eclipse-cyclonedds/cyclonedds-python/blob/42ce826a981a4bff9e02f01614719e9c1078c105/buildhelp/cyclone_search.py#L48-L52) and [buildhelp/oxidize_library.py#L49-L53](https://github.com/eclipse-cyclonedds/cyclonedds-python/blob/42ce826a981a4bff9e02f01614719e9c1078c105/buildhelp/oxidize_library.py#L49-L53), but because installation of cyclonedds from apt (`apt install cyclonedds-dev`) provides only libraries without header files there's missing some includes when...
@Miaaaim I wanted to create the issue for "Multiple reminders in one day", and found this issue and think this can be related. Is it appropriate to request this feature...