LLamaSharp
LLamaSharp copied to clipboard
SciSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
I'm not sure what I'm doing wrong, but I'm getting following error after updating from 0.8.1 to 0.9.1 `Cannot add a user message after another user message (Parameter 'message') `...
NBGV allows automatic versioning based on the git commit height from when it was initially installed. This would enable automatic publishing for pre-release packages to NuGet.org or github packages, and...
Hi, how can i use this repo in unity 3d? to make a chatbot in unity 3d. can you give me some guidelines.
## README FIRST *This commit is a draft, it requires changes to work, if this is merged without those changes, actions other than CI that attempt to build the project...
RTX 3090 Windows 11 CUDA 12.3 Same result with WSL2 or Native. --- ggml_init_cublas: GGML_CUDA_FORCE_MMQ: no ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes ggml_init_cublas: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 3090,...
What is the correct way to serialize State after GetState()? From what I can see, State would need to keep the length to allow for writing that raw memory to...
https://github.com/guidance-ai/guidance/blob/main/notebooks/art_of_prompt_design/prompt_boundaries_and_token_healing.ipynb
The WebAPI project does not appear to use the GPU, even though I can see the CUDA 12 llamalib.dll being loaded in TryLoad. In both the StatefulChatService and StatelessChatService, I...
I'm implementing a Save State and Load State system to pick up past conversations. I did all my development using CPU and just recently got a GPU to try it...
I used the Grammar Example and created a little program for myself where I iterate over text in a file and ask a question of that text. Please note I...
