Thong Truong comments

Repositories
Issues
Comments

Results 3 comments of


                                            Thong Truong

Add Box Shadow Component

Found this issue while searching for something else. Coincidentally, I developed a small card block plugin that enable user to fully customize the box shadow property. The controls for box...

Issue: seed=-1 in llama_cpp.Llama Does Not Ensure Randomness

The model is Mistral 7B Instruct v0.3 Q4_K_M GGUF from https://huggingface.co/MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF.

Empty output when running Q4_K_M quantization of Llama-3-8B-Instruct with llama-cpp-python

Is there any update on this? I’m facing a similar issue, consistently getting empty outputs. I’m using finetuned quantized unsloth/mistral-7b-instruct-v0.3-bnb-4bit GGUF with no GPU, n_threads=8, `create_chat_completion` with JSON Schema Mode