Aleef Bilal
Results
1
issues of
Aleef Bilal
**Description**: I'm experiencing random assertion failures and segmentation faults when streaming responses from a fine-tuned Llama3.1 70B GGUF model. The error occurs in the GGML matrix multiplication validation. Sometimes, it...