davidray222

Results 12 comments of davidray222

thank you very much!!!! I have successfully run it, based on other versions of Triton. the next step is to use merge.py,right? Thank you for taking the time to answer!...

@Qubitium I successfully quantized DeepSeek-R1-Distill-Llama-8B into a 4-bit model, but I encountered an issue where, no matter what input I provide, the output is always "!!!!!!!!". Could this be due...