Neoh Huey Li

Results 3 comments of Neoh Huey Li

Hi @garrett361, I will try to reproduce the issue and get back to you.

Hi @duyanyao, I can run the Llama 2 quantization and int8 performance test without having any issue. Please see attached. Thus, can you share the error you encountered from v2.1.0.dev+cpu.llm...