SingJumpRapp

How to get qc chips parameters? Help!

1

I want run the LLM on my phone with qc chip SM8845, and I need to compile the model to .dlc format, but I can't find the parameters arch/soc id/vtcm/hvx...

QAT for LLM

1

Is there some documents about the QAT code for LLM? I want to do the QAT on llama3 but I can only find the code for mobilenet_v2, I think there...

The aimet_onnx package was installed via pip but it couldn't be used

4

I use the command "pip install aimet-onnx", but the version is v0.0.2 and when I try "import aimet_onnx", error occurs "ModuleNotFoundError: No module named 'aimet_onnx'"