aimet
aimet copied to clipboard
How to get qc chips parameters? Help!
I want run the LLM on my phone with qc chip SM8845, and I need to compile the model to .dlc format, but I can't find the parameters arch/soc id/vtcm/hvx in qnn document, can you provide me more information? Thanks
We have LLM on genie tutorial on AI Hub Models that you can follow for end-to-end recipe for LLM quantization and deployment here https://github.com/quic/ai-hub-apps/tree/main/tutorials/llm_on_genie