mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

Is tunning scripts available？

Open Wanger-SJTU opened this issue 2 years ago • 1 comments

It seems like the tuning is per device, although the m1 tuning is applied when using any GPU. How would I use relax_integration.tune_relax on mod_deploy to create other databases?

Wanger-SJTU avatar May 05 '23 06:05 Wanger-SJTU

We are not using tune_relax because it only supports static shape workloads. Will release a tutorial soon

junrushao avatar May 08 '23 22:05 junrushao