auto-round icon indicating copy to clipboard operation
auto-round copied to clipboard

Published 20 hours ago • verified publisher icon intel

support F.linear and matmul in some moe models

Open wenhuach21 opened this issue 3 months ago • 0 comments

https://huggingface.co/databricks/dbrx-instruct/blob/main/modeling_dbrx.py A simple but engineering ugly solution is to follow https://huggingface.co/databricks/dbrx-instruct/discussions/10 to change the matmul to linear, let's follow this way to add a patch for this model

wenhuach21 avatar Mar 28 '24 14:03 wenhuach21