jetson-containers icon indicating copy to clipboard operation
jetson-containers copied to clipboard

mlc_llm_build fails for Mistral-7B-Instruct-v0.2

Open rgobbel opened this issue 11 months ago • 0 comments

Mistral-7B-Instruct-v0.2 does not use sliding window attention, so building fails because there is an assumption that Mistral models all have some value for sliding_window.

rgobbel avatar Mar 26 '24 19:03 rgobbel