gemma.cpp Run 7b model error,"./gemma --tokenizer tokenizer.spm --model 7b-it --compressed_weights 7b-it.sbs" ,error message: "Failed to read cache gating_ein

Run 7b model error,"./gemma --tokenizer tokenizer.spm --model 7b-it --compressed_weights 7b-it.sbs" ,error message: "Failed to read cache gating_ein_0 (error 294)"

Open lnxknl opened this issue 1 year ago • 2 comments

Failed to read cache gating_ein_0 (error 294) │ Abort at /home/.../models/gemma.cpp/./gemma.cc:117: Failed│ to open model file - does it exist? │

Feb 23 '24 12:02 lnxknl

Hi, please see #5, does that help?

Feb 23 '24 12:02 jan-wassenberg

Yes it does, hanks ! That's indeed the cmake option to solve this error:

cmake -DWEIGHT_TYPE=hwy::bfloat16_t ..

Feb 24 '24 17:02 cerisara

Yes it does, hanks ! That's indeed the cmake option to solve this error:
cmake -DWEIGHT_TYPE=hwy::bfloat16_t ..

yes, compile with this cmake opition without this error.

Feb 25 '24 05:02 lnxknl