gemma.cpp icon indicating copy to clipboard operation
gemma.cpp copied to clipboard

Mismatch between expected 1024000 and actual 1024512 KiB size.

Open ticcky opened this issue 1 year ago • 1 comments

I downloaded weigths from https://huggingface.co/google/gemma-2b-cpp/blob/main/2b-pt.sbs but can't make them run:

$ ./gemma --tokenizer ~/Downloads/gemma-2b-pt/tokenizer.spm --model 2b-it --weights ~/Downloads/gemma-2b-pt/2b-pt.sbs 
Mismatch between expected 1024000 and actual 1024512 KiB size. Please see README.md on how to update the weights.

Am I missing some flags? I tried compiling with cmake -B build -DWEIGHT_TYPE=hwy::bfloat16_t but that didn't seem to have any effect.

ticcky avatar Apr 21 '24 08:04 ticcky

Sorry about the trouble. The weights have changed and they appear not to be synced across all sources. Are you able to download the v3 version from Kaggle, or the model there prefixed with "1.1" which also contain the updated size?

jan-wassenberg avatar Apr 22 '24 08:04 jan-wassenberg

Hi @ticcky , Could you please confirm, if the issue is resolved. If yes, please feel free to move this issue to closed status

KumarGitesh2024 avatar Jun 10 '24 09:06 KumarGitesh2024