llama.cpp
llama.cpp copied to clipboard
Published
1 month ago
•
ggml-org
ggml-org
Misc. bug: Eval bug: Conversion fails for PleIAs/Baguettotron & PleIAs/Monad - BPE pre-tokenizer not recognized
Name and Version
convert_hf_to_gguf.py b6957
Operating systems
Linux
Which llama.cpp modules do you know to be affected?
Python/Bash scripts
Command line
python convert_hf_to_gguf.py 'Monad' --outfile Monad --outtype f16
Problem description & steps to reproduce
download https://huggingface.co/PleIAs/Baguettotron or https://huggingface.co/PleIAs/Monad run convert_hf_to_gguf.py --outfile "you name choice" --outtype f16
First Bad Commit
No response
Relevant log output
INFO:hf-to-gguf:Loading model: Monad
INFO:hf-to-gguf:Model architecture: LlamaForCausalLM
INFO:hf-to-gguf:gguf: indexing model part 'model.safetensors'
INFO:gguf.gguf_writer:gguf: This GGUF file is for Little Endian only
INFO:hf-to-gguf:Exporting model...
INFO:hf-to-gguf:token_embd.weight, torch.bfloat16 --> F16, shape = {256, 8192}
INFO:hf-to-gguf:blk.0.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.0.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.0.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.0.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.0.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.0.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.0.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.0.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.0.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.1.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.1.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.1.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.1.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.1.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.1.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.1.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.1.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.1.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.10.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.10.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.10.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.10.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.10.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.10.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.10.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.10.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.10.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.11.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.11.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.11.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.11.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.11.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.11.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.11.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.11.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.11.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.12.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.12.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.12.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.12.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.12.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.12.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.12.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.12.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.12.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.13.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.13.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.13.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.13.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.13.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.13.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.13.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.13.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.13.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.14.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.14.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.14.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.14.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.14.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.14.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.14.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.14.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.14.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.15.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.15.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.15.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.15.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.15.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.15.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.15.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.15.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.15.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.16.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.16.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.16.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.16.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.16.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.16.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.16.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.16.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.16.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.17.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.17.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.17.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.17.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.17.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.17.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.17.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.17.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.17.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.18.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.18.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.18.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.18.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.18.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.18.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.18.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.18.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.18.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.19.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.19.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.19.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.19.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.19.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.19.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.19.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.19.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.19.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.2.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.2.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.2.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.2.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.2.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.2.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.2.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.2.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.2.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.20.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.20.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.20.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.20.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.20.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.20.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.20.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.20.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.20.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.21.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.21.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.21.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.21.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.21.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.21.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.21.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.21.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.21.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.22.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.22.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.22.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.22.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.22.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.22.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.22.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.22.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.22.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.23.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.23.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.23.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.23.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.23.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.23.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.23.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.23.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.23.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.24.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.24.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.24.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.24.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.24.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.24.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.24.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.24.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.24.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.25.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.25.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.25.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.25.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.25.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.25.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.25.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.25.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.25.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.26.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.26.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.26.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.26.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.26.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.26.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.26.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.26.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.26.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.27.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.27.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.27.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.27.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.27.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.27.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.27.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.27.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.27.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.28.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.28.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.28.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.28.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.28.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.28.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.28.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.28.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.28.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.29.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.29.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.29.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.29.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.29.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.29.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.29.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.29.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.29.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.3.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.3.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.3.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.3.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.3.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.3.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.3.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.3.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.3.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.30.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.30.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.30.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.30.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.30.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.30.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.30.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.30.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.30.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.31.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.31.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.31.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.31.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.31.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.31.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.31.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.31.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.31.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.32.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.32.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.32.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.32.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.32.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.32.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.32.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.32.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.32.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.33.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.33.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.33.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.33.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.33.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.33.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.33.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.33.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.33.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.34.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.34.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.34.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.34.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.34.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.34.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.34.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.34.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.34.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.35.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.35.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.35.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.35.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.35.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.35.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.35.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.35.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.35.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.36.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.36.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.36.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.36.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.36.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.36.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.36.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.36.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.36.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.37.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.37.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.37.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.37.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.37.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.37.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.37.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.37.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.37.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.38.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.38.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.38.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.38.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.38.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.38.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.38.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.38.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.38.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.39.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.39.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.39.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.39.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.39.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.39.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.39.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.39.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.39.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.4.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.4.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.4.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.4.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.4.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.4.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.4.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.4.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.4.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.40.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.40.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.40.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.40.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.40.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.40.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.40.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.40.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.40.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.41.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.41.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.41.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.41.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.41.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.41.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.41.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.41.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.41.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.42.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.42.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.42.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.42.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.42.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.42.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.42.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.42.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.42.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.43.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.43.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.43.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.43.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.43.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.43.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.43.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.43.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.43.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.44.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.44.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.44.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.44.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.44.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.44.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.44.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.44.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.44.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.45.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.45.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.45.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.45.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.45.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.45.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.45.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.45.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.45.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.46.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.46.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.46.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.46.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.46.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.46.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.46.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.46.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.46.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.47.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.47.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.47.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.47.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.47.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.47.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.47.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.47.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.47.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.48.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.48.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.48.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.48.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.48.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.48.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.48.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.48.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.48.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.49.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.49.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.49.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.49.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.49.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.49.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.49.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.49.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.49.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.5.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.5.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.5.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.5.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.5.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.5.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.5.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.5.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.5.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.50.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.50.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.50.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.50.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.50.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.50.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.50.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.50.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.50.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.51.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.51.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.51.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.51.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.51.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.51.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.51.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.51.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.51.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.52.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.52.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.52.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.52.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.52.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.52.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.52.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.52.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.52.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.53.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.53.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.53.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.53.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.53.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.53.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.53.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.53.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.53.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.54.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.54.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.54.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.54.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.54.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.54.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.54.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.54.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.54.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.55.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.55.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.55.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.55.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.55.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.55.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.55.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.55.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.55.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.56.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.56.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.56.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.56.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.56.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.56.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.56.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.56.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.56.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.57.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.57.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.57.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.57.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.57.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.57.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.57.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.57.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.57.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.58.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.58.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.58.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.58.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.58.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.58.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.58.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.58.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.58.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.59.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.59.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.59.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.59.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.59.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.59.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.59.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.59.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.59.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.6.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.6.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.6.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.6.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.6.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.6.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.6.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.6.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.6.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.60.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.60.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.60.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.60.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.60.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.60.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.60.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.60.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.60.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.61.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.61.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.61.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.61.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.61.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.61.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.61.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.61.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.61.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.62.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.62.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.62.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.62.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.62.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.62.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.62.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.62.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.62.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.63.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.63.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.63.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.63.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.63.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.63.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.63.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.63.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.63.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.7.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.7.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.7.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.7.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.7.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.7.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.7.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.7.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.7.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.8.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.8.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.8.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.8.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.8.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.8.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.8.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.8.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.8.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.9.attn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.9.ffn_down.weight, torch.bfloat16 --> F16, shape = {768, 256}
INFO:hf-to-gguf:blk.9.ffn_gate.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.9.ffn_up.weight, torch.bfloat16 --> F16, shape = {256, 768}
INFO:hf-to-gguf:blk.9.ffn_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:blk.9.attn_k.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.9.attn_output.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.9.attn_q.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:blk.9.attn_v.weight, torch.bfloat16 --> F16, shape = {256, 256}
INFO:hf-to-gguf:output_norm.weight, torch.bfloat16 --> F32, shape = {256}
INFO:hf-to-gguf:Set meta model
INFO:hf-to-gguf:Set model parameters
INFO:hf-to-gguf:gguf: context length = 2048
INFO:hf-to-gguf:gguf: embedding length = 256
INFO:hf-to-gguf:gguf: feed forward length = 768
INFO:hf-to-gguf:gguf: head count = 4
INFO:hf-to-gguf:gguf: key-value head count = 4
INFO:hf-to-gguf:gguf: rope theta = 10000
INFO:hf-to-gguf:gguf: rms norm epsilon = 1e-05
INFO:hf-to-gguf:gguf: file type = 1
INFO:hf-to-gguf:Set model quantization version
INFO:hf-to-gguf:Set model tokenizer
WARNING:hf-to-gguf:
WARNING:hf-to-gguf:**************************************************************************************
WARNING:hf-to-gguf:** WARNING: The BPE pre-tokenizer was not recognized!
WARNING:hf-to-gguf:** There are 2 possible reasons for this:
WARNING:hf-to-gguf:** - the model has not been added to convert_hf_to_gguf_update.py yet
WARNING:hf-to-gguf:** - the pre-tokenization config has changed upstream
WARNING:hf-to-gguf:** Check your model files and convert_hf_to_gguf_update.py and update them accordingly.
WARNING:hf-to-gguf:** ref: https://github.com/ggml-org/llama.cpp/pull/6920
WARNING:hf-to-gguf:**
WARNING:hf-to-gguf:** chkhsh: ae79c606a6c791b0419283242a04475cb9c400710397d3a7f145b49a91cd8f8b
WARNING:hf-to-gguf:**************************************************************************************
WARNING:hf-to-gguf:
Traceback (most recent call last):
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 2277, in set_vocab
self._set_vocab_sentencepiece()
File "/p/llama.cpp-b6957/convert_hf_to_gguf.py", line 1150, in _set_vocab_sentencepiece
tokens, scores, toktypes = self._create_vocab_sentencepiece()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 1167, in _create_vocab_sentencepiece
raise FileNotFoundError(f"File not found: {tokenizer_path}")
FileNotFoundError: File not found: /home/joe/Documents/chatbot/moded cashe/Monad/tokenizer.model
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 2280, in set_vocab
self._set_vocab_llama_hf()
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 1252, in _set_vocab_llama_hf
vocab = gguf.LlamaHfVocab(self.dir_model)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "//llama.cpp-b6957/gguf-py/gguf/vocab.py", line 515, in __init__
raise TypeError('Llama 3 must be converted with BpeVocab')
TypeError: Llama 3 must be converted with BpeVocab
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 10267, in <module>
main()
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 10261, in main
model_instance.write()
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 584, in write
self.prepare_metadata(vocab_only=False)
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 705, in prepare_metadata
self.set_vocab()
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 2283, in set_vocab
self._set_vocab_gpt2()
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 1086, in _set_vocab_gpt2
tokens, toktypes, tokpre = self.get_vocab_base()
^^^^^^^^^^^^^^^^^^^^^
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 801, in get_vocab_base
tokpre = self.get_vocab_base_pre(tokenizer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/llama.cpp-b6957/convert_hf_to_gguf.py", line 1074, in get_vocab_base_pre
raise NotImplementedError("BPE pre-tokenizer was not recognized - update get_vocab_base_pre()")
NotImplementedError: BPE pre-tokenizer was not recognized - update get_vocab_base_pre()
They've removed the alternate (?i:'s|'t|'re|'ve|'m|'ll|'d) regex from the Llama pre-tokenizer, meaning you (or someone else) will have to update and run convert_hf_to_gguf_update.py to generate the chkhsh entry and submit a PR with those changes and the new pre-tokenizer regex in llama-vocab.cpp before being able to convert it.
Hi. Pleias here: we plan to release a new version of the model for the model and can bundle a modified tokenizer to ease conversion.
You only see this issue or others?
Hi. Pleias here: we plan to release a new version of the model for the model and can bundle a modified tokenizer to ease conversion.
It would be preferable to submit a PR as outlined above, it's a simple update, no need to modify tokenizer.
You only see this issue or others?
Nothing obvious, the easiest way to find out is to do the changes and convert and test. :)
