stable-diffusion.cpp icon indicating copy to clipboard operation
stable-diffusion.cpp copied to clipboard

FAILID TO LOAD T5XXL GGUF VERSION 4_K_S

Open ZFOURTYONE opened this issue 1 year ago • 6 comments

./generator -M txt2img --diffusion-model models/unet/FLUX/fluxFusionV24StepsGGUFNF4_V2GGUFQ3KM.gguf --clip_l models/clip/clip_l.safetensors --t5xxl 'models/clip/t5xxl_Q4_K_S.gguf' --vae models/vae/FLUX/diffusion_pytorch_model.safetensors -o 'output/imagen.png' -p 'a cat holding a paper with text "stable difussion cpp"' ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices [INFO ] stable-diffusion.cpp:202 - loading clip_l from 'models/clip/clip_l.safetensors' [INFO ] model.cpp:888 - load models/clip/clip_l.safetensors using safetensors format [INFO ] stable-diffusion.cpp:216 - loading t5xxl from 'models/clip/t5xxl_Q4_K_S.gguf' [INFO ] model.cpp:885 - load models/clip/t5xxl_Q4_K_S.gguf using gguf format [INFO ] stable-diffusion.cpp:223 - loading diffusion model from 'models/unet/FLUX/fluxFusionV24StepsGGUFNF4_V2GGUFQ3KM.gguf' [INFO ] model.cpp:885 - load models/unet/FLUX/fluxFusionV24StepsGGUFNF4_V2GGUFQ3KM.gguf using gguf format [INFO ] stable-diffusion.cpp:230 - loading vae from 'models/vae/FLUX/diffusion_pytorch_model.safetensors' [INFO ] model.cpp:888 - load models/vae/FLUX/diffusion_pytorch_model.safetensors using safetensors format [INFO ] stable-diffusion.cpp:242 - Version: Flux Schnell [INFO ] stable-diffusion.cpp:273 - Weight type: f16 [INFO ] stable-diffusion.cpp:274 - Conditioner weight type: f16 [INFO ] stable-diffusion.cpp:275 - Diffusion model weight type: q3_K [INFO ] stable-diffusion.cpp:276 - VAE weight type: f32 [INFO ] stable-diffusion.cpp:317 - set clip_on_cpu to true [INFO ] stable-diffusion.cpp:320 - CLIP: Using CPU backend [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.attn_rel_b.weight | f32 | 2 [64, 32, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.attn_v.weight | q5_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.ffn_down.weight | q5_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.0.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.attn_v.weight | q5_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.ffn_down.weight | q5_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.1.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.attn_v.weight | q5_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.ffn_down.weight | q5_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.2.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.attn_v.weight | q5_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.3.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.4.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.token_embd.weight | q6_K | 2 [4096, 32128, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.10.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.11.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.5.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.6.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.7.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.8.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.9.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.12.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.13.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.14.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.15.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.16.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.17.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.18.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.19.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.20.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.21.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.22.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.attn_k.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.attn_o.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.attn_q.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.attn_v.weight | q4_K | 2 [4096, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.attn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.ffn_gate.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.ffn_up.weight | q4_K | 2 [4096, 10240, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.ffn_down.weight | q4_K | 2 [10240, 4096, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.blk.23.ffn_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [INFO ] model.cpp:1818 - unknown tensor 'text_encoders.t5xxl.transformer.enc.output_norm.weight | f32 | 1 [4096, 1, 1, 1, 1]' in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.0.SelfAttention.relative_attention_bias.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.0.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.1.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.10.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.11.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.12.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.13.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.14.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.15.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.16.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.17.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.18.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.19.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.2.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.20.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.21.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.22.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.23.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.3.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.4.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.5.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.6.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.7.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.8.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.0.SelfAttention.k.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.0.SelfAttention.o.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.0.SelfAttention.q.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.0.SelfAttention.v.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.0.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.1.DenseReluDense.wi_0.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.1.DenseReluDense.wi_1.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.1.DenseReluDense.wo.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.block.9.layer.1.layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.encoder.final_layer_norm.weight' not in model file [ERROR] model.cpp:1862 - tensor 'text_encoders.t5xxl.transformer.shared.weight' not in model file [ERROR] stable-diffusion.cpp:436 - load tensors from model loader failed new_sd_ctx_t failed

ZFOURTYONE avatar Nov 28 '24 05:11 ZFOURTYONE

I think the t5 tensors got renamed to llama.cpp convention. We currently don't support that.

In the mean time you can try one of the t5s from here https://huggingface.co/Green-Sky/flux.1-schnell-GGUF/tree/main .

Green-Sky avatar Nov 28 '24 10:11 Green-Sky

I'm using your t5 tensor,but there's still unknown tensor name.

[DEBUG] stable-diffusion.cpp:172 - Using Vulkan backend ggml_vulkan: Found 1 Vulkan devices: ggml_vulkan: 0 = AMD Radeon(TM) Vega 8 Graphics (AMD proprietary driver) | uma: 1 | fp16: 1 | warp size: 64 ggml_vulkan: Compiling shaders..............................Done! [INFO ] stable-diffusion.cpp:202 - loading clip_l from './clip_l_f16.gguf' [INFO ] model.cpp:885 - load ./clip_l_f16.gguf using gguf format [DEBUG] model.cpp:902 - init from './clip_l_f16.gguf' [INFO ] stable-diffusion.cpp:216 - loading t5xxl from './t5-xxl-q4_k.gguf' [INFO ] model.cpp:885 - load ./t5-xxl-q4_k.gguf using gguf format [DEBUG] model.cpp:902 - init from './t5-xxl-q4_k.gguf' [INFO ] stable-diffusion.cpp:223 - loading diffusion model from './modern_anime_full_Q4_0.gguf' [INFO ] model.cpp:885 - load ./modern_anime_full_Q4_0.gguf using gguf format [DEBUG] model.cpp:902 - init from './modern_anime_full_Q4_0.gguf' [INFO ] stable-diffusion.cpp:230 - loading vae from './ae_f32.gguf' [INFO ] model.cpp:885 - load ./ae_f32.gguf using gguf format [DEBUG] model.cpp:902 - init from './ae_f32.gguf' [INFO ] stable-diffusion.cpp:242 - Version: Flux [INFO ] stable-diffusion.cpp:275 - Weight type: f16 [INFO ] stable-diffusion.cpp:276 - Conditioner weight type: f16 [INFO ] stable-diffusion.cpp:277 - Diffusion model weight type: q4_0 [INFO ] stable-diffusion.cpp:278 - VAE weight type: f32 [DEBUG] stable-diffusion.cpp:280 - ggml tensor size = 400 bytes [INFO ] stable-diffusion.cpp:319 - set clip_on_cpu to true [INFO ] stable-diffusion.cpp:322 - CLIP: Using CPU backend [DEBUG] clip.hpp:171 - vocab size: 49408 [DEBUG] clip.hpp:182 - trigger word img already in vocab [INFO ] flux.hpp:889 - Flux blocks: 19 double, 38 single [DEBUG] ggml_extend.hpp:1111 - clip params backend buffer size = 235.06 MB(RAM) (196 tensors) [DEBUG] ggml_extend.hpp:1111 - t5 params backend buffer size = 2555.36 MB(RAM) (219 tensors) ggml_vulkan: Device memory allocation of size 2111031296 failed. ggml_vulkan: vk::Device::allocateMemory: ErrorOutOfDeviceMemory [ERROR] ggml_extend.hpp:1103 - flux alloc params backend buffer failed, num_tensors = 780 [DEBUG] ggml_extend.hpp:1111 - vae params backend buffer size = 94.57 MB(VRAM) (138 tensors) [DEBUG] stable-diffusion.cpp:417 - loading weights [DEBUG] model.cpp:1698 - loading tensors from ./clip_l_f16.gguf |======> | 196/1440 - 0.00it/s[K[DEBUG] model.cpp:1698 - loading tensors from ./t5-xxl-q4_k.gguf |==============> | 413/1440 - 0.00it/s[K[INFO ] model.cpp:1868 - unknown tensor 'text_encoders.t5xxl.transformer.encoder.embed_tokens.weight | q4_K | 2 [4096, 32128, 1, 1, 1]' in model file |==============> | 416/1440 - 2.92it/s[K[DEBUG] model.cpp:1698 - loading tensors from ./modern_anime_full_Q4_0.gguf

Is there anyting I can do?

xhy2008 avatar Jan 16 '25 13:01 xhy2008

That single "unknown tensor" is to be expected. It should not cause any issues.

stduhpf avatar Jan 16 '25 14:01 stduhpf

I thought it was okay too. But the program stopped after showing the error.😭

xhy2008 avatar Jan 16 '25 14:01 xhy2008

It looks like it's crashing when loading tensors from the diffusion model file...

ggml_vulkan: Device memory allocation of size 2111031296 failed. ggml_vulkan: vk::Device::allocateMemory: ErrorOutOfDeviceMemory

Could also be related to that. How much VRAM do you have? Can you try running on CPU backend to see if it works?

stduhpf avatar Jan 16 '25 14:01 stduhpf

Oh,yes. I used the AVX2 build and it worked.😃 But it's quite slow. I think it can't generate a picture with flux until I die.😂

xhy2008 avatar Jan 19 '25 13:01 xhy2008

This should be fixed.

leejet avatar Nov 13 '25 15:11 leejet