bert.cpp
bert.cpp copied to clipboard
converter does not work with the current ggml
Tried to convert https://huggingface.co/intfloat/e5-large-v2
to ggml with the current d9f04e609fb7f7e5fb3b20a77d4d685219971009
commit. However, execution of the converted f32, f16, q4_0, and q4_1 models shows the not enough space in the context's memory pool
message. Maybe it is related to https://github.com/ggerganov/ggml/issues/158 ?