bert.cpp icon indicating copy to clipboard operation
bert.cpp copied to clipboard

Published 20 hours ago • verified publisher icon skeskinen

converter does not work with the current ggml

Open yunghoy opened this issue 1 year ago • 4 comments

Tried to convert https://huggingface.co/intfloat/e5-large-v2 to ggml with the current d9f04e609fb7f7e5fb3b20a77d4d685219971009 commit. However, execution of the converted f32, f16, q4_0, and q4_1 models shows the not enough space in the context's memory pool message. Maybe it is related to https://github.com/ggerganov/ggml/issues/158 ?

yunghoy avatar Jul 19 '23 01:07 yunghoy