llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

discussion: expanding the use-case of llama.cpp - embedded LLM toolchain

Open jon-chuang opened this issue 2 years ago • 0 comments

For instance, should llama.cpp:

  1. support an embedded vector-similarity knowledge base?
  2. support other models for multimodality (similar to GPT4). (See e.g. CLIP-based)

It doesn't have be part of the compilation of main, it could be in a llama.embed toolchain

jon-chuang avatar Apr 13 '23 01:04 jon-chuang