ggml icon indicating copy to clipboard operation
ggml copied to clipboard

Published 20 hours ago • verified publisher icon ggerganov

support for falcon model

Open aseok opened this issue 1 year ago • 1 comments

Is it possible to convert falcon model by other example conversion codes?

aseok avatar May 30 '23 09:05 aseok

The architecture that Falcon uses is different than those currently supported.

More discussion here: https://github.com/ggerganov/llama.cpp/issues/1602

klosax avatar May 30 '23 09:05 klosax

Falcon LLM ggml framework with CPU and GPU support: https://github.com/cmp-nct/ggllm.cpp

klosax avatar Jul 20 '23 19:07 klosax