lollms-webui icon indicating copy to clipboard operation
lollms-webui copied to clipboard

Add support for other backend

Open ParisNeo opened this issue 2 years ago • 1 comments

Expected Behavior

We should be able to select different backends. Need at least to support : 1- llamacpp 2- gpt-j 3- hugging face transformers models

Current Behavior

Only llamacpp is supported

ParisNeo avatar Apr 20 '23 10:04 ParisNeo

Now gpt-j backend is supported with a simplified mode (no word by word output)

ParisNeo avatar Apr 20 '23 17:04 ParisNeo

this is completed

andzejsp avatar May 27 '23 14:05 andzejsp