LLMFarm icon indicating copy to clipboard operation
LLMFarm copied to clipboard

Spews complete nonsense after any prompt

Open Stooovie opened this issue 8 months ago • 2 comments

Tried StableLM model with llama inference. This is an answer to "hi!"

{<E> ========== [EXPL] | 1) {prompt}

    1. (1, "2") [/EXPL]}; template <class E, class S> struct test_pair { typedef pair<E,S> type; };

int main(void) { #define PRINT0(x) cout << #x ": " << x << endl //PRINTTEST test_pair<short int, string> a; cout << "sizeof(std::pair <char, std::basic_string , long, short>) = "; printtest1(a); }

I have not found any way to get any output that wouldn't be total BS.

Stooovie avatar Jun 17 '24 21:06 Stooovie