LLMZoo

LLMZoo copied to clipboard

chat with phoenix-inst-chat-7b report error

1

 It seems the model input limit is exceeded. The first few questions can be answered normally.

ananwjq

Running issue

1

 When I run "python -m llmzoo.deploy.cli --model-name /path/to/weights/", the terminal occurs an error. Could you please tell me what is the problem? Thanks a lot.

Tong010618

Evaluating RWKV "Raven" (ChatGPT-tuned models)

1

Hi everyone. Thanks for the great work. Would you be interested in evaluating RWKV "Raven" (ChatGPT-tuned), firstly the English models? :) DEMO: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B p.s. What kind of decoding method (very...

BlinkDL

When will the chat data release? Thanks!

2

REIGN12

running model with 8-bit, too slow!

2

Hi, I am running model:chimera-inst-chat-13b in 8-bit on a A100, and it cost almost double time than FP16 version, is it normal?  And I found that 8-bit LLM is...

ananwjq

Is it possible the have the Web API inteface just like 'llmzoo.deploy.cli'

4

as the title, if we have some http apis serve to create convarsation, append the context messages, call the selected LLM model the generate the response text , is it...

timiil

ask tuning details, like lr

1

Can you explain the learning rate Settings of Instruction-based Tuning and Conversation-based Tuning? thanks so much!

ninisy

is there a llama.cpp version?

2

is there a llama.cpp version?

lucasjinreal

Is is possible to run the pre-trained model with rtx 2060 6g?

3

My computer has the rtx 2060 6G, the results say my gpu is lack, is there any way to run the phoenix model. thank you.

dream-desktop

Would you provide some details of model training process?

2

I noticed that you have provided instructions for deploying a large model, but there is no information about the model training process. I was wondering if it would be possible...

intelligencegear