LLMZoo
LLMZoo copied to clipboard
FreedomIntelligence
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
Why the tokenizer class specified in tokenizer config is BloomTokenizer? There is only BloomTokenizerFast in transformers implementation.
This PR adds support for the above mentioned LLMs using LiteLLM https://github.com/BerriAI/litellm/ LiteLLM is a lightweight package to simplify LLM API calls - use any llm as a drop in...
I run the train phoenix-script and got the following error. How can I fix it? ``` RuntimeError: CUDA error: invalid device ordinal CUDA kernel errors might be asynchronously reported at...
lora训练出错
使用lora方式训练时，出现以下错误 RuntimeError: Expected to mark a variable ready only once. This error is caused by one of the following reasons: 1) Use of a module parameter outside the `forward` function....
ModuleNotFoundError: No module named 'auto_gptq'
# One word for all As reported in the technical report, the bs: 256 is seemly a large-scale batch size with 2048 max sequence length. I wonder what hardware environment...
I trained the model and save the checkpoint successfully. After that, how could I load the checkpoint in inference? I tried to use the checkpoint path as the model path...
Metadata
Owner
Metadata
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡