LongWriter
LongWriter copied to clipboard
THUDM
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
### System Info / 系統信息 ValueError: As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define...
### System Info / 系統信息 Python version: 3.10 Hardware: 2x NVIDIA T4 GPUs (Kaggle environment) CUDA: Latest available on Kaggle vLLM: Latest (installed via pip with --force-reinstall) Model: THUDM/LongWriter-glm4-9b Platform:...
### Feature request / 功能建议 how to use a local LLM to evaluate prediction quality? For example, Llama-3-70B-Instruct? ### Motivation / 动机 how to use a local LLM to evaluate...
I have a 3070Ti and was wondering if running this training pipeline on consumer grade hardware is possible. If not, then what is the recommend hardware requirement and cost of...
do you provide api for testing? since i do not have the hardware to deploy the model, any way i could see how it works
想知道qwen3系列模型是否也会有输出2k words的困境，有人了解吗？ 或者有人知道大模型输出长度限制是多少，网上很难搜到相关说明呢，一般都是说上下文长度、输入+输出限制
### System Info / 系統信息 点击链接进去后，还是去年8月的paper ### Who can help? / 谁可以帮助到您？ _No response_ ### Information / 问题信息 - [ ] The official example scripts / 官方的示例脚本 - [ ]...
