ChatGLM-6B
ChatGLM-6B copied to clipboard
[Help] <title>我是想做一些新闻关键词标注,但是经常遇到超出token的问题,有没有好的解决方法
Is there an existing issue for this?
- [X] I have searched the existing issues
Current Behavior
大部分文章长度都会超出maxtoken
Expected Behavior
No response
Steps To Reproduce
提取较长篇新闻的关键词
Environment
- OS:
- Python:
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :
Anything else?
No response