Yulun Du
Yulun Du
Could you give us a screenshot/copy of your chat so we could investigate what went wrong with the formatting?
Quantization (or any other kind of “scaling down”) is not on our timeline at this moment. We welcome the community to add more support on these aspects. e.g. I have...
It is to avoid information loss. Imagine by chunking you enforced the model focusing on every part of the full input, making sure that every piece of information is considered...