AGI Security

Same here. Any solution?

While NBCE may be not the best approach, we can also take a look at this: - https://github.com/epfml/landmark-attention - https://github.com/princeton-nlp/AutoCompressors - https://arxiv.org/pdf/2305.19370.pdf Nice article: - https://blog.gopenai.com/how-to-speed-up-llms-and-use-100k-context-window-all-tricks-in-one-place-ffd40577b4c

Quantization support is crucial. 8 and 4 bit support is a must

Any examples?