Larger models and RoPE interpolation

[nivibilla]

Hey,

Amazing work! Can we expect a followup with larger models(13B, 30B and 65B)?

Also I think combining your method with https://arxiv.org/abs//2306.15595 would be amazing to get an open source 32k model

thanks