exllama icon indicating copy to clipboard operation
exllama copied to clipboard

Published 20 hours ago • verified publisher icon turboderp

Dynamic NTK RoPe scaling support

Open epicfilemcnulty opened this issue 2 years ago • 1 comments

transformers merged https://github.com/huggingface/transformers/pull/24653 only dynamic NTK RoPe scaling (NTKv2), would be nice to have it in exllama.

epicfilemcnulty avatar Jul 20 '23 18:07 epicfilemcnulty

Yes, this is planned. Stay tuned.

turboderp avatar Jul 20 '23 20:07 turboderp