Long-Context-Data-Engineering icon indicating copy to clipboard operation
Long-Context-Data-Engineering copied to clipboard

Published 20 hours ago • verified publisher icon FranxYao

When did you perform dynamic-NTK?

Open Liu-yuliang opened this issue 3 months ago • 1 comments

hi, i find you used dynamic NTK in llama-7b-80k, I'm curious about when you used it, before or after training phase? thank you for your reply

Liu-yuliang avatar Mar 20 '24 14:03 Liu-yuliang