LongRoPE icon indicating copy to clipboard operation
LongRoPE copied to clipboard

verified publisher icon jshuadvd
→

Metadata

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

Results 3 LongRoPE issues
Sort by recently updated
recently updated
newest added

Add usage example instructions use case, such as `phi-3-mini-4k-instruct` to `phi-3-mini-256k-instruct` ?

Firstly, this paper is really really impression. This resolves one of main issues của currently LLMs. But I have many confused, maybe because I don't really welling in this field....

lh0x00 avatar lh0x00

Can this repo reproduce thie results of the original paper?

hijkzzz avatar hijkzzz

Thank you for your implementation and request to cite our official repository

Hi, I'm Jiahang from Microsoft LongRoPE team. Thank you for your interest in our work and for creating a comprehensive implementation of it on GitHub. We truly appreciate your effort...

JiahangXu avatar JiahangXu

← Metadata

82
Stars
8
Forks
Watchers

Owner

verified publisher icon jshuadvd

Metadata

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

Back