CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Published 20 hours ago • verified publisher icon OpenNMT

Context Extension with Ctranslate2

Open pranavbhat12 opened this issue 1 year ago • 1 comments

Hey,

I am currently stuck if I want to enable rope scaling for Llama-2 models.Is it supported? I went through the documentation but there is not enough guidance on how to go about this.

Any help would be much appreciated. Thankyou.

pranavbhat12 avatar Nov 28 '23 11:11 pranavbhat12

read here: https://github.com/OpenNMT/CTranslate2/blob/master/python/ctranslate2/converters/transformers.py#L1281-L1322

vince62s avatar Nov 28 '23 12:11 vince62s