OpenChatKit icon indicating copy to clipboard operation
OpenChatKit copied to clipboard

Published 20 hours ago • verified publisher icon togethercomputer

LOST in the MIDDLE

Open eyuansu62 opened this issue 2 years ago • 0 comments

hi, i'm curious about the experiment that togetherAI reproduced of paper: LOST in the MIDDLE. It seems that llama-2 and llama2-32K does not have the "U-shape performance" in the long-context QA. Did togetherAI use the same setting with LOST in the MIDDLE?

eyuansu62 avatar Aug 07 '23 02:08 eyuansu62