mistral-inference icon indicating copy to clipboard operation
mistral-inference copied to clipboard

Published 20 hours ago • verified publisher icon mistralai

Mixtral sliding window

Open tuyaao opened this issue 1 year ago • 0 comments

What is the sliding window size for Mixtral training, Is it 32k or 8k

tuyaao avatar Jan 19 '24 12:01 tuyaao