bilingual_book_maker icon indicating copy to clipboard operation
bilingual_book_maker copied to clipboard

Published 20 hours ago • verified publisher icon yihong0618

根据原文各行所占token数自动调整每次请求时的--batch_size值

Open WeeAris opened this issue 1 year ago • 1 comments

发起请求前，统计原文各行所占token数，自动调整每次请求时的--batch_size值，最大化利用每次请求的token数。 例如：--batch_size auto

WeeAris avatar May 25 '23 00:05 WeeAris

附议 不然一分钟三次太慢了

werran2 avatar May 29 '23 16:05 werran2