handsome-chips

Results 1 issues of handsome-chips

请问:batch_indices 是什么含义? LookaheadCache 的put、stream_put函数的最后一个参数idx是什么含义? mode和 idx 直接有关系吗? 为啥mode='input', idx = 0,1,2,3.. batch的值,为啥mode='output', idx=-1 ? https://github.com/alipay/PainlessInferenceAcceleration/blob/8015f12f7fe32acc102bb3eb51c4f8b3a420e79c/pia/lookahead/common/pretrained_model_batch.py#L1254-L1259 ```python def put(self, token_ids, branch_length=8, final=False, mode='output', idx=0): ``` 为什么 `idx is only used for...