ios

Results 3 comments of ios

同问,我目前在多个模型中发现token的vocab_size小于generate后的logit的size,请问楼主有解决吗

已解决,可以参看qwen中的issues,具体原因时model中为了和128 size对齐 提高运算效率,导致vocab_size在model中会大于token中实际的vocab_size。

I have the same request, I want to find functions with zero or more arguments, is there any good solution now?