Yao Matrix
Yao Matrix
> > The recovered token should not be from the target token ids if temperature != 0. It should be sampled from a new distribution. Correct me if I misunderstand...
Since most of the optimizations are de-bottlenecking CPU, so I suppose CPU information in benchmark will be important for us to reproduce and analyze. Could you add your CPU info...
ci failure seems not brought by my PR
@ArthurZucker @IlyasMoutawwakil could you help review and comment? Thx very much
ci failure maybe because of the instable ci env
@IlyasMoutawwakil , could you help review? Thx very much.
@Rocketknight1 , do you know who else need review this PR after Ilyas approved? Thx.
> > > @sywangyi do you have test result? > > > > > > Hi, @libinta , we used a docker image with build 438 for 1.18.0 release from...
@regisss , maybe we can merge it? Since it works on 1.21 and it's a 10-month journey w/ times of rebase.
@Qubitium, could you pls help review? Thx.