YanjunZhao comments

Repositories
Issues
Comments

Results 3 comments of


                                            YanjunZhao

关于 e-maxx 的进度

balanced-ternary已完成并merge

Results of Trec dataset on Roberta-large(K=512) with MeZO(LoRA)

thanks for your reply! But I have used the updated code and failed in Trec dataset.

Results of Trec dataset on Roberta-large(K=512) with MeZO(LoRA)

I use the code with `param.data = param.data - self.args.learning_rate * (projected_grad * z + self.args.weight_decay * param.data)`. I cann't reproduce the result with `TASK=trec K=512 SEED=42 BS=64 WD=0.1 LR=1e-4/5e-5/1e-5...