GaLore icon indicating copy to clipboard operation
GaLore copied to clipboard

Published 20 hours ago • verified publisher icon jiaweizzhao

Reproducing Perplexity evaluation

Open NitzanHod opened this issue 11 months ago • 2 comments

How exactly did you measure Perplexity during pre-training with GaLore? (e.g. when creating Figure 5 in your paper https://arxiv.org/pdf/2403.03507.pdf ). Thanks.

NitzanHod avatar Mar 22 '24 15:03 NitzanHod