petals icon indicating copy to clipboard operation
petals copied to clipboard

Published 20 hours ago • verified publisher icon bigscience-workshop

Prompt Tuning met NaN error

Open xinghua-qu opened this issue 1 year ago • 1 comments

I tried to run the code for prompt tuning example, but got the NaN error after some iterations.

Does anybody know the reason for such error? Thanks :) The dots after the training curve mean NaN. image

xinghua-qu avatar Jun 13 '23 08:06 xinghua-qu

Hi @xinghua-qu! We made a fix for this in https://github.com/bigscience-workshop/petals/pull/343 which should likely resolve your issue. Can you try running the SST-2 prompt tuning notebook from main?

mryab avatar Jul 12 '23 12:07 mryab