Jack BAI

Hi, I'm wondering what tools to use for visualizing JSON. Do you use a NoSQL database to create the data and then export it? Or do you simply use some...

Finetuning on Downstream Tasks: Eval zero-shot perplexities on standard evals (e.g. LAMBADA? HELM? etc.)

1

Excuse me, just want to ask whether there's any progress on Eval zero-shot perplexities on standard evals (e.g. LAMBADA? HELM? etc.). We're using this repo for downstream eval to show...

Why do we need further pretrain given the loss is already converged

1

I observe that the loss converges around 100000 steps. Why do we need to further train the model until 600000 steps?

The simulator model text-davinci-003 is now deprecated and the other models (babbage-002 and ada-002) are super unreliable. Is there a workaround on this?