Handling new lines in evaluation?

[mrconter1]

Hi!

I am planning on creating an evaluation but I am still thinking about how to write new lines in the evaluation .jsonl file. Would the model see "\n" exactly the same as I do when I enter this:

into the prompt? How about with "\t"?

Regards, Rasmus

[SierotkaM]

Mi kiedyś Gpt 3 taka wykreował r n b q k b n r p p p p p p p p . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . P P P P P P P P R N B Q K B N R Jakoś trzeba mu oznaczenia szachowe jak na szachownicy zrobic

pt., 24 mar 2023, 13:34 użytkownik Rasmus Lindahl @.***> napisał:

Hi!

I am planning on creating an evaluation but I am still thinking about how to write new lines in the evaluation .jsonl file. Would the model see "\n" exactly the same as I do when I enter this:

[image: image] https://user-images.githubusercontent.com/32551374/227522289-5d16a787-1750-45dd-8cf1-f5c3a94b2449.png

into the prompt? How about with "\t"?

Regards, Rasmus

— Reply to this email directly, view it on GitHub https://github.com/openai/evals/issues/431, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6PJHHXLYSIJTIWMIYYXO5DW5WIE3ANCNFSM6AAAAAAWGQDFJQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

[Sypherd]

Yes, '\n' will work in the "ideal" part of the .jsonl file. If you ask it to output values on newlines, you can see that the model outputs '\n' between lines in the 'sampled` part of the logs.

[SierotkaM]

Gogle robi problemy z czego nie korzystam przy szkoleniu Gpt jest opatrzone informacja ,że to ich i niby tylko informują Ale czuje się presję .proszę oi szachy do dyspozycji i tłumaczenie ekranu

pt., 24 mar 2023, 16:49 użytkownik Chris Sypherd @.***> napisał:

Yes, '\n' will work in the "ideal" part of the .jsonl file. If you ask it to output values on newlines, you can see that the model outputs '\n' between lines in the 'sampled` part of the logs.

— Reply to this email directly, view it on GitHub https://github.com/openai/evals/issues/431#issuecomment-1483025394, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6PJHHR3U6G257AOJHWH6MTW5W67NANCNFSM6AAAAAAWGQDFJQ . You are receiving this because you commented.Message ID: @.***>