Gael Gendron
Gael Gendron
Thank you for the feedback! I proceeded to the following changes: 1. I changed the format of the ideal labels from int to str 2. I added a file in...
Thank you for the additional feedback. I modified the evaluation from `Match` to `Includes` and changed the prompt to `Figure out the pattern in the following examples and apply it...
Thank you for the feedback! I proceeded to the following changes: 1. I changed the format of the `symbolic_samples` labels from int to str 2. I pruned the files to...
Thank you for the additional feedback. I modified the evaluation from `Match `to `Includes `and added the following sentence to the prompt: `Explain your reasoning step-by-step and provide the expected...
[Eval] Evaluation of abstract reasoning capabilities of language models with the Raven Matrices test
Thank you for the feedback! I proceeded to the following changes: 1. I reverted the modification of the `.gitattributes` file 2. I modified the evaluation from `Match `to `Includes `and...
[Eval] Evaluation of abstract reasoning capabilities of language models with the Raven Matrices test
Thank you for the additional feedback. I changed the prompt from `provide the expected output` to `provide the expected letter` to make the intended format clearer to the model.
[Eval] Evaluation of abstract reasoning capabilities of language models with the Raven Matrices test
It's better indeed, I modified the prompt accordingly