gerbil icon indicating copy to clipboard operation
gerbil copied to clipboard

Configuring GERBIL Experiment

Open lsiciliani opened this issue 4 years ago • 6 comments

Hello everyone,

I hope someone can help me with this issue. Is it possible to configure an experiment with both the following settings?

  1. As a system, an uploaded file with answers
  2. As a dataset, an uploaded JSON file (both are compliant with the QALD format)

I've tried to set up this configuration but it seems that when uploading a file with answers I'm forced to chose a dataset...I thought that this choice was done just to point out to the system how the answer file is formatted but it appears that it determines also the dataset even if I upload a "custom" one.

lsiciliani avatar Mar 19 '20 21:03 lsiciliani

Hi,

thanks for using GERBIL (QA).

Yes, this was a restriction in the current system (that I thought we had circumvented). Can you send us the two files (shorten as much as you want) and we will have a look into quick fixing it?

Best Ricardo

RicardoUsbeck avatar Mar 20 '20 08:03 RicardoUsbeck

Hi Ricardo, thanks for your reply. Here you can find an example of the files I'm trying to upload for my experiments. (of course, answers is the file containing the system output, and dataset is my custom dataset) https://drive.google.com/open?id=1jm-IuhAOCQM4GHlFNTgt1YwjUDr5yS0X Let me know if the problem can be fixed.

Best Regards, Lucia

lsiciliani avatar Mar 20 '20 09:03 lsiciliani

FYI: we had the discussion before. See #250

MichaelRoeder avatar Mar 20 '20 09:03 MichaelRoeder

Oh right, thanks for updating my memory. So, currently, there is no way to do it. Thus, either one of the core developers has time to change it (?) or you @lsiciliani could contribute to the source code. I am sorry, that this is not yet done.

RicardoUsbeck avatar Mar 20 '20 09:03 RicardoUsbeck

Tested, commited and updated in the online version. Please test if it is working for you :)

TortugaAttack avatar Jul 14 '20 10:07 TortugaAttack

We assume, it is done. Please reopen @lsiciliani if it does not work

RicardoUsbeck avatar Nov 10 '20 09:11 RicardoUsbeck