gerbil
gerbil copied to clipboard
Configuring GERBIL Experiment
Hello everyone,
I hope someone can help me with this issue. Is it possible to configure an experiment with both the following settings?
- As a system, an uploaded file with answers
- As a dataset, an uploaded JSON file (both are compliant with the QALD format)
I've tried to set up this configuration but it seems that when uploading a file with answers I'm forced to chose a dataset...I thought that this choice was done just to point out to the system how the answer file is formatted but it appears that it determines also the dataset even if I upload a "custom" one.
Hi,
thanks for using GERBIL (QA).
Yes, this was a restriction in the current system (that I thought we had circumvented). Can you send us the two files (shorten as much as you want) and we will have a look into quick fixing it?
Best Ricardo
Hi Ricardo, thanks for your reply. Here you can find an example of the files I'm trying to upload for my experiments. (of course, answers is the file containing the system output, and dataset is my custom dataset) https://drive.google.com/open?id=1jm-IuhAOCQM4GHlFNTgt1YwjUDr5yS0X Let me know if the problem can be fixed.
Best Regards, Lucia
FYI: we had the discussion before. See #250
Oh right, thanks for updating my memory. So, currently, there is no way to do it. Thus, either one of the core developers has time to change it (?) or you @lsiciliani could contribute to the source code. I am sorry, that this is not yet done.
Tested, commited and updated in the online version. Please test if it is working for you :)
We assume, it is done. Please reopen @lsiciliani if it does not work