scarlet icon indicating copy to clipboard operation
scarlet copied to clipboard

Regression test data sets

Open silkerice opened this issue 2 years ago • 3 comments

Hello,

As part of my bachelor thesis I'm playing around with the constraints for the SCARLET algorithm. I want to test the SCARLET algorithm without any monotonicity constraint to see how much worse it performs in that case. On the website you created (https://pmelchior.github.io/scarlet/regression.html) you discuss three datasets used for regression testing. I tried accessing these datasets via the api.py and aws.py files (scarlet/scarlet/testing/....), but was not able to do so. Is it possible to access the AWS container so I can download these datasets?

Thank you in advance!

silkerice avatar Apr 19 '22 14:04 silkerice

@fred3m is there a way to allow the data download from AWS or would it be better to make a static download for Silke?

pmelchior avatar Apr 19 '22 15:04 pmelchior

Sorry for the delayed response, I've been out of the office. Will post an update soon after @pmelchior and I talk offline.

fred3m avatar Apr 25 '22 17:04 fred3m

The solution we came up is to open-source the test data in the form of a git-lfs repo, so everyone (incl us) who needs it can simply clone the repo.

pmelchior avatar Jul 06 '22 15:07 pmelchior