submission-criteria icon indicating copy to clipboard operation
submission-criteria copied to clipboard

Originality, concordance, and consistency checks for submissions in Numerai's tournament.

Results 17 submission-criteria issues
Sort by recently updated
recently updated
newest added

Bounty: 10NMR

enhancement
good first issue
bounty

On Rocket.Chat, user `harambe`:

bug

To prevent merging broken submission download code (#34 and #46) This could be straightforward: simply call s3_util.download() on a file that's always in S3. An example would be in the...

enhancement
bounty
infrastructure

Delete submission CSVs that are older than two weeks.

bug
high priority

The project is currently tightly coupled to psycopg2. It should be decoupled and the business logic should depend on SqlAlchemy instead. This leads to: * unit tests can be written,...

Based on the suggested improvements in the pdf. I am now pull the tournament_data to allow the user submission data and other submissions to be broken down into the `validation`,...

Currently, we get all the submissions for originality to compare to with this query: ``` query = """ SELECT s.id FROM submissions s INNER JOIN originalities o ON s.id =...

bug
high priority

Inputs we could use: - Filenames - submission time - submission IP - account creation IP - withdrawal time - withdrawal IP

enhancement

I've created a FIFO queue `api-ml-production.fifo`. It's guaranteed to deliver each message only once. Each message has hidden visibility for 2 minutes after it's been received by a consumer. This...

enhancement
infrastructure

One idea related to distances, is divergence. There exists a really good generalization framework that produces a lot of difference divergence criteria. It would be cool to investigate using one...