seg
Number of submissions
Hi @kwinkunks considering it's not a traditional format of Machine Learning contests which would be upload the .csv file and it would automatically give the accuracy. I just want to know can we submit 2 or more model(by 1 user) from the time you might have scored their previous model ? Till now I have been building one model waiting for you score to submit my next. I feel like it's one submission per day and a lot of time is left idle in between. Let me know your thoughts.
You can submit as often as you like, but I can't guarantee that I can score more than one a day. Yours are fairly easy to score, since you give me the results in a CSV.
Note that, if we did use the 'traditional' approach, we'd be back to the problem of meta-overtraining we discuss in #2 , so I feel like a bit of time lag is a good thing, in a way.
In future, I'll look for a larger blind dataset so that we can score immediately against a 'pseudo-blind' subset, then score against the entire blind dataset at the end of the contest.
