Erin LeDell

Submit to CRAN

1

I think we're probably ready to do our first CRAN submission!

Fill in NEWS.md file with recent updates

3

We have been forgetting to update the NEWS.md file with our updates. We should try to fill in what's happened in recent versions by looking at merged PRs.

List of demos or projects using meetupr

4

Please add any demos or references to the meetupr package that you see on the internet as a comment below. Once there is a short list, we can make this...

The method of using Gmail to send your wimlds emails has changed. We need to update the screenshots using the new settings (link to correct/updated settings is in the doc...

Information on how these datasets were chosen

2

Hi there, I realize this benchmark is a few years old now, but can you explain how these datasets from OpenML were selected for this benchmark? If they were not...

Benchmark reports logloss, but benchmark does not tell AutoML systems to optimize for logloss

2

I noticed that you're reporting logloss as the metric to evaluate systems, but you're not passing this information to any of the AutoML systems. Both auto-sklearn and H2O AutoML (maybe...

Missing information (not reproducible)

15

Hi there, Thanks for releasing this code. There are a few pieces of information missing that prevent the benchmarks from being reproducible. - Which version of H2O and auto-sklearn were...

highlight package orphaned on CRAN

1

Just in case you didn't notice (maybe missed the email), I wanted to mention that this package now has "ORPHANED" status on [CRAN](https://cran.r-project.org/web/packages/highlight/index.html).