Alex Dunn
Alex Dunn
Great, thanks for the PR! I will review and merge soon
As a point of discussion, are there thoughts on using F1 as a replacement for ROCAUC for the leaderboards? Since many of the algorithms only have discretized probability $\in {0,1}$
@hrushikesh-s @computron thoughts on this?
Hey @sgbaird I just read through this now. We have been brainstorming w/TRI what a good improvement on matbench would look like (generative, adaptive learning, etc.). These sorts of generative...
> I'm curious to hear your thoughts about how integration with Matbench might work. Sure. ### Codebase In terms of actual implementation and code, I don't think it would require...
I can do either of those as well @janosh, just shoot me a calendar invite!!
@hrushikesh-s yes, it's so there is never a scenario where the docs/website don't represent the actual benchmark data. Without this commit and push action, the workflow for updating looks like...
Oh, I did not see that link you posted essentially takes care of the problem. If we can put in a workflow script to take care of it automatically, I'm...
 but 
> When I clone the repo and try rebuilding the website on a local server by running `scripts/rebuild_docs.py` and having `mkdocs serve` running in another terminal, I'm able to get...