ludwig icon indicating copy to clipboard operation
ludwig copied to clipboard

Story for model-agnostic, predict-only "free" parameters

Open justinxzhao opened this issue 2 years ago • 0 comments

Model-agnostic, predict-only parameters like top_k and threshold are "free" parameters since they have no bearing on how the model is architected or how the model is trained. However, they are interesting to configure and experiment with since they can have an outsized impact on evaluation metrics.

These parameters are currently set in the model config, but since they don't directly impact the model, it could be worth scoping out a more lightweight way to change these parameters without having to change the Ludwig config.

justinxzhao avatar Jun 22 '22 00:06 justinxzhao