dvclive icon indicating copy to clipboard operation
dvclive copied to clipboard

Check integrations and update them to log params

Open shcheklein opened this issue 3 years ago • 3 comments

E.g. in the Lighting logger there is call:

    @rank_zero_only
    def log_hyperparams(self, params, *args, **kwargs):
        pass

should we utilize it to automatically track things?

Edit: add checkboxes per framework in order of priority based on framework pageviews

  • [x] lightning (https://github.com/iterative/dvclive/pull/388)
  • [x] huggingface
  • [ ] keras
  • [x] fast.ai (#416)
  • [ ] catalyst
  • [ ] xgboost
  • [ ] mmcv
  • [ ] lightgbm

shcheklein avatar Oct 01 '22 17:10 shcheklein

should we utilize it to automatically track things?

Yes, we should use log_params there

daavoo avatar Oct 03 '22 09:10 daavoo

Examples of logging parameters in other frameworks:

daavoo avatar Oct 03 '22 14:10 daavoo

I would suggest we prioritize at the same time as #305 since it's part of the same story (auto logging everything from the framework callbacks).

dberenbaum avatar Oct 03 '22 19:10 dberenbaum