dvclive
dvclive copied to clipboard
iterative
📈 Log and track ML metrics, parameters, models with Git and/or DVC
In https://github.com/iterative/example-repos-dev/pull/117, inserting a `live.make_report()` call will fail because there is a manually written `precision_recall.json` file in the live dir: ``` $ python src/evaluate.py model.pkl data/features INFO:dvclive:Report path (if generated):...
😓 Catalyst uses `valid` instead of `eval` so I actually forgot to include it in the standardization _Originally posted by @daavoo in https://github.com/iterative/dvc.org/pull/3726#discussion_r914724169_
* [ ] ❗ I have followed the [Contributing to DVCLive](https://github.com/iterative/dvclive/blob/master/CONTRIBUTING.md) guide. * [ ] 📖 If this PR requires [documentation](https://dvc.org/doc) updates, I have created a separate PR (or issue,...
In order to properly [resume training with dvc checkpoints](https://dvc.org/doc/user-guide/experiment-management/checkpoints#starting-from-an-existing-checkpoint), the user needs to load the existing `model_file` at the beginning of training. Given that DVCLive integrations already take care of...
The [TensorBoard callback](https://www.tensorflow.org/api_docs/python/tf/keras/callbacks/TensorBoard) collects and stores learning rate: https://github.com/keras-team/keras/blob/d8fcb9d4d4dad45080ecfdd575483653028f8eda/keras/callbacks.py#L2527-L2531
Depending on the type of model to be trained, the time in between calls to `next_step` may vary significantly. In common deep learning scenarios, i.e. the [keras callback](https://github.com/iterative/dvclive/blob/master/dvclive/keras.py), `next_step` is...
https://github.com/iterative/vscode-dvc/pull/1673#discussion_r866510987
can we rename it? is it a default name? it's a bit confusing to have `dvclive` dir, `dvclive/scalars` which are actually plots and `dvclive.json` that is actually scalars ... how...
I think having this here also leads to the old "experiment is logged with the last epoch number" error _Originally posted by @mattseddon in https://github.com/iterative/vscode-dvc/pull/1618#discussion_r861417166_
> It might be enough to hint about the environment variable like in https://github.com/iterative/dvc/blob/f84f9cf1846554a13f388693220378edb8d17be6/dvc/commands/plots.py#L111. @daavoo What do you think about this idea? _Originally posted by @dberenbaum in https://github.com/iterative/dvclive/pull/243#discussion_r859756930_