dvc icon indicating copy to clipboard operation
dvc copied to clipboard

dvc queue logs -f could take more then one job_id

Open behrica opened this issue 2 years ago • 6 comments

Similar to "dvc exp run --run-all", which follows the log of all running jobs.

so maybe as simple as:

dvc queue logs -f 107f918,a6ca492

or maybe as options to follow "all running"

dvc queue logs -f all

behrica avatar Dec 05 '22 15:12 behrica

It could be as simple as dvc queue logs without any args follows all tasks.

dberenbaum avatar Dec 30 '22 15:12 dberenbaum

This would also be useful as a replacement for dvc exp run --run-all. See https://github.com/iterative/dvc/discussions/8724.

dberenbaum avatar Jan 02 '23 13:01 dberenbaum

I agree with this, especially given that dvc exp run --run-all will be deprecated in a future release! The documentation says:

dvc exp run --run-all [--jobs] is now a shortcut for dvc queue start [--jobs] followed by dvc queue logs -f.

However, there isn't actually a set of suitable DVC commands that could replace --run-all without the addition of at least the option suggested by @behrica, since dvc queue logs -f requires exactly one task to be specified.

In that spirit, I would go even further and suggest that an option should also be added to dvc queue start (perhaps --logs, --follow, or --attach), which follows the logs of all of the experiments in the queue (for which I imagine the easiest implementation would be creating a --follow-all option for queue logs and making it a shortcut).

ReveStobinson avatar Jan 30 '23 22:01 ReveStobinson

Let's make dvc queue logs show logs for all experiments by default, and then make dvc queue start --follow equivalent to dvc queue start && dvc queue logs --follow.

dberenbaum avatar May 30 '23 17:05 dberenbaum

Afaik dvc queue logs does NOT show all experiments by default still, and this issue is still valid. Is that correct @dberenbaum ?

BradyJ27 avatar Dec 15 '23 23:12 BradyJ27

Yes, that's correct.

dberenbaum avatar Dec 16 '23 11:12 dberenbaum