vscode-dvc icon indicating copy to clipboard operation
vscode-dvc copied to clipboard

Extension can't handle custom folder structure

Open andiedrums opened this issue 1 year ago • 0 comments

image I have a repository structure (depicted in the image) where I want to use different stages and different params for each inspection, so each subfolder has its own params.yaml and dvc.yaml file. To demonstrate the problem, I adapt the amount of training epochs.

Things that work:

  • Using the terminal, dvc exp run -S inspections\nose_4pol_0deg_surface\params.yaml:train.epochs=28 in the corresponding inspection subdirectory.
  • Using the terminal, dvc exp run --queue inspections\nose_4pol_0deg_surface\dvc.yaml -S inspections\nose_4pol_0deg_surface\params.yaml:train.epochs=28 in the root directory.

Things that do not work:

  • Using the Modify and Run functionality of the vs code extension. While the vs code dropdown menu lists all params of the inspections\nose_4pol_0deg_surface\params.yaml (as it should be), executing the experiment shows the following error:
Running: dvc exp run -S inspections\nose_4pol_0deg_surface\params.yaml:train.epochs=28

ERROR: Invalid --set-param value: Could not override 'train.epochs'.
To append to your config use +train.epochs=28: Key 'train' is not in struct
    full_key: train
    object_type=dict
  • Using the Modify and Queue functionality of the vs code extension. This leads to the same error as mentioned above.
  • Executing experiments from the queue via dvc queue start from the root directory (after adding an experiment using dvc exp run --queue inspections\nose_4pol_0deg_surface\dvc.yaml -S inspections\nose_4pol_0deg_surface\params.yaml:train.epochs=28). Here, hovering over the experiment only shows Experiment run failed, I could not find any additional error logs.

andiedrums avatar Jan 16 '24 05:01 andiedrums