terraform-provider-iterative icon indicating copy to clipboard operation
terraform-provider-iterative copied to clipboard

Published 20 hours ago • verified publisher icon iterative

Data sync: allow more advanced `workdir` and `output` specs

Open dberenbaum opened this issue 3 years ago • 2 comments

It would be great for workdir/output to support:

  • Lists of multiple paths
  • Globs or regexes

dberenbaum avatar May 20 '22 19:05 dberenbaum

Storage syntax can be easily extended to support rclone filters to include and exclude several paths or globs from data transfers:

  • https://github.com/iterative/terraform-provider-iterative/issues/414#issuecomment-1064016678

0x2b3bfa0 avatar May 20 '22 19:05 0x2b3bfa0

+1 for a exclude option,

storage {
  workdir = "."
  exclude = [
    ".dvc/cache",
    "venv"
  ]
  output = "./reports"
}

dacbd avatar Jun 03 '22 17:06 dacbd

Quick note: exclude should be a list[str] relative to workdir

casperdcl avatar Oct 18 '22 14:10 casperdcl