filesystem_spec
filesystem_spec copied to clipboard
Path expansion is inconsistent in helper utilities
Path expansion is inconsistent when sequences are passed in to helper utilities such as fsspec.mv
, fsspec.copy
etc... fsspec.open_files()
will call expand_if_needed depending on the args, but fsspec.mv
and fsspec.copy
will not. We should be consistently expanding file paths. Addditionally unit tests for fsspec.spec are lacking more broadly and this could lead to undefined behavior.
Sounds like more abstract tests are in order. I agree that consistency is good.