dvc
dvc copied to clipboard
localfs: make it fsspec-compatible
The LocalFileSystem is the only filesystem that is not fsspec-compatible. There's also DvcFileSystem and RepoFileSystem but they are virtual filesystem and needs LocalFileSystem to be first compatible.
https://github.com/iterative/dvc/blob/9b5ccb75549ab950ece23b7938ea0eea637c440d/dvc/fs/local.py#L15
This may help us use localfs in more locations instead of os.path/open functions. And also may get rid of the ugly inheritance chain with FileSystem/FSSpecWrapper.
This may help us use
localfsin more locations instead ofos.path/openfunctions.
Is there any idea of what this will mean for performance?
@skshetry Is this something you plan to take or research? Should it be on the project board?
Is there any idea of what this will mean for performance?
We already use localfs on data-management systems or wherever we are filesystem agnostic.
Is this something you plan to take or research? Should it be on the project board?
I noticed this while working on #7331, but it's not required right now.
Can we lower the priority?
@skshetry What's the status of this issue?