Fix lazy loading of ObjectStoragePath fs backends
The new structure introduces eager loading, which we don't want. This re-instates lazy loading at the expense of that storage_options might not be fully parsed.
@potiuk @ap-- @Taragolis
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.
@ap-- could you take a look if this makes sense? particularly the __str__ function as its a bit of a hack to workaround https://github.com/fsspec/universal_pathlib/issues/198
This fails du to an import when the path needs to be parsed. I will open a new issue in universal_pathlib to see how long this could be delayed.
I see a few tests are failing. Closing and reopening to return them.
closing as this will be solved differently