Peter Bull
Peter Bull
@lucemia Subclassing the [BaseModel](https://pydantic-docs.helpmanual.io/usage/model_config/#change-behaviour-globally) that you use is, I believe, the recommended way of doing this in Pydantic. I'm not sure there's a good, supported implementation on our side for...
👋 @martindurant sounds cool! There are probably a few level of integration that could work well. We intend to make it pretty easy to add custom clients/backends by implementing a...
@remi-braun Thanks for the vote for `fsspec`! So that I understand your use case, is the reason that you want an `fsspec` implementation that you want to be able to...
Ah, interesting. That looks to me like a `geopandas` feature request since they don't support [`os.PathLike`](https://docs.python.org/3/library/os.html#os.PathLike). They do say they support filelike objects. You could try the following and see...
Thanks, @martindurant. How would you use `fsspec` when opening a file with `geopandas`? I'm curious what `fsspec` implements that would make this work without having to explicitly download to a...
> This is an exaggeration! 😆 certainly an exaggeration in terms of it actually getting implemented by libraries, but it is a PEP that was accepted for exactly this purpose!...
>fsspec can do this job implicitly; but yes, there are libraries which, typically because of some inner C code, can only work with real OS file handles on the local...
Two options with Azure: - `max_concurrency` parameter - https://docs.microsoft.com/en-us/python/api/azure-storage-blob/azure.storage.blob.blobclient?view=azure-python#download-blob-offset-none--length-none----kwargs- - New `aio` interface: https://docs.microsoft.com/en-us/python/api/azure-storage-blob/azure.storage.blob.aio.blobclient?view=azure-python For S3, it appears to be setting transfer config with something like: ```python from boto3.s3.transfer import...
@mcclurem Out of curiosity, which S3-emulating service are you using? Happy to take a PR on this. Answers to specific questions below. -------------- > I think it should be acceptable...
@aaossa Yep, that implementation looks good to me initially, thanks. Like you said, it will need some testing. Maybe update the message when you raise `FileNotFoundError` to indicate we were...