Joona Gynther

Results 5 comments of Joona Gynther

Here is my minimal code example (that fails): ```python from pyiceberg.table import StaticTable # Latest metadata file object = "iceberg/metadata/00068-b5e701c2-1520-4ff5-9484-aef7ba257d6f.metadata.json" table = StaticTable.from_metadata( f"s3://--s3alias/{object}" ) connection = table.scan(limit=100).to_duckdb("test") ``` And...

I found the same issue. However using Access Point S3 alias it seems to work just fine. Here is a minimal PyArrow example that reads a file: ```python from pyarrow...

Thinking about this further I see two options: 1. Change the way metadata is read when the target is an access point alias, either by checking for the "-s3alias" suffix...

Finally had a chance to poke this. To me it seems that there is no easy way out to implement this. When creating and scanning a StaticTable the actual location...

Testing a very simple wrapper like: ```Python from pyarrow.fs import S3FileSystem class WrappedS3FileSystem(S3FileSystem): def __init__(self, bucket_override, **kwargs): super().__init__(**kwargs) self.override = bucket_override def open_input_file(self, path): for bucket in self.override: path =...