Can't use any catalog action related to S3 (create_table, load_table...)

[harelo-cf]

Apache Iceberg version

0.8.1 (latest release)

Please describe the bug 🐞

Issue Summary

We are experiencing a critical issue with PyIceberg that has suddenly emerged. Previously, we were able to create tables from a local environment without any issues. However, today, when running the exact same code, using the same AWS account, same S3 bucket, and same Glue catalog, we are now encountering the following error:

AWS Error NETWORK_CONNECTION during HeadObject operation: curlCode: 6, Couldn't resolve host name

Observations

This issue appears to be related to PyArrow. Glue-related operations, such as listing tables and namespaces, continue to work. However, S3-dependent operations (e.g., create_table, load_table) fail with the above error. There have been no changes to our environment, IAM permissions, or configurations.

Expected Behavior

PyIceberg should be able to create and load tables as before, without network errors related to S3.

Steps to Reproduce

Use PyIceberg to create a table with the same setup that previously worked. Observe that S3-related operations fail with a NETWORK_CONNECTION error. Glue-related operations still function correctly.

Environment Details

PyIceberg Version: 0.8.1 PyArrow Version: 18.1.0 AWS SDK / Boto3 Version: 1.35.81 Python Version: 3.12.7 Operating System: Mac Sequoia 15.2

Questions & Next Steps

Has there been a recent change in PyIceberg, PyArrow, or AWS networking that could cause this? Are there any workarounds or known fixes for this issue? Is there an alternative way to perform these operations while troubleshooting? Any guidance or insights would be greatly appreciated.

Thanks in advance! 🙏

Willingness to contribute

• [ ] I can contribute a fix for this bug independently
• [x] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• [ ] I cannot contribute a fix for this bug at this time

[kevinjqliu]

thanks for reporting the issue. What version were you using previously? Can you share how you set up the glue catalog and fileio? Can you use the same aws credentials to do aws s3 calls? i.e. are the credentials still valid and not expired

[github-actions[bot]]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions[bot]]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'