apache
new feature: support s3 directory bucket (Express One Zone)
Feature Description
S3 has a relatively new feature called S3 Express One Zone. In a gist, 10x faster than standard and more expensive.
Read more here
Problem and Solution
Express One-Zone is session-based. Other differences are here.
The largest difference is still the session.
If you are interested in the feature, leave a 👍.
Additional Context
No response
Are you willing to contribute to the development of this feature?
- [ ] Yes, I am willing to contribute to the development of this feature.
I tested OpenDAL with Express One Zone; it works, but the performance isn't as expected. I suspect we need to add support for CreateSession.
Nice! I couldn't set up a VPC endpoint for S3 Express - DNS resolution fails.
I tested with boto3 which shows 10x performance as advertised.
When debugging the DNS resolution problem, I got some logs from tcpdump, which roughly shows these behaviors from boto3:
- was not creating a short-term session via
CreateSession, but IMDSv2. - resolving DNS just fine - CNAME to another internal zonal endpoint and A/AAAA records.
I didn't look into it further. I believe you have the same access as I do. If you need more information from my end, happy to help.