Iceberg `$partitions` data scanning extremely slow

[jayceslesar]

Any thoughts on why scanning iceberg $partitions dat is slower than actually scanning the iceberg table itself?

Im on 475, running on EKS.

Relevant configuration:

additionalConfigProperties:
  - optimizer.optimize-metadata-queries=true
  - query.max-scan-physical-bytes=10GB
  - query.max-execution-time=5m

catalogs:
  glue: |-
    connector.name=iceberg
    iceberg.catalog.type=glue
    s3.region=us-east-1
    fs.native-s3.enabled=true
    fs.cache.enabled=true
    fs.cache.directories=/tmp/trino-cache
    fs.cache.max-sizes=15GB
    fs.cache.ttl=10m