incubator-xtable icon indicating copy to clipboard operation
incubator-xtable copied to clipboard

Docs improvement: Glue Data Catalog

Open sagarlakshmipathy opened this issue 1 year ago • 2 comments

According to https://github.com/onetable-io/onetable/issues/262

Docs needs to clarify

  1. DB names appropriately i.e. instead of onetable_synced_db call it onetable_synced_delta_db (same for hudi and iceberg as well)
  2. Command to create the crawler is incorrect. It should instead be like aws glue create-crawler --name onetable_delta_crawler --role arn:aws:iam::${accountId}:role/service-role/${roleName} --database onetable_synced_delta_db --targets "{\"DeltaTargets\":[{\"DeltaTables\":[\"${s3DataPath}\"],\"WriteManifest\":false,\"CreateNativeDeltaTable\":true}]}"

sagarlakshmipathy avatar Dec 01 '23 21:12 sagarlakshmipathy

I can take this up @sagarlakshmipathy you can assign this to me

rahil-c avatar Dec 04 '23 07:12 rahil-c

@rahil-c bump! following up on this. Do you still have bandwidth to address this?

sagarlakshmipathy avatar Jan 17 '24 18:01 sagarlakshmipathy