hadoop-connectors icon indicating copy to clipboard operation
hadoop-connectors copied to clipboard

Shared GCS delegation tokens

Open ntr opened this issue 3 years ago • 1 comments

This change introduces new configuration variable applicable to GCS connector fs.gs.delegation.token.instantiation_strategy. It defines how delegation tokens are instantiated.

Its default value is 'GCS_TOKEN_INSTANTION_STRATEGY' and it does not change current functionality. Gcs tokens are instantiated per service and per renewer.

When it is set to 'SHARED' - GCS delegation tokens are shared across multiple storage buckets. Tokens are still unique per renewer.

This change applies to user authentication only and allows controlling user policies via Ranger plugin for jobs that use multiple GCS buckets at the same time.

ntr avatar Jan 24 '22 19:01 ntr

/gcbrun

ntr avatar Jan 24 '22 20:01 ntr