deeplake icon indicating copy to clipboard operation
deeplake copied to clipboard

Allow creds_key to be passed to deeplake.empty() and deeplake.load()

Open nvoxland-al opened this issue 1 month ago • 1 comments

🚀 🚀 Pull Request

Impact

  • [ ] Bug fix (non-breaking change which fixes expected existing functionality)
  • [X] Enhancement/New feature (adds functionality without impacting existing logic)
  • [ ] Breaking change (fix or feature that would cause existing functionality to change)

Description

As long as org_id and a token are passed along, the creds passed to deeplake.load and deeplake.empty can be given managed credentials from the organization.

Example:

ds = deeplake.empty("s3://my/path", creds={"creds_key": "aws_creds"}, org_id="my_org")
ds = deeplake.load("s3://my/path" creds={"creds_key": "aws_creds"}, org_id="my_org")

Things to be aware of

Also works with deeplake.delete and exists

nvoxland-al avatar May 16 '24 19:05 nvoxland-al