Backup all S3 bucket

[gdelafond]

Hello,

Is your feature request related to a problem? Please describe.

Today with plakar, we can backup one bucket per source. I have some S3 users (user=access key) that have many many buckets (at least one user with more than 500 000 buckets) and they add/remove buckets every days. I want to backup all user's buckets.

Describe the solution you'd like

I would like plakar to be able to find itself the buckets list to backup. I see 2 ways to specify which buckets to backup :

• via a static list
• via regex

maybe with something like for regex:

sources:
    mys3data:
        access_key: ...
        location: s3://..../
        buckets: "*"
        secret_access_key: ...

or

sources:
    mys3data:
        access_key: ...
        location: s3://..../
        buckets: "prod-*"
        secret_access_key: ...

with static list:

sources:
    mys3data:
        access_key: ...
        location: s3://..../
        buckets: [ "bucket1", "bucket2" ]
        secret_access_key: ...

Describe alternatives you've considered

Doing the listing with a script, and create all source in the sources.yml file, and run a plakar backup for each source.