Mount s3 Drive to Sweep / Trials

[tchaton]

🚀 Feature

Motivation

TODOS:

• [] Add Drives Metadata to SweepConfig
• [] Add Drives parsing to the RunSweepCommand
• [] Dynamically create the Drives in the SweepController and pass them to the Sweep. Propagate the drives down to the works.

API:

lightning run sweep ... --drives {S3_URL}:{MOUNT_DIR} (--env {AWS_CREDENTIALS})

Pitch

Alternatives

Additional context