EPIC: CSB Cloud Pilot Phase II

[dneufeldcu]

Summary

As a	pilot phase
I want to be able to	demonstrate e2e CSB data landing in s3 and being discoverable in OneStop
So that I can	determine if OneStop supports non-satellite data sets

Description

Support CSB processing and discoverability in the OSIM cloud environment.

Tasks

• [ ] CSB collection level metadata record available and loaded into OneStop
• [ ] Ensure all on-prem data is uploaded to s3 using consistent file format (#1282)
• [ ] Use the BDP s3 account (roll over from AWS ODP)
• [ ] Deploy CSBCrawler2Cloud on prem
• [ ] Add metadata capture from s3 events
• [ ] Add metadata capture from file (geospatial/temporal bounds)