register
register copied to clipboard
PSC-STM-B7: Switch over to live transformation
- Perform live transformation on all existing S3 files produced by the Kinesis Firehose attached to the ingester
- Start the live transformer (which will default to the start of the stream, but will skip any records which have already been published).
Following this, it should be unnecessary to keep performing bulk imports, since the live transformer should immediately transform latest data.
Estimate: 4 hours