spring-batch
spring-batch copied to clipboard
Aggregate execution context on RemoteStepExecutionAggregator
Leonardo Diniz opened BATCH-2684 and commented
Sometimes when using remote partitioning is necessary to share data between the partitions and the master partition step. An easy way to do it is to add parameters to the step execution context.
Example of the problem: Master application has a partitioned step that will deploy 4 docker images. Each image will execute a partition of the master partitioned step. At the end of each partition, they will upload a file to s3. The next step in the master application needs to know where this file is, or download it. If you add this information to the step context it won't be aggregated with the current implementation of RemoteStepExecutionAggregator.
Referenced from: pull request https://github.com/spring-projects/spring-batch/pull/585