cocoindex
cocoindex copied to clipboard
[FEATURE] [FlowCapability] Repartition after (large) fanout
What is the use case? For example, sometimes we may have a large input file (like USPTO's patent XML files which can be near 1GB). After converting it to many rows, for each we may want to process / checkpoint separately.
Describe the solution you'd like A clear and concise description of what you want to happen.
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context or screenshots about the feature request here.