cocoindex icon indicating copy to clipboard operation
cocoindex copied to clipboard

[FEATURE] [FlowCapability] Repartition after (large) fanout

Open badmonster0 opened this issue 9 months ago • 0 comments

What is the use case? For example, sometimes we may have a large input file (like USPTO's patent XML files which can be near 1GB). After converting it to many rows, for each we may want to process / checkpoint separately.

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

badmonster0 avatar Mar 05 '25 18:03 badmonster0