pinot
pinot copied to clipboard
Replicate table with different config
Use case: a table is bootstrapped already, however we want to test if how much perf boost partitioning a column will bring.
The only solution now is to create a new table, regenerate all the segments.
It would be better to have a way to check segment partition mechanism and repartition data if needed.
I would model it into 2 steps:
- Replicate a table
- Re-partition the data if necessary
The second step can be very expensive because it requires shuffle the data across segments, so we want to leverage minion to do that.