qryn icon indicating copy to clipboard operation
qryn copied to clipboard

Configurable Partition options

Open mr-karan opened this issue 2 years ago • 2 comments

We have a large deployment log cluster and store multiple year's worth of logs. For us, partitioning by date is more useful than partitioning by hour.

Would it be possible to have this configurable as a PARTITION_INTERVAL variable?

Probably we can take

  • weekly
  • monthly
  • daily`
  • hourly

as different options from user, fallback being the current hourly.

Thanks!

mr-karan avatar Nov 30 '21 06:11 mr-karan

@akvlad and @adubovikov any comments or suggestions here?

lmangani avatar Nov 30 '21 08:11 lmangani

@mr-karan i suggestion to you make it daily because at the end you should not have a huge number of partitions in the table. You should not worry about huge file, because scan will be by partition datetime key.

adubovikov avatar Nov 30 '21 12:11 adubovikov

Feel free to reopen if still interested for 3.x

lmangani avatar Nov 01 '23 22:11 lmangani