piccolo icon indicating copy to clipboard operation
piccolo copied to clipboard

CockroachDB: Hash Sharded Indexes. (#622)

Open gnat opened this issue 3 years ago • 2 comments

Issue: https://github.com/piccolo-orm/piccolo/issues/622

Implements "Sharding for Sequential Indexes" as noted in: https://github.com/piccolo-orm/piccolo/issues/607

Major performance feature for "sequential data" for clusters (timestamps, etc).

  • Article: https://www.cockroachlabs.com/blog/hash-sharded-indexes-unlock-linear-scaling-for-sequential-workloads/
  • Video: https://www.youtube.com/watch?v=JlT_Co_wYFo
  • Reference manual: https://www.cockroachlabs.com/docs/stable/hash-sharded-indexes.html

gnat avatar Oct 11 '22 12:10 gnat

@dantownsend This is the last major addition to complete the Cockroach integration. I separated it out of the main PR to reduce complexity.

It's optional, but very highly recommended.

I wanted to get feedback on the approach here, if there was a more elegant way to do this.

I have to step away for today, but I will get all the linters and such passing shortly.

gnat avatar Oct 11 '22 12:10 gnat

I have to step away for today, but I will get all the linters and such passing shortly.

@gnat Cool, no worries!

dantownsend avatar Oct 11 '22 12:10 dantownsend