hera icon indicating copy to clipboard operation
hera copied to clipboard

Add scatter-gather

Open ModEtchFill opened this issue 6 years ago • 1 comments

What I Did

I would like to query all shards. This is expensive, but we need to do this sometimes.

What I See

I get a shard key not found error.

What I Expect

I expect a select query to be sent to all the shards and the results returned. I would add /* hint-allow-scatter-gather */ to the query text to indicate that the programmer knows that the query is expensive.

ModEtchFill avatar May 06 '19 23:05 ModEtchFill

In some discussions, it seems this may be too powerful and could be abused. Maybe thinking through a global-secondary-index case--possibly with caching--would constrain scatter-gather usage and keep hera sharding scalable.

ModEtchFill avatar Jan 03 '20 18:01 ModEtchFill

We think scatter-gather will cause too many scaling issues and abuse

ModEtchFill avatar Sep 29 '23 15:09 ModEtchFill