spark-dgraph-connector icon indicating copy to clipboard operation
spark-dgraph-connector copied to clipboard

Sample partition's uids

Open EnricoMi opened this issue 4 years ago • 0 comments

Check with Dgraph devs if they could add an operation to GraphQL that provides you a sample of the uids that match a query. Retrieving only every N-th uid could be fed into the uid range partitioner to get proper partitions. Right now we split the possible space of uids into partitions. With the sample we could split the actual space of uids per partition.

An approximation of the sample would also help and might scale sub-linearly. See Sample your result.

EnricoMi avatar Jul 09 '20 10:07 EnricoMi