subql icon indicating copy to clipboard operation
subql copied to clipboard

new dictionary limit flag, decouple with batchSize

Open ianhe8x opened this issue 1 year ago • 0 comments

Prerequisites

  • [ ] Are you running the latest version(s)?
  • [ ] Have you searched the documentation for your issue?
  • [ ] Did you search for an existing issue or pull request?

Description

When we construct dictionary query, we set first: batchSize.toString(), which may leads to more query requests if batchSize is small. The thing is we change batchSize mostly considering memory usage and rpc ratelimits, not dictionary queries.

Details

We should use a separated flag for dictionary limit, and default it to a larger value like 100

ianhe8x avatar Aug 19 '23 11:08 ianhe8x