mempool
Add wallet / address group endpoints
No re-index required.
This draft PR adds some new endpoints at /addresses/txs, /scripthashes/txs, /addresses/txs/summary, and /scripthashes/txs/summary, which act as multi-address versions of the corresponding single address/scripthash APIs.
The general idea is to allow paging through the combined history of multiple addresses while keeping the cost per request low and without needing to spam separate requests for each address.
This is mostly a placeholder implementation to support developing/testing https://github.com/mempool/mempool/pull/4831, and probably wants to be heavily refactored and optimized before it's deployed anywhere.
(e.g. the ReverseScanGroupIterator custom multi-iterator should maybe be replaced by something from itertools, and it would be nice to avoid fetching every unconfirmed txid for every address in paginated /txs calls)
I would be curious to see a comparison between this and just hitting the other endpoints consecutively... maybe write a simple bash script to try out both against this PR.
I feel like it might be significantly slower, although when accounting for latency in actual prod environments the ability to combine them into a single request might make things a bit faster.
Just looking over the code real quick, it seems pretty sane... but yeah, some testing needs to be done imo.
I think the main benefit of doing it this way is that you can share the pagination budget across several addresses.
e.g. currently you'd get rate limited or banned trying to fetch transaction history for 50 addresses with one transaction each in separate requests, even though the actual processing cost is similar to a single request for an address with many transactions.
Also @mononaut if there's another reason for this to still be a Draft let me know. I'll let you remove the Draft status once you get a chance.