[feature][CLI] Add commands to run 'scanOffloadedLedgers'.
Master Issue: #16070
Motivation
Add pulsar-admin command to execute scanOffloadedLedgers, introduced with #14930
Documentation
- [x]
doc-not-needed
@Technoboy- Need update docs?
@Technoboy- Need update docs?
No need.
I had started to work on a prototype https://github.com/apache/pulsar/compare/master...eolivelli:pulsar:impl/pulsar-admin-scanoffloaded
I suggest to not change the "StreamingOutput" part, maybe there is a better way to do it, but I did not find. There should be some way in the client to do Streaming Reads
I prefer to use the original streaming way to return the scan results. Because it will be huge and will cost very long time to scan.
ok.
@eolivelli @hangc0276 I think the streaming style you are talking about is similar to https://trino.io/docs/current/develop/client-protocol.html ? The client can get part of the data for each request and perform the next request based on the last response nextUrl. I'm not sure how https://github.com/apache/pulsar/pull/14930 can resolve the issue of the server-side run for a long time, but the client-side will not get a timeout.
in #14930 we send the data in a streaming fashion, without accumulating the results on the server.
now the problem is to read it in a streaming way on the client
The pr had no activity for 30 days, mark with Stale label.