ctlstore
ctlstore copied to clipboard
[CONFIG-325] Increase ldb download speeds
- Replace
aws-sdk-go
withaws-sdk-go-v2
- Use concurrent downloading mechanism to download s3 snapshot with hardcoded concurrency configuration
- replace golang's
gzip
withklauspost/gizp
I know I may have asked this in our last 1-on-1, but do you have any benchmark / at least a snapshot of time of before / after this change? Even if you didn't profile the whole thing? If not should a separate PR be sent out first with just the metrics and then the change so the rough difference can be measured and observed?
yes totally, the plan will be deploying to a ctlstore-beta node and validate the downloading speed via the dashboard I will circle back on this
yes totally, the plan will be deploying to a ctlstore-beta node and validate the downloading speed via the dashboard I will circle back on this
Sounds good