warp icon indicating copy to clipboard operation
warp copied to clipboard

Feature request for system design : Byte Range Fetch and Prefix specification

Open julienlau opened this issue 4 years ago • 1 comments

Hi, Thanks for this very useful tool !

Would it be possible to implement byte range fetch in order to use this tool to benchmark different partitioning scheme :

  • use byte range fetch on 8MB chunks to read 1GB of data from a large single
  • use multiples objects of smaller sizes with the same prefix
  • use multiples objects of smaller sizes with the different prefix

In addition, given the importance of sharding on performance, it would be nice to get a grip on how to use prefix to populate the object store. Example : option to specify a target of ~100 objects per prefix

Regards

julienlau avatar Jan 06 '22 11:01 julienlau

Feel free to send a PR @julienlau

harshavardhana avatar Sep 09 '22 21:09 harshavardhana