web3.storage icon indicating copy to clipboard operation
web3.storage copied to clipboard

Create a script to populate large data sets of uploads and pins for testing

Open joshJarr opened this issue 2 years ago • 2 comments

I made a quick script to generate 1000 files for testing pagination and performance. Feel like it could be useful, so plan on cleaning it up and committing it - could also be handy to do the same for pins.

joshJarr avatar Jun 17 '22 15:06 joshJarr

@dchoi27 Are you happy for us to implement this? Could be helpful to test file lists and pagination for both uploads and pins. Alternatively, can put in backlog.

Put estimate at 1 days, but should definitely be less than that.

mbommerez avatar Jun 20 '22 15:06 mbommerez

Let's scope into the PSA follow up issue! And do this if this would be useful for the other tickets in that set

dchoi27 avatar Jun 20 '22 16:06 dchoi27

I've had a little script to do this locally for a while, but a few people have asked me for it when building and testing the pagination for uploads and pins, so thought I'd just commit it

joshJarr avatar Aug 23 '22 17:08 joshJarr

We identified an improvement, the script currently does not throw any error if pins can't be created. @joshJarr to create a follow-up ticket for that.

flea89 avatar Sep 21 '22 09:09 flea89