arche icon indicating copy to clipboard operation
arche copied to clipboard

Published 20 hours ago • verified publisher icon scrapinghub

Use `pool` to download items with `filter`

Open manycoding opened this issue 6 years ago • 1 comments

The current logic of dividing on batches by start_index and count doesn't account for filter. When using filter, returned items _key don't correspond with actual index so the data repeats.

manycoding avatar Dec 25 '18 20:12 manycoding

The solution is to use nodata https://github.com/scrapinghub/python-scrapinghub/pull/129

manycoding avatar Aug 19 '19 12:08 manycoding