billiboy

command to check if a document already exists in the index

2

how do i do a check in the index to know if a document exists or not? I created an index which is based on prefixes with the hash. I...

Async and queue

2

Can queue and async be used together in colly? I don't quite understand what queues are for. other question, should i extract more categories from one site and i want...

command to check if a document already exists in the index

1

how do i do a check in the index to know if a document exists or not? I created an index which is based on prefixes with the hash. I...