elasticsearch-river-web icon indicating copy to clipboard operation
elasticsearch-river-web copied to clipboard
verified publisher icon codelibs

Ignoring already stored URL's

Open Choumy opened this issue 10 years ago • 1 comments

without inserting then deleting, it just ignores url if already indexed. Any comments are welcome ..

Choumy avatar Aug 06 '15 21:08 Choumy

Crawled data is not unique by URL.

marevol avatar Aug 07 '15 14:08 marevol