Shane Evans
Shane Evans
Add support for incremental indexing - opening an existing database and adding more queries to it.
The memory backends are all implemented using heapq. This allows for some succinct code when using different crawl ordering, but it's less efficient than choosing more appropriate datastructures for each...
Previously reported by pablo on Trac http://dev.scrapy.org/ticket/292 It would be nice to add a command line option for performing POSTs, like curl -d does. This would be added to all...