Paul Tremberth

Results 81 comments of Paul Tremberth

@vionemc , it's true that [pause/resume](https://docs.scrapy.org/en/latest/topics/jobs.html#how-to-use-it) is designed for when you close scrapy gracefully (Ctrl+C pressed once, not twice) This will let all ongoing requests finish, persisting things nicely. Calling...

For what it's worth, I use slimit in [js2xml](https://github.com/redapple/js2xml) and I had to add a simple OR to the lexer's string literal regexes, `\\\d{1,}`: It's probably not acurate, for example...

Hi @dolohow , I'm having trouble understanding the behavior you are describing. Could you show the behavior in a scrapy or Python shell session, with item loader calls and comments...

(just digging out old issues) If we really want that (disclaimer: I don't use loaders myself), I'd favor a seperate processor `TakeFirstN(n)`, always returning a list of at most n...

@oltarasenko @qrilka @pablohoffman , I do think adding headers is important to test different options for different customer levels. Though I think a `-H "name: value"` option, repeatable, à-la-cURL, would...

Cool! Can you update the travis config to run Py3 tests? Example matrix config: https://github.com/scrapy/scrapy/blob/master/.travis.yml#L8

In other projects, we've been using `TOXENV` in the matrix in Travis and it's been working well. And local tests still use `tox -e py27,py35` for example. See https://github.com/scrapinghub/extruct/blob/master/.travis.yml for...

Thank you Peter, it happens I already started a branch "multi_nodescsv" in this very direction https://github.com/redapple/sql2graph/tree/multi_nodescsv This branch also uses different CSV nodes files (another recent feature from batchimport), theses...

hey @doobybug , sorry for the late reply. I'm really not sure if the current steps are still compatible with MusicBrainz current schema or neo4j import tools. I have started...

@pawelmhm , I also think it makes sense to have `OffsiteMiddleware` (or it's functionality) as a downloader middleware, if only to handle offsite-redirects (#15, #184) [@pablohoffman 's comment there](https://github.com/scrapy/scrapy/issues/15#issuecomment-2048222) recommends...