Andrey Rakhmatullin

Document the SpiderState extension

2

`scrapy.extensions.spiderstate.SpiderState` is not on https://docs.scrapy.org/en/latest/topics/extensions.html and is only mentioned on https://docs.scrapy.org/en/latest/topics/jobs.html as "an extension" and "a built-in extension".

Investigate speeding up `MockServer()`

3

On my machine, with coverage enabled and `h2` installed (both of these things add significant additional time), a single call of `tests.mockserver.MockServer()`, at least in `FeedExportTest.run_and_export()`, takes up to 6.5s,...

exceptions.pyi doesn't contain MultipleInvalid

3

Looks like stubs were generated for an old version of zope.interface, is that intended?

Better Deferred type hints for callbacks that return `_T|Deferred[_T]`

4

It looks like there are some cases where a callback that returns a type or a Deferred of the same type is not accepted by mypy. The most basic case,...

persist_file() can return a Deferred that is never awaited

2

All non-local FilesPipeline store classes (`S3FilesStore`, `GCSFilesStore`, `FTPFilesStore`) return a Deferred from the `persist_file()` method but `FilesPipeline.file_downloaded()` ignores the result of this method. Looks like it was this way since...

https://github.com/scrapinghub/extruct/workflows/build/badge.svg?branch=master is 404

3.8 support ends on 31 Oct, so I'm thinking about changes we can do after that. Looks like they are mostly related to typing. * Drop Reppy which doesn't support...

I've just noticed this outdated text and updated it but there is a bigger related issue with https://docs.scrapy.org/en/latest/topics/items.html as this docstring (and the docstring of `Field`) isn't included there and...