Alex Waygood

> I would prefer to implement this kind of check in stubtest over adding yet another tool. It's slightly outside stubtest's original use case, but "finding problems in stubs that...

> I think I'd also like to see the stubtest / mypy diff before we merge 30 typeshed PRs. There are ways in which I can imagine this going wrong,...

In fact, for some special methods such as `__eq__` and `__format__` (see https://github.com/python/typeshed/pull/6877#issuecomment-1008350944), it might be good to have stubtest do the _opposite_ to what's being proposed here: to ensure...

> We should make sure to include #13500 in the next release. Currently users of Python 3.10.7 and numpy are broken. +1, we've had two duplicates reported today

Typeshed's test suite is currently quite badly broken on the `master` and `release-0.980` branches: - #13654

Things like this should be discussed in the python/typing issue tracker or on the typing-sig mailing list, not the mypy issue tracker. We'd need agreement on the spec before individual...

I like this idea, and have been mulling something similar myself. The name floating around my head was `FailsUnless`: ```python def assert_is_nonempty_list_of_str(x: object) -> FailsUnless[list[str]]: if not isinstance(x, list): raise...

Stubtest is enabled for all the socket constants on Windows and macOS these days, but we still have two very broad allowlist entries on linux: https://github.com/python/typeshed/blob/18cd196109938b690a97dc1dadf1c92b391b9639/tests/stubtest_allowlists/linux.txt#L1 https://github.com/python/typeshed/blob/18cd196109938b690a97dc1dadf1c92b391b9639/tests/stubtest_allowlists/linux.txt#L6

@srittau, reckon we can close this now that we have https://alexwaygood.github.io/typeshed-stats/? :)

As of #9408, third-party stubs with non-types dependencies are now tested with mypy in isolated venvs. The venvs are setup concurrently using a threadpool, meaning we still test all typeshed...