Commit Graph

271 Commits

Author SHA1 Message Date
Alex Waygood
40bfc266f7 3rd-party stubtest: run on Python 3.10 (#9342) 2022-12-07 20:25:57 +00:00
Alex Waygood
fc69819a89 Don't run mypy_primer on stubsabot PRs (#9332)
We can be fairly confident that PRs updating only a `METADATA.toml` file will never produce an interesting `mypy_primer` diff.
2022-12-05 23:47:59 -08:00
Avasam
5c3f10e1df Deduplicate pinned pyright version (#9299)
Co-authored-by: Alex Waygood <Alex.Waygood@Gmail.com>
2022-11-30 08:52:55 +00:00
Alex Waygood
95c74ba7e1 Minor improvements to tests/regr_test.py (#9274) 2022-11-25 15:03:20 +00:00
Alex Waygood
e2ad6fbe62 Add color back to CI output (#9276) 2022-11-25 15:01:31 +00:00
Avasam
7050c1d907 Add support for Homebrew and Chocolatey (#9187) 2022-11-24 07:17:17 +00:00
Avasam
72d1597de2 stubtest_third_party.py: Allow running non-listed platforms locally (#9173)
Co-authored-by: Alex Waygood <Alex.Waygood@Gmail.com>
2022-11-15 01:39:57 +00:00
Avasam
cfed3e1113 Cache pip downloads in CI (#9192) 2022-11-15 00:57:20 +00:00
Nikita Sobolev
66edd05cf3 Cancel old daily CI jobs on PRs (#9196) 2022-11-14 15:47:53 +00:00
Nikita Sobolev
9f80dbd3db Do not run stubtest_third_party on requirements change (#9160)
Co-authored-by: Alex Waygood <Alex.Waygood@Gmail.com>
2022-11-11 18:16:00 +00:00
Nikita Sobolev
dbac458bd5 Fix CI failure when no third-party stubs were updated (#9159) 2022-11-11 07:09:35 -08:00
Nikita Sobolev
9cd9f6f6e0 Add the ability to run third-party stubtest on Windows or MacOS when needed (#8923)
Co-authored-by: Alex Waygood <Alex.Waygood@Gmail.com>
Co-authored-by: Jelle Zijlstra <jelle.zijlstra@gmail.com>
2022-11-11 13:40:50 +00:00
Nikita Sobolev
7b3fff714a Do not run create-issue-on-failure on PRs (#9140) 2022-11-09 15:02:50 +00:00
Nikita Sobolev
cb5ed3c5fb Run stubtest on all third party stubs if requirements.txt is changed (#9132) 2022-11-09 14:30:56 +00:00
Nikita Sobolev
86f9d93003 Update pyright to 1.1.278 (#9077)
Co-authored-by: Alex Waygood <Alex.Waygood@Gmail.com>
2022-11-03 15:32:10 +00:00
Alex Waygood
401a7b929e Bump various test dependencies; pin Python to <3.10 in CI to workaround pytype incompatibility (#9068) 2022-11-02 18:44:48 +00:00
Sebastian Rittau
96daaf60bf Remove references to master branch (#9060) 2022-11-01 13:02:38 +01:00
Sebastian Rittau
3aaf6b9999 'master' branch was updated to 'main' (#9045) 2022-11-01 12:57:57 +01:00
Nikita Sobolev
fd75bc21fc Use 3.11 instead of 3.11-dev (#8983) 2022-10-26 15:52:24 +02:00
Alex Waygood
122bceeade CI: Use macOS-11 for stdlib stubtest (#8949) 2022-10-20 15:45:18 +02:00
Nikita Sobolev
fe3a34503c Cancel old mypy_primer builds (#8873) 2022-10-10 01:28:17 -07:00
Shantanu
ae1cca13c1 stubsabot: try and fix change detection logic (#8851) 2022-10-05 09:53:57 -07:00
Alex Waygood
5cb7ef1f73 stubsabot: use an ssh-key when checking out typeshed (#8844)
Fixes #8434.

This uses a new ssh key that @JelleZijlstra just set up for our repo ([this option](https://github.com/peter-evans/create-pull-request/blob/main/docs/concepts-guidelines.md#push-using-ssh-deploy-keys) in Peter Evans's guide to getting checks to run on automated PRs. It seems to be a good option in terms of both security and usability. It's also the option used by `oddbird/MetaDeploy` [here](https://github.com/oddbird/MetaDeploy/blob/main/.github/workflows/upgrade-deps.yml#L20), and they seem pretty happy about it (they wrote a nice blog post about their automated PRs for uprading dependencies [here](https://www.oddbird.net/2022/06/01/dependabot-single-pull-request/).)
2022-10-04 14:13:18 -07:00
Alex Waygood
08a3359e94 Run stubsabot daily, not weekly (#8845)
I think stubsabot has been a really big success. Let's change it to a daily workflow, so that we don't get an avalanche of PRs every Friday, and so that we can see more quickly if a PR changing stubsabot has accidentally broken the script. (If that _does_ happen, it should be pretty easy to just revert the commit that accidentally broke stubsabot, and go back to a version that works pretty well.)
2022-10-04 14:12:50 -07:00
Alex Waygood
5da171ba45 mypy_test.py: Always add dependencies of stubs to the files to test (#8800) 2022-10-04 08:05:13 -07:00
Shantanu
d7a701372d Run stub_uploader tests in CI (#8794) 2022-09-30 10:07:34 -07:00
Akuli
ba7f9b3715 Fix installing dependencies for 3rd party stubtest (#8807) 2022-09-29 10:52:11 +02:00
Alex Waygood
d84fda1f12 Upgrade pyright to 1.1.273 (#8802) 2022-09-28 14:01:08 +01:00
Alex Waygood
3e71efbc73 Improve the daily.yml workflow (#8737) 2022-09-14 21:46:18 -07:00
Akuli
ab022557e2 Run third-party stubtest under xvfb-run (#8719) 2022-09-10 18:34:11 +03:00
Alex Waygood
b53843ab46 Add infrastructure allowing for test cases for third-party stubs (#8700)
- Move the logic for running mypy on the test cases from `tests/mypy_test.py` to a separate script, `tests/regr_test.py`.
- Add the necessary logic in order to be able to have test cases for third-party stubs.
- Move logic common to `tests/mypy_test.py` and `tests/regr_test.py` into `tests/colors.py`, and rename `tests/colors.py` to `tests/utils.py`.
- Add a new check to `tests/check_consistent.py`, to enforce the use of `# pyright: reportUnnecessaryTypeIgnoreComment=true` comments in third-party test cases. These are essential if we want to have our tests against false-negatives work with pyright.
- Update the relevant documentation to account for the new test file.
- Add a new job to the `tests.yml` GitHub workflow, to run the new test in CI.
- Add a simple proof-of-concept test case for `requests`, as a regression test for #7998.

Co-authored-by: Jelle Zijlstra <jelle.zijlstra@gmail.com>
Co-authored-by: Sebastian Rittau <srittau@rittau.biz>
2022-09-08 16:51:33 +01:00
Alex Waygood
fd4feba2c9 Enable pyright's reportUnnecessaryTypeIgnoreComment setting for the whole test_cases directory (#8683) 2022-09-05 15:20:04 +02:00
Alex Waygood
54c562827b Cancel old test jobs in CI (#8679) 2022-09-03 13:04:54 -07:00
Alex Waygood
1b6cda86d4 Alphabetise items in requirements-tests.txt (#8635) 2022-08-28 07:59:17 -07:00
Shantanu
c91dfdeb2b Fix stubsabot action (#8618)
Broken by #8605 and the issue creation code was always broken
2022-08-25 17:28:59 -07:00
Alex Waygood
15f74295d2 Add aiohttp and tomlkit to requirements-tests.txt (#8605) 2022-08-24 23:08:54 +01:00
Alex Waygood
875f0ca7fc mypy_test.py: Move type-checking of our tests and scripts into a different test (#8587) 2022-08-22 17:16:03 +01:00
Jelle Zijlstra
5477097c6d Upgrade pyright (#8541) 2022-08-12 20:24:51 -07:00
Alex Waygood
1ec57121e3 Unpin stubtest from 3.10.5 (#8523) 2022-08-12 10:01:26 +02:00
Alex Waygood
c68bcc7e69 Temporarily pin stubtest to 3.10.5 (#8511) 2022-08-09 13:55:00 +02:00
Alex Waygood
eca5549ee1 CI: Use macos-latest for stubtest (#8353) 2022-07-21 16:52:41 +02:00
Shantanu
936314b979 Add stubsabot Github Action (#8303) 2022-07-17 13:21:51 -07:00
Shantanu
5ef20e8021 Use packaging to parse versions (#8314)
packaging is the standard tool for dealing with versions and
requirements. This allows us to easily support all PEP 508 specs.
packaging also has good error messages, so I don't create our own here.
This lets us get rid of our handrolled half parser and sanity checks.
I kept the whitespace consistency check, since that's just a formatting
lint and isn't testing the correctness of parsing (which we now
definitely do correctly).
2022-07-17 12:35:32 -07:00
Alex Waygood
78d96cd17e Drop support for Python 2 (#8272) 2022-07-12 09:08:56 +02:00
Sebastian Rittau
9a5c865034 Drop support for Python 3.6, part 1 (#8250)
* Document that typeshed support 3.7+.
* Don't run tests on Python 3.6.
* Remove Python 3.6 allow lists.
* Merge common allowlist items.

Part of #6189
2022-07-07 14:42:02 +02:00
Jon Dufresne
0570cd9f9c Update GitHub actions to their latest versions (#8160)
The actions/setup-python now always requires a version specified.
2022-06-26 11:36:15 +02:00
Alex Waygood
bae4fd2209 Upgrade pyright (#8110) 2022-06-20 17:07:43 +01:00
Alex Waygood
6b0c8df9ec Upgrade pyright, improve pyright config files (#8072) 2022-06-16 18:50:50 +01:00
Shantanu
bf68214245 mypy_primer: report lines truncated (#7993)
Co-authored-by: hauntsaninja <>
2022-05-30 17:04:34 -07:00
Alex Waygood
ac9efd8573 stubtest_stdlib: run on PRs updating requirements-tests.txt (#7949) 2022-05-25 15:29:05 +02:00